2023-10-16T19:45:19.545 INFO:root:teuthology version: 0.0.1.dev197+g8cdab07 2023-10-16T19:45:19.546 DEBUG:teuthology.run:Teuthology command: teuthology --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/mds-full} --verbose --owner scheduled_rishabh@teuthology --archive /home/teuthworker/archive/rishabh-2023-10-16_18:49:15-fs-rishabh-2023oct13-testing-default-smithi/7430083 --name rishabh-2023-10-16_18:49:15-fs-rishabh-2023oct13-testing-default-smithi -- /home/teuthworker/archive/rishabh-2023-10-16_18:49:15-fs-rishabh-2023oct13-testing-default-smithi/7430083/orig.config.yaml 2023-10-16T19:45:19.595 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T19:45:19.673 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/rishabh-2023-10-16_18:49:15-fs-rishabh-2023oct13-testing-default-smithi/7430083 branch: rishabh-2023oct13 description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/mds-full} email: null first_in_suite: false job_id: '7430083' kernel: client: sha1: distro flavor: default kdb: true sha1: 47672119149b103ec7cec2cc65c063ccbb001ac7 ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: rishabh-2023-10-16_18:49:15-fs-rishabh-2023oct13-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: rhel os_version: '8.6' overrides: admin_socket: branch: rishabh-2023oct13 ceph: cephfs: ec_profile: - disabled conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 client.0: debug client: 20 debug objectcacher: 20 debug objecter: 20 client.1: debug client: 20 debug objectcacher: 20 debug objecter: 20 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 mon osd backfillfull ratio: 0.6 mon osd full ratio: 0.7 mon osd nearfull ratio: 0.6 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 memstore device bytes: 200000000 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 1.0 osd mon report interval: 5 osd objectstore: memstore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - OSD full dropping all updates - OSD near full - pausewr flag - failsafe engaged, dropping updates - failsafe disengaged, no longer dropping - is full \(reached quota - POOL_FULL - POOL_BACKFILLFULL - PG_RECOVERY_FULL - PG_DEGRADED sha1: 4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 kclient: syntax: v2 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: rishabh-2023oct13-qa2 sha1: 19fd96fe3581520b6d9f50ffdabf29051aee5d4d owner: scheduled_rishabh@teuthology priority: 50 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 6006 sha1: 4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 sleep_before_teardown: 0 subset: 402/512 suite: fs suite_branch: rishabh-2023oct13-qa2 suite_path: /home/teuthworker/src/github.com_rishabh-d-dave_ceph_19fd96fe3581520b6d9f50ffdabf29051aee5d4d/qa suite_relpath: qa suite_repo: https://github.com/rishabh-d-dave/ceph suite_sha1: 19fd96fe3581520b6d9f50ffdabf29051aee5d4d syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi157.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs= smithi187.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - kclient: null - cephfs_test_runner: modules: - tasks.cephfs.test_full teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 8cdab074dcca9a68965bc5a50e9c30b691949723 timestamp: 2023-10-16_18:49:15 tube: smithi user: rishabh verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2830 2023-10-16T19:45:19.674 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_rishabh-d-dave_ceph_19fd96fe3581520b6d9f50ffdabf29051aee5d4d/qa; will attempt to use it 2023-10-16T19:45:19.675 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_rishabh-d-dave_ceph_19fd96fe3581520b6d9f50ffdabf29051aee5d4d/qa/tasks 2023-10-16T19:45:19.675 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-10-16T19:45:19.677 INFO:teuthology.task.internal:Checking packages... 2023-10-16T19:45:19.700 INFO:teuthology.task.internal:Checking packages for os_type 'rhel', flavor 'default' and ceph hash '4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0' 2023-10-16T19:45:19.700 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-10-16T19:45:19.700 INFO:teuthology.packaging:ref: None 2023-10-16T19:45:19.701 INFO:teuthology.packaging:tag: None 2023-10-16T19:45:19.701 INFO:teuthology.packaging:branch: rishabh-2023oct13 2023-10-16T19:45:19.701 INFO:teuthology.packaging:sha1: 4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 2023-10-16T19:45:19.702 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=rishabh-2023oct13 2023-10-16T19:45:19.844 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-6730.g4ba8a190 2023-10-16T19:45:19.845 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-10-16T19:45:19.851 INFO:teuthology.task.internal:no buildpackages task found 2023-10-16T19:45:19.851 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-10-16T19:45:19.864 INFO:teuthology.task.internal:Saving configuration 2023-10-16T19:45:19.881 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-10-16T19:45:19.889 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-16T19:45:19.915 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi157.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-10-16_18:49:15-fs-rishabh-2023oct13-testing-default-smithi/7430083', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-16 19:40:19.634404', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-10-16T19:45:19.937 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi187.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-10-16_18:49:15-fs-rishabh-2023oct13-testing-default-smithi/7430083', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-16 19:40:19.632769', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-10-16T19:45:19.937 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-10-16T19:45:19.943 INFO:teuthology.task.internal:roles: ubuntu@smithi157.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2023-10-16T19:45:19.943 INFO:teuthology.task.internal:roles: ubuntu@smithi187.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2023-10-16T19:45:19.943 INFO:teuthology.run_tasks:Running task console_log... 2023-10-16T19:45:20.017 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7efd829bca60>, signals=[15]) 2023-10-16T19:45:20.018 INFO:teuthology.run_tasks:Running task internal.connect... 2023-10-16T19:45:20.025 INFO:teuthology.task.internal:Opening connections... 2023-10-16T19:45:20.025 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi157.front.sepia.ceph.com 2023-10-16T19:45:20.027 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T19:45:20.096 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi187.front.sepia.ceph.com 2023-10-16T19:45:20.096 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T19:45:20.163 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-10-16T19:45:20.169 DEBUG:teuthology.orchestra.run.smithi157:> uname -m 2023-10-16T19:45:20.189 INFO:teuthology.orchestra.run.smithi157.stdout:x86_64 2023-10-16T19:45:20.189 DEBUG:teuthology.orchestra.run.smithi157:> cat /etc/os-release 2023-10-16T19:45:20.244 INFO:teuthology.orchestra.run.smithi157.stdout:NAME="Red Hat Enterprise Linux" 2023-10-16T19:45:20.245 INFO:teuthology.orchestra.run.smithi157.stdout:VERSION="8.6 (Ootpa)" 2023-10-16T19:45:20.245 INFO:teuthology.orchestra.run.smithi157.stdout:ID="rhel" 2023-10-16T19:45:20.245 INFO:teuthology.orchestra.run.smithi157.stdout:ID_LIKE="fedora" 2023-10-16T19:45:20.245 INFO:teuthology.orchestra.run.smithi157.stdout:VERSION_ID="8.6" 2023-10-16T19:45:20.245 INFO:teuthology.orchestra.run.smithi157.stdout:PLATFORM_ID="platform:el8" 2023-10-16T19:45:20.246 INFO:teuthology.orchestra.run.smithi157.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-10-16T19:45:20.246 INFO:teuthology.orchestra.run.smithi157.stdout:ANSI_COLOR="0;31" 2023-10-16T19:45:20.246 INFO:teuthology.orchestra.run.smithi157.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-10-16T19:45:20.246 INFO:teuthology.orchestra.run.smithi157.stdout:HOME_URL="https://www.redhat.com/" 2023-10-16T19:45:20.246 INFO:teuthology.orchestra.run.smithi157.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-16T19:45:20.247 INFO:teuthology.orchestra.run.smithi157.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-16T19:45:20.247 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-10-16T19:45:20.247 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-16T19:45:20.247 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-10-16T19:45:20.247 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-16T19:45:20.248 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-10-16T19:45:20.248 INFO:teuthology.lock.ops:Updating smithi157.front.sepia.ceph.com on lock server 2023-10-16T19:45:20.271 DEBUG:teuthology.orchestra.run.smithi187:> uname -m 2023-10-16T19:45:20.291 INFO:teuthology.orchestra.run.smithi187.stdout:x86_64 2023-10-16T19:45:20.292 DEBUG:teuthology.orchestra.run.smithi187:> cat /etc/os-release 2023-10-16T19:45:20.350 INFO:teuthology.orchestra.run.smithi187.stdout:NAME="Red Hat Enterprise Linux" 2023-10-16T19:45:20.351 INFO:teuthology.orchestra.run.smithi187.stdout:VERSION="8.6 (Ootpa)" 2023-10-16T19:45:20.351 INFO:teuthology.orchestra.run.smithi187.stdout:ID="rhel" 2023-10-16T19:45:20.351 INFO:teuthology.orchestra.run.smithi187.stdout:ID_LIKE="fedora" 2023-10-16T19:45:20.352 INFO:teuthology.orchestra.run.smithi187.stdout:VERSION_ID="8.6" 2023-10-16T19:45:20.352 INFO:teuthology.orchestra.run.smithi187.stdout:PLATFORM_ID="platform:el8" 2023-10-16T19:45:20.352 INFO:teuthology.orchestra.run.smithi187.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-10-16T19:45:20.352 INFO:teuthology.orchestra.run.smithi187.stdout:ANSI_COLOR="0;31" 2023-10-16T19:45:20.352 INFO:teuthology.orchestra.run.smithi187.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-10-16T19:45:20.353 INFO:teuthology.orchestra.run.smithi187.stdout:HOME_URL="https://www.redhat.com/" 2023-10-16T19:45:20.353 INFO:teuthology.orchestra.run.smithi187.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-16T19:45:20.353 INFO:teuthology.orchestra.run.smithi187.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-16T19:45:20.353 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-10-16T19:45:20.353 INFO:teuthology.orchestra.run.smithi187.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-16T19:45:20.353 INFO:teuthology.orchestra.run.smithi187.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-10-16T19:45:20.354 INFO:teuthology.orchestra.run.smithi187.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-16T19:45:20.354 INFO:teuthology.orchestra.run.smithi187.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-10-16T19:45:20.354 INFO:teuthology.lock.ops:Updating smithi187.front.sepia.ceph.com on lock server 2023-10-16T19:45:20.379 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-10-16T19:45:20.388 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-10-16T19:45:20.393 INFO:teuthology.task.internal:Checking for old test directory... 2023-10-16T19:45:20.393 DEBUG:teuthology.orchestra.run.smithi157:> test '!' -e /home/ubuntu/cephtest 2023-10-16T19:45:20.396 DEBUG:teuthology.orchestra.run.smithi187:> test '!' -e /home/ubuntu/cephtest 2023-10-16T19:45:20.414 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-10-16T19:45:20.420 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-10-16T19:45:20.420 DEBUG:teuthology.orchestra.run.smithi157:> test -z $(ls -A /var/lib/ceph) 2023-10-16T19:45:20.452 DEBUG:teuthology.orchestra.run.smithi187:> test -z $(ls -A /var/lib/ceph) 2023-10-16T19:45:20.476 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-10-16T19:45:20.529 INFO:teuthology.run_tasks:Running task kernel... 2023-10-16T19:45:20.544 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'flavor': 'default', 'kdb': True, 'sha1': '47672119149b103ec7cec2cc65c063ccbb001ac7'} 2023-10-16T19:45:20.544 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}, 'client.2': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}, 'client.3': {'sha1': 'distro'}} 2023-10-16T19:45:20.545 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}}, timeout 300 2023-10-16T19:45:20.545 DEBUG:teuthology.orchestra.run.smithi157:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-16T19:45:20.546 DEBUG:teuthology.orchestra.run.smithi187:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-16T19:45:20.561 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-16T19:45:20.562 DEBUG:teuthology.orchestra.run.smithi157:> uname -r 2023-10-16T19:45:20.564 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-16T19:45:20.565 DEBUG:teuthology.orchestra.run.smithi187:> uname -r 2023-10-16T19:45:20.619 INFO:teuthology.orchestra.run.smithi157.stdout:4.18.0-372.9.1.el8.x86_64 2023-10-16T19:45:20.619 INFO:teuthology.task.kernel:Running kernel on smithi157: 4.18.0-372.9.1.el8.x86_64 2023-10-16T19:45:20.619 DEBUG:teuthology.orchestra.run.smithi157:> sudo yum install -y kernel 2023-10-16T19:45:20.624 INFO:teuthology.orchestra.run.smithi187.stdout:4.18.0-372.9.1.el8.x86_64 2023-10-16T19:45:20.624 INFO:teuthology.task.kernel:Running kernel on smithi187: 4.18.0-372.9.1.el8.x86_64 2023-10-16T19:45:20.624 DEBUG:teuthology.orchestra.run.smithi187:> sudo yum install -y kernel 2023-10-16T19:45:21.823 INFO:teuthology.orchestra.run.smithi187.stdout:Updating Subscription Management repositories. 2023-10-16T19:45:21.823 INFO:teuthology.orchestra.run.smithi187.stdout:Unable to read consumer identity 2023-10-16T19:45:21.923 INFO:teuthology.orchestra.run.smithi157.stdout:Updating Subscription Management repositories. 2023-10-16T19:45:21.923 INFO:teuthology.orchestra.run.smithi157.stdout:Unable to read consumer identity 2023-10-16T19:45:23.320 INFO:teuthology.orchestra.run.smithi187.stdout:Copr repo for python3-asyncssh owned by ceph 16 kB/s | 3.5 kB 00:00 2023-10-16T19:45:23.768 INFO:teuthology.orchestra.run.smithi157.stdout:Copr repo for python3-asyncssh owned by ceph 14 kB/s | 3.5 kB 00:00 2023-10-16T19:45:24.478 INFO:teuthology.orchestra.run.smithi157.stdout:Extra Packages for Enterprise Linux 23 MB/s | 16 MB 00:00 2023-10-16T19:45:24.720 INFO:teuthology.orchestra.run.smithi187.stdout:Extra Packages for Enterprise Linux 12 MB/s | 16 MB 00:01 2023-10-16T19:45:27.986 INFO:teuthology.orchestra.run.smithi157.stdout:lab-extras 460 kB/s | 24 kB 00:00 2023-10-16T19:45:28.287 INFO:teuthology.orchestra.run.smithi187.stdout:lab-extras 189 kB/s | 24 kB 00:00 2023-10-16T19:45:28.713 INFO:teuthology.orchestra.run.smithi157.stdout:Package kernel-4.18.0-372.9.1.el8.x86_64 is already installed. 2023-10-16T19:45:28.762 INFO:teuthology.orchestra.run.smithi157.stdout:Dependencies resolved. 2023-10-16T19:45:28.765 INFO:teuthology.orchestra.run.smithi157.stdout:Nothing to do. 2023-10-16T19:45:28.765 INFO:teuthology.orchestra.run.smithi157.stdout:Complete! 2023-10-16T19:45:28.883 DEBUG:teuthology.orchestra.run.smithi157:> echo no | sudo yum reinstall kernel || true 2023-10-16T19:45:28.997 INFO:teuthology.orchestra.run.smithi187.stdout:Package kernel-4.18.0-372.9.1.el8.x86_64 is already installed. 2023-10-16T19:45:29.058 INFO:teuthology.orchestra.run.smithi187.stdout:Dependencies resolved. 2023-10-16T19:45:29.059 INFO:teuthology.orchestra.run.smithi187.stdout:Nothing to do. 2023-10-16T19:45:29.059 INFO:teuthology.orchestra.run.smithi187.stdout:Complete! 2023-10-16T19:45:29.179 DEBUG:teuthology.orchestra.run.smithi187:> echo no | sudo yum reinstall kernel || true 2023-10-16T19:45:29.254 INFO:teuthology.orchestra.run.smithi157.stdout:Updating Subscription Management repositories. 2023-10-16T19:45:29.254 INFO:teuthology.orchestra.run.smithi157.stdout:Unable to read consumer identity 2023-10-16T19:45:29.521 INFO:teuthology.orchestra.run.smithi157.stdout:Last metadata expiration check: 0:00:02 ago on Mon 16 Oct 2023 07:45:27 PM UTC. 2023-10-16T19:45:29.549 INFO:teuthology.orchestra.run.smithi187.stdout:Updating Subscription Management repositories. 2023-10-16T19:45:29.550 INFO:teuthology.orchestra.run.smithi187.stdout:Unable to read consumer identity 2023-10-16T19:45:29.564 INFO:teuthology.orchestra.run.smithi157.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-10-16T19:45:29.597 INFO:teuthology.orchestra.run.smithi157.stderr:Error: No packages marked for reinstall. 2023-10-16T19:45:29.644 DEBUG:teuthology.orchestra.run.smithi157:> sudo yum reinstall -y kernel || true 2023-10-16T19:45:29.813 INFO:teuthology.orchestra.run.smithi187.stdout:Last metadata expiration check: 0:00:01 ago on Mon 16 Oct 2023 07:45:28 PM UTC. 2023-10-16T19:45:29.853 INFO:teuthology.orchestra.run.smithi187.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-10-16T19:45:29.900 INFO:teuthology.orchestra.run.smithi187.stderr:Error: No packages marked for reinstall. 2023-10-16T19:45:29.947 DEBUG:teuthology.orchestra.run.smithi187:> sudo yum reinstall -y kernel || true 2023-10-16T19:45:29.974 INFO:teuthology.orchestra.run.smithi157.stdout:Updating Subscription Management repositories. 2023-10-16T19:45:29.974 INFO:teuthology.orchestra.run.smithi157.stdout:Unable to read consumer identity 2023-10-16T19:45:30.231 INFO:teuthology.orchestra.run.smithi157.stdout:Last metadata expiration check: 0:00:03 ago on Mon 16 Oct 2023 07:45:27 PM UTC. 2023-10-16T19:45:30.272 INFO:teuthology.orchestra.run.smithi157.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-10-16T19:45:30.274 INFO:teuthology.orchestra.run.smithi187.stdout:Updating Subscription Management repositories. 2023-10-16T19:45:30.274 INFO:teuthology.orchestra.run.smithi187.stdout:Unable to read consumer identity 2023-10-16T19:45:30.294 INFO:teuthology.orchestra.run.smithi157.stderr:Error: No packages marked for reinstall. 2023-10-16T19:45:30.341 DEBUG:teuthology.orchestra.run.smithi157:> rpm -q kernel | sort -rV | head -n 1 2023-10-16T19:45:30.420 INFO:teuthology.orchestra.run.smithi157.stdout:kernel-4.18.0-372.9.1.el8.x86_64 2023-10-16T19:45:30.421 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-372.9.1.el8.x86_64 2023-10-16T19:45:30.421 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2023-10-16T19:45:30.421 DEBUG:teuthology.parallel:result is None 2023-10-16T19:45:30.533 INFO:teuthology.orchestra.run.smithi187.stdout:Last metadata expiration check: 0:00:02 ago on Mon 16 Oct 2023 07:45:28 PM UTC. 2023-10-16T19:45:30.575 INFO:teuthology.orchestra.run.smithi187.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-10-16T19:45:30.607 INFO:teuthology.orchestra.run.smithi187.stderr:Error: No packages marked for reinstall. 2023-10-16T19:45:30.654 DEBUG:teuthology.orchestra.run.smithi187:> rpm -q kernel | sort -rV | head -n 1 2023-10-16T19:45:30.734 INFO:teuthology.orchestra.run.smithi187.stdout:kernel-4.18.0-372.9.1.el8.x86_64 2023-10-16T19:45:30.735 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-372.9.1.el8.x86_64 2023-10-16T19:45:30.735 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2023-10-16T19:45:30.735 DEBUG:teuthology.parallel:result is None 2023-10-16T19:45:30.735 INFO:teuthology.run_tasks:Running task internal.base... 2023-10-16T19:45:30.742 INFO:teuthology.task.internal:Creating test directory... 2023-10-16T19:45:30.743 DEBUG:teuthology.orchestra.run.smithi157:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-16T19:45:30.745 DEBUG:teuthology.orchestra.run.smithi187:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-16T19:45:30.761 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-10-16T19:45:30.768 INFO:teuthology.run_tasks:Running task internal.archive... 2023-10-16T19:45:30.778 INFO:teuthology.task.internal:Creating archive directory... 2023-10-16T19:45:30.778 DEBUG:teuthology.orchestra.run.smithi157:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-16T19:45:30.802 DEBUG:teuthology.orchestra.run.smithi187:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-16T19:45:30.835 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-10-16T19:45:30.842 INFO:teuthology.task.internal:Enabling coredump saving... 2023-10-16T19:45:30.842 DEBUG:teuthology.orchestra.run.smithi157:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-16T19:45:30.866 DEBUG:teuthology.orchestra.run.smithi187:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-16T19:45:30.908 INFO:teuthology.orchestra.run.smithi187.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-16T19:45:30.910 INFO:teuthology.orchestra.run.smithi157.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-16T19:45:30.920 INFO:teuthology.orchestra.run.smithi187.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-16T19:45:30.922 INFO:teuthology.orchestra.run.smithi157.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-16T19:45:30.923 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-10-16T19:45:30.930 INFO:teuthology.task.internal:Configuring sudo... 2023-10-16T19:45:30.930 DEBUG:teuthology.orchestra.run.smithi157:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-16T19:45:30.933 DEBUG:teuthology.orchestra.run.smithi187:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-16T19:45:30.988 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-10-16T19:45:30.996 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-10-16T19:45:30.997 DEBUG:teuthology.orchestra.run.smithi157:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-16T19:45:31.000 DEBUG:teuthology.orchestra.run.smithi187:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-16T19:45:31.045 DEBUG:teuthology.orchestra.run.smithi157:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-16T19:45:31.092 DEBUG:teuthology.orchestra.run.smithi157:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-16T19:45:31.147 DEBUG:teuthology.orchestra.run.smithi157:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-16T19:45:31.228 DEBUG:teuthology.orchestra.run.smithi157:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-16T19:45:31.272 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2023-10-16T19:45:31.272 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-16T19:45:31.351 DEBUG:teuthology.orchestra.run.smithi187:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-16T19:45:31.390 DEBUG:teuthology.orchestra.run.smithi187:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-16T19:45:31.447 DEBUG:teuthology.orchestra.run.smithi187:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-16T19:45:31.531 DEBUG:teuthology.orchestra.run.smithi187:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-16T19:45:31.570 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-10-16T19:45:31.571 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-16T19:45:31.638 DEBUG:teuthology.orchestra.run.smithi157:> sudo service rsyslog restart 2023-10-16T19:45:31.640 DEBUG:teuthology.orchestra.run.smithi187:> sudo service rsyslog restart 2023-10-16T19:45:31.691 INFO:teuthology.orchestra.run.smithi157.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-16T19:45:31.772 INFO:teuthology.orchestra.run.smithi187.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-16T19:45:32.174 INFO:teuthology.run_tasks:Running task internal.timer... 2023-10-16T19:45:32.181 INFO:teuthology.task.internal:Starting timer... 2023-10-16T19:45:32.182 INFO:teuthology.run_tasks:Running task pcp... 2023-10-16T19:45:32.191 INFO:teuthology.run_tasks:Running task selinux... 2023-10-16T19:45:32.199 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2023-10-16T19:45:32.200 DEBUG:teuthology.orchestra.run.smithi157:> sudo service auditd rotate 2023-10-16T19:45:32.257 INFO:teuthology.orchestra.run.smithi157.stdout:Rotating logs: 2023-10-16T19:45:32.258 DEBUG:teuthology.orchestra.run.smithi187:> sudo service auditd rotate 2023-10-16T19:45:32.322 INFO:teuthology.orchestra.run.smithi187.stdout:Rotating logs: 2023-10-16T19:45:32.324 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-10-16T19:45:32.324 DEBUG:teuthology.orchestra.run.smithi157:> /usr/sbin/getenforce 2023-10-16T19:45:32.346 INFO:teuthology.orchestra.run.smithi157.stdout:Permissive 2023-10-16T19:45:32.346 DEBUG:teuthology.orchestra.run.smithi187:> /usr/sbin/getenforce 2023-10-16T19:45:32.368 INFO:teuthology.orchestra.run.smithi187.stdout:Permissive 2023-10-16T19:45:32.368 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi157.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi187.front.sepia.ceph.com': 'permissive'} 2023-10-16T19:45:32.369 DEBUG:teuthology.orchestra.run.smithi157:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-16T19:45:32.415 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-16T19:45:32.416 DEBUG:teuthology.orchestra.run.smithi187:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-16T19:45:32.442 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-16T19:45:32.443 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-10-16T19:45:32.443 DEBUG:teuthology.orchestra.run.smithi157:> sudo /usr/sbin/setenforce permissive 2023-10-16T19:45:32.482 DEBUG:teuthology.orchestra.run.smithi187:> sudo /usr/sbin/setenforce permissive 2023-10-16T19:45:32.511 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-10-16T19:45:32.520 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2023-10-16T19:45:32.525 INFO:teuthology.repo_utils:Fetching main from origin 2023-10-16T19:45:32.636 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-10-16T19:45:32.651 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-10-16T19:45:32.652 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi157.front.sepia.ceph.com,smithi187.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-10-16T19:54:19.621 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi157.front.sepia.ceph.com'), Remote(name='ubuntu@smithi187.front.sepia.ceph.com')] 2023-10-16T19:54:19.622 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi157.front.sepia.ceph.com' 2023-10-16T19:54:19.623 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T19:54:19.692 DEBUG:teuthology.orchestra.run.smithi157:> true 2023-10-16T19:54:19.760 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi157.front.sepia.ceph.com' 2023-10-16T19:54:19.760 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi187.front.sepia.ceph.com' 2023-10-16T19:54:19.761 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T19:54:19.829 DEBUG:teuthology.orchestra.run.smithi187:> true 2023-10-16T19:54:19.896 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi187.front.sepia.ceph.com' 2023-10-16T19:54:19.897 INFO:teuthology.run_tasks:Running task clock... 2023-10-16T19:54:19.908 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-10-16T19:54:19.909 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-16T19:54:19.910 DEBUG:teuthology.orchestra.run.smithi157:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-16T19:54:19.912 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-16T19:54:19.913 DEBUG:teuthology.orchestra.run.smithi187:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-16T19:54:19.940 INFO:teuthology.orchestra.run.smithi157.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-10-16T19:54:19.954 INFO:teuthology.orchestra.run.smithi157.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-10-16T19:54:19.969 INFO:teuthology.orchestra.run.smithi187.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-10-16T19:54:19.984 INFO:teuthology.orchestra.run.smithi187.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-10-16T19:54:20.025 INFO:teuthology.orchestra.run.smithi157.stderr:sudo: ntpd: command not found 2023-10-16T19:54:20.036 INFO:teuthology.orchestra.run.smithi157.stdout:506 Cannot talk to daemon 2023-10-16T19:54:20.047 INFO:teuthology.orchestra.run.smithi187.stderr:sudo: ntpd: command not found 2023-10-16T19:54:20.051 INFO:teuthology.orchestra.run.smithi157.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-10-16T19:54:20.061 INFO:teuthology.orchestra.run.smithi187.stdout:506 Cannot talk to daemon 2023-10-16T19:54:20.064 INFO:teuthology.orchestra.run.smithi157.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-10-16T19:54:20.073 INFO:teuthology.orchestra.run.smithi187.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-10-16T19:54:20.086 INFO:teuthology.orchestra.run.smithi187.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-10-16T19:54:20.133 INFO:teuthology.orchestra.run.smithi157.stderr:bash: ntpq: command not found 2023-10-16T19:54:20.137 INFO:teuthology.orchestra.run.smithi157.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-16T19:54:20.138 INFO:teuthology.orchestra.run.smithi157.stdout:=============================================================================== 2023-10-16T19:54:20.138 INFO:teuthology.orchestra.run.smithi157.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-16T19:54:20.138 INFO:teuthology.orchestra.run.smithi157.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-16T19:54:20.138 INFO:teuthology.orchestra.run.smithi157.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-16T19:54:20.138 INFO:teuthology.orchestra.run.smithi157.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-16T19:54:20.156 INFO:teuthology.orchestra.run.smithi187.stderr:bash: ntpq: command not found 2023-10-16T19:54:20.161 INFO:teuthology.orchestra.run.smithi187.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-16T19:54:20.161 INFO:teuthology.orchestra.run.smithi187.stdout:=============================================================================== 2023-10-16T19:54:20.161 INFO:teuthology.orchestra.run.smithi187.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-16T19:54:20.161 INFO:teuthology.orchestra.run.smithi187.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-16T19:54:20.162 INFO:teuthology.orchestra.run.smithi187.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-16T19:54:20.162 INFO:teuthology.orchestra.run.smithi187.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-16T19:54:20.163 INFO:teuthology.run_tasks:Running task install... 2023-10-16T19:54:20.170 DEBUG:teuthology.task.install:project ceph 2023-10-16T19:54:20.171 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0'}} 2023-10-16T19:54:20.171 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0'} 2023-10-16T19:54:20.171 INFO:teuthology.task.install:Using flavor: default 2023-10-16T19:54:20.177 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-10-16T19:54:20.178 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-10-16T19:54:20.178 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0', 'tag': None, 'wait_for_package': False} 2023-10-16T19:54:20.179 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 2023-10-16T19:54:20.182 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0', 'tag': None, 'wait_for_package': False} 2023-10-16T19:54:20.182 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 2023-10-16T19:54:20.326 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/centos/8/flavors/default/ 2023-10-16T19:54:20.326 INFO:teuthology.task.install.rpm:Package version is 18.0.0-6730.g4ba8a190 2023-10-16T19:54:20.334 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/centos/8/flavors/default/ 2023-10-16T19:54:20.335 INFO:teuthology.task.install.rpm:Package version is 18.0.0-6730.g4ba8a190 2023-10-16T19:54:20.516 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-10-16T19:54:20.517 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2023-10-16T19:54:20.517 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-10-16T19:54:20.545 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-10-16T19:54:20.546 DEBUG:teuthology.orchestra.run.smithi157:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-10-16T19:54:20.595 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-10-16T19:54:20.595 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-10-16T19:54:20.595 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-10-16T19:54:20.613 DEBUG:teuthology.orchestra.run.smithi157:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-10-16T19:54:20.624 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-10-16T19:54:20.625 DEBUG:teuthology.orchestra.run.smithi187:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-10-16T19:54:20.690 DEBUG:teuthology.orchestra.run.smithi157:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-10-16T19:54:20.692 DEBUG:teuthology.orchestra.run.smithi187:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-10-16T19:54:20.756 INFO:teuthology.orchestra.run.smithi157.stdout:check_obsoletes = 1 2023-10-16T19:54:20.758 DEBUG:teuthology.orchestra.run.smithi157:> sudo yum clean all 2023-10-16T19:54:20.769 DEBUG:teuthology.orchestra.run.smithi187:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-10-16T19:54:20.835 INFO:teuthology.orchestra.run.smithi187.stdout:check_obsoletes = 1 2023-10-16T19:54:20.836 DEBUG:teuthology.orchestra.run.smithi187:> sudo yum clean all 2023-10-16T19:54:21.130 INFO:teuthology.orchestra.run.smithi157.stdout:Updating Subscription Management repositories. 2023-10-16T19:54:21.206 INFO:teuthology.orchestra.run.smithi187.stdout:Updating Subscription Management repositories. 2023-10-16T19:54:21.391 INFO:teuthology.orchestra.run.smithi157.stdout:44 files removed 2023-10-16T19:54:21.433 INFO:teuthology.orchestra.run.smithi187.stdout:44 files removed 2023-10-16T19:54:21.439 DEBUG:teuthology.orchestra.run.smithi157:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-10-16T19:54:21.481 DEBUG:teuthology.orchestra.run.smithi187:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-10-16T19:54:21.771 INFO:teuthology.orchestra.run.smithi157.stdout:Updating Subscription Management repositories. 2023-10-16T19:54:21.812 INFO:teuthology.orchestra.run.smithi187.stdout:Updating Subscription Management repositories. 2023-10-16T19:54:22.732 INFO:teuthology.orchestra.run.smithi157.stdout:ceph packages for x86_64 134 kB/s | 81 kB 00:00 2023-10-16T19:54:22.792 INFO:teuthology.orchestra.run.smithi187.stdout:ceph packages for x86_64 130 kB/s | 81 kB 00:00 2023-10-16T19:54:23.192 INFO:teuthology.orchestra.run.smithi157.stdout:ceph noarch packages 22 kB/s | 9.4 kB 00:00 2023-10-16T19:54:23.401 INFO:teuthology.orchestra.run.smithi187.stdout:ceph noarch packages 16 kB/s | 9.4 kB 00:00 2023-10-16T19:54:23.734 INFO:teuthology.orchestra.run.smithi157.stdout:ceph source packages 2.9 kB/s | 1.5 kB 00:00 2023-10-16T19:54:23.785 INFO:teuthology.orchestra.run.smithi187.stdout:ceph source packages 4.1 kB/s | 1.5 kB 00:00 2023-10-16T19:54:23.893 INFO:teuthology.orchestra.run.smithi157.stdout:Copr repo for python3-asyncssh owned by ceph 25 kB/s | 3.5 kB 00:00 2023-10-16T19:54:23.927 INFO:teuthology.orchestra.run.smithi187.stdout:Copr repo for python3-asyncssh owned by ceph 28 kB/s | 3.5 kB 00:00 2023-10-16T19:54:25.111 INFO:teuthology.orchestra.run.smithi187.stdout:Extra Packages for Enterprise Linux 14 MB/s | 16 MB 00:01 2023-10-16T19:54:26.760 INFO:teuthology.orchestra.run.smithi157.stdout:Extra Packages for Enterprise Linux 5.6 MB/s | 16 MB 00:02 2023-10-16T19:54:28.594 INFO:teuthology.orchestra.run.smithi187.stdout:lab-extras 389 kB/s | 24 kB 00:00 2023-10-16T19:54:29.438 INFO:teuthology.orchestra.run.smithi187.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 61 MB/s | 47 MB 00:00 2023-10-16T19:54:30.227 INFO:teuthology.orchestra.run.smithi157.stdout:lab-extras 396 kB/s | 24 kB 00:00 2023-10-16T19:54:31.170 INFO:teuthology.orchestra.run.smithi157.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 61 MB/s | 53 MB 00:00 2023-10-16T19:54:37.313 INFO:teuthology.orchestra.run.smithi187.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 59 MB/s | 53 MB 00:00 2023-10-16T19:54:39.346 INFO:teuthology.orchestra.run.smithi157.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 59 MB/s | 47 MB 00:00 2023-10-16T19:54:48.479 INFO:teuthology.orchestra.run.smithi187.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-16T19:54:48.480 INFO:teuthology.orchestra.run.smithi187.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-16T19:54:48.496 INFO:teuthology.orchestra.run.smithi187.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2023-10-16T19:54:48.497 INFO:teuthology.orchestra.run.smithi187.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2023-10-16T19:54:48.498 INFO:teuthology.orchestra.run.smithi187.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2023-10-16T19:54:48.499 INFO:teuthology.orchestra.run.smithi187.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-10-16T19:54:48.501 INFO:teuthology.orchestra.run.smithi187.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-10-16T19:54:48.505 INFO:teuthology.orchestra.run.smithi187.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-10-16T19:54:48.506 INFO:teuthology.orchestra.run.smithi187.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-10-16T19:54:48.640 INFO:teuthology.orchestra.run.smithi187.stdout:Dependencies resolved. 2023-10-16T19:54:48.652 INFO:teuthology.orchestra.run.smithi187.stdout:=========================================================================================================================== 2023-10-16T19:54:48.652 INFO:teuthology.orchestra.run.smithi187.stdout: Package Arch Version Repository Size 2023-10-16T19:54:48.652 INFO:teuthology.orchestra.run.smithi187.stdout:=========================================================================================================================== 2023-10-16T19:54:48.652 INFO:teuthology.orchestra.run.smithi187.stdout:Installing: 2023-10-16T19:54:48.653 INFO:teuthology.orchestra.run.smithi187.stdout: NetworkManager-initscripts-updown noarch 1:1.36.0-9.el8_6 rhel-8-for-x86_64-baseos-rpms 138 k 2023-10-16T19:54:48.653 INFO:teuthology.orchestra.run.smithi187.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-10-16T19:54:48.653 INFO:teuthology.orchestra.run.smithi187.stdout: ceph x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 6.4 k 2023-10-16T19:54:48.653 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-base x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 5.4 M 2023-10-16T19:54:48.653 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-fuse x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 918 k 2023-10-16T19:54:48.654 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 167 k 2023-10-16T19:54:48.654 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-mgr x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 1.6 M 2023-10-16T19:54:48.654 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-mgr-cephadm noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 132 k 2023-10-16T19:54:48.654 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-mgr-dashboard noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 1.8 M 2023-10-16T19:54:48.655 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 7.4 M 2023-10-16T19:54:48.655 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-mgr-rook noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 47 k 2023-10-16T19:54:48.655 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-radosgw x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 14 M 2023-10-16T19:54:48.655 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-test x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 49 M 2023-10-16T19:54:48.655 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-volume noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 261 k 2023-10-16T19:54:48.656 INFO:teuthology.orchestra.run.smithi187.stdout: cephadm noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 192 k 2023-10-16T19:54:48.656 INFO:teuthology.orchestra.run.smithi187.stdout: cephfs-mirror x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 261 k 2023-10-16T19:54:48.656 INFO:teuthology.orchestra.run.smithi187.stdout: cephfs-top noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 18 k 2023-10-16T19:54:48.656 INFO:teuthology.orchestra.run.smithi187.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2023-10-16T19:54:48.656 INFO:teuthology.orchestra.run.smithi187.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-10-16T19:54:48.657 INFO:teuthology.orchestra.run.smithi187.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-10-16T19:54:48.657 INFO:teuthology.orchestra.run.smithi187.stdout: libcephfs-devel x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 31 k 2023-10-16T19:54:48.657 INFO:teuthology.orchestra.run.smithi187.stdout: libcephfs2 x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 839 k 2023-10-16T19:54:48.657 INFO:teuthology.orchestra.run.smithi187.stdout: librados-devel x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 139 k 2023-10-16T19:54:48.657 INFO:teuthology.orchestra.run.smithi187.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-10-16T19:54:48.657 INFO:teuthology.orchestra.run.smithi187.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2023-10-16T19:54:48.658 INFO:teuthology.orchestra.run.smithi187.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-10-16T19:54:48.658 INFO:teuthology.orchestra.run.smithi187.stdout: postgresql x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 1.5 M 2023-10-16T19:54:48.658 INFO:teuthology.orchestra.run.smithi187.stdout: postgresql-contrib x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 808 k 2023-10-16T19:54:48.658 INFO:teuthology.orchestra.run.smithi187.stdout: postgresql-server x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 5.1 M 2023-10-16T19:54:48.658 INFO:teuthology.orchestra.run.smithi187.stdout: python3-cephfs x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 197 k 2023-10-16T19:54:48.659 INFO:teuthology.orchestra.run.smithi187.stdout: python3-rados x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 371 k 2023-10-16T19:54:48.659 INFO:teuthology.orchestra.run.smithi187.stdout: python3-rbd x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 365 k 2023-10-16T19:54:48.659 INFO:teuthology.orchestra.run.smithi187.stdout: python3-rgw x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 107 k 2023-10-16T19:54:48.659 INFO:teuthology.orchestra.run.smithi187.stdout: rbd-fuse x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 94 k 2023-10-16T19:54:48.660 INFO:teuthology.orchestra.run.smithi187.stdout: rbd-mirror x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 3.6 M 2023-10-16T19:54:48.660 INFO:teuthology.orchestra.run.smithi187.stdout: rbd-nbd x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 179 k 2023-10-16T19:54:48.660 INFO:teuthology.orchestra.run.smithi187.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2023-10-16T19:54:48.660 INFO:teuthology.orchestra.run.smithi187.stdout:Upgrading: 2023-10-16T19:54:48.660 INFO:teuthology.orchestra.run.smithi187.stdout: iproute x86_64 5.15.0-4.el8_6.1 rhel-8-for-x86_64-baseos-rpms 798 k 2023-10-16T19:54:48.661 INFO:teuthology.orchestra.run.smithi187.stdout: librados2 x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 3.7 M 2023-10-16T19:54:48.661 INFO:teuthology.orchestra.run.smithi187.stdout: librbd1 x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 3.7 M 2023-10-16T19:54:48.661 INFO:teuthology.orchestra.run.smithi187.stdout:Installing dependencies: 2023-10-16T19:54:48.661 INFO:teuthology.orchestra.run.smithi187.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-10-16T19:54:48.661 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-common x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 23 M 2023-10-16T19:54:48.662 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-grafana-dashboards noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 23 k 2023-10-16T19:54:48.662 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-mds x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 2.3 M 2023-10-16T19:54:48.662 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-mgr-modules-core noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 242 k 2023-10-16T19:54:48.662 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-mon x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 4.6 M 2023-10-16T19:54:48.662 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-osd x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 18 M 2023-10-16T19:54:48.663 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-prometheus-alerts noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 15 k 2023-10-16T19:54:48.663 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-selinux x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 24 k 2023-10-16T19:54:48.663 INFO:teuthology.orchestra.run.smithi187.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-10-16T19:54:48.663 INFO:teuthology.orchestra.run.smithi187.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-10-16T19:54:48.663 INFO:teuthology.orchestra.run.smithi187.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-10-16T19:54:48.664 INFO:teuthology.orchestra.run.smithi187.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-10-16T19:54:48.664 INFO:teuthology.orchestra.run.smithi187.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2023-10-16T19:54:48.664 INFO:teuthology.orchestra.run.smithi187.stdout: libcephsqlite x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 184 k 2023-10-16T19:54:48.664 INFO:teuthology.orchestra.run.smithi187.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-10-16T19:54:48.664 INFO:teuthology.orchestra.run.smithi187.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2023-10-16T19:54:48.665 INFO:teuthology.orchestra.run.smithi187.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-10-16T19:54:48.665 INFO:teuthology.orchestra.run.smithi187.stdout: libpq x86_64 13.5-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2023-10-16T19:54:48.665 INFO:teuthology.orchestra.run.smithi187.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2023-10-16T19:54:48.665 INFO:teuthology.orchestra.run.smithi187.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-10-16T19:54:48.665 INFO:teuthology.orchestra.run.smithi187.stdout: libradosstriper1 x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 518 k 2023-10-16T19:54:48.666 INFO:teuthology.orchestra.run.smithi187.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-10-16T19:54:48.666 INFO:teuthology.orchestra.run.smithi187.stdout: librgw2 x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 6.9 M 2023-10-16T19:54:48.666 INFO:teuthology.orchestra.run.smithi187.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-10-16T19:54:48.666 INFO:teuthology.orchestra.run.smithi187.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-10-16T19:54:48.666 INFO:teuthology.orchestra.run.smithi187.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-10-16T19:54:48.667 INFO:teuthology.orchestra.run.smithi187.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-10-16T19:54:48.667 INFO:teuthology.orchestra.run.smithi187.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-10-16T19:54:48.667 INFO:teuthology.orchestra.run.smithi187.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-10-16T19:54:48.667 INFO:teuthology.orchestra.run.smithi187.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-10-16T19:54:48.667 INFO:teuthology.orchestra.run.smithi187.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2023-10-16T19:54:48.668 INFO:teuthology.orchestra.run.smithi187.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-10-16T19:54:48.668 INFO:teuthology.orchestra.run.smithi187.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-10-16T19:54:48.668 INFO:teuthology.orchestra.run.smithi187.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-10-16T19:54:48.668 INFO:teuthology.orchestra.run.smithi187.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-10-16T19:54:48.669 INFO:teuthology.orchestra.run.smithi187.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-10-16T19:54:48.669 INFO:teuthology.orchestra.run.smithi187.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-10-16T19:54:48.669 INFO:teuthology.orchestra.run.smithi187.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-10-16T19:54:48.669 INFO:teuthology.orchestra.run.smithi187.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-10-16T19:54:48.669 INFO:teuthology.orchestra.run.smithi187.stdout: python3-ceph-argparse x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 45 k 2023-10-16T19:54:48.670 INFO:teuthology.orchestra.run.smithi187.stdout: python3-ceph-common x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 126 k 2023-10-16T19:54:48.670 INFO:teuthology.orchestra.run.smithi187.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-10-16T19:54:48.670 INFO:teuthology.orchestra.run.smithi187.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-10-16T19:54:48.670 INFO:teuthology.orchestra.run.smithi187.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-10-16T19:54:48.670 INFO:teuthology.orchestra.run.smithi187.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-10-16T19:54:48.671 INFO:teuthology.orchestra.run.smithi187.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-10-16T19:54:48.671 INFO:teuthology.orchestra.run.smithi187.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-10-16T19:54:48.671 INFO:teuthology.orchestra.run.smithi187.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-10-16T19:54:48.673 INFO:teuthology.orchestra.run.smithi187.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-10-16T19:54:48.673 INFO:teuthology.orchestra.run.smithi187.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-10-16T19:54:48.674 INFO:teuthology.orchestra.run.smithi187.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-10-16T19:54:48.674 INFO:teuthology.orchestra.run.smithi187.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-10-16T19:54:48.674 INFO:teuthology.orchestra.run.smithi187.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-16T19:54:48.674 INFO:teuthology.orchestra.run.smithi187.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-10-16T19:54:48.674 INFO:teuthology.orchestra.run.smithi187.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-10-16T19:54:48.675 INFO:teuthology.orchestra.run.smithi187.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-10-16T19:54:48.675 INFO:teuthology.orchestra.run.smithi187.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-10-16T19:54:48.675 INFO:teuthology.orchestra.run.smithi187.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-10-16T19:54:48.675 INFO:teuthology.orchestra.run.smithi187.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-10-16T19:54:48.675 INFO:teuthology.orchestra.run.smithi187.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-10-16T19:54:48.676 INFO:teuthology.orchestra.run.smithi187.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-10-16T19:54:48.676 INFO:teuthology.orchestra.run.smithi187.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-10-16T19:54:48.676 INFO:teuthology.orchestra.run.smithi187.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-10-16T19:54:48.676 INFO:teuthology.orchestra.run.smithi187.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-10-16T19:54:48.676 INFO:teuthology.orchestra.run.smithi187.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-10-16T19:54:48.677 INFO:teuthology.orchestra.run.smithi187.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-10-16T19:54:48.677 INFO:teuthology.orchestra.run.smithi187.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-10-16T19:54:48.677 INFO:teuthology.orchestra.run.smithi187.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-10-16T19:54:48.677 INFO:teuthology.orchestra.run.smithi187.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-10-16T19:54:48.678 INFO:teuthology.orchestra.run.smithi187.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-10-16T19:54:48.678 INFO:teuthology.orchestra.run.smithi187.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-10-16T19:54:48.678 INFO:teuthology.orchestra.run.smithi187.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-16T19:54:48.678 INFO:teuthology.orchestra.run.smithi187.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-10-16T19:54:48.678 INFO:teuthology.orchestra.run.smithi187.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-10-16T19:54:48.679 INFO:teuthology.orchestra.run.smithi187.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-10-16T19:54:48.679 INFO:teuthology.orchestra.run.smithi187.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-10-16T19:54:48.680 INFO:teuthology.orchestra.run.smithi187.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-10-16T19:54:48.680 INFO:teuthology.orchestra.run.smithi187.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-10-16T19:54:48.680 INFO:teuthology.orchestra.run.smithi187.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-10-16T19:54:48.680 INFO:teuthology.orchestra.run.smithi187.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-10-16T19:54:48.680 INFO:teuthology.orchestra.run.smithi187.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-10-16T19:54:48.681 INFO:teuthology.orchestra.run.smithi187.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-10-16T19:54:48.681 INFO:teuthology.orchestra.run.smithi187.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-10-16T19:54:48.681 INFO:teuthology.orchestra.run.smithi187.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-10-16T19:54:48.681 INFO:teuthology.orchestra.run.smithi187.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-10-16T19:54:48.681 INFO:teuthology.orchestra.run.smithi187.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-10-16T19:54:48.682 INFO:teuthology.orchestra.run.smithi187.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-10-16T19:54:48.682 INFO:teuthology.orchestra.run.smithi187.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2023-10-16T19:54:48.682 INFO:teuthology.orchestra.run.smithi187.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-10-16T19:54:48.682 INFO:teuthology.orchestra.run.smithi187.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-10-16T19:54:48.683 INFO:teuthology.orchestra.run.smithi187.stdout:Enabling module streams: 2023-10-16T19:54:48.683 INFO:teuthology.orchestra.run.smithi187.stdout: postgresql 10 2023-10-16T19:54:48.683 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-10-16T19:54:48.684 INFO:teuthology.orchestra.run.smithi187.stdout:Transaction Summary 2023-10-16T19:54:48.684 INFO:teuthology.orchestra.run.smithi187.stdout:=========================================================================================================================== 2023-10-16T19:54:48.684 INFO:teuthology.orchestra.run.smithi187.stdout:Install 128 Packages 2023-10-16T19:54:48.684 INFO:teuthology.orchestra.run.smithi187.stdout:Upgrade 3 Packages 2023-10-16T19:54:48.684 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-10-16T19:54:48.685 INFO:teuthology.orchestra.run.smithi187.stdout:Total download size: 209 M 2023-10-16T19:54:48.685 INFO:teuthology.orchestra.run.smithi187.stdout:Downloading Packages: 2023-10-16T19:54:48.822 INFO:teuthology.orchestra.run.smithi187.stdout:(1/131): ceph-18.0.0-6730.g4ba8a190.el8.x86_64. 51 kB/s | 6.4 kB 00:00 2023-10-16T19:54:49.172 INFO:teuthology.orchestra.run.smithi187.stdout:(2/131): ceph-fuse-18.0.0-6730.g4ba8a190.el8.x8 2.6 MB/s | 918 kB 00:00 2023-10-16T19:54:49.280 INFO:teuthology.orchestra.run.smithi187.stdout:(3/131): ceph-base-18.0.0-6730.g4ba8a190.el8.x8 9.2 MB/s | 5.4 MB 00:00 2023-10-16T19:54:49.306 INFO:teuthology.orchestra.run.smithi187.stdout:(4/131): ceph-immutable-object-cache-18.0.0-673 1.2 MB/s | 167 kB 00:00 2023-10-16T19:54:49.473 INFO:teuthology.orchestra.run.smithi187.stdout:(5/131): ceph-mds-18.0.0-6730.g4ba8a190.el8.x86 12 MB/s | 2.3 MB 00:00 2023-10-16T19:54:49.748 INFO:teuthology.orchestra.run.smithi187.stdout:(6/131): ceph-mgr-18.0.0-6730.g4ba8a190.el8.x86 3.7 MB/s | 1.6 MB 00:00 2023-10-16T19:54:49.806 INFO:teuthology.orchestra.run.smithi187.stdout:(7/131): ceph-mon-18.0.0-6730.g4ba8a190.el8.x86 14 MB/s | 4.6 MB 00:00 2023-10-16T19:54:50.410 INFO:teuthology.orchestra.run.smithi157.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-16T19:54:50.411 INFO:teuthology.orchestra.run.smithi157.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-16T19:54:50.426 INFO:teuthology.orchestra.run.smithi157.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2023-10-16T19:54:50.427 INFO:teuthology.orchestra.run.smithi157.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2023-10-16T19:54:50.429 INFO:teuthology.orchestra.run.smithi157.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2023-10-16T19:54:50.429 INFO:teuthology.orchestra.run.smithi157.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-10-16T19:54:50.431 INFO:teuthology.orchestra.run.smithi157.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-10-16T19:54:50.434 INFO:teuthology.orchestra.run.smithi157.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-10-16T19:54:50.435 INFO:teuthology.orchestra.run.smithi157.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-10-16T19:54:50.565 INFO:teuthology.orchestra.run.smithi157.stdout:Dependencies resolved. 2023-10-16T19:54:50.578 INFO:teuthology.orchestra.run.smithi157.stdout:=========================================================================================================================== 2023-10-16T19:54:50.578 INFO:teuthology.orchestra.run.smithi157.stdout: Package Arch Version Repository Size 2023-10-16T19:54:50.578 INFO:teuthology.orchestra.run.smithi157.stdout:=========================================================================================================================== 2023-10-16T19:54:50.579 INFO:teuthology.orchestra.run.smithi157.stdout:Installing: 2023-10-16T19:54:50.579 INFO:teuthology.orchestra.run.smithi157.stdout: NetworkManager-initscripts-updown noarch 1:1.36.0-9.el8_6 rhel-8-for-x86_64-baseos-rpms 138 k 2023-10-16T19:54:50.579 INFO:teuthology.orchestra.run.smithi157.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-10-16T19:54:50.579 INFO:teuthology.orchestra.run.smithi157.stdout: ceph x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 6.4 k 2023-10-16T19:54:50.579 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-base x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 5.4 M 2023-10-16T19:54:50.580 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-fuse x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 918 k 2023-10-16T19:54:50.580 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 167 k 2023-10-16T19:54:50.580 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 1.6 M 2023-10-16T19:54:50.580 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr-cephadm noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 132 k 2023-10-16T19:54:50.580 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr-dashboard noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 1.8 M 2023-10-16T19:54:50.581 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 7.4 M 2023-10-16T19:54:50.581 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr-rook noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 47 k 2023-10-16T19:54:50.581 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-radosgw x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 14 M 2023-10-16T19:54:50.581 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-test x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 49 M 2023-10-16T19:54:50.581 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-volume noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 261 k 2023-10-16T19:54:50.582 INFO:teuthology.orchestra.run.smithi157.stdout: cephadm noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 192 k 2023-10-16T19:54:50.582 INFO:teuthology.orchestra.run.smithi157.stdout: cephfs-mirror x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 261 k 2023-10-16T19:54:50.582 INFO:teuthology.orchestra.run.smithi157.stdout: cephfs-top noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 18 k 2023-10-16T19:54:50.583 INFO:teuthology.orchestra.run.smithi157.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2023-10-16T19:54:50.583 INFO:teuthology.orchestra.run.smithi157.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-10-16T19:54:50.583 INFO:teuthology.orchestra.run.smithi157.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-10-16T19:54:50.583 INFO:teuthology.orchestra.run.smithi157.stdout: libcephfs-devel x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 31 k 2023-10-16T19:54:50.583 INFO:teuthology.orchestra.run.smithi157.stdout: libcephfs2 x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 839 k 2023-10-16T19:54:50.584 INFO:teuthology.orchestra.run.smithi157.stdout: librados-devel x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 139 k 2023-10-16T19:54:50.584 INFO:teuthology.orchestra.run.smithi157.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-10-16T19:54:50.584 INFO:teuthology.orchestra.run.smithi157.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2023-10-16T19:54:50.584 INFO:teuthology.orchestra.run.smithi157.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-10-16T19:54:50.584 INFO:teuthology.orchestra.run.smithi157.stdout: postgresql x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 1.5 M 2023-10-16T19:54:50.585 INFO:teuthology.orchestra.run.smithi157.stdout: postgresql-contrib x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 808 k 2023-10-16T19:54:50.585 INFO:teuthology.orchestra.run.smithi157.stdout: postgresql-server x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 5.1 M 2023-10-16T19:54:50.585 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cephfs x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 197 k 2023-10-16T19:54:50.585 INFO:teuthology.orchestra.run.smithi157.stdout: python3-rados x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 371 k 2023-10-16T19:54:50.585 INFO:teuthology.orchestra.run.smithi157.stdout: python3-rbd x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 365 k 2023-10-16T19:54:50.586 INFO:teuthology.orchestra.run.smithi157.stdout: python3-rgw x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 107 k 2023-10-16T19:54:50.586 INFO:teuthology.orchestra.run.smithi157.stdout: rbd-fuse x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 94 k 2023-10-16T19:54:50.586 INFO:teuthology.orchestra.run.smithi157.stdout: rbd-mirror x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 3.6 M 2023-10-16T19:54:50.586 INFO:teuthology.orchestra.run.smithi157.stdout: rbd-nbd x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 179 k 2023-10-16T19:54:50.587 INFO:teuthology.orchestra.run.smithi157.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2023-10-16T19:54:50.587 INFO:teuthology.orchestra.run.smithi157.stdout:Upgrading: 2023-10-16T19:54:50.587 INFO:teuthology.orchestra.run.smithi157.stdout: iproute x86_64 5.15.0-4.el8_6.1 rhel-8-for-x86_64-baseos-rpms 798 k 2023-10-16T19:54:50.587 INFO:teuthology.orchestra.run.smithi157.stdout: librados2 x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 3.7 M 2023-10-16T19:54:50.587 INFO:teuthology.orchestra.run.smithi157.stdout: librbd1 x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 3.7 M 2023-10-16T19:54:50.588 INFO:teuthology.orchestra.run.smithi157.stdout:Installing dependencies: 2023-10-16T19:54:50.588 INFO:teuthology.orchestra.run.smithi157.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-10-16T19:54:50.588 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-common x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 23 M 2023-10-16T19:54:50.588 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-grafana-dashboards noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 23 k 2023-10-16T19:54:50.588 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mds x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 2.3 M 2023-10-16T19:54:50.588 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr-modules-core noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 242 k 2023-10-16T19:54:50.589 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mon x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 4.6 M 2023-10-16T19:54:50.589 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-osd x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 18 M 2023-10-16T19:54:50.589 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-prometheus-alerts noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 15 k 2023-10-16T19:54:50.589 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-selinux x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 24 k 2023-10-16T19:54:50.589 INFO:teuthology.orchestra.run.smithi157.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-10-16T19:54:50.590 INFO:teuthology.orchestra.run.smithi157.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-10-16T19:54:50.590 INFO:teuthology.orchestra.run.smithi157.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-10-16T19:54:50.590 INFO:teuthology.orchestra.run.smithi157.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-10-16T19:54:50.590 INFO:teuthology.orchestra.run.smithi157.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2023-10-16T19:54:50.590 INFO:teuthology.orchestra.run.smithi157.stdout: libcephsqlite x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 184 k 2023-10-16T19:54:50.591 INFO:teuthology.orchestra.run.smithi157.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-10-16T19:54:50.591 INFO:teuthology.orchestra.run.smithi157.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2023-10-16T19:54:50.591 INFO:teuthology.orchestra.run.smithi157.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-10-16T19:54:50.591 INFO:teuthology.orchestra.run.smithi157.stdout: libpq x86_64 13.5-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2023-10-16T19:54:50.591 INFO:teuthology.orchestra.run.smithi157.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2023-10-16T19:54:50.592 INFO:teuthology.orchestra.run.smithi157.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-10-16T19:54:50.592 INFO:teuthology.orchestra.run.smithi157.stdout: libradosstriper1 x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 518 k 2023-10-16T19:54:50.592 INFO:teuthology.orchestra.run.smithi157.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-10-16T19:54:50.592 INFO:teuthology.orchestra.run.smithi157.stdout: librgw2 x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 6.9 M 2023-10-16T19:54:50.592 INFO:teuthology.orchestra.run.smithi157.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-10-16T19:54:50.593 INFO:teuthology.orchestra.run.smithi157.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-10-16T19:54:50.593 INFO:teuthology.orchestra.run.smithi157.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-10-16T19:54:50.593 INFO:teuthology.orchestra.run.smithi157.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-10-16T19:54:50.593 INFO:teuthology.orchestra.run.smithi157.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-10-16T19:54:50.593 INFO:teuthology.orchestra.run.smithi157.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-10-16T19:54:50.594 INFO:teuthology.orchestra.run.smithi157.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-10-16T19:54:50.594 INFO:teuthology.orchestra.run.smithi157.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2023-10-16T19:54:50.594 INFO:teuthology.orchestra.run.smithi157.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-10-16T19:54:50.594 INFO:teuthology.orchestra.run.smithi157.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-10-16T19:54:50.594 INFO:teuthology.orchestra.run.smithi157.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-10-16T19:54:50.595 INFO:teuthology.orchestra.run.smithi157.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-10-16T19:54:50.595 INFO:teuthology.orchestra.run.smithi157.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-10-16T19:54:50.595 INFO:teuthology.orchestra.run.smithi157.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-10-16T19:54:50.595 INFO:teuthology.orchestra.run.smithi157.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-10-16T19:54:50.595 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-10-16T19:54:50.596 INFO:teuthology.orchestra.run.smithi157.stdout: python3-ceph-argparse x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 45 k 2023-10-16T19:54:50.596 INFO:teuthology.orchestra.run.smithi157.stdout: python3-ceph-common x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 126 k 2023-10-16T19:54:50.596 INFO:teuthology.orchestra.run.smithi157.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-10-16T19:54:50.596 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-10-16T19:54:50.596 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-10-16T19:54:50.596 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-10-16T19:54:50.597 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-10-16T19:54:50.597 INFO:teuthology.orchestra.run.smithi157.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-10-16T19:54:50.597 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-10-16T19:54:50.597 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-10-16T19:54:50.597 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-10-16T19:54:50.598 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-10-16T19:54:50.598 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-10-16T19:54:50.598 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-16T19:54:50.598 INFO:teuthology.orchestra.run.smithi157.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-10-16T19:54:50.598 INFO:teuthology.orchestra.run.smithi157.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-10-16T19:54:50.599 INFO:teuthology.orchestra.run.smithi157.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-10-16T19:54:50.599 INFO:teuthology.orchestra.run.smithi157.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-10-16T19:54:50.599 INFO:teuthology.orchestra.run.smithi157.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-10-16T19:54:50.599 INFO:teuthology.orchestra.run.smithi157.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-10-16T19:54:50.599 INFO:teuthology.orchestra.run.smithi157.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-10-16T19:54:50.599 INFO:teuthology.orchestra.run.smithi157.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-10-16T19:54:50.600 INFO:teuthology.orchestra.run.smithi157.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-10-16T19:54:50.600 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-10-16T19:54:50.600 INFO:teuthology.orchestra.run.smithi157.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-10-16T19:54:50.600 INFO:teuthology.orchestra.run.smithi157.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-10-16T19:54:50.600 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-10-16T19:54:50.601 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-10-16T19:54:50.601 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-10-16T19:54:50.601 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-10-16T19:54:50.601 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-10-16T19:54:50.601 INFO:teuthology.orchestra.run.smithi157.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-10-16T19:54:50.602 INFO:teuthology.orchestra.run.smithi157.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-16T19:54:50.602 INFO:teuthology.orchestra.run.smithi157.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-10-16T19:54:50.602 INFO:teuthology.orchestra.run.smithi157.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-10-16T19:54:50.602 INFO:teuthology.orchestra.run.smithi157.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-10-16T19:54:50.602 INFO:teuthology.orchestra.run.smithi157.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-10-16T19:54:50.603 INFO:teuthology.orchestra.run.smithi157.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-10-16T19:54:50.603 INFO:teuthology.orchestra.run.smithi157.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-10-16T19:54:50.603 INFO:teuthology.orchestra.run.smithi157.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-10-16T19:54:50.603 INFO:teuthology.orchestra.run.smithi157.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-10-16T19:54:50.603 INFO:teuthology.orchestra.run.smithi157.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-10-16T19:54:50.603 INFO:teuthology.orchestra.run.smithi157.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-10-16T19:54:50.604 INFO:teuthology.orchestra.run.smithi157.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-10-16T19:54:50.604 INFO:teuthology.orchestra.run.smithi157.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-10-16T19:54:50.604 INFO:teuthology.orchestra.run.smithi157.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-10-16T19:54:50.604 INFO:teuthology.orchestra.run.smithi157.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-10-16T19:54:50.604 INFO:teuthology.orchestra.run.smithi157.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-10-16T19:54:50.605 INFO:teuthology.orchestra.run.smithi157.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2023-10-16T19:54:50.605 INFO:teuthology.orchestra.run.smithi157.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-10-16T19:54:50.605 INFO:teuthology.orchestra.run.smithi157.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-10-16T19:54:50.605 INFO:teuthology.orchestra.run.smithi157.stdout:Enabling module streams: 2023-10-16T19:54:50.605 INFO:teuthology.orchestra.run.smithi157.stdout: postgresql 10 2023-10-16T19:54:50.606 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-10-16T19:54:50.606 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction Summary 2023-10-16T19:54:50.606 INFO:teuthology.orchestra.run.smithi157.stdout:=========================================================================================================================== 2023-10-16T19:54:50.606 INFO:teuthology.orchestra.run.smithi157.stdout:Install 128 Packages 2023-10-16T19:54:50.606 INFO:teuthology.orchestra.run.smithi157.stdout:Upgrade 3 Packages 2023-10-16T19:54:50.607 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-10-16T19:54:50.607 INFO:teuthology.orchestra.run.smithi157.stdout:Total download size: 209 M 2023-10-16T19:54:50.608 INFO:teuthology.orchestra.run.smithi157.stdout:Downloading Packages: 2023-10-16T19:54:51.079 INFO:teuthology.orchestra.run.smithi157.stdout:(1/131): ceph-18.0.0-6730.g4ba8a190.el8.x86_64. 48 kB/s | 6.4 kB 00:00 2023-10-16T19:54:51.115 INFO:teuthology.orchestra.run.smithi187.stdout:(8/131): ceph-radosgw-18.0.0-6730.g4ba8a190.el8 11 MB/s | 14 MB 00:01 2023-10-16T19:54:51.165 INFO:teuthology.orchestra.run.smithi187.stdout:(9/131): ceph-selinux-18.0.0-6730.g4ba8a190.el8 487 kB/s | 24 kB 00:00 2023-10-16T19:54:51.596 INFO:teuthology.orchestra.run.smithi157.stdout:(2/131): ceph-fuse-18.0.0-6730.g4ba8a190.el8.x8 1.7 MB/s | 918 kB 00:00 2023-10-16T19:54:51.624 INFO:teuthology.orchestra.run.smithi187.stdout:(10/131): ceph-common-18.0.0-6730.g4ba8a190.el8 7.7 MB/s | 23 MB 00:02 2023-10-16T19:54:51.694 INFO:teuthology.orchestra.run.smithi157.stdout:(3/131): ceph-immutable-object-cache-18.0.0-673 1.7 MB/s | 167 kB 00:00 2023-10-16T19:54:51.824 INFO:teuthology.orchestra.run.smithi187.stdout:(11/131): ceph-osd-18.0.0-6730.g4ba8a190.el8.x8 8.6 MB/s | 18 MB 00:02 2023-10-16T19:54:51.849 INFO:teuthology.orchestra.run.smithi187.stdout:(12/131): cephfs-mirror-18.0.0-6730.g4ba8a190.e 1.1 MB/s | 261 kB 00:00 2023-10-16T19:54:51.875 INFO:teuthology.orchestra.run.smithi187.stdout:(13/131): libcephfs-devel-18.0.0-6730.g4ba8a190 619 kB/s | 31 kB 00:00 2023-10-16T19:54:51.950 INFO:teuthology.orchestra.run.smithi187.stdout:(14/131): libcephsqlite-18.0.0-6730.g4ba8a190.e 2.4 MB/s | 184 kB 00:00 2023-10-16T19:54:52.025 INFO:teuthology.orchestra.run.smithi187.stdout:(15/131): libcephfs2-18.0.0-6730.g4ba8a190.el8. 4.7 MB/s | 839 kB 00:00 2023-10-16T19:54:52.051 INFO:teuthology.orchestra.run.smithi187.stdout:(16/131): librados-devel-18.0.0-6730.g4ba8a190. 1.4 MB/s | 139 kB 00:00 2023-10-16T19:54:52.130 INFO:teuthology.orchestra.run.smithi157.stdout:(4/131): ceph-mds-18.0.0-6730.g4ba8a190.el8.x86 5.3 MB/s | 2.3 MB 00:00 2023-10-16T19:54:52.168 INFO:teuthology.orchestra.run.smithi187.stdout:(17/131): libradosstriper1-18.0.0-6730.g4ba8a19 3.6 MB/s | 518 kB 00:00 2023-10-16T19:54:52.251 INFO:teuthology.orchestra.run.smithi187.stdout:(18/131): python3-ceph-argparse-18.0.0-6730.g4b 538 kB/s | 45 kB 00:00 2023-10-16T19:54:52.343 INFO:teuthology.orchestra.run.smithi187.stdout:(19/131): python3-ceph-common-18.0.0-6730.g4ba8 1.3 MB/s | 126 kB 00:00 2023-10-16T19:54:52.435 INFO:teuthology.orchestra.run.smithi187.stdout:(20/131): python3-cephfs-18.0.0-6730.g4ba8a190. 2.1 MB/s | 197 kB 00:00 2023-10-16T19:54:52.580 INFO:teuthology.orchestra.run.smithi157.stdout:(5/131): ceph-mgr-18.0.0-6730.g4ba8a190.el8.x86 3.6 MB/s | 1.6 MB 00:00 2023-10-16T19:54:52.602 INFO:teuthology.orchestra.run.smithi187.stdout:(21/131): python3-rados-18.0.0-6730.g4ba8a190.e 2.2 MB/s | 371 kB 00:00 2023-10-16T19:54:52.711 INFO:teuthology.orchestra.run.smithi187.stdout:(22/131): librgw2-18.0.0-6730.g4ba8a190.el8.x86 11 MB/s | 6.9 MB 00:00 2023-10-16T19:54:52.736 INFO:teuthology.orchestra.run.smithi187.stdout:(23/131): python3-rbd-18.0.0-6730.g4ba8a190.el8 2.7 MB/s | 365 kB 00:00 2023-10-16T19:54:52.786 INFO:teuthology.orchestra.run.smithi187.stdout:(24/131): python3-rgw-18.0.0-6730.g4ba8a190.el8 1.4 MB/s | 107 kB 00:00 2023-10-16T19:54:52.812 INFO:teuthology.orchestra.run.smithi187.stdout:(25/131): rbd-fuse-18.0.0-6730.g4ba8a190.el8.x8 1.2 MB/s | 94 kB 00:00 2023-10-16T19:54:52.912 INFO:teuthology.orchestra.run.smithi187.stdout:(26/131): rbd-nbd-18.0.0-6730.g4ba8a190.el8.x86 1.8 MB/s | 179 kB 00:00 2023-10-16T19:54:53.021 INFO:teuthology.orchestra.run.smithi187.stdout:(27/131): ceph-grafana-dashboards-18.0.0-6730.g 213 kB/s | 23 kB 00:00 2023-10-16T19:54:53.221 INFO:teuthology.orchestra.run.smithi187.stdout:(28/131): rbd-mirror-18.0.0-6730.g4ba8a190.el8. 8.3 MB/s | 3.6 MB 00:00 2023-10-16T19:54:53.297 INFO:teuthology.orchestra.run.smithi157.stdout:(6/131): ceph-mon-18.0.0-6730.g4ba8a190.el8.x86 6.4 MB/s | 4.6 MB 00:00 2023-10-16T19:54:53.388 INFO:teuthology.orchestra.run.smithi187.stdout:(29/131): ceph-mgr-dashboard-18.0.0-6730.g4ba8a 11 MB/s | 1.8 MB 00:00 2023-10-16T19:54:53.473 INFO:teuthology.orchestra.run.smithi157.stdout:(7/131): ceph-base-18.0.0-6730.g4ba8a190.el8.x8 2.1 MB/s | 5.4 MB 00:02 2023-10-16T19:54:53.605 INFO:teuthology.orchestra.run.smithi187.stdout:(30/131): ceph-mgr-cephadm-18.0.0-6730.g4ba8a19 226 kB/s | 132 kB 00:00 2023-10-16T19:54:53.713 INFO:teuthology.orchestra.run.smithi187.stdout:(31/131): ceph-mgr-modules-core-18.0.0-6730.g4b 2.2 MB/s | 242 kB 00:00 2023-10-16T19:54:53.805 INFO:teuthology.orchestra.run.smithi187.stdout:(32/131): ceph-mgr-rook-18.0.0-6730.g4ba8a190.e 517 kB/s | 47 kB 00:00 2023-10-16T19:54:53.905 INFO:teuthology.orchestra.run.smithi187.stdout:(33/131): ceph-prometheus-alerts-18.0.0-6730.g4 150 kB/s | 15 kB 00:00 2023-10-16T19:54:54.056 INFO:teuthology.orchestra.run.smithi187.stdout:(34/131): ceph-volume-18.0.0-6730.g4ba8a190.el8 1.7 MB/s | 261 kB 00:00 2023-10-16T19:54:54.173 INFO:teuthology.orchestra.run.smithi187.stdout:(35/131): ceph-mgr-diskprediction-local-18.0.0- 9.4 MB/s | 7.4 MB 00:00 2023-10-16T19:54:54.198 INFO:teuthology.orchestra.run.smithi187.stdout:(36/131): cephadm-18.0.0-6730.g4ba8a190.el8.noa 1.3 MB/s | 192 kB 00:00 2023-10-16T19:54:54.240 INFO:teuthology.orchestra.run.smithi187.stdout:(37/131): cephfs-top-18.0.0-6730.g4ba8a190.el8. 272 kB/s | 18 kB 00:00 2023-10-16T19:54:54.457 INFO:teuthology.orchestra.run.smithi187.stdout:(38/131): liboath-2.6.2-3.el8.x86_64.rpm 277 kB/s | 59 kB 00:00 2023-10-16T19:54:54.482 INFO:teuthology.orchestra.run.smithi187.stdout:(39/131): gperftools-libs-2.7-9.el8.x86_64.rpm 1.1 MB/s | 306 kB 00:00 2023-10-16T19:54:54.541 INFO:teuthology.orchestra.run.smithi187.stdout:(40/131): libunwind-1.3.1-3.el8.x86_64.rpm 900 kB/s | 75 kB 00:00 2023-10-16T19:54:54.608 INFO:teuthology.orchestra.run.smithi187.stdout:(41/131): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 654 kB/s | 44 kB 00:00 2023-10-16T19:54:54.675 INFO:teuthology.orchestra.run.smithi187.stdout:(42/131): python3-asyncssh-2.7.0-2.el8.noarch.r 2.4 MB/s | 476 kB 00:00 2023-10-16T19:54:54.709 INFO:teuthology.orchestra.run.smithi187.stdout:(43/131): python3-beautifulsoup4-4.6.3-2.el8.1. 1.8 MB/s | 185 kB 00:00 2023-10-16T19:54:54.734 INFO:teuthology.orchestra.run.smithi187.stdout:(44/131): python3-cachetools-3.1.1-4.el8.noarch 563 kB/s | 33 kB 00:00 2023-10-16T19:54:54.767 INFO:teuthology.orchestra.run.smithi187.stdout:(45/131): python3-certifi-2018.10.15-7.el8.noar 279 kB/s | 16 kB 00:00 2023-10-16T19:54:54.834 INFO:teuthology.orchestra.run.smithi187.stdout:(46/131): python3-cheroot-8.5.2-1.el8.noarch.rp 1.7 MB/s | 173 kB 00:00 2023-10-16T19:54:54.876 INFO:teuthology.orchestra.run.smithi187.stdout:(47/131): python3-cherrypy-18.4.0-1.el8.noarch. 3.5 MB/s | 384 kB 00:00 2023-10-16T19:54:54.893 INFO:teuthology.orchestra.run.smithi187.stdout:(48/131): python3-google-auth-1.1.1-10.el8.noar 1.4 MB/s | 81 kB 00:00 2023-10-16T19:54:54.927 INFO:teuthology.orchestra.run.smithi187.stdout:(49/131): python3-jaraco-6.2-6.el8.noarch.rpm 220 kB/s | 11 kB 00:00 2023-10-16T19:54:54.944 INFO:teuthology.orchestra.run.smithi187.stdout:(50/131): python3-jaraco-functools-2.0-4.el8.no 349 kB/s | 18 kB 00:00 2023-10-16T19:54:54.994 INFO:teuthology.orchestra.run.smithi187.stdout:(51/131): python3-logutils-0.3.5-11.el8.noarch. 976 kB/s | 49 kB 00:00 2023-10-16T19:54:55.044 INFO:teuthology.orchestra.run.smithi187.stdout:(52/131): python3-more-itertools-7.2.0-3.el8.no 1.1 MB/s | 59 kB 00:00 2023-10-16T19:54:55.120 INFO:teuthology.orchestra.run.smithi187.stdout:(53/131): python3-kubernetes-11.0.0-6.el8.noarc 6.1 MB/s | 1.2 MB 00:00 2023-10-16T19:54:55.137 INFO:teuthology.orchestra.run.smithi187.stdout:(54/131): python3-natsort-7.1.1-2.el8.noarch.rp 655 kB/s | 60 kB 00:00 2023-10-16T19:54:55.187 INFO:teuthology.orchestra.run.smithi187.stdout:(55/131): python3-portend-2.6-1.el8.noarch.rpm 312 kB/s | 16 kB 00:00 2023-10-16T19:54:55.212 INFO:teuthology.orchestra.run.smithi187.stdout:(56/131): python3-pecan-1.3.2-9.el8.noarch.rpm 3.0 MB/s | 283 kB 00:00 2023-10-16T19:54:55.231 INFO:teuthology.orchestra.run.smithi157.stdout:(8/131): ceph-radosgw-18.0.0-6730.g4ba8a190.el8 7.9 MB/s | 14 MB 00:01 2023-10-16T19:54:55.237 INFO:teuthology.orchestra.run.smithi187.stdout:(57/131): python3-repoze-lru-0.7-6.el8.noarch.r 669 kB/s | 34 kB 00:00 2023-10-16T19:54:55.296 INFO:teuthology.orchestra.run.smithi187.stdout:(58/131): python3-rsa-4.9-2.el8.noarch.rpm 1.1 MB/s | 64 kB 00:00 2023-10-16T19:54:55.298 INFO:teuthology.orchestra.run.smithi157.stdout:(9/131): ceph-selinux-18.0.0-6730.g4ba8a190.el8 366 kB/s | 24 kB 00:00 2023-10-16T19:54:55.313 INFO:teuthology.orchestra.run.smithi187.stdout:(59/131): python3-routes-2.4.1-12.el8.noarch.rp 1.9 MB/s | 196 kB 00:00 2023-10-16T19:54:55.347 INFO:teuthology.orchestra.run.smithi187.stdout:(60/131): python3-simplegeneric-0.8.1-17.el8.no 375 kB/s | 19 kB 00:00 2023-10-16T19:54:55.372 INFO:teuthology.orchestra.run.smithi187.stdout:(61/131): python3-singledispatch-3.4.0.3-18.el8 408 kB/s | 24 kB 00:00 2023-10-16T19:54:55.406 INFO:teuthology.orchestra.run.smithi187.stdout:(62/131): python3-tempora-1.14.1-5.el8.noarch.r 500 kB/s | 29 kB 00:00 2023-10-16T19:54:55.431 INFO:teuthology.orchestra.run.smithi187.stdout:(63/131): python3-trustme-0.6.0-4.el8.noarch.rp 469 kB/s | 27 kB 00:00 2023-10-16T19:54:55.490 INFO:teuthology.orchestra.run.smithi187.stdout:(64/131): python3-webob-1.8.5-1.el8.1.noarch.rp 4.2 MB/s | 251 kB 00:00 2023-10-16T19:54:55.515 INFO:teuthology.orchestra.run.smithi187.stdout:(65/131): python3-waitress-1.4.3-1.el8.noarch.r 2.3 MB/s | 255 kB 00:00 2023-10-16T19:54:55.557 INFO:teuthology.orchestra.run.smithi187.stdout:(66/131): python3-websocket-client-0.56.0-5.el8 918 kB/s | 61 kB 00:00 2023-10-16T19:54:55.582 INFO:teuthology.orchestra.run.smithi187.stdout:(67/131): python3-webtest-2.0.33-1.el8.noarch.r 1.2 MB/s | 85 kB 00:00 2023-10-16T19:54:55.616 INFO:teuthology.orchestra.run.smithi187.stdout:(68/131): python3-zc-lockfile-2.0-2.el8.noarch. 392 kB/s | 23 kB 00:00 2023-10-16T19:54:55.641 INFO:teuthology.orchestra.run.smithi187.stdout:(69/131): xmlstarlet-1.6.1-20.el8.x86_64.rpm 2.7 MB/s | 70 kB 00:00 2023-10-16T19:54:55.682 INFO:teuthology.orchestra.run.smithi157.stdout:(10/131): ceph-osd-18.0.0-6730.g4ba8a190.el8.x8 7.5 MB/s | 18 MB 00:02 2023-10-16T19:54:55.790 INFO:teuthology.orchestra.run.smithi157.stdout:(11/131): cephfs-mirror-18.0.0-6730.g4ba8a190.e 2.4 MB/s | 261 kB 00:00 2023-10-16T19:54:55.866 INFO:teuthology.orchestra.run.smithi157.stdout:(12/131): libcephfs-devel-18.0.0-6730.g4ba8a190 415 kB/s | 31 kB 00:00 2023-10-16T19:54:55.891 INFO:teuthology.orchestra.run.smithi187.stdout:(70/131): thrift-0.13.0-2.el8.x86_64.rpm 5.6 MB/s | 1.7 MB 00:00 2023-10-16T19:54:56.091 INFO:teuthology.orchestra.run.smithi157.stdout:(13/131): libcephfs2-18.0.0-6730.g4ba8a190.el8. 3.6 MB/s | 839 kB 00:00 2023-10-16T19:54:56.142 INFO:teuthology.orchestra.run.smithi187.stdout:(71/131): python3-scipy-1.0.0-21.module+el8.5.0 27 MB/s | 14 MB 00:00 2023-10-16T19:54:56.167 INFO:teuthology.orchestra.run.smithi187.stdout:(72/131): python3-pyasn1-modules-0.3.7-6.el8.no 399 kB/s | 110 kB 00:00 2023-10-16T19:54:56.183 INFO:teuthology.orchestra.run.smithi157.stdout:(14/131): libcephsqlite-18.0.0-6730.g4ba8a190.e 2.0 MB/s | 184 kB 00:00 2023-10-16T19:54:56.217 INFO:teuthology.orchestra.run.smithi187.stdout:(73/131): python3-pytz-2017.2-9.el8.noarch.rpm 723 kB/s | 54 kB 00:00 2023-10-16T19:54:56.243 INFO:teuthology.orchestra.run.smithi187.stdout:(74/131): lttng-ust-2.8.1-11.el8.x86_64.rpm 3.4 MB/s | 259 kB 00:00 2023-10-16T19:54:56.283 INFO:teuthology.orchestra.run.smithi157.stdout:(15/131): librados-devel-18.0.0-6730.g4ba8a190. 1.4 MB/s | 139 kB 00:00 2023-10-16T19:54:56.318 INFO:teuthology.orchestra.run.smithi187.stdout:(75/131): python3-markupsafe-0.23-19.el8.x86_64 519 kB/s | 39 kB 00:00 2023-10-16T19:54:56.393 INFO:teuthology.orchestra.run.smithi187.stdout:(76/131): socat-1.7.4.1-1.el8.x86_64.rpm 1.8 MB/s | 323 kB 00:00 2023-10-16T19:54:56.434 INFO:teuthology.orchestra.run.smithi157.stdout:(16/131): libradosstriper1-18.0.0-6730.g4ba8a19 3.4 MB/s | 518 kB 00:00 2023-10-16T19:54:56.443 INFO:teuthology.orchestra.run.smithi187.stdout:(77/131): bison-3.0.4-10.el8.x86_64.rpm 5.4 MB/s | 688 kB 00:00 2023-10-16T19:54:56.527 INFO:teuthology.orchestra.run.smithi187.stdout:(78/131): python3-jinja2-2.10.1-3.el8.noarch.rp 3.9 MB/s | 538 kB 00:00 2023-10-16T19:54:56.652 INFO:teuthology.orchestra.run.smithi187.stdout:(79/131): python3-mako-1.0.6-13.el8.noarch.rpm 752 kB/s | 157 kB 00:00 2023-10-16T19:54:56.694 INFO:teuthology.orchestra.run.smithi187.stdout:(80/131): oniguruma-6.8.2-2.el8.x86_64.rpm 1.1 MB/s | 187 kB 00:00 2023-10-16T19:54:56.861 INFO:teuthology.orchestra.run.smithi187.stdout:(81/131): automake-1.16.1-7.el8.noarch.rpm 3.3 MB/s | 713 kB 00:00 2023-10-16T19:54:57.020 INFO:teuthology.orchestra.run.smithi187.stdout:(82/131): python3-babel-2.5.1-7.el8.noarch.rpm 15 MB/s | 4.8 MB 00:00 2023-10-16T19:54:57.045 INFO:teuthology.orchestra.run.smithi187.stdout:(83/131): python3-jsonpatch-1.21-2.el8.noarch.r 145 kB/s | 27 kB 00:00 2023-10-16T19:54:57.121 INFO:teuthology.orchestra.run.smithi187.stdout:(84/131): python3-prettytable-0.7.2-14.el8.noar 586 kB/s | 44 kB 00:00 2023-10-16T19:54:57.196 INFO:teuthology.orchestra.run.smithi187.stdout:(85/131): flex-2.6.1-9.el8.x86_64.rpm 1.8 MB/s | 320 kB 00:00 2023-10-16T19:54:57.367 INFO:teuthology.orchestra.run.smithi187.stdout:(86/131): python3-numpy-1.14.3-10.el8.x86_64.rp 15 MB/s | 3.7 MB 00:00 2023-10-16T19:54:57.397 INFO:teuthology.orchestra.run.smithi187.stdout:(87/131): python3-werkzeug-0.12.2-4.el8.noarch. 2.2 MB/s | 457 kB 00:00 2023-10-16T19:54:57.467 INFO:teuthology.orchestra.run.smithi157.stdout:(17/131): librgw2-18.0.0-6730.g4ba8a190.el8.x86 6.7 MB/s | 6.9 MB 00:01 2023-10-16T19:54:57.488 INFO:teuthology.orchestra.run.smithi187.stdout:(88/131): python3-numpy-f2py-1.14.3-10.el8.x86_ 1.8 MB/s | 225 kB 00:00 2023-10-16T19:54:57.534 INFO:teuthology.orchestra.run.smithi157.stdout:(18/131): python3-ceph-argparse-18.0.0-6730.g4b 674 kB/s | 45 kB 00:00 2023-10-16T19:54:57.555 INFO:teuthology.orchestra.run.smithi187.stdout:(89/131): uuid-1.6.2-43.el8.x86_64.rpm 404 kB/s | 64 kB 00:00 2023-10-16T19:54:57.618 INFO:teuthology.orchestra.run.smithi157.stdout:(19/131): python3-ceph-common-18.0.0-6730.g4ba8 1.5 MB/s | 126 kB 00:00 2023-10-16T19:54:57.664 INFO:teuthology.orchestra.run.smithi187.stdout:(90/131): python3-pyasn1-0.3.7-6.el8.noarch.rpm 722 kB/s | 126 kB 00:00 2023-10-16T19:54:57.693 INFO:teuthology.orchestra.run.smithi157.stdout:(20/131): python3-cephfs-18.0.0-6730.g4ba8a190. 2.6 MB/s | 197 kB 00:00 2023-10-16T19:54:57.768 INFO:teuthology.orchestra.run.smithi157.stdout:(21/131): python3-rados-18.0.0-6730.g4ba8a190.e 4.8 MB/s | 371 kB 00:00 2023-10-16T19:54:57.852 INFO:teuthology.orchestra.run.smithi157.stdout:(22/131): python3-rbd-18.0.0-6730.g4ba8a190.el8 4.3 MB/s | 365 kB 00:00 2023-10-16T19:54:57.911 INFO:teuthology.orchestra.run.smithi157.stdout:(23/131): python3-rgw-18.0.0-6730.g4ba8a190.el8 1.8 MB/s | 107 kB 00:00 2023-10-16T19:54:58.106 INFO:teuthology.orchestra.run.smithi187.stdout:(91/131): ceph-test-18.0.0-6730.g4ba8a190.el8.x 7.1 MB/s | 49 MB 00:06 2023-10-16T19:54:58.123 INFO:teuthology.orchestra.run.smithi187.stdout:(92/131): python3-jsonpointer-1.10-11.el8.noarc 35 kB/s | 20 kB 00:00 2023-10-16T19:54:58.148 INFO:teuthology.orchestra.run.smithi187.stdout:(93/131): python3-pyOpenSSL-19.0.0-1.el8.noarch 214 kB/s | 103 kB 00:00 2023-10-16T19:54:58.223 INFO:teuthology.orchestra.run.smithi187.stdout:(94/131): libtool-2.4.6-25.el8.x86_64.rpm 5.9 MB/s | 709 kB 00:00 2023-10-16T19:54:58.298 INFO:teuthology.orchestra.run.smithi187.stdout:(95/131): libpq-13.5-1.el8.x86_64.rpm 1.3 MB/s | 198 kB 00:00 2023-10-16T19:54:58.361 INFO:teuthology.orchestra.run.smithi157.stdout:(24/131): ceph-test-18.0.0-6730.g4ba8a190.el8.x 16 MB/s | 49 MB 00:03 2023-10-16T19:54:58.386 INFO:teuthology.orchestra.run.smithi157.stdout:(25/131): rbd-fuse-18.0.0-6730.g4ba8a190.el8.x8 197 kB/s | 94 kB 00:00 2023-10-16T19:54:58.399 INFO:teuthology.orchestra.run.smithi187.stdout:(96/131): openblas-threads-0.3.15-3.el8.x86_64. 18 MB/s | 4.9 MB 00:00 2023-10-16T19:54:58.432 INFO:teuthology.orchestra.run.smithi187.stdout:(97/131): jq-1.6-3.el8.x86_64.rpm 1.5 MB/s | 202 kB 00:00 2023-10-16T19:54:58.436 INFO:teuthology.orchestra.run.smithi157.stdout:(26/131): rbd-nbd-18.0.0-6730.g4ba8a190.el8.x86 3.5 MB/s | 179 kB 00:00 2023-10-16T19:54:58.495 INFO:teuthology.orchestra.run.smithi157.stdout:(27/131): ceph-grafana-dashboards-18.0.0-6730.g 396 kB/s | 23 kB 00:00 2023-10-16T19:54:58.549 INFO:teuthology.orchestra.run.smithi187.stdout:(98/131): openblas-0.3.15-3.el8.x86_64.rpm 15 MB/s | 4.7 MB 00:00 2023-10-16T19:54:58.554 INFO:teuthology.orchestra.run.smithi157.stdout:(28/131): ceph-mgr-cephadm-18.0.0-6730.g4ba8a19 2.2 MB/s | 132 kB 00:00 2023-10-16T19:54:58.583 INFO:teuthology.orchestra.run.smithi187.stdout:(99/131): librdkafka-0.11.4-3.el8.x86_64.rpm 1.9 MB/s | 354 kB 00:00 2023-10-16T19:54:58.604 INFO:teuthology.orchestra.run.smithi157.stdout:(29/131): rbd-mirror-18.0.0-6730.g4ba8a190.el8. 15 MB/s | 3.6 MB 00:00 2023-10-16T19:54:58.683 INFO:teuthology.orchestra.run.smithi187.stdout:(100/131): postgresql-server-10.21-2.module+el8 20 MB/s | 5.1 MB 00:00 2023-10-16T19:54:58.725 INFO:teuthology.orchestra.run.smithi187.stdout:(101/131): postgresql-contrib-10.21-2.module+el 4.5 MB/s | 808 kB 00:00 2023-10-16T19:54:58.767 INFO:teuthology.orchestra.run.smithi187.stdout:(102/131): postgresql-10.21-2.module+el8.6.0+15 8.2 MB/s | 1.5 MB 00:00 2023-10-16T19:54:58.821 INFO:teuthology.orchestra.run.smithi157.stdout:(30/131): ceph-mgr-dashboard-18.0.0-6730.g4ba8a 6.6 MB/s | 1.8 MB 00:00 2023-10-16T19:54:58.858 INFO:teuthology.orchestra.run.smithi187.stdout:(103/131): librabbitmq-0.9.0-3.el8.x86_64.rpm 280 kB/s | 47 kB 00:00 2023-10-16T19:54:58.876 INFO:teuthology.orchestra.run.smithi187.stdout:(104/131): libselinux-devel-2.9-5.el8.x86_64.rp 1.3 MB/s | 200 kB 00:00 2023-10-16T19:54:58.896 INFO:teuthology.orchestra.run.smithi157.stdout:(31/131): ceph-mgr-modules-core-18.0.0-6730.g4b 3.2 MB/s | 242 kB 00:00 2023-10-16T19:54:58.926 INFO:teuthology.orchestra.run.smithi187.stdout:(105/131): python3-jwt-1.6.1-2.el8.noarch.rpm 268 kB/s | 43 kB 00:00 2023-10-16T19:54:58.963 INFO:teuthology.orchestra.run.smithi157.stdout:(32/131): ceph-mgr-rook-18.0.0-6730.g4ba8a190.e 713 kB/s | 47 kB 00:00 2023-10-16T19:54:58.968 INFO:teuthology.orchestra.run.smithi187.stdout:(106/131): keyutils-libs-devel-1.5.10-9.el8.x86 524 kB/s | 48 kB 00:00 2023-10-16T19:54:58.994 INFO:teuthology.orchestra.run.smithi187.stdout:(107/131): pcre2-utf32-10.32-2.el8.x86_64.rpm 1.5 MB/s | 220 kB 00:00 2023-10-16T19:54:59.019 INFO:teuthology.orchestra.run.smithi187.stdout:(108/131): libsepol-devel-2.9-3.el8.x86_64.rpm 945 kB/s | 87 kB 00:00 2023-10-16T19:54:59.055 INFO:teuthology.orchestra.run.smithi157.stdout:(33/131): ceph-mgr-diskprediction-local-18.0.0- 16 MB/s | 7.4 MB 00:00 2023-10-16T19:54:59.081 INFO:teuthology.orchestra.run.smithi157.stdout:(34/131): ceph-prometheus-alerts-18.0.0-6730.g4 128 kB/s | 15 kB 00:00 2023-10-16T19:54:59.086 INFO:teuthology.orchestra.run.smithi187.stdout:(109/131): python3-requests-oauthlib-1.0.0-1.el 364 kB/s | 43 kB 00:00 2023-10-16T19:54:59.106 INFO:teuthology.orchestra.run.smithi157.stdout:(35/131): ceph-volume-18.0.0-6730.g4ba8a190.el8 5.1 MB/s | 261 kB 00:00 2023-10-16T19:54:59.119 INFO:teuthology.orchestra.run.smithi187.stdout:(110/131): python3-pycparser-2.14-14.el8.noarch 869 kB/s | 109 kB 00:00 2023-10-16T19:54:59.140 INFO:teuthology.orchestra.run.smithi157.stdout:(36/131): cephadm-18.0.0-6730.g4ba8a190.el8.noa 3.2 MB/s | 192 kB 00:00 2023-10-16T19:54:59.170 INFO:teuthology.orchestra.run.smithi187.stdout:(111/131): pcre2-utf16-10.32-2.el8.x86_64.rpm 1.5 MB/s | 229 kB 00:00 2023-10-16T19:54:59.188 INFO:teuthology.orchestra.run.smithi157.stdout:(37/131): cephfs-top-18.0.0-6730.g4ba8a190.el8. 222 kB/s | 18 kB 00:00 2023-10-16T19:54:59.195 INFO:teuthology.orchestra.run.smithi187.stdout:(112/131): libaio-devel-0.3.112-1.el8.x86_64.rp 249 kB/s | 19 kB 00:00 2023-10-16T19:54:59.229 INFO:teuthology.orchestra.run.smithi187.stdout:(113/131): krb5-devel-1.18.2-14.el8.x86_64.rpm 3.8 MB/s | 560 kB 00:00 2023-10-16T19:54:59.315 INFO:teuthology.orchestra.run.smithi157.stdout:(38/131): liboath-2.6.2-3.el8.x86_64.rpm 464 kB/s | 59 kB 00:00 2023-10-16T19:54:59.320 INFO:teuthology.orchestra.run.smithi187.stdout:(114/131): python3-oauthlib-2.1.0-1.el8.noarch. 1.0 MB/s | 155 kB 00:00 2023-10-16T19:54:59.346 INFO:teuthology.orchestra.run.smithi187.stdout:(115/131): libverto-devel-0.3.0-5.el8.x86_64.rp 153 kB/s | 18 kB 00:00 2023-10-16T19:54:59.379 INFO:teuthology.orchestra.run.smithi187.stdout:(116/131): python3-cryptography-3.2.1-5.el8.x86 3.0 MB/s | 559 kB 00:00 2023-10-16T19:54:59.382 INFO:teuthology.orchestra.run.smithi157.stdout:(39/131): gperftools-libs-2.7-9.el8.x86_64.rpm 1.2 MB/s | 306 kB 00:00 2023-10-16T19:54:59.407 INFO:teuthology.orchestra.run.smithi157.stdout:(40/131): libunwind-1.3.1-3.el8.x86_64.rpm 817 kB/s | 75 kB 00:00 2023-10-16T19:54:59.446 INFO:teuthology.orchestra.run.smithi187.stdout:(117/131): pcre2-devel-10.32-2.el8.x86_64.rpm 4.7 MB/s | 605 kB 00:00 2023-10-16T19:54:59.458 INFO:teuthology.orchestra.run.smithi157.stdout:(41/131): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 872 kB/s | 44 kB 00:00 2023-10-16T19:54:59.472 INFO:teuthology.orchestra.run.smithi187.stdout:(118/131): python3-cffi-1.11.5-5.el8.x86_64.rpm 1.9 MB/s | 238 kB 00:00 2023-10-16T19:54:59.525 INFO:teuthology.orchestra.run.smithi157.stdout:(42/131): python3-beautifulsoup4-4.6.3-2.el8.1. 2.7 MB/s | 185 kB 00:00 2023-10-16T19:54:59.550 INFO:teuthology.orchestra.run.smithi157.stdout:(43/131): python3-asyncssh-2.7.0-2.el8.noarch.r 2.8 MB/s | 476 kB 00:00 2023-10-16T19:54:59.575 INFO:teuthology.orchestra.run.smithi157.stdout:(44/131): python3-cachetools-3.1.1-4.el8.noarch 658 kB/s | 33 kB 00:00 2023-10-16T19:54:59.613 INFO:teuthology.orchestra.run.smithi187.stdout:(119/131): openssl-devel-1.1.1k-7.el8_6.x86_64. 9.9 MB/s | 2.3 MB 00:00 2023-10-16T19:54:59.624 INFO:teuthology.orchestra.run.smithi157.stdout:(45/131): python3-certifi-2018.10.15-7.el8.noar 220 kB/s | 16 kB 00:00 2023-10-16T19:54:59.630 INFO:teuthology.orchestra.run.smithi187.stdout:(120/131): xfsprogs-devel-5.0.0-10.el8.x86_64.r 393 kB/s | 72 kB 00:00 2023-10-16T19:54:59.656 INFO:teuthology.orchestra.run.smithi187.stdout:(121/131): fuse-2.9.7-15.el8.x86_64.rpm 450 kB/s | 83 kB 00:00 2023-10-16T19:54:59.659 INFO:teuthology.orchestra.run.smithi157.stdout:(46/131): python3-cheroot-8.5.2-1.el8.noarch.rp 2.0 MB/s | 173 kB 00:00 2023-10-16T19:54:59.698 INFO:teuthology.orchestra.run.smithi187.stdout:(122/131): elfutils-libelf-devel-0.186-1.el8.x8 716 kB/s | 60 kB 00:00 2023-10-16T19:54:59.709 INFO:teuthology.orchestra.run.smithi157.stdout:(47/131): python3-google-auth-1.1.1-10.el8.noar 1.6 MB/s | 81 kB 00:00 2023-10-16T19:54:59.752 INFO:teuthology.orchestra.run.smithi157.stdout:(48/131): python3-jaraco-6.2-6.el8.noarch.rpm 267 kB/s | 11 kB 00:00 2023-10-16T19:54:59.765 INFO:teuthology.orchestra.run.smithi187.stdout:(123/131): libuuid-devel-2.32.1-35.el8.x86_64.r 733 kB/s | 98 kB 00:00 2023-10-16T19:54:59.785 INFO:teuthology.orchestra.run.smithi157.stdout:(49/131): python3-cherrypy-18.4.0-1.el8.noarch. 2.3 MB/s | 384 kB 00:00 2023-10-16T19:54:59.798 INFO:teuthology.orchestra.run.smithi187.stdout:(124/131): libcom_err-devel-1.45.6-4.el8.x86_64 385 kB/s | 39 kB 00:00 2023-10-16T19:54:59.810 INFO:teuthology.orchestra.run.smithi157.stdout:(50/131): python3-jaraco-functools-2.0-4.el8.no 301 kB/s | 18 kB 00:00 2023-10-16T19:54:59.823 INFO:teuthology.orchestra.run.smithi187.stdout:(125/131): zlib-devel-1.2.11-18.el8_5.x86_64.rp 345 kB/s | 58 kB 00:00 2023-10-16T19:54:59.861 INFO:teuthology.orchestra.run.smithi157.stdout:(51/131): python3-logutils-0.3.5-11.el8.noarch. 977 kB/s | 49 kB 00:00 2023-10-16T19:54:59.903 INFO:teuthology.orchestra.run.smithi157.stdout:(52/131): python3-more-itertools-7.2.0-3.el8.no 1.4 MB/s | 59 kB 00:00 2023-10-16T19:54:59.932 INFO:teuthology.orchestra.run.smithi187.stdout:(126/131): libgfortran-8.5.0-10.1.el8_6.x86_64. 3.8 MB/s | 644 kB 00:00 2023-10-16T19:54:59.949 INFO:teuthology.orchestra.run.smithi187.stdout:(127/131): NetworkManager-initscripts-updown-1. 1.1 MB/s | 138 kB 00:00 2023-10-16T19:54:59.953 INFO:teuthology.orchestra.run.smithi157.stdout:(53/131): python3-natsort-7.1.1-2.el8.noarch.rp 1.2 MB/s | 60 kB 00:00 2023-10-16T19:54:59.974 INFO:teuthology.orchestra.run.smithi187.stdout:(128/131): libquadmath-8.5.0-10.1.el8_6.x86_64. 974 kB/s | 171 kB 00:00 2023-10-16T19:55:00.061 INFO:teuthology.orchestra.run.smithi157.stdout:(54/131): python3-kubernetes-11.0.0-6.el8.noarc 4.2 MB/s | 1.2 MB 00:00 2023-10-16T19:55:00.087 INFO:teuthology.orchestra.run.smithi157.stdout:(55/131): python3-pecan-1.3.2-9.el8.noarch.rpm 2.1 MB/s | 283 kB 00:00 2023-10-16T19:55:00.104 INFO:teuthology.orchestra.run.smithi157.stdout:(56/131): python3-portend-2.6-1.el8.noarch.rpm 366 kB/s | 16 kB 00:00 2023-10-16T19:55:00.129 INFO:teuthology.orchestra.run.smithi157.stdout:(57/131): python3-repoze-lru-0.7-6.el8.noarch.r 802 kB/s | 34 kB 00:00 2023-10-16T19:55:00.150 INFO:teuthology.orchestra.run.smithi187.stdout:(129/131): iproute-5.15.0-4.el8_6.1.x86_64.rpm 4.5 MB/s | 798 kB 00:00 2023-10-16T19:55:00.171 INFO:teuthology.orchestra.run.smithi157.stdout:(58/131): python3-routes-2.4.1-12.el8.noarch.rp 2.9 MB/s | 196 kB 00:00 2023-10-16T19:55:00.196 INFO:teuthology.orchestra.run.smithi157.stdout:(59/131): python3-rsa-4.9-2.el8.noarch.rpm 961 kB/s | 64 kB 00:00 2023-10-16T19:55:00.213 INFO:teuthology.orchestra.run.smithi157.stdout:(60/131): python3-simplegeneric-0.8.1-17.el8.no 447 kB/s | 19 kB 00:00 2023-10-16T19:55:00.239 INFO:teuthology.orchestra.run.smithi157.stdout:(61/131): python3-singledispatch-3.4.0.3-18.el8 570 kB/s | 24 kB 00:00 2023-10-16T19:55:00.264 INFO:teuthology.orchestra.run.smithi157.stdout:(62/131): python3-tempora-1.14.1-5.el8.noarch.r 579 kB/s | 29 kB 00:00 2023-10-16T19:55:00.290 INFO:teuthology.orchestra.run.smithi157.stdout:(63/131): python3-trustme-0.6.0-4.el8.noarch.rp 545 kB/s | 27 kB 00:00 2023-10-16T19:55:00.331 INFO:teuthology.orchestra.run.smithi157.stdout:(64/131): python3-waitress-1.4.3-1.el8.noarch.r 3.7 MB/s | 255 kB 00:00 2023-10-16T19:55:00.382 INFO:teuthology.orchestra.run.smithi157.stdout:(65/131): python3-websocket-client-0.56.0-5.el8 1.2 MB/s | 61 kB 00:00 2023-10-16T19:55:00.432 INFO:teuthology.orchestra.run.smithi157.stdout:(66/131): python3-webob-1.8.5-1.el8.1.noarch.rp 1.7 MB/s | 251 kB 00:00 2023-10-16T19:55:00.457 INFO:teuthology.orchestra.run.smithi157.stdout:(67/131): python3-webtest-2.0.33-1.el8.noarch.r 1.1 MB/s | 85 kB 00:00 2023-10-16T19:55:00.511 INFO:teuthology.orchestra.run.smithi157.stdout:(68/131): python3-zc-lockfile-2.0-2.el8.noarch. 290 kB/s | 23 kB 00:00 2023-10-16T19:55:00.533 INFO:teuthology.orchestra.run.smithi187.stdout:(130/131): librados2-18.0.0-6730.g4ba8a190.el8. 6.2 MB/s | 3.7 MB 00:00 2023-10-16T19:55:00.549 INFO:teuthology.orchestra.run.smithi157.stdout:(69/131): xmlstarlet-1.6.1-20.el8.x86_64.rpm 1.8 MB/s | 70 kB 00:00 2023-10-16T19:55:00.658 INFO:teuthology.orchestra.run.smithi187.stdout:(131/131): librbd1-18.0.0-6730.g4ba8a190.el8.x8 5.2 MB/s | 3.7 MB 00:00 2023-10-16T19:55:00.661 INFO:teuthology.orchestra.run.smithi187.stdout:-------------------------------------------------------------------------------- 2023-10-16T19:55:00.662 INFO:teuthology.orchestra.run.smithi187.stdout:Total 17 MB/s | 209 MB 00:12 2023-10-16T19:55:00.666 INFO:teuthology.orchestra.run.smithi157.stdout:(70/131): librabbitmq-0.9.0-3.el8.x86_64.rpm 402 kB/s | 47 kB 00:00 2023-10-16T19:55:00.842 INFO:teuthology.orchestra.run.smithi157.stdout:(71/131): libselinux-devel-2.9-5.el8.x86_64.rpm 1.1 MB/s | 200 kB 00:00 2023-10-16T19:55:00.909 INFO:teuthology.orchestra.run.smithi157.stdout:(72/131): thrift-0.13.0-2.el8.x86_64.rpm 3.8 MB/s | 1.7 MB 00:00 2023-10-16T19:55:00.959 INFO:teuthology.orchestra.run.smithi157.stdout:(73/131): python3-jwt-1.6.1-2.el8.noarch.rpm 364 kB/s | 43 kB 00:00 2023-10-16T19:55:01.059 INFO:teuthology.orchestra.run.smithi157.stdout:(74/131): pcre2-utf32-10.32-2.el8.x86_64.rpm 1.4 MB/s | 220 kB 00:00 2023-10-16T19:55:01.093 INFO:teuthology.orchestra.run.smithi157.stdout:(75/131): keyutils-libs-devel-1.5.10-9.el8.x86_ 376 kB/s | 48 kB 00:00 2023-10-16T19:55:01.143 INFO:teuthology.orchestra.run.smithi157.stdout:(76/131): libsepol-devel-2.9-3.el8.x86_64.rpm 1.0 MB/s | 87 kB 00:00 2023-10-16T19:55:01.194 INFO:teuthology.orchestra.run.smithi157.stdout:(77/131): python3-requests-oauthlib-1.0.0-1.el8 426 kB/s | 43 kB 00:00 2023-10-16T19:55:01.294 INFO:teuthology.orchestra.run.smithi157.stdout:(78/131): python3-pycparser-2.14-14.el8.noarch. 726 kB/s | 109 kB 00:00 2023-10-16T19:55:01.486 INFO:teuthology.orchestra.run.smithi157.stdout:(79/131): pcre2-utf16-10.32-2.el8.x86_64.rpm 784 kB/s | 229 kB 00:00 2023-10-16T19:55:01.489 INFO:teuthology.orchestra.run.smithi187.stdout:Running transaction check 2023-10-16T19:55:01.520 INFO:teuthology.orchestra.run.smithi157.stdout:(80/131): krb5-devel-1.18.2-14.el8.x86_64.rpm 2.4 MB/s | 560 kB 00:00 2023-10-16T19:55:01.610 INFO:teuthology.orchestra.run.smithi187.stdout:Transaction check succeeded. 2023-10-16T19:55:01.610 INFO:teuthology.orchestra.run.smithi187.stdout:Running transaction test 2023-10-16T19:55:01.636 INFO:teuthology.orchestra.run.smithi157.stdout:(81/131): libaio-devel-0.3.112-1.el8.x86_64.rpm 124 kB/s | 19 kB 00:00 2023-10-16T19:55:01.695 INFO:teuthology.orchestra.run.smithi157.stdout:(82/131): python3-oauthlib-2.1.0-1.el8.noarch.r 884 kB/s | 155 kB 00:00 2023-10-16T19:55:01.762 INFO:teuthology.orchestra.run.smithi157.stdout:(83/131): python3-cryptography-3.2.1-5.el8.x86_ 4.4 MB/s | 559 kB 00:00 2023-10-16T19:55:01.846 INFO:teuthology.orchestra.run.smithi157.stdout:(84/131): libverto-devel-0.3.0-5.el8.x86_64.rpm 119 kB/s | 18 kB 00:00 2023-10-16T19:55:01.913 INFO:teuthology.orchestra.run.smithi157.stdout:(85/131): pcre2-devel-10.32-2.el8.x86_64.rpm 3.9 MB/s | 605 kB 00:00 2023-10-16T19:55:01.988 INFO:teuthology.orchestra.run.smithi157.stdout:(86/131): python3-cffi-1.11.5-5.el8.x86_64.rpm 1.6 MB/s | 238 kB 00:00 2023-10-16T19:55:02.147 INFO:teuthology.orchestra.run.smithi157.stdout:(87/131): openssl-devel-1.1.1k-7.el8_6.x86_64.r 10 MB/s | 2.3 MB 00:00 2023-10-16T19:55:02.232 INFO:teuthology.orchestra.run.smithi157.stdout:(88/131): xfsprogs-devel-5.0.0-10.el8.x86_64.rp 297 kB/s | 72 kB 00:00 2023-10-16T19:55:02.272 INFO:teuthology.orchestra.run.smithi157.stdout:(89/131): fuse-2.9.7-15.el8.x86_64.rpm 661 kB/s | 83 kB 00:00 2023-10-16T19:55:02.347 INFO:teuthology.orchestra.run.smithi157.stdout:(90/131): elfutils-libelf-devel-0.186-1.el8.x86 519 kB/s | 60 kB 00:00 2023-10-16T19:55:02.373 INFO:teuthology.orchestra.run.smithi157.stdout:(91/131): libuuid-devel-2.32.1-35.el8.x86_64.rp 977 kB/s | 98 kB 00:00 2023-10-16T19:55:02.481 INFO:teuthology.orchestra.run.smithi157.stdout:(92/131): zlib-devel-1.2.11-18.el8_5.x86_64.rpm 432 kB/s | 58 kB 00:00 2023-10-16T19:55:02.507 INFO:teuthology.orchestra.run.smithi157.stdout:(93/131): libcom_err-devel-1.45.6-4.el8.x86_64. 289 kB/s | 39 kB 00:00 2023-10-16T19:55:02.599 INFO:teuthology.orchestra.run.smithi157.stdout:(94/131): libquadmath-8.5.0-10.1.el8_6.x86_64.r 1.8 MB/s | 171 kB 00:00 2023-10-16T19:55:02.668 INFO:teuthology.orchestra.run.smithi157.stdout:(95/131): libgfortran-8.5.0-10.1.el8_6.x86_64.r 3.4 MB/s | 644 kB 00:00 2023-10-16T19:55:02.740 INFO:teuthology.orchestra.run.smithi187.stdout:Transaction test succeeded. 2023-10-16T19:55:02.744 INFO:teuthology.orchestra.run.smithi187.stdout:Running transaction 2023-10-16T19:55:02.766 INFO:teuthology.orchestra.run.smithi157.stdout:(96/131): NetworkManager-initscripts-updown-1.3 825 kB/s | 138 kB 00:00 2023-10-16T19:55:02.900 INFO:teuthology.orchestra.run.smithi157.stdout:(97/131): python3-pyasn1-modules-0.3.7-6.el8.no 827 kB/s | 110 kB 00:00 2023-10-16T19:55:02.958 INFO:teuthology.orchestra.run.smithi157.stdout:(98/131): python3-pytz-2017.2-9.el8.noarch.rpm 934 kB/s | 54 kB 00:00 2023-10-16T19:55:03.142 INFO:teuthology.orchestra.run.smithi157.stdout:(99/131): python3-scipy-1.0.0-21.module+el8.5.0 29 MB/s | 14 MB 00:00 2023-10-16T19:55:03.167 INFO:teuthology.orchestra.run.smithi157.stdout:(100/131): lttng-ust-2.8.1-11.el8.x86_64.rpm 1.2 MB/s | 259 kB 00:00 2023-10-16T19:55:03.309 INFO:teuthology.orchestra.run.smithi157.stdout:(101/131): socat-1.7.4.1-1.el8.x86_64.rpm 1.9 MB/s | 323 kB 00:00 2023-10-16T19:55:03.376 INFO:teuthology.orchestra.run.smithi157.stdout:(102/131): python3-markupsafe-0.23-19.el8.x86_6 186 kB/s | 39 kB 00:00 2023-10-16T19:55:03.468 INFO:teuthology.orchestra.run.smithi157.stdout:(103/131): bison-3.0.4-10.el8.x86_64.rpm 4.2 MB/s | 688 kB 00:00 2023-10-16T19:55:03.568 INFO:teuthology.orchestra.run.smithi157.stdout:(104/131): python3-jinja2-2.10.1-3.el8.noarch.r 2.7 MB/s | 538 kB 00:00 2023-10-16T19:55:03.593 INFO:teuthology.orchestra.run.smithi157.stdout:(105/131): python3-mako-1.0.6-13.el8.noarch.rpm 1.2 MB/s | 157 kB 00:00 2023-10-16T19:55:03.685 INFO:teuthology.orchestra.run.smithi157.stdout:(106/131): automake-1.16.1-7.el8.noarch.rpm 7.6 MB/s | 713 kB 00:00 2023-10-16T19:55:03.711 INFO:teuthology.orchestra.run.smithi157.stdout:(107/131): oniguruma-6.8.2-2.el8.x86_64.rpm 1.3 MB/s | 187 kB 00:00 2023-10-16T19:55:03.769 INFO:teuthology.orchestra.run.smithi157.stdout:(108/131): python3-jsonpatch-1.21-2.el8.noarch. 454 kB/s | 27 kB 00:00 2023-10-16T19:55:03.845 INFO:teuthology.orchestra.run.smithi157.stdout:(109/131): python3-babel-2.5.1-7.el8.noarch.rpm 30 MB/s | 4.8 MB 00:00 2023-10-16T19:55:03.903 INFO:teuthology.orchestra.run.smithi157.stdout:(110/131): flex-2.6.1-9.el8.x86_64.rpm 2.3 MB/s | 320 kB 00:00 2023-10-16T19:55:04.020 INFO:teuthology.orchestra.run.smithi157.stdout:(111/131): python3-prettytable-0.7.2-14.el8.noa 251 kB/s | 44 kB 00:00 2023-10-16T19:55:04.112 INFO:teuthology.orchestra.run.smithi157.stdout:(112/131): python3-werkzeug-0.12.2-4.el8.noarch 4.9 MB/s | 457 kB 00:00 2023-10-16T19:55:04.181 INFO:teuthology.orchestra.run.smithi157.stdout:(113/131): python3-numpy-1.14.3-10.el8.x86_64.r 14 MB/s | 3.7 MB 00:00 2023-10-16T19:55:04.230 INFO:teuthology.orchestra.run.smithi157.stdout:(114/131): python3-numpy-f2py-1.14.3-10.el8.x86 1.9 MB/s | 225 kB 00:00 2023-10-16T19:55:04.305 INFO:teuthology.orchestra.run.smithi157.stdout:(115/131): uuid-1.6.2-43.el8.x86_64.rpm 511 kB/s | 64 kB 00:00 2023-10-16T19:55:04.363 INFO:teuthology.orchestra.run.smithi157.stdout:(116/131): python3-pyasn1-0.3.7-6.el8.noarch.rp 946 kB/s | 126 kB 00:00 2023-10-16T19:55:04.416 INFO:teuthology.orchestra.run.smithi157.stdout:(117/131): python3-jsonpointer-1.10-11.el8.noar 180 kB/s | 20 kB 00:00 2023-10-16T19:55:04.548 INFO:teuthology.orchestra.run.smithi157.stdout:(118/131): python3-pyOpenSSL-19.0.0-1.el8.noarc 563 kB/s | 103 kB 00:00 2023-10-16T19:55:04.615 INFO:teuthology.orchestra.run.smithi157.stdout:(119/131): libtool-2.4.6-25.el8.x86_64.rpm 3.5 MB/s | 709 kB 00:00 2023-10-16T19:55:04.815 INFO:teuthology.orchestra.run.smithi157.stdout:(120/131): openblas-threads-0.3.15-3.el8.x86_64 18 MB/s | 4.9 MB 00:00 2023-10-16T19:55:04.873 INFO:teuthology.orchestra.run.smithi157.stdout:(121/131): libpq-13.5-1.el8.x86_64.rpm 765 kB/s | 198 kB 00:00 2023-10-16T19:55:05.007 INFO:teuthology.orchestra.run.smithi157.stdout:(122/131): jq-1.6-3.el8.x86_64.rpm 1.5 MB/s | 202 kB 00:00 2023-10-16T19:55:05.099 INFO:teuthology.orchestra.run.smithi157.stdout:(123/131): openblas-0.3.15-3.el8.x86_64.rpm 17 MB/s | 4.7 MB 00:00 2023-10-16T19:55:05.183 INFO:teuthology.orchestra.run.smithi157.stdout:(124/131): librdkafka-0.11.4-3.el8.x86_64.rpm 2.0 MB/s | 354 kB 00:00 2023-10-16T19:55:05.341 INFO:teuthology.orchestra.run.smithi157.stdout:(125/131): postgresql-server-10.21-2.module+el8 21 MB/s | 5.1 MB 00:00 2023-10-16T19:55:05.375 INFO:teuthology.orchestra.run.smithi157.stdout:(126/131): postgresql-contrib-10.21-2.module+el 4.1 MB/s | 808 kB 00:00 2023-10-16T19:55:05.425 INFO:teuthology.orchestra.run.smithi157.stdout:(127/131): postgresql-10.21-2.module+el8.6.0+15 18 MB/s | 1.5 MB 00:00 2023-10-16T19:55:05.850 INFO:teuthology.orchestra.run.smithi157.stdout:(128/131): ceph-common-18.0.0-6730.g4ba8a190.el 1.5 MB/s | 23 MB 00:14 2023-10-16T19:55:05.901 INFO:teuthology.orchestra.run.smithi157.stdout:(129/131): iproute-5.15.0-4.el8_6.1.x86_64.rpm 16 MB/s | 798 kB 00:00 2023-10-16T19:55:06.301 INFO:teuthology.orchestra.run.smithi157.stdout:(130/131): librbd1-18.0.0-6730.g4ba8a190.el8.x8 4.2 MB/s | 3.7 MB 00:00 2023-10-16T19:55:06.368 INFO:teuthology.orchestra.run.smithi157.stdout:(131/131): librados2-18.0.0-6730.g4ba8a190.el8. 3.8 MB/s | 3.7 MB 00:00 2023-10-16T19:55:06.370 INFO:teuthology.orchestra.run.smithi157.stdout:-------------------------------------------------------------------------------- 2023-10-16T19:55:06.370 INFO:teuthology.orchestra.run.smithi157.stdout:Total 13 MB/s | 209 MB 00:15 2023-10-16T19:55:07.199 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction check 2023-10-16T19:55:07.320 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction check succeeded. 2023-10-16T19:55:07.320 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction test 2023-10-16T19:55:07.570 INFO:teuthology.orchestra.run.smithi187.stdout: Preparing : 1/1 2023-10-16T19:55:07.762 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/134 2023-10-16T19:55:07.937 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/134 2023-10-16T19:55:08.153 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 3/134 2023-10-16T19:55:08.355 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 4/134 2023-10-16T19:55:08.454 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction test succeeded. 2023-10-16T19:55:08.458 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction 2023-10-16T19:55:08.481 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 4/134 2023-10-16T19:55:08.697 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 5/134 2023-10-16T19:55:09.105 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 5/134 2023-10-16T19:55:09.305 INFO:teuthology.orchestra.run.smithi187.stdout: Upgrading : librados2-2:18.0.0-6730.g4ba8a190.el8.x86_64 6/134 2023-10-16T19:55:09.698 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: librados2-2:18.0.0-6730.g4ba8a190.el8.x86_64 6/134 2023-10-16T19:55:09.904 INFO:teuthology.orchestra.run.smithi187.stdout: Upgrading : librbd1-2:18.0.0-6730.g4ba8a190.el8.x86_64 7/134 2023-10-16T19:55:10.021 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: librbd1-2:18.0.0-6730.g4ba8a190.el8.x86_64 7/134 2023-10-16T19:55:10.238 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : libcephfs2-2:18.0.0-6730.g4ba8a190.el8.x86_64 8/134 2023-10-16T19:55:10.338 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: libcephfs2-2:18.0.0-6730.g4ba8a190.el8.x86_64 8/134 2023-10-16T19:55:10.583 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-rados-2:18.0.0-6730.g4ba8a190.el8.x86_64 9/134 2023-10-16T19:55:10.816 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : libpq-13.5-1.el8.x86_64 10/134 2023-10-16T19:55:10.991 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/134 2023-10-16T19:55:11.372 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/134 2023-10-16T19:55:11.628 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : postgresql-10.21-2.module+el8.6.0+15342+53518fac 13/134 2023-10-16T19:55:11.813 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : libcephsqlite-2:18.0.0-6730.g4ba8a190.el8.x86_64 14/134 2023-10-16T19:55:11.906 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: libcephsqlite-2:18.0.0-6730.g4ba8a190.el8.x86_64 14/134 2023-10-16T19:55:12.079 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : libradosstriper1-2:18.0.0-6730.g4ba8a190.el8.x86 15/134 2023-10-16T19:55:12.160 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: libradosstriper1-2:18.0.0-6730.g4ba8a190.el8.x86 15/134 2023-10-16T19:55:12.296 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 16/134 2023-10-16T19:55:12.464 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 16/134 2023-10-16T19:55:12.612 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 17/134 2023-10-16T19:55:13.224 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 17/134 2023-10-16T19:55:13.387 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 18/134 2023-10-16T19:55:13.735 INFO:teuthology.orchestra.run.smithi157.stdout: Preparing : 1/1 2023-10-16T19:55:13.916 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/134 2023-10-16T19:55:13.966 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 18/134 2023-10-16T19:55:14.133 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/134 2023-10-16T19:55:14.145 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : openblas-0.3.15-3.el8.x86_64 19/134 2023-10-16T19:55:14.285 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 3/134 2023-10-16T19:55:14.431 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 3/134 2023-10-16T19:55:14.643 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 4/134 2023-10-16T19:55:14.841 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 19/134 2023-10-16T19:55:15.056 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 4/134 2023-10-16T19:55:15.094 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 20/134 2023-10-16T19:55:15.312 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 21/134 2023-10-16T19:55:15.326 INFO:teuthology.orchestra.run.smithi157.stdout: Upgrading : librados2-2:18.0.0-6730.g4ba8a190.el8.x86_64 5/134 2023-10-16T19:55:15.515 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 22/134 2023-10-16T19:55:15.685 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 23/134 2023-10-16T19:55:15.741 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: librados2-2:18.0.0-6730.g4ba8a190.el8.x86_64 5/134 2023-10-16T19:55:15.878 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 24/134 2023-10-16T19:55:15.934 INFO:teuthology.orchestra.run.smithi157.stdout: Upgrading : librbd1-2:18.0.0-6730.g4ba8a190.el8.x86_64 6/134 2023-10-16T19:55:16.065 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: librbd1-2:18.0.0-6730.g4ba8a190.el8.x86_64 6/134 2023-10-16T19:55:16.080 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/134 2023-10-16T19:55:16.235 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-ceph-common-2:18.0.0-6730.g4ba8a190.el8. 26/134 2023-10-16T19:55:16.284 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : libcephfs2-2:18.0.0-6730.g4ba8a190.el8.x86_64 7/134 2023-10-16T19:55:16.356 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-ceph-argparse-2:18.0.0-6730.g4ba8a190.el 27/134 2023-10-16T19:55:16.381 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: libcephfs2-2:18.0.0-6730.g4ba8a190.el8.x86_64 7/134 2023-10-16T19:55:16.555 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-rados-2:18.0.0-6730.g4ba8a190.el8.x86_64 8/134 2023-10-16T19:55:16.760 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 9/134 2023-10-16T19:55:16.970 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : libpq-13.5-1.el8.x86_64 10/134 2023-10-16T19:55:17.204 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/134 2023-10-16T19:55:17.240 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-cephfs-2:18.0.0-6730.g4ba8a190.el8.x86_6 28/134 2023-10-16T19:55:17.593 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/134 2023-10-16T19:55:17.739 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 29/134 2023-10-16T19:55:17.990 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 30/134 2023-10-16T19:55:18.253 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 31/134 2023-10-16T19:55:18.342 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : postgresql-10.21-2.module+el8.6.0+15342+53518fac 13/134 2023-10-16T19:55:18.453 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/134 2023-10-16T19:55:18.534 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : libcephsqlite-2:18.0.0-6730.g4ba8a190.el8.x86_64 14/134 2023-10-16T19:55:18.627 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: libcephsqlite-2:18.0.0-6730.g4ba8a190.el8.x86_64 14/134 2023-10-16T19:55:18.826 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : libradosstriper1-2:18.0.0-6730.g4ba8a190.el8.x86 15/134 2023-10-16T19:55:18.980 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: libradosstriper1-2:18.0.0-6730.g4ba8a190.el8.x86 15/134 2023-10-16T19:55:19.146 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 16/134 2023-10-16T19:55:19.358 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 17/134 2023-10-16T19:55:19.525 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 18/134 2023-10-16T19:55:19.700 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 19/134 2023-10-16T19:55:19.847 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 19/134 2023-10-16T19:55:19.986 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 20/134 2023-10-16T19:55:20.206 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/134 2023-10-16T19:55:20.487 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 33/134 2023-10-16T19:55:20.606 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 20/134 2023-10-16T19:55:20.664 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-rsa-4.9-2.el8.noarch 34/134 2023-10-16T19:55:20.767 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 21/134 2023-10-16T19:55:20.847 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 35/134 2023-10-16T19:55:21.026 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-rbd-2:18.0.0-6730.g4ba8a190.el8.x86_64 36/134 2023-10-16T19:55:21.190 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : librados-devel-2:18.0.0-6730.g4ba8a190.el8.x86_6 37/134 2023-10-16T19:55:21.347 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 38/134 2023-10-16T19:55:21.365 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 21/134 2023-10-16T19:55:21.546 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 39/134 2023-10-16T19:55:21.583 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : openblas-0.3.15-3.el8.x86_64 22/134 2023-10-16T19:55:21.730 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : fuse-2.9.7-15.el8.x86_64 40/134 2023-10-16T19:55:21.856 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 41/134 2023-10-16T19:55:22.077 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 42/134 2023-10-16T19:55:22.268 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 43/134 2023-10-16T19:55:22.276 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 22/134 2023-10-16T19:55:22.552 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 23/134 2023-10-16T19:55:22.626 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 44/134 2023-10-16T19:55:22.772 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 24/134 2023-10-16T19:55:22.922 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 45/134 2023-10-16T19:55:22.977 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/134 2023-10-16T19:55:23.181 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-ceph-common-2:18.0.0-6730.g4ba8a190.el8. 26/134 2023-10-16T19:55:23.290 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 46/134 2023-10-16T19:55:23.335 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-ceph-argparse-2:18.0.0-6730.g4ba8a190.el 27/134 2023-10-16T19:55:23.563 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-cephfs-2:18.0.0-6730.g4ba8a190.el8.x86_6 28/134 2023-10-16T19:55:23.644 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 47/134 2023-10-16T19:55:23.734 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/134 2023-10-16T19:55:23.859 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 48/134 2023-10-16T19:55:24.175 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 49/134 2023-10-16T19:55:24.427 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 50/134 2023-10-16T19:55:24.602 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 51/134 2023-10-16T19:55:24.826 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 52/134 2023-10-16T19:55:24.975 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 53/134 2023-10-16T19:55:25.139 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 54/134 2023-10-16T19:55:25.450 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 55/134 2023-10-16T19:55:25.513 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/134 2023-10-16T19:55:25.716 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 56/134 2023-10-16T19:55:25.941 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 57/134 2023-10-16T19:55:26.167 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 58/134 2023-10-16T19:55:26.334 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 59/134 2023-10-16T19:55:26.479 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 60/134 2023-10-16T19:55:26.545 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 30/134 2023-10-16T19:55:26.643 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : uuid-1.6.2-43.el8.x86_64 61/134 2023-10-16T19:55:26.707 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 61/134 2023-10-16T19:55:26.872 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 31/134 2023-10-16T19:55:26.955 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 62/134 2023-10-16T19:55:27.155 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : automake-1.16.1-7.el8.noarch 63/134 2023-10-16T19:55:27.186 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 32/134 2023-10-16T19:55:27.302 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 64/134 2023-10-16T19:55:27.386 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 64/134 2023-10-16T19:55:27.416 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 33/134 2023-10-16T19:55:27.609 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : jq-1.6-3.el8.x86_64 65/134 2023-10-16T19:55:27.654 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-rsa-4.9-2.el8.noarch 34/134 2023-10-16T19:55:27.789 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 66/134 2023-10-16T19:55:27.827 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 35/134 2023-10-16T19:55:27.944 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 67/134 2023-10-16T19:55:28.022 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-rbd-2:18.0.0-6730.g4ba8a190.el8.x86_64 36/134 2023-10-16T19:55:28.108 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 68/134 2023-10-16T19:55:28.164 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : librados-devel-2:18.0.0-6730.g4ba8a190.el8.x86_6 37/134 2023-10-16T19:55:28.306 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 38/134 2023-10-16T19:55:28.351 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 69/134 2023-10-16T19:55:28.484 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 39/134 2023-10-16T19:55:28.559 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 70/134 2023-10-16T19:55:28.682 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : uuid-1.6.2-43.el8.x86_64 40/134 2023-10-16T19:55:28.706 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 71/134 2023-10-16T19:55:28.757 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 40/134 2023-10-16T19:55:28.846 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 72/134 2023-10-16T19:55:29.003 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 41/134 2023-10-16T19:55:29.037 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 73/134 2023-10-16T19:55:29.223 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 74/134 2023-10-16T19:55:29.294 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : automake-1.16.1-7.el8.noarch 42/134 2023-10-16T19:55:29.396 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 75/134 2023-10-16T19:55:29.433 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 43/134 2023-10-16T19:55:29.518 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 43/134 2023-10-16T19:55:29.538 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 76/134 2023-10-16T19:55:29.657 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 77/134 2023-10-16T19:55:29.748 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : jq-1.6-3.el8.x86_64 44/134 2023-10-16T19:55:29.840 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 78/134 2023-10-16T19:55:29.913 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 45/134 2023-10-16T19:55:30.072 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 79/134 2023-10-16T19:55:30.073 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 46/134 2023-10-16T19:55:30.240 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 80/134 2023-10-16T19:55:30.251 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 47/134 2023-10-16T19:55:30.401 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : fuse-2.9.7-15.el8.x86_64 48/134 2023-10-16T19:55:30.489 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-portend-2.6-1.el8.noarch 81/134 2023-10-16T19:55:30.569 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 49/134 2023-10-16T19:55:30.717 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 82/134 2023-10-16T19:55:30.765 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 50/134 2023-10-16T19:55:30.874 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 83/134 2023-10-16T19:55:30.956 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 51/134 2023-10-16T19:55:31.091 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 84/134 2023-10-16T19:55:31.311 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 52/134 2023-10-16T19:55:31.617 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 53/134 2023-10-16T19:55:31.868 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 54/134 2023-10-16T19:55:32.113 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 55/134 2023-10-16T19:55:32.183 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 85/134 2023-10-16T19:55:32.362 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 56/134 2023-10-16T19:55:32.421 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 86/134 2023-10-16T19:55:32.608 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 87/134 2023-10-16T19:55:32.658 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 57/134 2023-10-16T19:55:32.892 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 88/134 2023-10-16T19:55:32.897 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 58/134 2023-10-16T19:55:33.082 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 59/134 2023-10-16T19:55:33.181 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 89/134 2023-10-16T19:55:33.304 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 60/134 2023-10-16T19:55:33.398 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 90/134 2023-10-16T19:55:33.480 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 61/134 2023-10-16T19:55:33.685 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 62/134 2023-10-16T19:55:33.989 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 63/134 2023-10-16T19:55:34.227 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 91/134 2023-10-16T19:55:34.238 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 64/134 2023-10-16T19:55:34.425 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : librgw2-2:18.0.0-6730.g4ba8a190.el8.x86_64 92/134 2023-10-16T19:55:34.489 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 65/134 2023-10-16T19:55:34.502 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: librgw2-2:18.0.0-6730.g4ba8a190.el8.x86_64 92/134 2023-10-16T19:55:34.676 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-rgw-2:18.0.0-6730.g4ba8a190.el8.x86_64 93/134 2023-10-16T19:55:34.716 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 66/134 2023-10-16T19:55:34.878 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 67/134 2023-10-16T19:55:35.059 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 68/134 2023-10-16T19:55:35.325 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 69/134 2023-10-16T19:55:35.546 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 70/134 2023-10-16T19:55:35.702 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 71/134 2023-10-16T19:55:35.874 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 72/134 2023-10-16T19:55:36.047 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 73/134 2023-10-16T19:55:36.267 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 74/134 2023-10-16T19:55:36.449 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 75/134 2023-10-16T19:55:36.583 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 76/134 2023-10-16T19:55:36.745 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 77/134 2023-10-16T19:55:36.960 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 78/134 2023-10-16T19:55:37.219 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 79/134 2023-10-16T19:55:37.403 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 80/134 2023-10-16T19:55:37.671 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-portend-2.6-1.el8.noarch 81/134 2023-10-16T19:55:37.940 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 82/134 2023-10-16T19:55:38.097 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 83/134 2023-10-16T19:55:38.303 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 84/134 2023-10-16T19:55:38.357 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: ceph-common-2:18.0.0-6730.g4ba8a190.el8.x86_64 94/134 2023-10-16T19:55:38.575 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-common-2:18.0.0-6730.g4ba8a190.el8.x86_64 94/134 2023-10-16T19:55:39.167 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: ceph-common-2:18.0.0-6730.g4ba8a190.el8.x86_64 94/134 2023-10-16T19:55:39.412 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 85/134 2023-10-16T19:55:39.521 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-base-2:18.0.0-6730.g4ba8a190.el8.x86_64 95/134 2023-10-16T19:55:39.587 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: ceph-base-2:18.0.0-6730.g4ba8a190.el8.x86_64 95/134 2023-10-16T19:55:39.699 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 86/134 2023-10-16T19:55:39.733 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-selinux-2:18.0.0-6730.g4ba8a190.el8.x86_64 96/134 2023-10-16T19:55:39.923 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 87/134 2023-10-16T19:55:40.232 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 88/134 2023-10-16T19:55:40.500 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 89/134 2023-10-16T19:55:40.704 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 90/134 2023-10-16T19:55:41.497 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 91/134 2023-10-16T19:55:41.663 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : librgw2-2:18.0.0-6730.g4ba8a190.el8.x86_64 92/134 2023-10-16T19:55:41.742 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: librgw2-2:18.0.0-6730.g4ba8a190.el8.x86_64 92/134 2023-10-16T19:55:41.922 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-rgw-2:18.0.0-6730.g4ba8a190.el8.x86_64 93/134 2023-10-16T19:55:45.654 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-common-2:18.0.0-6730.g4ba8a190.el8.x86_64 94/134 2023-10-16T19:55:45.897 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-common-2:18.0.0-6730.g4ba8a190.el8.x86_64 94/134 2023-10-16T19:55:46.514 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-common-2:18.0.0-6730.g4ba8a190.el8.x86_64 94/134 2023-10-16T19:55:46.837 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-base-2:18.0.0-6730.g4ba8a190.el8.x86_64 95/134 2023-10-16T19:55:46.909 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-base-2:18.0.0-6730.g4ba8a190.el8.x86_64 95/134 2023-10-16T19:55:47.046 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-selinux-2:18.0.0-6730.g4ba8a190.el8.x86_64 96/134 2023-10-16T19:55:58.755 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: ceph-selinux-2:18.0.0-6730.g4ba8a190.el8.x86_64 96/134 2023-10-16T19:55:58.755 INFO:teuthology.orchestra.run.smithi187.stdout:skipping the directory /sys 2023-10-16T19:55:58.755 INFO:teuthology.orchestra.run.smithi187.stdout:skipping the directory /proc 2023-10-16T19:55:58.756 INFO:teuthology.orchestra.run.smithi187.stdout:skipping the directory /dev 2023-10-16T19:55:58.756 INFO:teuthology.orchestra.run.smithi187.stdout:skipping the directory /run 2023-10-16T19:55:58.756 INFO:teuthology.orchestra.run.smithi187.stdout:skipping the directory /mnt 2023-10-16T19:55:58.756 INFO:teuthology.orchestra.run.smithi187.stdout:skipping the directory /var/tmp 2023-10-16T19:55:58.756 INFO:teuthology.orchestra.run.smithi187.stdout:skipping the directory /home 2023-10-16T19:55:58.757 INFO:teuthology.orchestra.run.smithi187.stdout:skipping the directory /tmp 2023-10-16T19:55:58.757 INFO:teuthology.orchestra.run.smithi187.stdout:skipping the directory /dev 2023-10-16T19:55:58.757 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-10-16T19:55:59.096 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-volume-2:18.0.0-6730.g4ba8a190.el8.noarch 97/134 2023-10-16T19:56:00.683 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: ceph-volume-2:18.0.0-6730.g4ba8a190.el8.noarch 97/134 2023-10-16T19:56:00.850 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-osd-2:18.0.0-6730.g4ba8a190.el8.x86_64 98/134 2023-10-16T19:56:01.070 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: ceph-osd-2:18.0.0-6730.g4ba8a190.el8.x86_64 98/134 2023-10-16T19:56:01.221 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-mds-2:18.0.0-6730.g4ba8a190.el8.x86_64 99/134 2023-10-16T19:56:01.684 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: ceph-mds-2:18.0.0-6730.g4ba8a190.el8.x86_64 99/134 2023-10-16T19:56:01.879 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-mon-2:18.0.0-6730.g4ba8a190.el8.x86_64 100/134 2023-10-16T19:56:01.896 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: ceph-mon-2:18.0.0-6730.g4ba8a190.el8.x86_64 100/134 2023-10-16T19:56:03.778 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: cephadm-2:18.0.0-6730.g4ba8a190.el8.noarch 101/134 2023-10-16T19:56:03.944 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : cephadm-2:18.0.0-6730.g4ba8a190.el8.noarch 101/134 2023-10-16T19:56:04.060 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-6730.g4ba8a190.e 102/134 2023-10-16T19:56:04.235 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-6730.g4ba8a190. 103/134 2023-10-16T19:56:04.411 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-6730.g4ba8a190.el8.noa 104/134 2023-10-16T19:56:04.629 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-6730.g4ba8a190.el8.noa 104/134 2023-10-16T19:56:04.909 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-6730.g4ba8a190.el8.n 105/134 2023-10-16T19:56:05.800 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-selinux-2:18.0.0-6730.g4ba8a190.el8.x86_64 96/134 2023-10-16T19:56:05.800 INFO:teuthology.orchestra.run.smithi157.stdout:skipping the directory /sys 2023-10-16T19:56:05.801 INFO:teuthology.orchestra.run.smithi157.stdout:skipping the directory /proc 2023-10-16T19:56:05.801 INFO:teuthology.orchestra.run.smithi157.stdout:skipping the directory /dev 2023-10-16T19:56:05.801 INFO:teuthology.orchestra.run.smithi157.stdout:skipping the directory /run 2023-10-16T19:56:05.801 INFO:teuthology.orchestra.run.smithi157.stdout:skipping the directory /mnt 2023-10-16T19:56:05.801 INFO:teuthology.orchestra.run.smithi157.stdout:skipping the directory /var/tmp 2023-10-16T19:56:05.801 INFO:teuthology.orchestra.run.smithi157.stdout:skipping the directory /home 2023-10-16T19:56:05.802 INFO:teuthology.orchestra.run.smithi157.stdout:skipping the directory /tmp 2023-10-16T19:56:05.802 INFO:teuthology.orchestra.run.smithi157.stdout:skipping the directory /dev 2023-10-16T19:56:05.802 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-10-16T19:56:05.867 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-6730.g4ba8a190.el8.n 105/134 2023-10-16T19:56:06.028 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-6730.g4ba 106/134 2023-10-16T19:56:06.118 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-6730.g4ba 106/134 2023-10-16T19:56:06.134 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-volume-2:18.0.0-6730.g4ba8a190.el8.noarch 97/134 2023-10-16T19:56:06.478 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-6730.g4ba8a190.el 107/134 2023-10-16T19:56:06.658 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-mgr-2:18.0.0-6730.g4ba8a190.el8.x86_64 108/134 2023-10-16T19:56:06.693 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: ceph-mgr-2:18.0.0-6730.g4ba8a190.el8.x86_64 108/134 2023-10-16T19:56:06.877 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-mgr-rook-2:18.0.0-6730.g4ba8a190.el8.noarch 109/134 2023-10-16T19:56:06.889 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-6730.g4ba8a190.el8.noarch 109/134 2023-10-16T19:56:07.732 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-volume-2:18.0.0-6730.g4ba8a190.el8.noarch 97/134 2023-10-16T19:56:07.883 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-osd-2:18.0.0-6730.g4ba8a190.el8.x86_64 98/134 2023-10-16T19:56:08.103 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-osd-2:18.0.0-6730.g4ba8a190.el8.x86_64 98/134 2023-10-16T19:56:08.217 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-2:18.0.0-6730.g4ba8a190.el8.x86_64 110/134 2023-10-16T19:56:08.234 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-mds-2:18.0.0-6730.g4ba8a190.el8.x86_64 99/134 2023-10-16T19:56:08.439 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-radosgw-2:18.0.0-6730.g4ba8a190.el8.x86_64 111/134 2023-10-16T19:56:08.473 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-6730.g4ba8a190.el8.x86_64 111/134 2023-10-16T19:56:08.628 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-6730.g4ba8a 112/134 2023-10-16T19:56:08.670 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-6730.g4ba8a 112/134 2023-10-16T19:56:08.699 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-mds-2:18.0.0-6730.g4ba8a190.el8.x86_64 99/134 2023-10-16T19:56:08.845 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : cephfs-mirror-2:18.0.0-6730.g4ba8a190.el8.x86_64 113/134 2023-10-16T19:56:08.901 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-mon-2:18.0.0-6730.g4ba8a190.el8.x86_64 100/134 2023-10-16T19:56:08.918 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-mon-2:18.0.0-6730.g4ba8a190.el8.x86_64 100/134 2023-10-16T19:56:09.211 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-6730.g4ba8a190.el8.x86_64 113/134 2023-10-16T19:56:09.411 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : rbd-mirror-2:18.0.0-6730.g4ba8a190.el8.x86_64 114/134 2023-10-16T19:56:10.688 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: cephadm-2:18.0.0-6730.g4ba8a190.el8.noarch 101/134 2023-10-16T19:56:10.868 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : cephadm-2:18.0.0-6730.g4ba8a190.el8.noarch 101/134 2023-10-16T19:56:10.973 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-6730.g4ba8a190.e 102/134 2023-10-16T19:56:11.185 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-6730.g4ba8a190. 103/134 2023-10-16T19:56:11.358 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-6730.g4ba8a190.el8.noa 104/134 2023-10-16T19:56:11.581 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-6730.g4ba8a190.el8.noa 104/134 2023-10-16T19:56:11.907 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-6730.g4ba8a190.el8.n 105/134 2023-10-16T19:56:12.872 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-6730.g4ba8a190.el8.n 105/134 2023-10-16T19:56:13.008 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-6730.g4ba 106/134 2023-10-16T19:56:13.099 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-6730.g4ba 106/134 2023-10-16T19:56:13.484 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-6730.g4ba8a190.el 107/134 2023-10-16T19:56:13.698 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-mgr-2:18.0.0-6730.g4ba8a190.el8.x86_64 108/134 2023-10-16T19:56:13.734 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-mgr-2:18.0.0-6730.g4ba8a190.el8.x86_64 108/134 2023-10-16T19:56:13.891 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-mgr-rook-2:18.0.0-6730.g4ba8a190.el8.noarch 109/134 2023-10-16T19:56:13.902 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-6730.g4ba8a190.el8.noarch 109/134 2023-10-16T19:56:14.065 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: rbd-mirror-2:18.0.0-6730.g4ba8a190.el8.x86_64 114/134 2023-10-16T19:56:14.355 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-test-2:18.0.0-6730.g4ba8a190.el8.x86_64 115/134 2023-10-16T19:56:14.526 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : libtool-2.4.6-25.el8.x86_64 116/134 2023-10-16T19:56:14.716 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 116/134 2023-10-16T19:56:15.235 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-2:18.0.0-6730.g4ba8a190.el8.x86_64 110/134 2023-10-16T19:56:15.472 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-radosgw-2:18.0.0-6730.g4ba8a190.el8.x86_64 111/134 2023-10-16T19:56:15.506 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-6730.g4ba8a190.el8.x86_64 111/134 2023-10-16T19:56:15.592 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 117/134 2023-10-16T19:56:15.658 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-6730.g4ba8a 112/134 2023-10-16T19:56:15.700 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-6730.g4ba8a 112/134 2023-10-16T19:56:15.866 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : cephfs-mirror-2:18.0.0-6730.g4ba8a190.el8.x86_64 113/134 2023-10-16T19:56:15.896 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 118/134 2023-10-16T19:56:16.081 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-fuse-2:18.0.0-6730.g4ba8a190.el8.x86_64 119/134 2023-10-16T19:56:16.233 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-6730.g4ba8a190.el8.x86_64 113/134 2023-10-16T19:56:16.255 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 120/134 2023-10-16T19:56:16.383 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : rbd-mirror-2:18.0.0-6730.g4ba8a190.el8.x86_64 114/134 2023-10-16T19:56:16.397 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : libcephfs-devel-2:18.0.0-6730.g4ba8a190.el8.x86_ 121/134 2023-10-16T19:56:16.544 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-10-16T19:56:18.678 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-10-16T19:56:18.934 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-10-16T19:56:18.952 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-10-16T19:56:19.118 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : cephfs-top-2:18.0.0-6730.g4ba8a190.el8.noarch 124/134 2023-10-16T19:56:19.425 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : rbd-fuse-2:18.0.0-6730.g4ba8a190.el8.x86_64 125/134 2023-10-16T19:56:19.713 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : rbd-nbd-2:18.0.0-6730.g4ba8a190.el8.x86_64 126/134 2023-10-16T19:56:20.036 INFO:teuthology.orchestra.run.smithi187.stdout: Upgrading : iproute-5.15.0-4.el8_6.1.x86_64 127/134 2023-10-16T19:56:20.192 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-10-16T19:56:20.201 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-10-16T19:56:20.381 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 129/134 2023-10-16T19:56:20.575 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : flex-2.6.1-9.el8.x86_64 130/134 2023-10-16T19:56:20.656 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 130/134 2023-10-16T19:56:20.875 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : bison-3.0.4-10.el8.x86_64 131/134 2023-10-16T19:56:20.888 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 131/134 2023-10-16T19:56:20.888 INFO:teuthology.orchestra.run.smithi187.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-10-16T19:56:21.040 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: rbd-mirror-2:18.0.0-6730.g4ba8a190.el8.x86_64 114/134 2023-10-16T19:56:21.095 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-10-16T19:56:21.095 INFO:teuthology.orchestra.run.smithi187.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 133/134 2023-10-16T19:56:21.339 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 133/134 2023-10-16T19:56:21.541 INFO:teuthology.orchestra.run.smithi187.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 134/134 2023-10-16T19:56:21.899 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-test-2:18.0.0-6730.g4ba8a190.el8.x86_64 115/134 2023-10-16T19:56:22.021 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: iproute-5.15.0-4.el8.x86_64 134/134 2023-10-16T19:56:22.021 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-2:18.0.0-6730.g4ba8a190.el8.x86_64 1/134 2023-10-16T19:56:22.021 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-base-2:18.0.0-6730.g4ba8a190.el8.x86_64 2/134 2023-10-16T19:56:22.022 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-common-2:18.0.0-6730.g4ba8a190.el8.x86_64 3/134 2023-10-16T19:56:22.022 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-fuse-2:18.0.0-6730.g4ba8a190.el8.x86_64 4/134 2023-10-16T19:56:22.022 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-6730.g4ba8a 5/134 2023-10-16T19:56:22.022 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-mds-2:18.0.0-6730.g4ba8a190.el8.x86_64 6/134 2023-10-16T19:56:22.022 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-mgr-2:18.0.0-6730.g4ba8a190.el8.x86_64 7/134 2023-10-16T19:56:22.023 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-mon-2:18.0.0-6730.g4ba8a190.el8.x86_64 8/134 2023-10-16T19:56:22.023 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-osd-2:18.0.0-6730.g4ba8a190.el8.x86_64 9/134 2023-10-16T19:56:22.023 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-radosgw-2:18.0.0-6730.g4ba8a190.el8.x86_64 10/134 2023-10-16T19:56:22.023 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-selinux-2:18.0.0-6730.g4ba8a190.el8.x86_64 11/134 2023-10-16T19:56:22.023 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-test-2:18.0.0-6730.g4ba8a190.el8.x86_64 12/134 2023-10-16T19:56:22.023 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : cephfs-mirror-2:18.0.0-6730.g4ba8a190.el8.x86_64 13/134 2023-10-16T19:56:22.024 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : libcephfs-devel-2:18.0.0-6730.g4ba8a190.el8.x86_ 14/134 2023-10-16T19:56:22.024 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : libcephfs2-2:18.0.0-6730.g4ba8a190.el8.x86_64 15/134 2023-10-16T19:56:22.024 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : libcephsqlite-2:18.0.0-6730.g4ba8a190.el8.x86_64 16/134 2023-10-16T19:56:22.024 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : librados-devel-2:18.0.0-6730.g4ba8a190.el8.x86_6 17/134 2023-10-16T19:56:22.024 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : libradosstriper1-2:18.0.0-6730.g4ba8a190.el8.x86 18/134 2023-10-16T19:56:22.025 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : librgw2-2:18.0.0-6730.g4ba8a190.el8.x86_64 19/134 2023-10-16T19:56:22.025 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-ceph-argparse-2:18.0.0-6730.g4ba8a190.el 20/134 2023-10-16T19:56:22.025 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-ceph-common-2:18.0.0-6730.g4ba8a190.el8. 21/134 2023-10-16T19:56:22.025 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-cephfs-2:18.0.0-6730.g4ba8a190.el8.x86_6 22/134 2023-10-16T19:56:22.025 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-rados-2:18.0.0-6730.g4ba8a190.el8.x86_64 23/134 2023-10-16T19:56:22.026 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-rbd-2:18.0.0-6730.g4ba8a190.el8.x86_64 24/134 2023-10-16T19:56:22.026 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-rgw-2:18.0.0-6730.g4ba8a190.el8.x86_64 25/134 2023-10-16T19:56:22.026 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : rbd-fuse-2:18.0.0-6730.g4ba8a190.el8.x86_64 26/134 2023-10-16T19:56:22.026 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : rbd-mirror-2:18.0.0-6730.g4ba8a190.el8.x86_64 27/134 2023-10-16T19:56:22.026 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : rbd-nbd-2:18.0.0-6730.g4ba8a190.el8.x86_64 28/134 2023-10-16T19:56:22.027 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-6730.g4ba8a190. 29/134 2023-10-16T19:56:22.027 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-6730.g4ba8a190.el8.noa 30/134 2023-10-16T19:56:22.036 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-6730.g4ba8a190.el8.n 31/134 2023-10-16T19:56:22.036 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-6730.g4ba 32/134 2023-10-16T19:56:22.036 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-6730.g4ba8a190.el 33/134 2023-10-16T19:56:22.036 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-mgr-rook-2:18.0.0-6730.g4ba8a190.el8.noarch 34/134 2023-10-16T19:56:22.037 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-6730.g4ba8a190.e 35/134 2023-10-16T19:56:22.037 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-volume-2:18.0.0-6730.g4ba8a190.el8.noarch 36/134 2023-10-16T19:56:22.037 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : cephadm-2:18.0.0-6730.g4ba8a190.el8.noarch 37/134 2023-10-16T19:56:22.037 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : cephfs-top-2:18.0.0-6730.g4ba8a190.el8.noarch 38/134 2023-10-16T19:56:22.037 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/134 2023-10-16T19:56:22.038 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/134 2023-10-16T19:56:22.038 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/134 2023-10-16T19:56:22.038 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/134 2023-10-16T19:56:22.038 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/134 2023-10-16T19:56:22.038 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/134 2023-10-16T19:56:22.039 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/134 2023-10-16T19:56:22.039 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/134 2023-10-16T19:56:22.039 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/134 2023-10-16T19:56:22.039 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/134 2023-10-16T19:56:22.039 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/134 2023-10-16T19:56:22.040 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/134 2023-10-16T19:56:22.040 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/134 2023-10-16T19:56:22.040 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/134 2023-10-16T19:56:22.040 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/134 2023-10-16T19:56:22.040 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/134 2023-10-16T19:56:22.041 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/134 2023-10-16T19:56:22.041 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/134 2023-10-16T19:56:22.041 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/134 2023-10-16T19:56:22.041 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/134 2023-10-16T19:56:22.041 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/134 2023-10-16T19:56:22.042 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/134 2023-10-16T19:56:22.042 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/134 2023-10-16T19:56:22.042 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/134 2023-10-16T19:56:22.042 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/134 2023-10-16T19:56:22.042 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/134 2023-10-16T19:56:22.043 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/134 2023-10-16T19:56:22.043 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/134 2023-10-16T19:56:22.043 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/134 2023-10-16T19:56:22.043 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/134 2023-10-16T19:56:22.043 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/134 2023-10-16T19:56:22.043 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/134 2023-10-16T19:56:22.044 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/134 2023-10-16T19:56:22.044 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 72/134 2023-10-16T19:56:22.044 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 73/134 2023-10-16T19:56:22.044 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 74/134 2023-10-16T19:56:22.044 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 75/134 2023-10-16T19:56:22.045 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 76/134 2023-10-16T19:56:22.045 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 77/134 2023-10-16T19:56:22.045 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : bison-3.0.4-10.el8.x86_64 78/134 2023-10-16T19:56:22.045 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 79/134 2023-10-16T19:56:22.045 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 80/134 2023-10-16T19:56:22.046 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 81/134 2023-10-16T19:56:22.046 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : automake-1.16.1-7.el8.noarch 82/134 2023-10-16T19:56:22.046 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 83/134 2023-10-16T19:56:22.046 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 84/134 2023-10-16T19:56:22.046 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : flex-2.6.1-9.el8.x86_64 85/134 2023-10-16T19:56:22.047 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 86/134 2023-10-16T19:56:22.047 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 87/134 2023-10-16T19:56:22.047 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 88/134 2023-10-16T19:56:22.047 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 89/134 2023-10-16T19:56:22.047 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 90/134 2023-10-16T19:56:22.047 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 91/134 2023-10-16T19:56:22.048 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 92/134 2023-10-16T19:56:22.048 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 93/134 2023-10-16T19:56:22.048 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 94/134 2023-10-16T19:56:22.048 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 95/134 2023-10-16T19:56:22.048 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : libpq-13.5-1.el8.x86_64 96/134 2023-10-16T19:56:22.049 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 97/134 2023-10-16T19:56:22.049 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : jq-1.6-3.el8.x86_64 98/134 2023-10-16T19:56:22.049 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 99/134 2023-10-16T19:56:22.049 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : postgresql-server-10.21-2.module+el8.6.0+15342+5 100/134 2023-10-16T19:56:22.049 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 101/134 2023-10-16T19:56:22.050 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : postgresql-10.21-2.module+el8.6.0+15342+53518fac 102/134 2023-10-16T19:56:22.050 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 103/134 2023-10-16T19:56:22.050 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 104/134 2023-10-16T19:56:22.050 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 105/134 2023-10-16T19:56:22.051 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 106/134 2023-10-16T19:56:22.051 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 107/134 2023-10-16T19:56:22.051 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 108/134 2023-10-16T19:56:22.051 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 109/134 2023-10-16T19:56:22.051 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 110/134 2023-10-16T19:56:22.052 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 111/134 2023-10-16T19:56:22.052 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 112/134 2023-10-16T19:56:22.052 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 113/134 2023-10-16T19:56:22.052 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 114/134 2023-10-16T19:56:22.052 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 115/134 2023-10-16T19:56:22.052 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 116/134 2023-10-16T19:56:22.053 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 117/134 2023-10-16T19:56:22.053 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 118/134 2023-10-16T19:56:22.053 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 119/134 2023-10-16T19:56:22.053 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 120/134 2023-10-16T19:56:22.053 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 121/134 2023-10-16T19:56:22.054 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-10-16T19:56:22.054 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 123/134 2023-10-16T19:56:22.054 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 124/134 2023-10-16T19:56:22.054 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 125/134 2023-10-16T19:56:22.054 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 126/134 2023-10-16T19:56:22.056 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 127/134 2023-10-16T19:56:22.056 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-10-16T19:56:22.057 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : librados2-2:18.0.0-6730.g4ba8a190.el8.x86_64 129/134 2023-10-16T19:56:22.057 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/134 2023-10-16T19:56:22.057 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : librbd1-2:18.0.0-6730.g4ba8a190.el8.x86_64 131/134 2023-10-16T19:56:22.057 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-10-16T19:56:22.057 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : iproute-5.15.0-4.el8_6.1.x86_64 133/134 2023-10-16T19:56:22.227 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 116/134 2023-10-16T19:56:22.429 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-fuse-2:18.0.0-6730.g4ba8a190.el8.x86_64 117/134 2023-10-16T19:56:22.670 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 118/134 2023-10-16T19:56:22.856 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : libtool-2.4.6-25.el8.x86_64 119/134 2023-10-16T19:56:23.048 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 119/134 2023-10-16T19:56:23.302 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 120/134 2023-10-16T19:56:23.468 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : libcephfs-devel-2:18.0.0-6730.g4ba8a190.el8.x86_ 121/134 2023-10-16T19:56:23.641 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-10-16T19:56:24.699 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 134/134 2023-10-16T19:56:24.700 INFO:teuthology.orchestra.run.smithi187.stdout:Last metadata expiration check: 0:01:47 ago on Mon 16 Oct 2023 07:54:37 PM UTC. 2023-10-16T19:56:25.947 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-10-16T19:56:26.231 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-10-16T19:56:26.249 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-10-16T19:56:26.406 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : cephfs-top-2:18.0.0-6730.g4ba8a190.el8.noarch 124/134 2023-10-16T19:56:26.689 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : rbd-fuse-2:18.0.0-6730.g4ba8a190.el8.x86_64 125/134 2023-10-16T19:56:26.989 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : rbd-nbd-2:18.0.0-6730.g4ba8a190.el8.x86_64 126/134 2023-10-16T19:56:27.360 INFO:teuthology.orchestra.run.smithi187.stdout:Installed products updated. 2023-10-16T19:56:27.378 INFO:teuthology.orchestra.run.smithi157.stdout: Upgrading : iproute-5.15.0-4.el8_6.1.x86_64 127/134 2023-10-16T19:56:27.572 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : flex-2.6.1-9.el8.x86_64 128/134 2023-10-16T19:56:27.586 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-10-16T19:56:27.587 INFO:teuthology.orchestra.run.smithi187.stdout:Upgraded: 2023-10-16T19:56:27.587 INFO:teuthology.orchestra.run.smithi187.stdout: iproute-5.15.0-4.el8_6.1.x86_64 2023-10-16T19:56:27.587 INFO:teuthology.orchestra.run.smithi187.stdout: librados2-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T19:56:27.587 INFO:teuthology.orchestra.run.smithi187.stdout: librbd1-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T19:56:27.588 INFO:teuthology.orchestra.run.smithi187.stdout:Installed: 2023-10-16T19:56:27.588 INFO:teuthology.orchestra.run.smithi187.stdout: NetworkManager-initscripts-updown-1:1.36.0-9.el8_6.noarch 2023-10-16T19:56:27.588 INFO:teuthology.orchestra.run.smithi187.stdout: automake-1.16.1-7.el8.noarch 2023-10-16T19:56:27.588 INFO:teuthology.orchestra.run.smithi187.stdout: bison-3.0.4-10.el8.x86_64 2023-10-16T19:56:27.588 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T19:56:27.588 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-base-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T19:56:27.589 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-common-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T19:56:27.589 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-fuse-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T19:56:27.589 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-grafana-dashboards-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-16T19:56:27.589 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-immutable-object-cache-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T19:56:27.589 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-mds-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T19:56:27.590 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-mgr-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T19:56:27.590 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-mgr-cephadm-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-16T19:56:27.590 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-mgr-dashboard-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-16T19:56:27.590 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-mgr-diskprediction-local-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-16T19:56:27.590 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-mgr-modules-core-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-16T19:56:27.591 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-mgr-rook-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-16T19:56:27.591 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-mon-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T19:56:27.591 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-osd-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T19:56:27.591 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-prometheus-alerts-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-16T19:56:27.591 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-radosgw-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T19:56:27.592 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-selinux-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T19:56:27.592 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-test-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T19:56:27.592 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-volume-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-16T19:56:27.592 INFO:teuthology.orchestra.run.smithi187.stdout: cephadm-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-16T19:56:27.592 INFO:teuthology.orchestra.run.smithi187.stdout: cephfs-mirror-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T19:56:27.593 INFO:teuthology.orchestra.run.smithi187.stdout: cephfs-top-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-16T19:56:27.593 INFO:teuthology.orchestra.run.smithi187.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2023-10-16T19:56:27.593 INFO:teuthology.orchestra.run.smithi187.stdout: flex-2.6.1-9.el8.x86_64 2023-10-16T19:56:27.593 INFO:teuthology.orchestra.run.smithi187.stdout: fuse-2.9.7-15.el8.x86_64 2023-10-16T19:56:27.593 INFO:teuthology.orchestra.run.smithi187.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-10-16T19:56:27.593 INFO:teuthology.orchestra.run.smithi187.stdout: jq-1.6-3.el8.x86_64 2023-10-16T19:56:27.594 INFO:teuthology.orchestra.run.smithi187.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-10-16T19:56:27.594 INFO:teuthology.orchestra.run.smithi187.stdout: krb5-devel-1.18.2-14.el8.x86_64 2023-10-16T19:56:27.594 INFO:teuthology.orchestra.run.smithi187.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-10-16T19:56:27.594 INFO:teuthology.orchestra.run.smithi187.stdout: libcephfs-devel-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T19:56:27.595 INFO:teuthology.orchestra.run.smithi187.stdout: libcephfs2-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T19:56:27.595 INFO:teuthology.orchestra.run.smithi187.stdout: libcephsqlite-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T19:56:27.595 INFO:teuthology.orchestra.run.smithi187.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-10-16T19:56:27.595 INFO:teuthology.orchestra.run.smithi187.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2023-10-16T19:56:27.595 INFO:teuthology.orchestra.run.smithi187.stdout: liboath-2.6.2-3.el8.x86_64 2023-10-16T19:56:27.596 INFO:teuthology.orchestra.run.smithi187.stdout: libpq-13.5-1.el8.x86_64 2023-10-16T19:56:27.596 INFO:teuthology.orchestra.run.smithi187.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2023-10-16T19:56:27.596 INFO:teuthology.orchestra.run.smithi187.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-10-16T19:56:27.596 INFO:teuthology.orchestra.run.smithi187.stdout: librados-devel-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T19:56:27.596 INFO:teuthology.orchestra.run.smithi187.stdout: libradosstriper1-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T19:56:27.596 INFO:teuthology.orchestra.run.smithi187.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-10-16T19:56:27.597 INFO:teuthology.orchestra.run.smithi187.stdout: librgw2-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T19:56:27.597 INFO:teuthology.orchestra.run.smithi187.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-10-16T19:56:27.597 INFO:teuthology.orchestra.run.smithi187.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-10-16T19:56:27.597 INFO:teuthology.orchestra.run.smithi187.stdout: libtool-2.4.6-25.el8.x86_64 2023-10-16T19:56:27.597 INFO:teuthology.orchestra.run.smithi187.stdout: libunwind-1.3.1-3.el8.x86_64 2023-10-16T19:56:27.598 INFO:teuthology.orchestra.run.smithi187.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2023-10-16T19:56:27.598 INFO:teuthology.orchestra.run.smithi187.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-10-16T19:56:27.598 INFO:teuthology.orchestra.run.smithi187.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-10-16T19:56:27.598 INFO:teuthology.orchestra.run.smithi187.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-10-16T19:56:27.598 INFO:teuthology.orchestra.run.smithi187.stdout: openblas-0.3.15-3.el8.x86_64 2023-10-16T19:56:27.599 INFO:teuthology.orchestra.run.smithi187.stdout: openblas-threads-0.3.15-3.el8.x86_64 2023-10-16T19:56:27.599 INFO:teuthology.orchestra.run.smithi187.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2023-10-16T19:56:27.599 INFO:teuthology.orchestra.run.smithi187.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-10-16T19:56:27.599 INFO:teuthology.orchestra.run.smithi187.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-10-16T19:56:27.599 INFO:teuthology.orchestra.run.smithi187.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-10-16T19:56:27.600 INFO:teuthology.orchestra.run.smithi187.stdout: postgresql-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-10-16T19:56:27.600 INFO:teuthology.orchestra.run.smithi187.stdout: postgresql-contrib-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-10-16T19:56:27.600 INFO:teuthology.orchestra.run.smithi187.stdout: postgresql-server-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-10-16T19:56:27.600 INFO:teuthology.orchestra.run.smithi187.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-10-16T19:56:27.600 INFO:teuthology.orchestra.run.smithi187.stdout: python3-babel-2.5.1-7.el8.noarch 2023-10-16T19:56:27.601 INFO:teuthology.orchestra.run.smithi187.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-10-16T19:56:27.601 INFO:teuthology.orchestra.run.smithi187.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-10-16T19:56:27.601 INFO:teuthology.orchestra.run.smithi187.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-10-16T19:56:27.601 INFO:teuthology.orchestra.run.smithi187.stdout: python3-ceph-argparse-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T19:56:27.601 INFO:teuthology.orchestra.run.smithi187.stdout: python3-ceph-common-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T19:56:27.601 INFO:teuthology.orchestra.run.smithi187.stdout: python3-cephfs-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T19:56:27.602 INFO:teuthology.orchestra.run.smithi187.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-10-16T19:56:27.602 INFO:teuthology.orchestra.run.smithi187.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-10-16T19:56:27.602 INFO:teuthology.orchestra.run.smithi187.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-10-16T19:56:27.602 INFO:teuthology.orchestra.run.smithi187.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-10-16T19:56:27.602 INFO:teuthology.orchestra.run.smithi187.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-10-16T19:56:27.603 INFO:teuthology.orchestra.run.smithi187.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-10-16T19:56:27.603 INFO:teuthology.orchestra.run.smithi187.stdout: python3-jaraco-6.2-6.el8.noarch 2023-10-16T19:56:27.603 INFO:teuthology.orchestra.run.smithi187.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-10-16T19:56:27.603 INFO:teuthology.orchestra.run.smithi187.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-10-16T19:56:27.603 INFO:teuthology.orchestra.run.smithi187.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-10-16T19:56:27.604 INFO:teuthology.orchestra.run.smithi187.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-10-16T19:56:27.604 INFO:teuthology.orchestra.run.smithi187.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-10-16T19:56:27.604 INFO:teuthology.orchestra.run.smithi187.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-10-16T19:56:27.604 INFO:teuthology.orchestra.run.smithi187.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-10-16T19:56:27.604 INFO:teuthology.orchestra.run.smithi187.stdout: python3-mako-1.0.6-13.el8.noarch 2023-10-16T19:56:27.604 INFO:teuthology.orchestra.run.smithi187.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-10-16T19:56:27.605 INFO:teuthology.orchestra.run.smithi187.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-10-16T19:56:27.605 INFO:teuthology.orchestra.run.smithi187.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-10-16T19:56:27.605 INFO:teuthology.orchestra.run.smithi187.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-10-16T19:56:27.605 INFO:teuthology.orchestra.run.smithi187.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-10-16T19:56:27.605 INFO:teuthology.orchestra.run.smithi187.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-10-16T19:56:27.606 INFO:teuthology.orchestra.run.smithi187.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-10-16T19:56:27.606 INFO:teuthology.orchestra.run.smithi187.stdout: python3-portend-2.6-1.el8.noarch 2023-10-16T19:56:27.606 INFO:teuthology.orchestra.run.smithi187.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-10-16T19:56:27.606 INFO:teuthology.orchestra.run.smithi187.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-10-16T19:56:27.606 INFO:teuthology.orchestra.run.smithi187.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-10-16T19:56:27.607 INFO:teuthology.orchestra.run.smithi187.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-10-16T19:56:27.607 INFO:teuthology.orchestra.run.smithi187.stdout: python3-pycparser-2.14-14.el8.noarch 2023-10-16T19:56:27.607 INFO:teuthology.orchestra.run.smithi187.stdout: python3-pytz-2017.2-9.el8.noarch 2023-10-16T19:56:27.607 INFO:teuthology.orchestra.run.smithi187.stdout: python3-rados-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T19:56:27.607 INFO:teuthology.orchestra.run.smithi187.stdout: python3-rbd-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T19:56:27.608 INFO:teuthology.orchestra.run.smithi187.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-10-16T19:56:27.608 INFO:teuthology.orchestra.run.smithi187.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-10-16T19:56:27.608 INFO:teuthology.orchestra.run.smithi187.stdout: python3-rgw-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T19:56:27.608 INFO:teuthology.orchestra.run.smithi187.stdout: python3-routes-2.4.1-12.el8.noarch 2023-10-16T19:56:27.608 INFO:teuthology.orchestra.run.smithi187.stdout: python3-rsa-4.9-2.el8.noarch 2023-10-16T19:56:27.608 INFO:teuthology.orchestra.run.smithi187.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-10-16T19:56:27.609 INFO:teuthology.orchestra.run.smithi187.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-10-16T19:56:27.609 INFO:teuthology.orchestra.run.smithi187.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-10-16T19:56:27.609 INFO:teuthology.orchestra.run.smithi187.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-10-16T19:56:27.609 INFO:teuthology.orchestra.run.smithi187.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-10-16T19:56:27.609 INFO:teuthology.orchestra.run.smithi187.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-10-16T19:56:27.610 INFO:teuthology.orchestra.run.smithi187.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-10-16T19:56:27.610 INFO:teuthology.orchestra.run.smithi187.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-10-16T19:56:27.610 INFO:teuthology.orchestra.run.smithi187.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-10-16T19:56:27.610 INFO:teuthology.orchestra.run.smithi187.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-10-16T19:56:27.610 INFO:teuthology.orchestra.run.smithi187.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-10-16T19:56:27.611 INFO:teuthology.orchestra.run.smithi187.stdout: rbd-fuse-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T19:56:27.611 INFO:teuthology.orchestra.run.smithi187.stdout: rbd-mirror-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T19:56:27.611 INFO:teuthology.orchestra.run.smithi187.stdout: rbd-nbd-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T19:56:27.611 INFO:teuthology.orchestra.run.smithi187.stdout: socat-1.7.4.1-1.el8.x86_64 2023-10-16T19:56:27.611 INFO:teuthology.orchestra.run.smithi187.stdout: thrift-0.13.0-2.el8.x86_64 2023-10-16T19:56:27.612 INFO:teuthology.orchestra.run.smithi187.stdout: uuid-1.6.2-43.el8.x86_64 2023-10-16T19:56:27.612 INFO:teuthology.orchestra.run.smithi187.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-10-16T19:56:27.612 INFO:teuthology.orchestra.run.smithi187.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-10-16T19:56:27.612 INFO:teuthology.orchestra.run.smithi187.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-10-16T19:56:27.613 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-10-16T19:56:27.613 INFO:teuthology.orchestra.run.smithi187.stdout:Complete! 2023-10-16T19:56:27.655 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 128/134 2023-10-16T19:56:27.799 DEBUG:teuthology.parallel:result is None 2023-10-16T19:56:27.839 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : bison-3.0.4-10.el8.x86_64 129/134 2023-10-16T19:56:27.851 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 129/134 2023-10-16T19:56:28.022 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : NetworkManager-initscripts-updown-1:1.36.0-9.el8 130/134 2023-10-16T19:56:28.030 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.36.0-9.el8 130/134 2023-10-16T19:56:28.158 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 131/134 2023-10-16T19:56:28.158 INFO:teuthology.orchestra.run.smithi157.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-10-16T19:56:28.350 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-10-16T19:56:28.351 INFO:teuthology.orchestra.run.smithi157.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 133/134 2023-10-16T19:56:28.586 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 133/134 2023-10-16T19:56:28.754 INFO:teuthology.orchestra.run.smithi157.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 134/134 2023-10-16T19:56:29.293 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: iproute-5.15.0-4.el8.x86_64 134/134 2023-10-16T19:56:29.294 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-2:18.0.0-6730.g4ba8a190.el8.x86_64 1/134 2023-10-16T19:56:29.294 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-base-2:18.0.0-6730.g4ba8a190.el8.x86_64 2/134 2023-10-16T19:56:29.294 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-common-2:18.0.0-6730.g4ba8a190.el8.x86_64 3/134 2023-10-16T19:56:29.295 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-fuse-2:18.0.0-6730.g4ba8a190.el8.x86_64 4/134 2023-10-16T19:56:29.295 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-6730.g4ba8a 5/134 2023-10-16T19:56:29.295 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-mds-2:18.0.0-6730.g4ba8a190.el8.x86_64 6/134 2023-10-16T19:56:29.295 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-mgr-2:18.0.0-6730.g4ba8a190.el8.x86_64 7/134 2023-10-16T19:56:29.295 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-mon-2:18.0.0-6730.g4ba8a190.el8.x86_64 8/134 2023-10-16T19:56:29.296 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-osd-2:18.0.0-6730.g4ba8a190.el8.x86_64 9/134 2023-10-16T19:56:29.296 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-radosgw-2:18.0.0-6730.g4ba8a190.el8.x86_64 10/134 2023-10-16T19:56:29.296 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-selinux-2:18.0.0-6730.g4ba8a190.el8.x86_64 11/134 2023-10-16T19:56:29.296 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-test-2:18.0.0-6730.g4ba8a190.el8.x86_64 12/134 2023-10-16T19:56:29.298 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : cephfs-mirror-2:18.0.0-6730.g4ba8a190.el8.x86_64 13/134 2023-10-16T19:56:29.298 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : libcephfs-devel-2:18.0.0-6730.g4ba8a190.el8.x86_ 14/134 2023-10-16T19:56:29.298 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : libcephfs2-2:18.0.0-6730.g4ba8a190.el8.x86_64 15/134 2023-10-16T19:56:29.298 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : libcephsqlite-2:18.0.0-6730.g4ba8a190.el8.x86_64 16/134 2023-10-16T19:56:29.299 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : librados-devel-2:18.0.0-6730.g4ba8a190.el8.x86_6 17/134 2023-10-16T19:56:29.299 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : libradosstriper1-2:18.0.0-6730.g4ba8a190.el8.x86 18/134 2023-10-16T19:56:29.299 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : librgw2-2:18.0.0-6730.g4ba8a190.el8.x86_64 19/134 2023-10-16T19:56:29.299 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-ceph-argparse-2:18.0.0-6730.g4ba8a190.el 20/134 2023-10-16T19:56:29.299 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-ceph-common-2:18.0.0-6730.g4ba8a190.el8. 21/134 2023-10-16T19:56:29.299 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-cephfs-2:18.0.0-6730.g4ba8a190.el8.x86_6 22/134 2023-10-16T19:56:29.300 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-rados-2:18.0.0-6730.g4ba8a190.el8.x86_64 23/134 2023-10-16T19:56:29.300 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-rbd-2:18.0.0-6730.g4ba8a190.el8.x86_64 24/134 2023-10-16T19:56:29.300 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-rgw-2:18.0.0-6730.g4ba8a190.el8.x86_64 25/134 2023-10-16T19:56:29.300 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : rbd-fuse-2:18.0.0-6730.g4ba8a190.el8.x86_64 26/134 2023-10-16T19:56:29.300 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : rbd-mirror-2:18.0.0-6730.g4ba8a190.el8.x86_64 27/134 2023-10-16T19:56:29.301 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : rbd-nbd-2:18.0.0-6730.g4ba8a190.el8.x86_64 28/134 2023-10-16T19:56:29.301 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-6730.g4ba8a190. 29/134 2023-10-16T19:56:29.301 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-6730.g4ba8a190.el8.noa 30/134 2023-10-16T19:56:29.313 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-6730.g4ba8a190.el8.n 31/134 2023-10-16T19:56:29.313 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-6730.g4ba 32/134 2023-10-16T19:56:29.313 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-6730.g4ba8a190.el 33/134 2023-10-16T19:56:29.314 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-mgr-rook-2:18.0.0-6730.g4ba8a190.el8.noarch 34/134 2023-10-16T19:56:29.314 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-6730.g4ba8a190.e 35/134 2023-10-16T19:56:29.314 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-volume-2:18.0.0-6730.g4ba8a190.el8.noarch 36/134 2023-10-16T19:56:29.314 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : cephadm-2:18.0.0-6730.g4ba8a190.el8.noarch 37/134 2023-10-16T19:56:29.314 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : cephfs-top-2:18.0.0-6730.g4ba8a190.el8.noarch 38/134 2023-10-16T19:56:29.315 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/134 2023-10-16T19:56:29.315 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/134 2023-10-16T19:56:29.315 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/134 2023-10-16T19:56:29.315 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/134 2023-10-16T19:56:29.315 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/134 2023-10-16T19:56:29.316 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/134 2023-10-16T19:56:29.316 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/134 2023-10-16T19:56:29.316 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/134 2023-10-16T19:56:29.316 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/134 2023-10-16T19:56:29.316 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/134 2023-10-16T19:56:29.317 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/134 2023-10-16T19:56:29.317 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/134 2023-10-16T19:56:29.317 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/134 2023-10-16T19:56:29.317 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/134 2023-10-16T19:56:29.317 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/134 2023-10-16T19:56:29.318 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/134 2023-10-16T19:56:29.318 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/134 2023-10-16T19:56:29.318 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/134 2023-10-16T19:56:29.319 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/134 2023-10-16T19:56:29.319 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/134 2023-10-16T19:56:29.319 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/134 2023-10-16T19:56:29.319 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/134 2023-10-16T19:56:29.319 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/134 2023-10-16T19:56:29.320 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/134 2023-10-16T19:56:29.320 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/134 2023-10-16T19:56:29.320 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/134 2023-10-16T19:56:29.320 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/134 2023-10-16T19:56:29.320 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/134 2023-10-16T19:56:29.321 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/134 2023-10-16T19:56:29.321 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/134 2023-10-16T19:56:29.321 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/134 2023-10-16T19:56:29.321 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/134 2023-10-16T19:56:29.321 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/134 2023-10-16T19:56:29.322 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 72/134 2023-10-16T19:56:29.322 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 73/134 2023-10-16T19:56:29.322 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 74/134 2023-10-16T19:56:29.322 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 75/134 2023-10-16T19:56:29.322 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 76/134 2023-10-16T19:56:29.323 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 77/134 2023-10-16T19:56:29.323 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 78/134 2023-10-16T19:56:29.323 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 79/134 2023-10-16T19:56:29.323 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 80/134 2023-10-16T19:56:29.323 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 81/134 2023-10-16T19:56:29.324 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 82/134 2023-10-16T19:56:29.324 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 83/134 2023-10-16T19:56:29.324 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 84/134 2023-10-16T19:56:29.324 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 85/134 2023-10-16T19:56:29.324 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 86/134 2023-10-16T19:56:29.325 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 87/134 2023-10-16T19:56:29.325 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 88/134 2023-10-16T19:56:29.325 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 89/134 2023-10-16T19:56:29.325 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 90/134 2023-10-16T19:56:29.325 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 91/134 2023-10-16T19:56:29.326 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 92/134 2023-10-16T19:56:29.326 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 93/134 2023-10-16T19:56:29.326 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 94/134 2023-10-16T19:56:29.326 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 95/134 2023-10-16T19:56:29.326 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 96/134 2023-10-16T19:56:29.327 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : NetworkManager-initscripts-updown-1:1.36.0-9.el8 97/134 2023-10-16T19:56:29.327 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 98/134 2023-10-16T19:56:29.327 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 99/134 2023-10-16T19:56:29.327 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 100/134 2023-10-16T19:56:29.327 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 101/134 2023-10-16T19:56:29.328 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 102/134 2023-10-16T19:56:29.328 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 103/134 2023-10-16T19:56:29.328 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : bison-3.0.4-10.el8.x86_64 104/134 2023-10-16T19:56:29.328 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 105/134 2023-10-16T19:56:29.328 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 106/134 2023-10-16T19:56:29.329 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 107/134 2023-10-16T19:56:29.329 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : automake-1.16.1-7.el8.noarch 108/134 2023-10-16T19:56:29.329 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 109/134 2023-10-16T19:56:29.329 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 110/134 2023-10-16T19:56:29.330 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : flex-2.6.1-9.el8.x86_64 111/134 2023-10-16T19:56:29.330 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 112/134 2023-10-16T19:56:29.330 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 113/134 2023-10-16T19:56:29.330 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 114/134 2023-10-16T19:56:29.330 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 115/134 2023-10-16T19:56:29.331 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 116/134 2023-10-16T19:56:29.331 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 117/134 2023-10-16T19:56:29.331 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 118/134 2023-10-16T19:56:29.331 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 119/134 2023-10-16T19:56:29.331 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 120/134 2023-10-16T19:56:29.332 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 121/134 2023-10-16T19:56:29.332 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : libpq-13.5-1.el8.x86_64 122/134 2023-10-16T19:56:29.332 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 123/134 2023-10-16T19:56:29.332 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : jq-1.6-3.el8.x86_64 124/134 2023-10-16T19:56:29.332 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 125/134 2023-10-16T19:56:29.332 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : postgresql-server-10.21-2.module+el8.6.0+15342+5 126/134 2023-10-16T19:56:29.333 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 127/134 2023-10-16T19:56:29.333 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : postgresql-10.21-2.module+el8.6.0+15342+53518fac 128/134 2023-10-16T19:56:29.333 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : librados2-2:18.0.0-6730.g4ba8a190.el8.x86_64 129/134 2023-10-16T19:56:29.333 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/134 2023-10-16T19:56:29.333 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : librbd1-2:18.0.0-6730.g4ba8a190.el8.x86_64 131/134 2023-10-16T19:56:29.334 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-10-16T19:56:29.334 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : iproute-5.15.0-4.el8_6.1.x86_64 133/134 2023-10-16T19:56:31.978 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 134/134 2023-10-16T19:56:31.979 INFO:teuthology.orchestra.run.smithi157.stdout:Last metadata expiration check: 0:01:53 ago on Mon 16 Oct 2023 07:54:38 PM UTC. 2023-10-16T19:56:34.611 INFO:teuthology.orchestra.run.smithi157.stdout:Installed products updated. 2023-10-16T19:56:34.828 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-10-16T19:56:34.828 INFO:teuthology.orchestra.run.smithi157.stdout:Upgraded: 2023-10-16T19:56:34.828 INFO:teuthology.orchestra.run.smithi157.stdout: iproute-5.15.0-4.el8_6.1.x86_64 2023-10-16T19:56:34.829 INFO:teuthology.orchestra.run.smithi157.stdout: librados2-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T19:56:34.829 INFO:teuthology.orchestra.run.smithi157.stdout: librbd1-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T19:56:34.829 INFO:teuthology.orchestra.run.smithi157.stdout:Installed: 2023-10-16T19:56:34.829 INFO:teuthology.orchestra.run.smithi157.stdout: NetworkManager-initscripts-updown-1:1.36.0-9.el8_6.noarch 2023-10-16T19:56:34.829 INFO:teuthology.orchestra.run.smithi157.stdout: automake-1.16.1-7.el8.noarch 2023-10-16T19:56:34.830 INFO:teuthology.orchestra.run.smithi157.stdout: bison-3.0.4-10.el8.x86_64 2023-10-16T19:56:34.830 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T19:56:34.830 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-base-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T19:56:34.830 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-common-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T19:56:34.830 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-fuse-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T19:56:34.831 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-grafana-dashboards-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-16T19:56:34.831 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-immutable-object-cache-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T19:56:34.831 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mds-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T19:56:34.831 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T19:56:34.831 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr-cephadm-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-16T19:56:34.832 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr-dashboard-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-16T19:56:34.832 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr-diskprediction-local-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-16T19:56:34.832 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr-modules-core-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-16T19:56:34.832 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr-rook-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-16T19:56:34.832 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mon-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T19:56:34.833 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-osd-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T19:56:34.833 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-prometheus-alerts-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-16T19:56:34.833 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-radosgw-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T19:56:34.833 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-selinux-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T19:56:34.833 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-test-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T19:56:34.834 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-volume-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-16T19:56:34.834 INFO:teuthology.orchestra.run.smithi157.stdout: cephadm-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-16T19:56:34.834 INFO:teuthology.orchestra.run.smithi157.stdout: cephfs-mirror-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T19:56:34.834 INFO:teuthology.orchestra.run.smithi157.stdout: cephfs-top-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-16T19:56:34.834 INFO:teuthology.orchestra.run.smithi157.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2023-10-16T19:56:34.835 INFO:teuthology.orchestra.run.smithi157.stdout: flex-2.6.1-9.el8.x86_64 2023-10-16T19:56:34.835 INFO:teuthology.orchestra.run.smithi157.stdout: fuse-2.9.7-15.el8.x86_64 2023-10-16T19:56:34.835 INFO:teuthology.orchestra.run.smithi157.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-10-16T19:56:34.835 INFO:teuthology.orchestra.run.smithi157.stdout: jq-1.6-3.el8.x86_64 2023-10-16T19:56:34.835 INFO:teuthology.orchestra.run.smithi157.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-10-16T19:56:34.836 INFO:teuthology.orchestra.run.smithi157.stdout: krb5-devel-1.18.2-14.el8.x86_64 2023-10-16T19:56:34.836 INFO:teuthology.orchestra.run.smithi157.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-10-16T19:56:34.836 INFO:teuthology.orchestra.run.smithi157.stdout: libcephfs-devel-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T19:56:34.836 INFO:teuthology.orchestra.run.smithi157.stdout: libcephfs2-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T19:56:34.836 INFO:teuthology.orchestra.run.smithi157.stdout: libcephsqlite-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T19:56:34.837 INFO:teuthology.orchestra.run.smithi157.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-10-16T19:56:34.837 INFO:teuthology.orchestra.run.smithi157.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2023-10-16T19:56:34.837 INFO:teuthology.orchestra.run.smithi157.stdout: liboath-2.6.2-3.el8.x86_64 2023-10-16T19:56:34.837 INFO:teuthology.orchestra.run.smithi157.stdout: libpq-13.5-1.el8.x86_64 2023-10-16T19:56:34.837 INFO:teuthology.orchestra.run.smithi157.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2023-10-16T19:56:34.838 INFO:teuthology.orchestra.run.smithi157.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-10-16T19:56:34.838 INFO:teuthology.orchestra.run.smithi157.stdout: librados-devel-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T19:56:34.838 INFO:teuthology.orchestra.run.smithi157.stdout: libradosstriper1-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T19:56:34.838 INFO:teuthology.orchestra.run.smithi157.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-10-16T19:56:34.839 INFO:teuthology.orchestra.run.smithi157.stdout: librgw2-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T19:56:34.839 INFO:teuthology.orchestra.run.smithi157.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-10-16T19:56:34.839 INFO:teuthology.orchestra.run.smithi157.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-10-16T19:56:34.839 INFO:teuthology.orchestra.run.smithi157.stdout: libtool-2.4.6-25.el8.x86_64 2023-10-16T19:56:34.839 INFO:teuthology.orchestra.run.smithi157.stdout: libunwind-1.3.1-3.el8.x86_64 2023-10-16T19:56:34.840 INFO:teuthology.orchestra.run.smithi157.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2023-10-16T19:56:34.840 INFO:teuthology.orchestra.run.smithi157.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-10-16T19:56:34.840 INFO:teuthology.orchestra.run.smithi157.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-10-16T19:56:34.840 INFO:teuthology.orchestra.run.smithi157.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-10-16T19:56:34.840 INFO:teuthology.orchestra.run.smithi157.stdout: openblas-0.3.15-3.el8.x86_64 2023-10-16T19:56:34.841 INFO:teuthology.orchestra.run.smithi157.stdout: openblas-threads-0.3.15-3.el8.x86_64 2023-10-16T19:56:34.841 INFO:teuthology.orchestra.run.smithi157.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2023-10-16T19:56:34.841 INFO:teuthology.orchestra.run.smithi157.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-10-16T19:56:34.841 INFO:teuthology.orchestra.run.smithi157.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-10-16T19:56:34.841 INFO:teuthology.orchestra.run.smithi157.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-10-16T19:56:34.842 INFO:teuthology.orchestra.run.smithi157.stdout: postgresql-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-10-16T19:56:34.842 INFO:teuthology.orchestra.run.smithi157.stdout: postgresql-contrib-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-10-16T19:56:34.842 INFO:teuthology.orchestra.run.smithi157.stdout: postgresql-server-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-10-16T19:56:34.842 INFO:teuthology.orchestra.run.smithi157.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-10-16T19:56:34.842 INFO:teuthology.orchestra.run.smithi157.stdout: python3-babel-2.5.1-7.el8.noarch 2023-10-16T19:56:34.843 INFO:teuthology.orchestra.run.smithi157.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-10-16T19:56:34.843 INFO:teuthology.orchestra.run.smithi157.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-10-16T19:56:34.843 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-10-16T19:56:34.843 INFO:teuthology.orchestra.run.smithi157.stdout: python3-ceph-argparse-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T19:56:34.843 INFO:teuthology.orchestra.run.smithi157.stdout: python3-ceph-common-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T19:56:34.843 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cephfs-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T19:56:34.844 INFO:teuthology.orchestra.run.smithi157.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-10-16T19:56:34.844 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-10-16T19:56:34.844 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-10-16T19:56:34.844 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-10-16T19:56:34.844 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-10-16T19:56:34.845 INFO:teuthology.orchestra.run.smithi157.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-10-16T19:56:34.845 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jaraco-6.2-6.el8.noarch 2023-10-16T19:56:34.845 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-10-16T19:56:34.845 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-10-16T19:56:34.845 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-10-16T19:56:34.846 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-10-16T19:56:34.846 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-10-16T19:56:34.846 INFO:teuthology.orchestra.run.smithi157.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-10-16T19:56:34.846 INFO:teuthology.orchestra.run.smithi157.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-10-16T19:56:34.846 INFO:teuthology.orchestra.run.smithi157.stdout: python3-mako-1.0.6-13.el8.noarch 2023-10-16T19:56:34.846 INFO:teuthology.orchestra.run.smithi157.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-10-16T19:56:34.847 INFO:teuthology.orchestra.run.smithi157.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-10-16T19:56:34.847 INFO:teuthology.orchestra.run.smithi157.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-10-16T19:56:34.847 INFO:teuthology.orchestra.run.smithi157.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-10-16T19:56:34.847 INFO:teuthology.orchestra.run.smithi157.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-10-16T19:56:34.847 INFO:teuthology.orchestra.run.smithi157.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-10-16T19:56:34.848 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-10-16T19:56:34.848 INFO:teuthology.orchestra.run.smithi157.stdout: python3-portend-2.6-1.el8.noarch 2023-10-16T19:56:34.848 INFO:teuthology.orchestra.run.smithi157.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-10-16T19:56:34.848 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-10-16T19:56:34.848 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-10-16T19:56:34.849 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-10-16T19:56:34.849 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pycparser-2.14-14.el8.noarch 2023-10-16T19:56:34.849 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pytz-2017.2-9.el8.noarch 2023-10-16T19:56:34.849 INFO:teuthology.orchestra.run.smithi157.stdout: python3-rados-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T19:56:34.849 INFO:teuthology.orchestra.run.smithi157.stdout: python3-rbd-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T19:56:34.849 INFO:teuthology.orchestra.run.smithi157.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-10-16T19:56:34.850 INFO:teuthology.orchestra.run.smithi157.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-10-16T19:56:34.850 INFO:teuthology.orchestra.run.smithi157.stdout: python3-rgw-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T19:56:34.850 INFO:teuthology.orchestra.run.smithi157.stdout: python3-routes-2.4.1-12.el8.noarch 2023-10-16T19:56:34.850 INFO:teuthology.orchestra.run.smithi157.stdout: python3-rsa-4.9-2.el8.noarch 2023-10-16T19:56:34.850 INFO:teuthology.orchestra.run.smithi157.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-10-16T19:56:34.851 INFO:teuthology.orchestra.run.smithi157.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-10-16T19:56:34.851 INFO:teuthology.orchestra.run.smithi157.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-10-16T19:56:34.851 INFO:teuthology.orchestra.run.smithi157.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-10-16T19:56:34.851 INFO:teuthology.orchestra.run.smithi157.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-10-16T19:56:34.851 INFO:teuthology.orchestra.run.smithi157.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-10-16T19:56:34.852 INFO:teuthology.orchestra.run.smithi157.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-10-16T19:56:34.852 INFO:teuthology.orchestra.run.smithi157.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-10-16T19:56:34.852 INFO:teuthology.orchestra.run.smithi157.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-10-16T19:56:34.852 INFO:teuthology.orchestra.run.smithi157.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-10-16T19:56:34.852 INFO:teuthology.orchestra.run.smithi157.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-10-16T19:56:34.852 INFO:teuthology.orchestra.run.smithi157.stdout: rbd-fuse-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T19:56:34.853 INFO:teuthology.orchestra.run.smithi157.stdout: rbd-mirror-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T19:56:34.853 INFO:teuthology.orchestra.run.smithi157.stdout: rbd-nbd-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T19:56:34.853 INFO:teuthology.orchestra.run.smithi157.stdout: socat-1.7.4.1-1.el8.x86_64 2023-10-16T19:56:34.853 INFO:teuthology.orchestra.run.smithi157.stdout: thrift-0.13.0-2.el8.x86_64 2023-10-16T19:56:34.853 INFO:teuthology.orchestra.run.smithi157.stdout: uuid-1.6.2-43.el8.x86_64 2023-10-16T19:56:34.854 INFO:teuthology.orchestra.run.smithi157.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-10-16T19:56:34.854 INFO:teuthology.orchestra.run.smithi157.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-10-16T19:56:34.854 INFO:teuthology.orchestra.run.smithi157.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-10-16T19:56:34.855 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-10-16T19:56:34.855 INFO:teuthology.orchestra.run.smithi157.stdout:Complete! 2023-10-16T19:56:35.047 DEBUG:teuthology.parallel:result is None 2023-10-16T19:56:35.048 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 2023-10-16T19:56:35.279 DEBUG:teuthology.orchestra.run.smithi157:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-10-16T19:56:35.303 INFO:teuthology.orchestra.run.smithi157.stdout:18.0.0-6730.g4ba8a190.el8 2023-10-16T19:56:35.304 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-6730.g4ba8a190.el8 2023-10-16T19:56:35.304 INFO:teuthology.task.install:The correct ceph version 18.0.0-6730.g4ba8a190 is installed. 2023-10-16T19:56:35.305 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 2023-10-16T19:56:35.451 DEBUG:teuthology.orchestra.run.smithi187:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-10-16T19:56:35.479 INFO:teuthology.orchestra.run.smithi187.stdout:18.0.0-6730.g4ba8a190.el8 2023-10-16T19:56:35.480 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-6730.g4ba8a190.el8 2023-10-16T19:56:35.480 INFO:teuthology.task.install:The correct ceph version 18.0.0-6730.g4ba8a190 is installed. 2023-10-16T19:56:35.481 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-10-16T19:56:35.481 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2023-10-16T19:56:35.482 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-16T19:56:35.523 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-10-16T19:56:35.524 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-16T19:56:35.573 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-10-16T19:56:35.574 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2023-10-16T19:56:35.574 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd of=/usr/bin/daemon-helper 2023-10-16T19:56:35.601 DEBUG:teuthology.orchestra.run.smithi157:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-16T19:56:35.668 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-10-16T19:56:35.668 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd of=/usr/bin/daemon-helper 2023-10-16T19:56:35.701 DEBUG:teuthology.orchestra.run.smithi187:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-16T19:56:35.772 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-10-16T19:56:35.773 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2023-10-16T19:56:35.773 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-16T19:56:35.799 DEBUG:teuthology.orchestra.run.smithi157:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-16T19:56:35.866 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-10-16T19:56:35.867 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-16T19:56:35.895 DEBUG:teuthology.orchestra.run.smithi187:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-16T19:56:35.963 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-10-16T19:56:35.963 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2023-10-16T19:56:35.964 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd of=/usr/bin/stdin-killer 2023-10-16T19:56:35.989 DEBUG:teuthology.orchestra.run.smithi157:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-16T19:56:36.056 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-10-16T19:56:36.056 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd of=/usr/bin/stdin-killer 2023-10-16T19:56:36.083 DEBUG:teuthology.orchestra.run.smithi187:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-16T19:56:36.152 INFO:teuthology.run_tasks:Running task ceph... 2023-10-16T19:56:36.245 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-10-16T19:56:36.246 DEBUG:teuthology.orchestra.run.smithi157:> sudo chmod 777 /var/log/ceph 2023-10-16T19:56:36.249 DEBUG:teuthology.orchestra.run.smithi187:> sudo chmod 777 /var/log/ceph 2023-10-16T19:56:36.277 INFO:tasks.ceph:Disabling ceph logrotate... 2023-10-16T19:56:36.277 DEBUG:teuthology.orchestra.run.smithi157:> sudo rm -f -- /etc/logrotate.d/ceph 2023-10-16T19:56:36.316 DEBUG:teuthology.orchestra.run.smithi187:> sudo rm -f -- /etc/logrotate.d/ceph 2023-10-16T19:56:36.344 INFO:tasks.ceph:Creating extra log directories... 2023-10-16T19:56:36.345 DEBUG:teuthology.orchestra.run.smithi157:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-10-16T19:56:36.382 DEBUG:teuthology.orchestra.run.smithi187:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-10-16T19:56:36.419 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-10-16T19:56:36.420 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-10-16T19:56:36.420 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-10-16T19:56:36.420 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2023-10-16T19:56:36.421 DEBUG:teuthology.orchestra.run.smithi157:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-10-16T19:56:36.464 DEBUG:teuthology.orchestra.run.smithi157:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-10-16T19:56:36.675 DEBUG:teuthology.orchestra.run.smithi157:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-10-16T19:56:36.702 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-10-16T19:56:36.702 DEBUG:teuthology.orchestra.run.smithi187:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-10-16T19:56:36.723 DEBUG:teuthology.orchestra.run.smithi187:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-10-16T19:56:36.874 DEBUG:teuthology.orchestra.run.smithi187:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-10-16T19:56:36.909 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-10-16T19:56:36.910 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'client.0': {'debug client': 20, 'debug objectcacher': 20, 'debug objecter': 20}, 'client.1': {'debug client': 20, 'debug objectcacher': 20, 'debug objecter': 20}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon osd backfillfull ratio': 0.6, 'mon osd full ratio': 0.7, 'mon osd nearfull ratio': 0.6}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'memstore device bytes': 200000000, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 1.0, 'osd mon report interval': 5, 'osd objectstore': 'memstore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL', 'PG_RECOVERY_FULL', 'PG_DEGRADED'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-10-16T19:56:36.910 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/rishabh-2023-10-16_18:49:15-fs-rishabh-2023oct13-testing-default-smithi/7430083', 'branch': 'rishabh-2023oct13', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/mds-full}', 'email': None, 'first_in_suite': False, 'job_id': '7430083', 'kernel': {'client': {'sha1': 'distro'}, 'flavor': 'default', 'kdb': True, 'sha1': '47672119149b103ec7cec2cc65c063ccbb001ac7'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'rishabh-2023-10-16_18:49:15-fs-rishabh-2023oct13-testing-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'rhel', 'os_version': '8.6', 'overrides': {'admin_socket': {'branch': 'rishabh-2023oct13'}, 'ceph': {'cephfs': {'ec_profile': ['disabled']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'client.0': {'debug client': 20, 'debug objectcacher': 20, 'debug objecter': 20}, 'client.1': {'debug client': 20, 'debug objectcacher': 20, 'debug objecter': 20}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon osd backfillfull ratio': 0.6, 'mon osd full ratio': 0.7, 'mon osd nearfull ratio': 0.6}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'memstore device bytes': 200000000, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 1.0, 'osd mon report interval': 5, 'osd objectstore': 'memstore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL', 'PG_RECOVERY_FULL', 'PG_DEGRADED'], 'sha1': '4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0'}}, 'kclient': {'syntax': 'v2'}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'rishabh-2023oct13-qa2', 'sha1': '19fd96fe3581520b6d9f50ffdabf29051aee5d4d'}}, 'owner': 'scheduled_rishabh@teuthology', 'priority': 50, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 6006, 'sha1': '4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0', 'sleep_before_teardown': 0, 'subset': '402/512', 'suite': 'fs', 'suite_branch': 'rishabh-2023oct13-qa2', 'suite_path': '/home/teuthworker/src/github.com_rishabh-d-dave_ceph_19fd96fe3581520b6d9f50ffdabf29051aee5d4d/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/rishabh-d-dave/ceph', 'suite_sha1': '19fd96fe3581520b6d9f50ffdabf29051aee5d4d', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi157.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs=', 'smithi187.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'sha1': 'distro'}, 'flavor': 'default', 'kdb': True, 'sha1': '47672119149b103ec7cec2cc65c063ccbb001ac7'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['disabled']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'client.0': {'debug client': 20, 'debug objectcacher': 20, 'debug objecter': 20}, 'client.1': {'debug client': 20, 'debug objectcacher': 20, 'debug objecter': 20}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon osd backfillfull ratio': 0.6, 'mon osd full ratio': 0.7, 'mon osd nearfull ratio': 0.6}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'memstore device bytes': 200000000, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 1.0, 'osd mon report interval': 5, 'osd objectstore': 'memstore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL', 'PG_RECOVERY_FULL', 'PG_DEGRADED'], 'sha1': '4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0', 'cluster': 'ceph'}}, {'kclient': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_full']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '8cdab074dcca9a68965bc5a50e9c30b691949723', 'timestamp': '2023-10-16_18:49:15', 'tube': 'smithi', 'user': 'rishabh', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2830'} 2023-10-16T19:56:36.911 DEBUG:teuthology.orchestra.run.smithi157:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-10-16T19:56:36.914 DEBUG:teuthology.orchestra.run.smithi187:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-10-16T19:56:36.963 DEBUG:teuthology.orchestra.run.smithi157:> sudo install -d -m0777 -- /var/run/ceph 2023-10-16T19:56:36.971 DEBUG:teuthology.orchestra.run.smithi187:> sudo install -d -m0777 -- /var/run/ceph 2023-10-16T19:56:37.031 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2023-10-16T19:56:37.032 DEBUG:teuthology.orchestra.run.smithi157:> dd if=/scratch_devs of=/dev/stdout 2023-10-16T19:56:37.054 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-16T19:56:37.054 DEBUG:teuthology.orchestra.run.smithi157:> stat /dev/vg_nvme/lv_1 2023-10-16T19:56:37.112 INFO:teuthology.orchestra.run.smithi157.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-16T19:56:37.112 INFO:teuthology.orchestra.run.smithi157.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-16T19:56:37.113 INFO:teuthology.orchestra.run.smithi157.stdout:Device: 6h/6d Inode: 389790 Links: 1 2023-10-16T19:56:37.113 INFO:teuthology.orchestra.run.smithi157.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-16T19:56:37.113 INFO:teuthology.orchestra.run.smithi157.stdout:Context: system_u:object_r:device_t:s0 2023-10-16T19:56:37.113 INFO:teuthology.orchestra.run.smithi157.stdout:Access: 2023-10-16 19:56:28.993364394 +0000 2023-10-16T19:56:37.113 INFO:teuthology.orchestra.run.smithi157.stdout:Modify: 2023-10-16 19:53:50.862649586 +0000 2023-10-16T19:56:37.114 INFO:teuthology.orchestra.run.smithi157.stdout:Change: 2023-10-16 19:53:50.862649586 +0000 2023-10-16T19:56:37.114 INFO:teuthology.orchestra.run.smithi157.stdout: Birth: - 2023-10-16T19:56:37.114 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-16T19:56:37.177 INFO:teuthology.orchestra.run.smithi157.stderr:1+0 records in 2023-10-16T19:56:37.178 INFO:teuthology.orchestra.run.smithi157.stderr:1+0 records out 2023-10-16T19:56:37.178 INFO:teuthology.orchestra.run.smithi157.stderr:512 bytes copied, 0.000136119 s, 3.8 MB/s 2023-10-16T19:56:37.179 DEBUG:teuthology.orchestra.run.smithi157:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-16T19:56:37.237 DEBUG:teuthology.orchestra.run.smithi157:> stat /dev/vg_nvme/lv_2 2023-10-16T19:56:37.294 INFO:teuthology.orchestra.run.smithi157.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-16T19:56:37.295 INFO:teuthology.orchestra.run.smithi157.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-16T19:56:37.295 INFO:teuthology.orchestra.run.smithi157.stdout:Device: 6h/6d Inode: 394398 Links: 1 2023-10-16T19:56:37.295 INFO:teuthology.orchestra.run.smithi157.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-16T19:56:37.295 INFO:teuthology.orchestra.run.smithi157.stdout:Context: system_u:object_r:device_t:s0 2023-10-16T19:56:37.296 INFO:teuthology.orchestra.run.smithi157.stdout:Access: 2023-10-16 19:56:28.994364375 +0000 2023-10-16T19:56:37.296 INFO:teuthology.orchestra.run.smithi157.stdout:Modify: 2023-10-16 19:53:51.361640490 +0000 2023-10-16T19:56:37.296 INFO:teuthology.orchestra.run.smithi157.stdout:Change: 2023-10-16 19:53:51.361640490 +0000 2023-10-16T19:56:37.296 INFO:teuthology.orchestra.run.smithi157.stdout: Birth: - 2023-10-16T19:56:37.296 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-16T19:56:37.360 INFO:teuthology.orchestra.run.smithi157.stderr:1+0 records in 2023-10-16T19:56:37.360 INFO:teuthology.orchestra.run.smithi157.stderr:1+0 records out 2023-10-16T19:56:37.360 INFO:teuthology.orchestra.run.smithi157.stderr:512 bytes copied, 0.000110036 s, 4.7 MB/s 2023-10-16T19:56:37.361 DEBUG:teuthology.orchestra.run.smithi157:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-16T19:56:37.419 DEBUG:teuthology.orchestra.run.smithi157:> stat /dev/vg_nvme/lv_3 2023-10-16T19:56:37.476 INFO:teuthology.orchestra.run.smithi157.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-16T19:56:37.476 INFO:teuthology.orchestra.run.smithi157.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-16T19:56:37.476 INFO:teuthology.orchestra.run.smithi157.stdout:Device: 6h/6d Inode: 389935 Links: 1 2023-10-16T19:56:37.476 INFO:teuthology.orchestra.run.smithi157.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-16T19:56:37.477 INFO:teuthology.orchestra.run.smithi157.stdout:Context: system_u:object_r:device_t:s0 2023-10-16T19:56:37.477 INFO:teuthology.orchestra.run.smithi157.stdout:Access: 2023-10-16 19:56:28.994364375 +0000 2023-10-16T19:56:37.477 INFO:teuthology.orchestra.run.smithi157.stdout:Modify: 2023-10-16 19:53:51.889630866 +0000 2023-10-16T19:56:37.477 INFO:teuthology.orchestra.run.smithi157.stdout:Change: 2023-10-16 19:53:51.889630866 +0000 2023-10-16T19:56:37.477 INFO:teuthology.orchestra.run.smithi157.stdout: Birth: - 2023-10-16T19:56:37.478 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-16T19:56:37.540 INFO:teuthology.orchestra.run.smithi157.stderr:1+0 records in 2023-10-16T19:56:37.540 INFO:teuthology.orchestra.run.smithi157.stderr:1+0 records out 2023-10-16T19:56:37.541 INFO:teuthology.orchestra.run.smithi157.stderr:512 bytes copied, 0.000116616 s, 4.4 MB/s 2023-10-16T19:56:37.541 DEBUG:teuthology.orchestra.run.smithi157:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-16T19:56:37.599 DEBUG:teuthology.orchestra.run.smithi157:> stat /dev/vg_nvme/lv_4 2023-10-16T19:56:37.657 INFO:teuthology.orchestra.run.smithi157.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-16T19:56:37.657 INFO:teuthology.orchestra.run.smithi157.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-16T19:56:37.657 INFO:teuthology.orchestra.run.smithi157.stdout:Device: 6h/6d Inode: 390000 Links: 1 2023-10-16T19:56:37.657 INFO:teuthology.orchestra.run.smithi157.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-16T19:56:37.658 INFO:teuthology.orchestra.run.smithi157.stdout:Context: system_u:object_r:device_t:s0 2023-10-16T19:56:37.658 INFO:teuthology.orchestra.run.smithi157.stdout:Access: 2023-10-16 19:56:28.994364375 +0000 2023-10-16T19:56:37.658 INFO:teuthology.orchestra.run.smithi157.stdout:Modify: 2023-10-16 19:53:52.405621460 +0000 2023-10-16T19:56:37.658 INFO:teuthology.orchestra.run.smithi157.stdout:Change: 2023-10-16 19:53:52.405621460 +0000 2023-10-16T19:56:37.658 INFO:teuthology.orchestra.run.smithi157.stdout: Birth: - 2023-10-16T19:56:37.659 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-16T19:56:37.722 INFO:teuthology.orchestra.run.smithi157.stderr:1+0 records in 2023-10-16T19:56:37.722 INFO:teuthology.orchestra.run.smithi157.stderr:1+0 records out 2023-10-16T19:56:37.723 INFO:teuthology.orchestra.run.smithi157.stderr:512 bytes copied, 0.000132642 s, 3.9 MB/s 2023-10-16T19:56:37.724 DEBUG:teuthology.orchestra.run.smithi157:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-16T19:56:37.782 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-16T19:56:37.782 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-10-16T19:56:37.783 DEBUG:teuthology.orchestra.run.smithi187:> dd if=/scratch_devs of=/dev/stdout 2023-10-16T19:56:37.803 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-16T19:56:37.803 DEBUG:teuthology.orchestra.run.smithi187:> stat /dev/vg_nvme/lv_1 2023-10-16T19:56:37.863 INFO:teuthology.orchestra.run.smithi187.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-16T19:56:37.863 INFO:teuthology.orchestra.run.smithi187.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-16T19:56:37.864 INFO:teuthology.orchestra.run.smithi187.stdout:Device: 6h/6d Inode: 392702 Links: 1 2023-10-16T19:56:37.864 INFO:teuthology.orchestra.run.smithi187.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-16T19:56:37.864 INFO:teuthology.orchestra.run.smithi187.stdout:Context: system_u:object_r:device_t:s0 2023-10-16T19:56:37.864 INFO:teuthology.orchestra.run.smithi187.stdout:Access: 2023-10-16 19:56:21.725774674 +0000 2023-10-16T19:56:37.864 INFO:teuthology.orchestra.run.smithi187.stdout:Modify: 2023-10-16 19:53:50.942998275 +0000 2023-10-16T19:56:37.865 INFO:teuthology.orchestra.run.smithi187.stdout:Change: 2023-10-16 19:53:50.942998275 +0000 2023-10-16T19:56:37.865 INFO:teuthology.orchestra.run.smithi187.stdout: Birth: - 2023-10-16T19:56:37.865 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-16T19:56:37.933 INFO:teuthology.orchestra.run.smithi187.stderr:1+0 records in 2023-10-16T19:56:37.933 INFO:teuthology.orchestra.run.smithi187.stderr:1+0 records out 2023-10-16T19:56:37.933 INFO:teuthology.orchestra.run.smithi187.stderr:512 bytes copied, 0.00027434 s, 1.9 MB/s 2023-10-16T19:56:37.934 DEBUG:teuthology.orchestra.run.smithi187:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-16T19:56:37.995 DEBUG:teuthology.orchestra.run.smithi187:> stat /dev/vg_nvme/lv_2 2023-10-16T19:56:38.054 INFO:teuthology.orchestra.run.smithi187.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-16T19:56:38.054 INFO:teuthology.orchestra.run.smithi187.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-16T19:56:38.054 INFO:teuthology.orchestra.run.smithi187.stdout:Device: 6h/6d Inode: 388377 Links: 1 2023-10-16T19:56:38.054 INFO:teuthology.orchestra.run.smithi187.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-16T19:56:38.055 INFO:teuthology.orchestra.run.smithi187.stdout:Context: system_u:object_r:device_t:s0 2023-10-16T19:56:38.055 INFO:teuthology.orchestra.run.smithi187.stdout:Access: 2023-10-16 19:56:21.725774674 +0000 2023-10-16T19:56:38.055 INFO:teuthology.orchestra.run.smithi187.stdout:Modify: 2023-10-16 19:53:51.469989856 +0000 2023-10-16T19:56:38.055 INFO:teuthology.orchestra.run.smithi187.stdout:Change: 2023-10-16 19:53:51.469989856 +0000 2023-10-16T19:56:38.056 INFO:teuthology.orchestra.run.smithi187.stdout: Birth: - 2023-10-16T19:56:38.056 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-16T19:56:38.122 INFO:teuthology.orchestra.run.smithi187.stderr:1+0 records in 2023-10-16T19:56:38.122 INFO:teuthology.orchestra.run.smithi187.stderr:1+0 records out 2023-10-16T19:56:38.123 INFO:teuthology.orchestra.run.smithi187.stderr:512 bytes copied, 0.000317057 s, 1.6 MB/s 2023-10-16T19:56:38.124 DEBUG:teuthology.orchestra.run.smithi187:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-16T19:56:38.184 DEBUG:teuthology.orchestra.run.smithi187:> stat /dev/vg_nvme/lv_3 2023-10-16T19:56:38.243 INFO:teuthology.orchestra.run.smithi187.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-16T19:56:38.244 INFO:teuthology.orchestra.run.smithi187.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-16T19:56:38.244 INFO:teuthology.orchestra.run.smithi187.stdout:Device: 6h/6d Inode: 395496 Links: 1 2023-10-16T19:56:38.244 INFO:teuthology.orchestra.run.smithi187.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-16T19:56:38.244 INFO:teuthology.orchestra.run.smithi187.stdout:Context: system_u:object_r:device_t:s0 2023-10-16T19:56:38.244 INFO:teuthology.orchestra.run.smithi187.stdout:Access: 2023-10-16 19:56:21.725774674 +0000 2023-10-16T19:56:38.245 INFO:teuthology.orchestra.run.smithi187.stdout:Modify: 2023-10-16 19:53:52.004981309 +0000 2023-10-16T19:56:38.245 INFO:teuthology.orchestra.run.smithi187.stdout:Change: 2023-10-16 19:53:52.004981309 +0000 2023-10-16T19:56:38.245 INFO:teuthology.orchestra.run.smithi187.stdout: Birth: - 2023-10-16T19:56:38.245 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-16T19:56:38.311 INFO:teuthology.orchestra.run.smithi187.stderr:1+0 records in 2023-10-16T19:56:38.312 INFO:teuthology.orchestra.run.smithi187.stderr:1+0 records out 2023-10-16T19:56:38.312 INFO:teuthology.orchestra.run.smithi187.stderr:512 bytes copied, 0.000255677 s, 2.0 MB/s 2023-10-16T19:56:38.313 DEBUG:teuthology.orchestra.run.smithi187:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-16T19:56:38.374 DEBUG:teuthology.orchestra.run.smithi187:> stat /dev/vg_nvme/lv_4 2023-10-16T19:56:38.433 INFO:teuthology.orchestra.run.smithi187.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-16T19:56:38.433 INFO:teuthology.orchestra.run.smithi187.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-16T19:56:38.433 INFO:teuthology.orchestra.run.smithi187.stdout:Device: 6h/6d Inode: 393468 Links: 1 2023-10-16T19:56:38.433 INFO:teuthology.orchestra.run.smithi187.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-16T19:56:38.434 INFO:teuthology.orchestra.run.smithi187.stdout:Context: system_u:object_r:device_t:s0 2023-10-16T19:56:38.434 INFO:teuthology.orchestra.run.smithi187.stdout:Access: 2023-10-16 19:56:21.725774674 +0000 2023-10-16T19:56:38.434 INFO:teuthology.orchestra.run.smithi187.stdout:Modify: 2023-10-16 19:53:52.523973019 +0000 2023-10-16T19:56:38.434 INFO:teuthology.orchestra.run.smithi187.stdout:Change: 2023-10-16 19:53:52.523973019 +0000 2023-10-16T19:56:38.434 INFO:teuthology.orchestra.run.smithi187.stdout: Birth: - 2023-10-16T19:56:38.435 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-16T19:56:38.500 INFO:teuthology.orchestra.run.smithi187.stderr:1+0 records in 2023-10-16T19:56:38.501 INFO:teuthology.orchestra.run.smithi187.stderr:1+0 records out 2023-10-16T19:56:38.501 INFO:teuthology.orchestra.run.smithi187.stderr:512 bytes copied, 0.000191962 s, 2.7 MB/s 2023-10-16T19:56:38.502 DEBUG:teuthology.orchestra.run.smithi187:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-16T19:56:38.561 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-16T19:56:38.561 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi157.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi187.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-10-16T19:56:38.562 INFO:tasks.ceph:Generating config... 2023-10-16T19:56:38.564 INFO:tasks.ceph:[client] client mount timeout = 600 2023-10-16T19:56:38.564 INFO:tasks.ceph:[client] debug client = 20 2023-10-16T19:56:38.565 INFO:tasks.ceph:[client] debug ms = 1 2023-10-16T19:56:38.565 INFO:tasks.ceph:[client] pid file = 2023-10-16T19:56:38.565 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-10-16T19:56:38.565 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-10-16T19:56:38.566 INFO:tasks.ceph:[client.0] debug client = 20 2023-10-16T19:56:38.566 INFO:tasks.ceph:[client.0] debug objectcacher = 20 2023-10-16T19:56:38.567 INFO:tasks.ceph:[client.0] debug objecter = 20 2023-10-16T19:56:38.567 INFO:tasks.ceph:[client.1] debug client = 20 2023-10-16T19:56:38.568 INFO:tasks.ceph:[client.1] debug objectcacher = 20 2023-10-16T19:56:38.568 INFO:tasks.ceph:[client.1] debug objecter = 20 2023-10-16T19:56:38.569 INFO:tasks.ceph:[global] ms die on skipped message = False 2023-10-16T19:56:38.569 INFO:tasks.ceph:[mds] debug mds = 20 2023-10-16T19:56:38.569 INFO:tasks.ceph:[mds] debug mds balancer = 20 2023-10-16T19:56:38.569 INFO:tasks.ceph:[mds] debug ms = 1 2023-10-16T19:56:38.570 INFO:tasks.ceph:[mds] mds debug frag = True 2023-10-16T19:56:38.570 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-10-16T19:56:38.570 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-10-16T19:56:38.570 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-10-16T19:56:38.571 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-10-16T19:56:38.571 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-10-16T19:56:38.571 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-10-16T19:56:38.571 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-10-16T19:56:38.572 INFO:tasks.ceph:[mgr] debug ms = 1 2023-10-16T19:56:38.572 INFO:tasks.ceph:[mon] debug mon = 20 2023-10-16T19:56:38.572 INFO:tasks.ceph:[mon] debug ms = 1 2023-10-16T19:56:38.572 INFO:tasks.ceph:[mon] debug paxos = 20 2023-10-16T19:56:38.573 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-10-16T19:56:38.573 INFO:tasks.ceph:[mon] mon osd backfillfull ratio = 0.6 2023-10-16T19:56:38.574 INFO:tasks.ceph:[mon] mon osd full ratio = 0.7 2023-10-16T19:56:38.574 INFO:tasks.ceph:[mon] mon osd nearfull ratio = 0.6 2023-10-16T19:56:38.574 INFO:tasks.ceph:[osd] bdev async discard = True 2023-10-16T19:56:38.575 INFO:tasks.ceph:[osd] bdev enable discard = True 2023-10-16T19:56:38.575 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2023-10-16T19:56:38.575 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-10-16T19:56:38.577 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-10-16T19:56:38.577 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2023-10-16T19:56:38.577 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2023-10-16T19:56:38.578 INFO:tasks.ceph:[osd] debug ms = 1 2023-10-16T19:56:38.578 INFO:tasks.ceph:[osd] debug osd = 20 2023-10-16T19:56:38.578 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2023-10-16T19:56:38.579 INFO:tasks.ceph:[osd] memstore device bytes = 200000000 2023-10-16T19:56:38.579 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-10-16T19:56:38.579 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-10-16T19:56:38.580 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-10-16T19:56:38.580 INFO:tasks.ceph:[osd] osd failsafe full ratio = 1.0 2023-10-16T19:56:38.580 INFO:tasks.ceph:[osd] osd mon report interval = 5 2023-10-16T19:56:38.580 INFO:tasks.ceph:[osd] osd objectstore = memstore 2023-10-16T19:56:38.581 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-10-16T19:56:38.581 INFO:tasks.ceph:Setting up mon.a... 2023-10-16T19:56:38.581 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-10-16T19:56:38.635 INFO:teuthology.orchestra.run.smithi157.stdout:creating /etc/ceph/ceph.keyring 2023-10-16T19:56:38.638 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-10-16T19:56:38.684 DEBUG:teuthology.orchestra.run.smithi157:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-16T19:56:38.711 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.157'), ('mon.b', '172.21.15.187'), ('mon.c', '[v2:172.21.15.187:3301,v1:172.21.15.187:6790]')] 2023-10-16T19:56:38.712 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.157,172.21.15.187,[v2:172.21.15.187:3301,v1:172.21.15.187:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'memstore device bytes': 200000000, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 1.0, 'osd mon report interval': 5, 'osd objectstore': 'memstore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120, 'mon osd backfillfull ratio': 0.6, 'mon osd full ratio': 0.7, 'mon osd nearfull ratio': 0.6}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'client.0': {'debug client': 20, 'debug objectcacher': 20, 'debug objecter': 20}, 'client.1': {'debug client': 20, 'debug objectcacher': 20, 'debug objecter': 20}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-10-16T19:56:38.713 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2023-10-16T19:56:38.713 DEBUG:teuthology.orchestra.run.smithi157:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-10-16T19:56:38.769 DEBUG:teuthology.orchestra.run.smithi157:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.157 --add b 172.21.15.187 --addv c '[v2:172.21.15.187:3301,v1:172.21.15.187:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-10-16T19:56:38.857 INFO:teuthology.orchestra.run.smithi157.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-10-16T19:56:38.857 INFO:teuthology.orchestra.run.smithi157.stdout:monmaptool: generated fsid 28199dc9-64d5-479e-83c6-21f097c33d39 2023-10-16T19:56:38.858 INFO:teuthology.orchestra.run.smithi157.stdout:setting min_mon_release = pacific 2023-10-16T19:56:38.858 INFO:teuthology.orchestra.run.smithi157.stdout:epoch 0 2023-10-16T19:56:38.858 INFO:teuthology.orchestra.run.smithi157.stdout:fsid 28199dc9-64d5-479e-83c6-21f097c33d39 2023-10-16T19:56:38.858 INFO:teuthology.orchestra.run.smithi157.stdout:last_changed 2023-10-16T19:56:38.855961+0000 2023-10-16T19:56:38.858 INFO:teuthology.orchestra.run.smithi157.stdout:created 2023-10-16T19:56:38.855961+0000 2023-10-16T19:56:38.859 INFO:teuthology.orchestra.run.smithi157.stdout:min_mon_release 16 (pacific) 2023-10-16T19:56:38.859 INFO:teuthology.orchestra.run.smithi157.stdout:election_strategy: 1 2023-10-16T19:56:38.859 INFO:teuthology.orchestra.run.smithi157.stdout:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2023-10-16T19:56:38.859 INFO:teuthology.orchestra.run.smithi157.stdout:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2023-10-16T19:56:38.860 INFO:teuthology.orchestra.run.smithi157.stdout:2: [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] mon.c 2023-10-16T19:56:38.860 INFO:teuthology.orchestra.run.smithi157.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-10-16T19:56:38.861 DEBUG:teuthology.orchestra.run.smithi157:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-10-16T19:56:38.878 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 28199dc9-64d5-479e-83c6-21f097c33d39... 2023-10-16T19:56:38.879 DEBUG:teuthology.orchestra.run.smithi157:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-16T19:56:38.920 DEBUG:teuthology.orchestra.run.smithi187:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-16T19:56:38.963 INFO:teuthology.orchestra.run.smithi157.stdout:[global] 2023-10-16T19:56:38.963 INFO:teuthology.orchestra.run.smithi157.stdout: chdir = "" 2023-10-16T19:56:38.963 INFO:teuthology.orchestra.run.smithi157.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-16T19:56:38.964 INFO:teuthology.orchestra.run.smithi157.stdout: auth supported = cephx 2023-10-16T19:56:38.964 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-10-16T19:56:38.964 INFO:teuthology.orchestra.run.smithi157.stdout: filestore xattr use omap = true 2023-10-16T19:56:38.964 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-10-16T19:56:38.965 INFO:teuthology.orchestra.run.smithi157.stdout: mon clock drift allowed = 1.000 2023-10-16T19:56:38.965 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-10-16T19:56:38.965 INFO:teuthology.orchestra.run.smithi157.stdout: osd crush chooseleaf type = 0 2023-10-16T19:56:38.965 INFO:teuthology.orchestra.run.smithi157.stdout: auth debug = true 2023-10-16T19:56:38.965 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-10-16T19:56:38.966 INFO:teuthology.orchestra.run.smithi157.stdout: ms die on old message = true 2023-10-16T19:56:38.966 INFO:teuthology.orchestra.run.smithi157.stdout: ms die on bug = true 2023-10-16T19:56:38.966 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-10-16T19:56:38.966 INFO:teuthology.orchestra.run.smithi157.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-16T19:56:38.967 INFO:teuthology.orchestra.run.smithi157.stdout: mon pg warn max object skew = 0 2023-10-16T19:56:38.967 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-10-16T19:56:38.967 INFO:teuthology.orchestra.run.smithi157.stdout: # disable pg_autoscaler by default for new pools 2023-10-16T19:56:38.967 INFO:teuthology.orchestra.run.smithi157.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-16T19:56:38.967 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-10-16T19:56:38.968 INFO:teuthology.orchestra.run.smithi157.stdout: osd pool default size = 2 2023-10-16T19:56:38.968 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-10-16T19:56:38.968 INFO:teuthology.orchestra.run.smithi157.stdout: mon osd allow primary affinity = true 2023-10-16T19:56:38.968 INFO:teuthology.orchestra.run.smithi157.stdout: mon osd allow pg remap = true 2023-10-16T19:56:38.968 INFO:teuthology.orchestra.run.smithi157.stdout: mon warn on legacy crush tunables = false 2023-10-16T19:56:38.969 INFO:teuthology.orchestra.run.smithi157.stdout: mon warn on crush straw calc version zero = false 2023-10-16T19:56:38.969 INFO:teuthology.orchestra.run.smithi157.stdout: mon warn on no sortbitwise = false 2023-10-16T19:56:38.969 INFO:teuthology.orchestra.run.smithi157.stdout: mon warn on osd down out interval zero = false 2023-10-16T19:56:38.969 INFO:teuthology.orchestra.run.smithi157.stdout: mon warn on too few osds = false 2023-10-16T19:56:38.969 INFO:teuthology.orchestra.run.smithi157.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-16T19:56:38.970 INFO:teuthology.orchestra.run.smithi157.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-16T19:56:38.970 INFO:teuthology.orchestra.run.smithi157.stdout: mon_allow_pool_size_one = true 2023-10-16T19:56:38.970 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-10-16T19:56:38.970 INFO:teuthology.orchestra.run.smithi157.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-16T19:56:38.971 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-10-16T19:56:38.971 INFO:teuthology.orchestra.run.smithi157.stdout: osd default data pool replay window = 5 2023-10-16T19:56:38.971 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-10-16T19:56:38.971 INFO:teuthology.orchestra.run.smithi157.stdout: mon allow pool delete = true 2023-10-16T19:56:38.971 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-10-16T19:56:38.972 INFO:teuthology.orchestra.run.smithi157.stdout: mon cluster log file level = debug 2023-10-16T19:56:38.972 INFO:teuthology.orchestra.run.smithi157.stdout: debug asserts on shutdown = true 2023-10-16T19:56:38.972 INFO:teuthology.orchestra.run.smithi157.stdout: mon health detail to clog = false 2023-10-16T19:56:38.972 INFO:teuthology.orchestra.run.smithi157.stdout: mon host = "172.21.15.157,172.21.15.187,[v2:172.21.15.187:3301,v1:172.21.15.187:6790]" 2023-10-16T19:56:38.973 INFO:teuthology.orchestra.run.smithi157.stdout: ms die on skipped message = False 2023-10-16T19:56:38.973 INFO:teuthology.orchestra.run.smithi157.stdout: fsid = 28199dc9-64d5-479e-83c6-21f097c33d39 2023-10-16T19:56:38.973 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-10-16T19:56:38.973 INFO:teuthology.orchestra.run.smithi157.stdout:[osd] 2023-10-16T19:56:38.973 INFO:teuthology.orchestra.run.smithi157.stdout: osd journal size = 100 2023-10-16T19:56:38.974 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-10-16T19:56:38.974 INFO:teuthology.orchestra.run.smithi157.stdout: osd scrub load threshold = 5.0 2023-10-16T19:56:38.974 INFO:teuthology.orchestra.run.smithi157.stdout: osd scrub max interval = 600 2023-10-16T19:56:38.974 INFO:teuthology.orchestra.run.smithi157.stdout: osd mclock profile = high_recovery_ops 2023-10-16T19:56:38.974 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-10-16T19:56:38.975 INFO:teuthology.orchestra.run.smithi157.stdout: osd recover clone overlap = true 2023-10-16T19:56:38.975 INFO:teuthology.orchestra.run.smithi157.stdout: osd recovery max chunk = 1048576 2023-10-16T19:56:38.975 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-10-16T19:56:38.975 INFO:teuthology.orchestra.run.smithi157.stdout: osd debug shutdown = true 2023-10-16T19:56:38.975 INFO:teuthology.orchestra.run.smithi157.stdout: osd debug op order = true 2023-10-16T19:56:38.976 INFO:teuthology.orchestra.run.smithi157.stdout: osd debug verify stray on activate = true 2023-10-16T19:56:38.976 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-10-16T19:56:38.976 INFO:teuthology.orchestra.run.smithi157.stdout: osd open classes on start = true 2023-10-16T19:56:38.976 INFO:teuthology.orchestra.run.smithi157.stdout: osd debug pg log writeout = true 2023-10-16T19:56:38.976 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-10-16T19:56:38.977 INFO:teuthology.orchestra.run.smithi157.stdout: osd deep scrub update digest min age = 30 2023-10-16T19:56:38.977 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-10-16T19:56:38.977 INFO:teuthology.orchestra.run.smithi157.stdout: osd map max advance = 10 2023-10-16T19:56:38.977 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-10-16T19:56:38.978 INFO:teuthology.orchestra.run.smithi157.stdout: journal zero on create = true 2023-10-16T19:56:38.978 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-10-16T19:56:38.978 INFO:teuthology.orchestra.run.smithi157.stdout: filestore ondisk finisher threads = 3 2023-10-16T19:56:38.978 INFO:teuthology.orchestra.run.smithi157.stdout: filestore apply finisher threads = 3 2023-10-16T19:56:38.979 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-10-16T19:56:38.979 INFO:teuthology.orchestra.run.smithi157.stdout: bdev debug aio = true 2023-10-16T19:56:38.979 INFO:teuthology.orchestra.run.smithi157.stdout: osd debug misdirected ops = true 2023-10-16T19:56:38.979 INFO:teuthology.orchestra.run.smithi157.stdout: bdev async discard = True 2023-10-16T19:56:38.979 INFO:teuthology.orchestra.run.smithi157.stdout: bdev enable discard = True 2023-10-16T19:56:38.980 INFO:teuthology.orchestra.run.smithi157.stdout: bluestore allocator = bitmap 2023-10-16T19:56:38.980 INFO:teuthology.orchestra.run.smithi157.stdout: bluestore block size = 96636764160 2023-10-16T19:56:38.980 INFO:teuthology.orchestra.run.smithi157.stdout: bluestore fsck on mount = True 2023-10-16T19:56:38.980 INFO:teuthology.orchestra.run.smithi157.stdout: debug bluefs = 1/20 2023-10-16T19:56:38.980 INFO:teuthology.orchestra.run.smithi157.stdout: debug bluestore = 1/20 2023-10-16T19:56:38.981 INFO:teuthology.orchestra.run.smithi157.stdout: debug ms = 1 2023-10-16T19:56:38.981 INFO:teuthology.orchestra.run.smithi157.stdout: debug osd = 20 2023-10-16T19:56:38.981 INFO:teuthology.orchestra.run.smithi157.stdout: debug rocksdb = 4/10 2023-10-16T19:56:38.981 INFO:teuthology.orchestra.run.smithi157.stdout: memstore device bytes = 200000000 2023-10-16T19:56:38.981 INFO:teuthology.orchestra.run.smithi157.stdout: mon osd backfillfull_ratio = 0.85 2023-10-16T19:56:38.982 INFO:teuthology.orchestra.run.smithi157.stdout: mon osd full ratio = 0.9 2023-10-16T19:56:38.982 INFO:teuthology.orchestra.run.smithi157.stdout: mon osd nearfull ratio = 0.8 2023-10-16T19:56:38.982 INFO:teuthology.orchestra.run.smithi157.stdout: osd failsafe full ratio = 1.0 2023-10-16T19:56:38.982 INFO:teuthology.orchestra.run.smithi157.stdout: osd mon report interval = 5 2023-10-16T19:56:38.982 INFO:teuthology.orchestra.run.smithi157.stdout: osd objectstore = memstore 2023-10-16T19:56:38.983 INFO:teuthology.orchestra.run.smithi157.stdout: osd op complaint time = 180 2023-10-16T19:56:38.983 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-10-16T19:56:38.983 INFO:teuthology.orchestra.run.smithi157.stdout:[mgr] 2023-10-16T19:56:38.983 INFO:teuthology.orchestra.run.smithi157.stdout: debug ms = 1 2023-10-16T19:56:38.983 INFO:teuthology.orchestra.run.smithi157.stdout: debug mgr = 20 2023-10-16T19:56:38.984 INFO:teuthology.orchestra.run.smithi157.stdout: debug mon = 20 2023-10-16T19:56:38.984 INFO:teuthology.orchestra.run.smithi157.stdout: debug auth = 20 2023-10-16T19:56:38.984 INFO:teuthology.orchestra.run.smithi157.stdout: mon reweight min pgs per osd = 4 2023-10-16T19:56:38.984 INFO:teuthology.orchestra.run.smithi157.stdout: mon reweight min bytes per osd = 10 2023-10-16T19:56:38.984 INFO:teuthology.orchestra.run.smithi157.stdout: mgr/telemetry/nag = false 2023-10-16T19:56:38.985 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-10-16T19:56:38.985 INFO:teuthology.orchestra.run.smithi157.stdout:[mon] 2023-10-16T19:56:38.985 INFO:teuthology.orchestra.run.smithi157.stdout: debug ms = 1 2023-10-16T19:56:38.985 INFO:teuthology.orchestra.run.smithi157.stdout: debug mon = 20 2023-10-16T19:56:38.985 INFO:teuthology.orchestra.run.smithi157.stdout: debug paxos = 20 2023-10-16T19:56:38.986 INFO:teuthology.orchestra.run.smithi157.stdout: debug auth = 20 2023-10-16T19:56:38.986 INFO:teuthology.orchestra.run.smithi157.stdout: mon data avail warn = 5 2023-10-16T19:56:38.986 INFO:teuthology.orchestra.run.smithi157.stdout: mon mgr mkfs grace = 240 2023-10-16T19:56:38.986 INFO:teuthology.orchestra.run.smithi157.stdout: mon reweight min pgs per osd = 4 2023-10-16T19:56:38.986 INFO:teuthology.orchestra.run.smithi157.stdout: mon osd reporter subtree level = osd 2023-10-16T19:56:38.989 INFO:teuthology.orchestra.run.smithi157.stdout: mon osd prime pg temp = true 2023-10-16T19:56:38.990 INFO:teuthology.orchestra.run.smithi157.stdout: mon reweight min bytes per osd = 10 2023-10-16T19:56:38.990 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-10-16T19:56:38.990 INFO:teuthology.orchestra.run.smithi157.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-16T19:56:38.990 INFO:teuthology.orchestra.run.smithi157.stdout: auth mon ticket ttl = 660 # 11m 2023-10-16T19:56:38.990 INFO:teuthology.orchestra.run.smithi157.stdout: auth service ticket ttl = 240 # 4m 2023-10-16T19:56:38.991 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-10-16T19:56:38.991 INFO:teuthology.orchestra.run.smithi157.stdout: # don't complain about insecure global_id in the test suite 2023-10-16T19:56:38.991 INFO:teuthology.orchestra.run.smithi157.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-16T19:56:38.991 INFO:teuthology.orchestra.run.smithi157.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-16T19:56:38.991 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-10-16T19:56:38.992 INFO:teuthology.orchestra.run.smithi157.stdout: # 1m isn't quite enough 2023-10-16T19:56:38.992 INFO:teuthology.orchestra.run.smithi157.stdout: mon_down_mkfs_grace = 2m 2023-10-16T19:56:38.992 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-10-16T19:56:38.992 INFO:teuthology.orchestra.run.smithi157.stdout: mon_warn_on_filestore_osds = false 2023-10-16T19:56:38.992 INFO:teuthology.orchestra.run.smithi157.stdout: mon op complaint time = 120 2023-10-16T19:56:38.993 INFO:teuthology.orchestra.run.smithi157.stdout: mon osd backfillfull ratio = 0.6 2023-10-16T19:56:38.993 INFO:teuthology.orchestra.run.smithi157.stdout: mon osd full ratio = 0.7 2023-10-16T19:56:38.993 INFO:teuthology.orchestra.run.smithi157.stdout: mon osd nearfull ratio = 0.6 2023-10-16T19:56:38.993 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-10-16T19:56:38.993 INFO:teuthology.orchestra.run.smithi157.stdout:[client] 2023-10-16T19:56:38.993 INFO:teuthology.orchestra.run.smithi157.stdout: rgw cache enabled = true 2023-10-16T19:56:38.994 INFO:teuthology.orchestra.run.smithi157.stdout: rgw enable ops log = true 2023-10-16T19:56:38.994 INFO:teuthology.orchestra.run.smithi157.stdout: rgw enable usage log = true 2023-10-16T19:56:38.994 INFO:teuthology.orchestra.run.smithi157.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-16T19:56:38.994 INFO:teuthology.orchestra.run.smithi157.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-16T19:56:38.995 INFO:teuthology.orchestra.run.smithi157.stdout: client mount timeout = 600 2023-10-16T19:56:38.995 INFO:teuthology.orchestra.run.smithi157.stdout: debug client = 20 2023-10-16T19:56:38.995 INFO:teuthology.orchestra.run.smithi157.stdout: debug ms = 1 2023-10-16T19:56:38.995 INFO:teuthology.orchestra.run.smithi157.stdout: pid file = "" 2023-10-16T19:56:38.995 INFO:teuthology.orchestra.run.smithi157.stdout: rados mon op timeout = 900 2023-10-16T19:56:38.996 INFO:teuthology.orchestra.run.smithi157.stdout: rados osd op timeout = 900 2023-10-16T19:56:38.996 INFO:teuthology.orchestra.run.smithi157.stdout:[mon.a] 2023-10-16T19:56:38.996 INFO:teuthology.orchestra.run.smithi157.stdout:[mon.b] 2023-10-16T19:56:38.996 INFO:teuthology.orchestra.run.smithi157.stdout:[mon.c] 2023-10-16T19:56:38.996 INFO:teuthology.orchestra.run.smithi157.stdout:[mds.a] 2023-10-16T19:56:38.997 INFO:teuthology.orchestra.run.smithi157.stdout:[mds.c] 2023-10-16T19:56:38.997 INFO:teuthology.orchestra.run.smithi157.stdout:[mds.b] 2023-10-16T19:56:38.997 INFO:teuthology.orchestra.run.smithi157.stdout:[mds.d] 2023-10-16T19:56:38.997 INFO:teuthology.orchestra.run.smithi157.stdout:[client.0] 2023-10-16T19:56:38.997 INFO:teuthology.orchestra.run.smithi157.stdout: debug client = 20 2023-10-16T19:56:38.998 INFO:teuthology.orchestra.run.smithi157.stdout: debug objectcacher = 20 2023-10-16T19:56:38.998 INFO:teuthology.orchestra.run.smithi157.stdout: debug objecter = 20 2023-10-16T19:56:38.998 INFO:teuthology.orchestra.run.smithi157.stdout:[client.1] 2023-10-16T19:56:38.998 INFO:teuthology.orchestra.run.smithi157.stdout: debug client = 20 2023-10-16T19:56:38.998 INFO:teuthology.orchestra.run.smithi157.stdout: debug objectcacher = 20 2023-10-16T19:56:38.999 INFO:teuthology.orchestra.run.smithi157.stdout: debug objecter = 20 2023-10-16T19:56:38.999 INFO:teuthology.orchestra.run.smithi157.stdout:[mds] 2023-10-16T19:56:38.999 INFO:teuthology.orchestra.run.smithi157.stdout: debug mds = 20 2023-10-16T19:56:38.999 INFO:teuthology.orchestra.run.smithi157.stdout: debug mds balancer = 20 2023-10-16T19:56:38.999 INFO:teuthology.orchestra.run.smithi157.stdout: debug ms = 1 2023-10-16T19:56:39.000 INFO:teuthology.orchestra.run.smithi157.stdout: mds debug frag = True 2023-10-16T19:56:39.000 INFO:teuthology.orchestra.run.smithi157.stdout: mds debug scatterstat = True 2023-10-16T19:56:39.000 INFO:teuthology.orchestra.run.smithi157.stdout: mds op complaint time = 180 2023-10-16T19:56:39.000 INFO:teuthology.orchestra.run.smithi157.stdout: mds verify scatter = True 2023-10-16T19:56:39.000 INFO:teuthology.orchestra.run.smithi157.stdout: osd op complaint time = 180 2023-10-16T19:56:39.001 INFO:teuthology.orchestra.run.smithi157.stdout: rados mon op timeout = 900 2023-10-16T19:56:39.001 INFO:teuthology.orchestra.run.smithi157.stdout: rados osd op timeout = 900 2023-10-16T19:56:39.003 INFO:teuthology.orchestra.run.smithi187.stdout:[global] 2023-10-16T19:56:39.003 INFO:teuthology.orchestra.run.smithi187.stdout: chdir = "" 2023-10-16T19:56:39.003 INFO:teuthology.orchestra.run.smithi187.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-16T19:56:39.003 INFO:teuthology.orchestra.run.smithi187.stdout: auth supported = cephx 2023-10-16T19:56:39.004 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-10-16T19:56:39.004 INFO:teuthology.orchestra.run.smithi187.stdout: filestore xattr use omap = true 2023-10-16T19:56:39.004 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-10-16T19:56:39.004 INFO:teuthology.orchestra.run.smithi187.stdout: mon clock drift allowed = 1.000 2023-10-16T19:56:39.004 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-10-16T19:56:39.005 INFO:teuthology.orchestra.run.smithi187.stdout: osd crush chooseleaf type = 0 2023-10-16T19:56:39.005 INFO:teuthology.orchestra.run.smithi187.stdout: auth debug = true 2023-10-16T19:56:39.005 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-10-16T19:56:39.005 INFO:teuthology.orchestra.run.smithi187.stdout: ms die on old message = true 2023-10-16T19:56:39.005 INFO:teuthology.orchestra.run.smithi187.stdout: ms die on bug = true 2023-10-16T19:56:39.006 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-10-16T19:56:39.006 INFO:teuthology.orchestra.run.smithi187.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-16T19:56:39.006 INFO:teuthology.orchestra.run.smithi187.stdout: mon pg warn max object skew = 0 2023-10-16T19:56:39.007 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-10-16T19:56:39.007 INFO:teuthology.orchestra.run.smithi187.stdout: # disable pg_autoscaler by default for new pools 2023-10-16T19:56:39.007 INFO:teuthology.orchestra.run.smithi187.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-16T19:56:39.007 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-10-16T19:56:39.007 INFO:teuthology.orchestra.run.smithi187.stdout: osd pool default size = 2 2023-10-16T19:56:39.008 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-10-16T19:56:39.008 INFO:teuthology.orchestra.run.smithi187.stdout: mon osd allow primary affinity = true 2023-10-16T19:56:39.008 INFO:teuthology.orchestra.run.smithi187.stdout: mon osd allow pg remap = true 2023-10-16T19:56:39.008 INFO:teuthology.orchestra.run.smithi187.stdout: mon warn on legacy crush tunables = false 2023-10-16T19:56:39.008 INFO:teuthology.orchestra.run.smithi187.stdout: mon warn on crush straw calc version zero = false 2023-10-16T19:56:39.009 INFO:teuthology.orchestra.run.smithi187.stdout: mon warn on no sortbitwise = false 2023-10-16T19:56:39.009 INFO:teuthology.orchestra.run.smithi187.stdout: mon warn on osd down out interval zero = false 2023-10-16T19:56:39.009 INFO:teuthology.orchestra.run.smithi187.stdout: mon warn on too few osds = false 2023-10-16T19:56:39.009 INFO:teuthology.orchestra.run.smithi187.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-16T19:56:39.009 INFO:teuthology.orchestra.run.smithi187.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-16T19:56:39.010 INFO:teuthology.orchestra.run.smithi187.stdout: mon_allow_pool_size_one = true 2023-10-16T19:56:39.010 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-10-16T19:56:39.010 INFO:teuthology.orchestra.run.smithi187.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-16T19:56:39.010 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-10-16T19:56:39.011 INFO:teuthology.orchestra.run.smithi187.stdout: osd default data pool replay window = 5 2023-10-16T19:56:39.011 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-10-16T19:56:39.011 INFO:teuthology.orchestra.run.smithi187.stdout: mon allow pool delete = true 2023-10-16T19:56:39.011 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-10-16T19:56:39.011 INFO:teuthology.orchestra.run.smithi187.stdout: mon cluster log file level = debug 2023-10-16T19:56:39.012 INFO:teuthology.orchestra.run.smithi187.stdout: debug asserts on shutdown = true 2023-10-16T19:56:39.012 INFO:teuthology.orchestra.run.smithi187.stdout: mon health detail to clog = false 2023-10-16T19:56:39.012 INFO:teuthology.orchestra.run.smithi187.stdout: mon host = "172.21.15.157,172.21.15.187,[v2:172.21.15.187:3301,v1:172.21.15.187:6790]" 2023-10-16T19:56:39.012 INFO:teuthology.orchestra.run.smithi187.stdout: ms die on skipped message = False 2023-10-16T19:56:39.013 INFO:teuthology.orchestra.run.smithi187.stdout: fsid = 28199dc9-64d5-479e-83c6-21f097c33d39 2023-10-16T19:56:39.013 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-10-16T19:56:39.013 INFO:teuthology.orchestra.run.smithi187.stdout:[osd] 2023-10-16T19:56:39.013 INFO:teuthology.orchestra.run.smithi187.stdout: osd journal size = 100 2023-10-16T19:56:39.013 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-10-16T19:56:39.014 INFO:teuthology.orchestra.run.smithi187.stdout: osd scrub load threshold = 5.0 2023-10-16T19:56:39.014 INFO:teuthology.orchestra.run.smithi187.stdout: osd scrub max interval = 600 2023-10-16T19:56:39.014 INFO:teuthology.orchestra.run.smithi187.stdout: osd mclock profile = high_recovery_ops 2023-10-16T19:56:39.014 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-10-16T19:56:39.014 INFO:teuthology.orchestra.run.smithi187.stdout: osd recover clone overlap = true 2023-10-16T19:56:39.015 INFO:teuthology.orchestra.run.smithi187.stdout: osd recovery max chunk = 1048576 2023-10-16T19:56:39.015 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-10-16T19:56:39.015 INFO:teuthology.orchestra.run.smithi187.stdout: osd debug shutdown = true 2023-10-16T19:56:39.015 INFO:teuthology.orchestra.run.smithi187.stdout: osd debug op order = true 2023-10-16T19:56:39.015 INFO:teuthology.orchestra.run.smithi187.stdout: osd debug verify stray on activate = true 2023-10-16T19:56:39.016 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-10-16T19:56:39.016 INFO:teuthology.orchestra.run.smithi187.stdout: osd open classes on start = true 2023-10-16T19:56:39.016 INFO:teuthology.orchestra.run.smithi187.stdout: osd debug pg log writeout = true 2023-10-16T19:56:39.016 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-10-16T19:56:39.016 INFO:teuthology.orchestra.run.smithi187.stdout: osd deep scrub update digest min age = 30 2023-10-16T19:56:39.017 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-10-16T19:56:39.017 INFO:teuthology.orchestra.run.smithi187.stdout: osd map max advance = 10 2023-10-16T19:56:39.017 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-10-16T19:56:39.017 INFO:teuthology.orchestra.run.smithi187.stdout: journal zero on create = true 2023-10-16T19:56:39.018 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-10-16T19:56:39.018 INFO:teuthology.orchestra.run.smithi187.stdout: filestore ondisk finisher threads = 3 2023-10-16T19:56:39.018 INFO:teuthology.orchestra.run.smithi187.stdout: filestore apply finisher threads = 3 2023-10-16T19:56:39.018 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-10-16T19:56:39.018 INFO:teuthology.orchestra.run.smithi187.stdout: bdev debug aio = true 2023-10-16T19:56:39.018 INFO:teuthology.orchestra.run.smithi187.stdout: osd debug misdirected ops = true 2023-10-16T19:56:39.019 INFO:teuthology.orchestra.run.smithi187.stdout: bdev async discard = True 2023-10-16T19:56:39.019 INFO:teuthology.orchestra.run.smithi187.stdout: bdev enable discard = True 2023-10-16T19:56:39.019 INFO:teuthology.orchestra.run.smithi187.stdout: bluestore allocator = bitmap 2023-10-16T19:56:39.019 INFO:teuthology.orchestra.run.smithi187.stdout: bluestore block size = 96636764160 2023-10-16T19:56:39.019 INFO:teuthology.orchestra.run.smithi187.stdout: bluestore fsck on mount = True 2023-10-16T19:56:39.020 INFO:teuthology.orchestra.run.smithi187.stdout: debug bluefs = 1/20 2023-10-16T19:56:39.020 INFO:teuthology.orchestra.run.smithi187.stdout: debug bluestore = 1/20 2023-10-16T19:56:39.020 INFO:teuthology.orchestra.run.smithi187.stdout: debug ms = 1 2023-10-16T19:56:39.020 INFO:teuthology.orchestra.run.smithi187.stdout: debug osd = 20 2023-10-16T19:56:39.020 INFO:teuthology.orchestra.run.smithi187.stdout: debug rocksdb = 4/10 2023-10-16T19:56:39.021 INFO:teuthology.orchestra.run.smithi187.stdout: memstore device bytes = 200000000 2023-10-16T19:56:39.021 INFO:teuthology.orchestra.run.smithi187.stdout: mon osd backfillfull_ratio = 0.85 2023-10-16T19:56:39.021 INFO:teuthology.orchestra.run.smithi187.stdout: mon osd full ratio = 0.9 2023-10-16T19:56:39.021 INFO:teuthology.orchestra.run.smithi187.stdout: mon osd nearfull ratio = 0.8 2023-10-16T19:56:39.022 INFO:teuthology.orchestra.run.smithi187.stdout: osd failsafe full ratio = 1.0 2023-10-16T19:56:39.022 INFO:teuthology.orchestra.run.smithi187.stdout: osd mon report interval = 5 2023-10-16T19:56:39.022 INFO:teuthology.orchestra.run.smithi187.stdout: osd objectstore = memstore 2023-10-16T19:56:39.022 INFO:teuthology.orchestra.run.smithi187.stdout: osd op complaint time = 180 2023-10-16T19:56:39.022 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-10-16T19:56:39.023 INFO:teuthology.orchestra.run.smithi187.stdout:[mgr] 2023-10-16T19:56:39.023 INFO:teuthology.orchestra.run.smithi187.stdout: debug ms = 1 2023-10-16T19:56:39.023 INFO:teuthology.orchestra.run.smithi187.stdout: debug mgr = 20 2023-10-16T19:56:39.023 INFO:teuthology.orchestra.run.smithi187.stdout: debug mon = 20 2023-10-16T19:56:39.023 INFO:teuthology.orchestra.run.smithi187.stdout: debug auth = 20 2023-10-16T19:56:39.024 INFO:teuthology.orchestra.run.smithi187.stdout: mon reweight min pgs per osd = 4 2023-10-16T19:56:39.024 INFO:teuthology.orchestra.run.smithi187.stdout: mon reweight min bytes per osd = 10 2023-10-16T19:56:39.024 INFO:teuthology.orchestra.run.smithi187.stdout: mgr/telemetry/nag = false 2023-10-16T19:56:39.024 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-10-16T19:56:39.024 INFO:teuthology.orchestra.run.smithi187.stdout:[mon] 2023-10-16T19:56:39.025 INFO:teuthology.orchestra.run.smithi187.stdout: debug ms = 1 2023-10-16T19:56:39.025 INFO:teuthology.orchestra.run.smithi187.stdout: debug mon = 20 2023-10-16T19:56:39.025 INFO:teuthology.orchestra.run.smithi187.stdout: debug paxos = 20 2023-10-16T19:56:39.025 INFO:teuthology.orchestra.run.smithi187.stdout: debug auth = 20 2023-10-16T19:56:39.025 INFO:teuthology.orchestra.run.smithi187.stdout: mon data avail warn = 5 2023-10-16T19:56:39.026 INFO:teuthology.orchestra.run.smithi187.stdout: mon mgr mkfs grace = 240 2023-10-16T19:56:39.026 INFO:teuthology.orchestra.run.smithi187.stdout: mon reweight min pgs per osd = 4 2023-10-16T19:56:39.026 INFO:teuthology.orchestra.run.smithi187.stdout: mon osd reporter subtree level = osd 2023-10-16T19:56:39.026 INFO:teuthology.orchestra.run.smithi187.stdout: mon osd prime pg temp = true 2023-10-16T19:56:39.026 INFO:teuthology.orchestra.run.smithi187.stdout: mon reweight min bytes per osd = 10 2023-10-16T19:56:39.027 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-10-16T19:56:39.027 INFO:teuthology.orchestra.run.smithi187.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-16T19:56:39.027 INFO:teuthology.orchestra.run.smithi187.stdout: auth mon ticket ttl = 660 # 11m 2023-10-16T19:56:39.027 INFO:teuthology.orchestra.run.smithi187.stdout: auth service ticket ttl = 240 # 4m 2023-10-16T19:56:39.027 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-10-16T19:56:39.027 INFO:teuthology.orchestra.run.smithi187.stdout: # don't complain about insecure global_id in the test suite 2023-10-16T19:56:39.028 INFO:teuthology.orchestra.run.smithi187.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-16T19:56:39.028 INFO:teuthology.orchestra.run.smithi187.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-16T19:56:39.028 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-10-16T19:56:39.028 INFO:teuthology.orchestra.run.smithi187.stdout: # 1m isn't quite enough 2023-10-16T19:56:39.028 INFO:teuthology.orchestra.run.smithi187.stdout: mon_down_mkfs_grace = 2m 2023-10-16T19:56:39.029 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-10-16T19:56:39.029 INFO:teuthology.orchestra.run.smithi187.stdout: mon_warn_on_filestore_osds = false 2023-10-16T19:56:39.029 INFO:teuthology.orchestra.run.smithi187.stdout: mon op complaint time = 120 2023-10-16T19:56:39.029 INFO:teuthology.orchestra.run.smithi187.stdout: mon osd backfillfull ratio = 0.6 2023-10-16T19:56:39.029 INFO:teuthology.orchestra.run.smithi187.stdout: mon osd full ratio = 0.7 2023-10-16T19:56:39.030 INFO:teuthology.orchestra.run.smithi187.stdout: mon osd nearfull ratio = 0.6 2023-10-16T19:56:39.030 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-10-16T19:56:39.030 INFO:teuthology.orchestra.run.smithi187.stdout:[client] 2023-10-16T19:56:39.030 INFO:teuthology.orchestra.run.smithi187.stdout: rgw cache enabled = true 2023-10-16T19:56:39.030 INFO:teuthology.orchestra.run.smithi187.stdout: rgw enable ops log = true 2023-10-16T19:56:39.031 INFO:teuthology.orchestra.run.smithi187.stdout: rgw enable usage log = true 2023-10-16T19:56:39.031 INFO:teuthology.orchestra.run.smithi187.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-16T19:56:39.031 INFO:teuthology.orchestra.run.smithi187.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-16T19:56:39.031 INFO:teuthology.orchestra.run.smithi187.stdout: client mount timeout = 600 2023-10-16T19:56:39.031 INFO:teuthology.orchestra.run.smithi187.stdout: debug client = 20 2023-10-16T19:56:39.032 INFO:teuthology.orchestra.run.smithi187.stdout: debug ms = 1 2023-10-16T19:56:39.032 INFO:teuthology.orchestra.run.smithi187.stdout: pid file = "" 2023-10-16T19:56:39.032 INFO:teuthology.orchestra.run.smithi187.stdout: rados mon op timeout = 900 2023-10-16T19:56:39.032 INFO:teuthology.orchestra.run.smithi187.stdout: rados osd op timeout = 900 2023-10-16T19:56:39.033 INFO:teuthology.orchestra.run.smithi187.stdout:[mon.a] 2023-10-16T19:56:39.033 INFO:teuthology.orchestra.run.smithi187.stdout:[mon.b] 2023-10-16T19:56:39.033 INFO:teuthology.orchestra.run.smithi187.stdout:[mon.c] 2023-10-16T19:56:39.033 INFO:teuthology.orchestra.run.smithi187.stdout:[mds.a] 2023-10-16T19:56:39.033 INFO:teuthology.orchestra.run.smithi187.stdout:[mds.c] 2023-10-16T19:56:39.034 INFO:teuthology.orchestra.run.smithi187.stdout:[mds.b] 2023-10-16T19:56:39.034 INFO:teuthology.orchestra.run.smithi187.stdout:[mds.d] 2023-10-16T19:56:39.034 INFO:teuthology.orchestra.run.smithi187.stdout:[client.0] 2023-10-16T19:56:39.034 INFO:teuthology.orchestra.run.smithi187.stdout: debug client = 20 2023-10-16T19:56:39.034 INFO:teuthology.orchestra.run.smithi187.stdout: debug objectcacher = 20 2023-10-16T19:56:39.035 INFO:teuthology.orchestra.run.smithi187.stdout: debug objecter = 20 2023-10-16T19:56:39.035 INFO:teuthology.orchestra.run.smithi187.stdout:[client.1] 2023-10-16T19:56:39.035 INFO:teuthology.orchestra.run.smithi187.stdout: debug client = 20 2023-10-16T19:56:39.035 INFO:teuthology.orchestra.run.smithi187.stdout: debug objectcacher = 20 2023-10-16T19:56:39.035 INFO:teuthology.orchestra.run.smithi187.stdout: debug objecter = 20 2023-10-16T19:56:39.036 INFO:teuthology.orchestra.run.smithi187.stdout:[mds] 2023-10-16T19:56:39.036 INFO:teuthology.orchestra.run.smithi187.stdout: debug mds = 20 2023-10-16T19:56:39.036 INFO:teuthology.orchestra.run.smithi187.stdout: debug mds balancer = 20 2023-10-16T19:56:39.036 INFO:teuthology.orchestra.run.smithi187.stdout: debug ms = 1 2023-10-16T19:56:39.037 INFO:teuthology.orchestra.run.smithi187.stdout: mds debug frag = True 2023-10-16T19:56:39.037 INFO:teuthology.orchestra.run.smithi187.stdout: mds debug scatterstat = True 2023-10-16T19:56:39.037 INFO:teuthology.orchestra.run.smithi187.stdout: mds op complaint time = 180 2023-10-16T19:56:39.037 INFO:teuthology.orchestra.run.smithi187.stdout: mds verify scatter = True 2023-10-16T19:56:39.037 INFO:teuthology.orchestra.run.smithi187.stdout: osd op complaint time = 180 2023-10-16T19:56:39.037 INFO:teuthology.orchestra.run.smithi187.stdout: rados mon op timeout = 900 2023-10-16T19:56:39.038 INFO:teuthology.orchestra.run.smithi187.stdout: rados osd op timeout = 900 2023-10-16T19:56:39.038 INFO:tasks.ceph:Creating admin key on mon.a... 2023-10-16T19:56:39.038 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-10-16T19:56:39.100 INFO:tasks.ceph:Copying monmap to all nodes... 2023-10-16T19:56:39.101 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2023-10-16T19:56:39.101 DEBUG:teuthology.orchestra.run.smithi157:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-10-16T19:56:39.118 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2023-10-16T19:56:39.118 DEBUG:teuthology.orchestra.run.smithi157:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-10-16T19:56:39.175 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi157.front.sepia.ceph.com 2023-10-16T19:56:39.175 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2023-10-16T19:56:39.175 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd of=/etc/ceph/ceph.keyring 2023-10-16T19:56:39.176 DEBUG:teuthology.orchestra.run.smithi157:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-16T19:56:39.251 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2023-10-16T19:56:39.251 DEBUG:teuthology.orchestra.run.smithi157:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-10-16T19:56:39.308 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi187.front.sepia.ceph.com 2023-10-16T19:56:39.308 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-10-16T19:56:39.308 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd of=/etc/ceph/ceph.keyring 2023-10-16T19:56:39.309 DEBUG:teuthology.orchestra.run.smithi187:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-16T19:56:39.352 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-10-16T19:56:39.353 DEBUG:teuthology.orchestra.run.smithi187:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-10-16T19:56:39.412 INFO:tasks.ceph:Setting up mon nodes... 2023-10-16T19:56:39.413 INFO:tasks.ceph:Setting up mgr nodes... 2023-10-16T19:56:39.413 DEBUG:teuthology.orchestra.run.smithi157:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-10-16T19:56:39.467 INFO:teuthology.orchestra.run.smithi157.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-10-16T19:56:39.469 DEBUG:teuthology.orchestra.run.smithi187:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-10-16T19:56:39.546 INFO:teuthology.orchestra.run.smithi187.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-10-16T19:56:39.549 INFO:tasks.ceph:Setting up mds nodes... 2023-10-16T19:56:39.549 DEBUG:teuthology.orchestra.run.smithi157:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-10-16T19:56:39.606 INFO:teuthology.orchestra.run.smithi157.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-10-16T19:56:39.606 DEBUG:teuthology.orchestra.run.smithi157:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-10-16T19:56:39.632 DEBUG:teuthology.orchestra.run.smithi157:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-10-16T19:56:39.726 INFO:teuthology.orchestra.run.smithi157.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-10-16T19:56:39.729 DEBUG:teuthology.orchestra.run.smithi157:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-10-16T19:56:39.755 DEBUG:teuthology.orchestra.run.smithi187:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-10-16T19:56:39.813 INFO:teuthology.orchestra.run.smithi187.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-10-16T19:56:39.815 DEBUG:teuthology.orchestra.run.smithi187:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-10-16T19:56:39.842 DEBUG:teuthology.orchestra.run.smithi187:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-10-16T19:56:39.935 INFO:teuthology.orchestra.run.smithi187.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-10-16T19:56:39.938 DEBUG:teuthology.orchestra.run.smithi187:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-10-16T19:56:39.964 INFO:tasks.ceph_client:Setting up client nodes... 2023-10-16T19:56:39.964 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-10-16T19:56:40.008 INFO:teuthology.orchestra.run.smithi157.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-10-16T19:56:40.021 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2023-10-16T19:56:40.104 INFO:teuthology.orchestra.run.smithi157.stdout:creating /etc/ceph/ceph.client.2.keyring 2023-10-16T19:56:40.117 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-10-16T19:56:40.160 INFO:teuthology.orchestra.run.smithi187.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-10-16T19:56:40.173 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2023-10-16T19:56:40.256 INFO:teuthology.orchestra.run.smithi187.stdout:creating /etc/ceph/ceph.client.3.keyring 2023-10-16T19:56:40.269 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-10-16T19:56:40.269 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi157.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi187.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-10-16T19:56:40.270 DEBUG:teuthology.orchestra.run.smithi157:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-10-16T19:56:40.297 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-16T19:56:40.297 INFO:tasks.ceph:role: osd.0 2023-10-16T19:56:40.297 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi157.front.sepia.ceph.com 2023-10-16T19:56:40.298 DEBUG:teuthology.orchestra.run.smithi157:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-10-16T19:56:40.363 INFO:teuthology.orchestra.run.smithi157.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-10-16T19:56:40.364 INFO:teuthology.orchestra.run.smithi157.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-16T19:56:40.364 INFO:teuthology.orchestra.run.smithi157.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-16T19:56:40.364 INFO:teuthology.orchestra.run.smithi157.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-16T19:56:40.364 INFO:teuthology.orchestra.run.smithi157.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-16T19:56:40.365 INFO:teuthology.orchestra.run.smithi157.stdout: = sunit=0 swidth=0 blks 2023-10-16T19:56:40.365 INFO:teuthology.orchestra.run.smithi157.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-16T19:56:40.365 INFO:teuthology.orchestra.run.smithi157.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-16T19:56:40.365 INFO:teuthology.orchestra.run.smithi157.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-16T19:56:40.365 INFO:teuthology.orchestra.run.smithi157.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-16T19:56:40.385 INFO:teuthology.orchestra.run.smithi157.stdout:Discarding blocks...Done. 2023-10-16T19:56:40.387 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi157.front.sepia.ceph.com -o noatime 2023-10-16T19:56:40.387 DEBUG:teuthology.orchestra.run.smithi157:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-10-16T19:56:40.468 DEBUG:teuthology.orchestra.run.smithi157:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-10-16T19:56:40.540 DEBUG:teuthology.orchestra.run.smithi157:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-10-16T19:56:40.607 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-16T19:56:40.607 INFO:tasks.ceph:role: osd.1 2023-10-16T19:56:40.607 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi157.front.sepia.ceph.com 2023-10-16T19:56:40.608 DEBUG:teuthology.orchestra.run.smithi157:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-10-16T19:56:40.673 INFO:teuthology.orchestra.run.smithi157.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-10-16T19:56:40.673 INFO:teuthology.orchestra.run.smithi157.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-16T19:56:40.673 INFO:teuthology.orchestra.run.smithi157.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-16T19:56:40.674 INFO:teuthology.orchestra.run.smithi157.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-16T19:56:40.674 INFO:teuthology.orchestra.run.smithi157.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-16T19:56:40.674 INFO:teuthology.orchestra.run.smithi157.stdout: = sunit=0 swidth=0 blks 2023-10-16T19:56:40.674 INFO:teuthology.orchestra.run.smithi157.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-16T19:56:40.674 INFO:teuthology.orchestra.run.smithi157.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-16T19:56:40.675 INFO:teuthology.orchestra.run.smithi157.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-16T19:56:40.675 INFO:teuthology.orchestra.run.smithi157.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-16T19:56:40.695 INFO:teuthology.orchestra.run.smithi157.stdout:Discarding blocks...Done. 2023-10-16T19:56:40.697 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi157.front.sepia.ceph.com -o noatime 2023-10-16T19:56:40.697 DEBUG:teuthology.orchestra.run.smithi157:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-10-16T19:56:40.776 DEBUG:teuthology.orchestra.run.smithi157:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-10-16T19:56:40.847 DEBUG:teuthology.orchestra.run.smithi157:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-10-16T19:56:40.913 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-16T19:56:40.914 INFO:tasks.ceph:role: osd.2 2023-10-16T19:56:40.914 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi157.front.sepia.ceph.com 2023-10-16T19:56:40.914 DEBUG:teuthology.orchestra.run.smithi157:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-10-16T19:56:40.978 INFO:teuthology.orchestra.run.smithi157.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-10-16T19:56:40.979 INFO:teuthology.orchestra.run.smithi157.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-16T19:56:40.979 INFO:teuthology.orchestra.run.smithi157.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-16T19:56:40.979 INFO:teuthology.orchestra.run.smithi157.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-16T19:56:40.979 INFO:teuthology.orchestra.run.smithi157.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-16T19:56:40.979 INFO:teuthology.orchestra.run.smithi157.stdout: = sunit=0 swidth=0 blks 2023-10-16T19:56:40.980 INFO:teuthology.orchestra.run.smithi157.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-16T19:56:40.980 INFO:teuthology.orchestra.run.smithi157.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-16T19:56:40.980 INFO:teuthology.orchestra.run.smithi157.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-16T19:56:40.980 INFO:teuthology.orchestra.run.smithi157.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-16T19:56:41.001 INFO:teuthology.orchestra.run.smithi157.stdout:Discarding blocks...Done. 2023-10-16T19:56:41.002 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi157.front.sepia.ceph.com -o noatime 2023-10-16T19:56:41.003 DEBUG:teuthology.orchestra.run.smithi157:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-10-16T19:56:41.082 DEBUG:teuthology.orchestra.run.smithi157:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-10-16T19:56:41.152 DEBUG:teuthology.orchestra.run.smithi157:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-10-16T19:56:41.219 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-16T19:56:41.220 INFO:tasks.ceph:role: osd.3 2023-10-16T19:56:41.220 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi157.front.sepia.ceph.com 2023-10-16T19:56:41.220 DEBUG:teuthology.orchestra.run.smithi157:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-10-16T19:56:41.285 INFO:teuthology.orchestra.run.smithi157.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-10-16T19:56:41.285 INFO:teuthology.orchestra.run.smithi157.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-16T19:56:41.285 INFO:teuthology.orchestra.run.smithi157.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-16T19:56:41.286 INFO:teuthology.orchestra.run.smithi157.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-16T19:56:41.286 INFO:teuthology.orchestra.run.smithi157.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-16T19:56:41.286 INFO:teuthology.orchestra.run.smithi157.stdout: = sunit=0 swidth=0 blks 2023-10-16T19:56:41.286 INFO:teuthology.orchestra.run.smithi157.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-16T19:56:41.287 INFO:teuthology.orchestra.run.smithi157.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-16T19:56:41.287 INFO:teuthology.orchestra.run.smithi157.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-16T19:56:41.287 INFO:teuthology.orchestra.run.smithi157.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-16T19:56:41.308 INFO:teuthology.orchestra.run.smithi157.stdout:Discarding blocks...Done. 2023-10-16T19:56:41.309 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi157.front.sepia.ceph.com -o noatime 2023-10-16T19:56:41.310 DEBUG:teuthology.orchestra.run.smithi157:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-10-16T19:56:41.388 DEBUG:teuthology.orchestra.run.smithi157:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-10-16T19:56:41.459 DEBUG:teuthology.orchestra.run.smithi157:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-16T19:56:41.737 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:56:41.735+0000 7f5ba019e640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-10-16T19:56:41.738 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:56:41.735+0000 7f5ba019e640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-10-16T19:56:41.738 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:56:41.735+0000 7f5ba019e640 -1 memstore(/var/lib/ceph/osd/ceph-0) /var/lib/ceph/osd/ceph-0 2023-10-16T19:56:41.744 DEBUG:teuthology.orchestra.run.smithi157:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-10-16T19:56:41.771 DEBUG:teuthology.orchestra.run.smithi157:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-16T19:56:41.857 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:56:41.855+0000 7f57c4dc0640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-10-16T19:56:41.858 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:56:41.855+0000 7f57c4dc0640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-10-16T19:56:41.858 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:56:41.855+0000 7f57c4dc0640 -1 memstore(/var/lib/ceph/osd/ceph-1) /var/lib/ceph/osd/ceph-1 2023-10-16T19:56:41.866 DEBUG:teuthology.orchestra.run.smithi157:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-10-16T19:56:41.892 DEBUG:teuthology.orchestra.run.smithi157:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-16T19:56:41.978 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:56:41.975+0000 7f718dac7640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-10-16T19:56:41.978 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:56:41.975+0000 7f718dac7640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-10-16T19:56:41.978 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:56:41.976+0000 7f718dac7640 -1 memstore(/var/lib/ceph/osd/ceph-2) /var/lib/ceph/osd/ceph-2 2023-10-16T19:56:41.984 DEBUG:teuthology.orchestra.run.smithi157:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-10-16T19:56:42.010 DEBUG:teuthology.orchestra.run.smithi157:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-16T19:56:42.096 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:56:42.094+0000 7ff12705c640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-10-16T19:56:42.096 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:56:42.094+0000 7ff12705c640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-10-16T19:56:42.097 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:56:42.094+0000 7ff12705c640 -1 memstore(/var/lib/ceph/osd/ceph-3) /var/lib/ceph/osd/ceph-3 2023-10-16T19:56:42.102 DEBUG:teuthology.orchestra.run.smithi157:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-10-16T19:56:42.129 DEBUG:teuthology.orchestra.run.smithi187:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-10-16T19:56:42.161 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-16T19:56:42.162 INFO:tasks.ceph:role: osd.4 2023-10-16T19:56:42.162 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi187.front.sepia.ceph.com 2023-10-16T19:56:42.162 DEBUG:teuthology.orchestra.run.smithi187:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-10-16T19:56:42.238 INFO:teuthology.orchestra.run.smithi187.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-10-16T19:56:42.238 INFO:teuthology.orchestra.run.smithi187.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-16T19:56:42.238 INFO:teuthology.orchestra.run.smithi187.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-16T19:56:42.239 INFO:teuthology.orchestra.run.smithi187.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-16T19:56:42.239 INFO:teuthology.orchestra.run.smithi187.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-16T19:56:42.239 INFO:teuthology.orchestra.run.smithi187.stdout: = sunit=0 swidth=0 blks 2023-10-16T19:56:42.239 INFO:teuthology.orchestra.run.smithi187.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-16T19:56:42.240 INFO:teuthology.orchestra.run.smithi187.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-16T19:56:42.240 INFO:teuthology.orchestra.run.smithi187.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-16T19:56:42.240 INFO:teuthology.orchestra.run.smithi187.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-16T19:56:42.666 INFO:teuthology.orchestra.run.smithi187.stdout:Discarding blocks...Done. 2023-10-16T19:56:42.668 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi187.front.sepia.ceph.com -o noatime 2023-10-16T19:56:42.669 DEBUG:teuthology.orchestra.run.smithi187:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-10-16T19:56:42.803 DEBUG:teuthology.orchestra.run.smithi187:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-10-16T19:56:42.839 DEBUG:teuthology.orchestra.run.smithi187:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-10-16T19:56:42.908 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-16T19:56:42.908 INFO:tasks.ceph:role: osd.5 2023-10-16T19:56:42.909 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi187.front.sepia.ceph.com 2023-10-16T19:56:42.909 DEBUG:teuthology.orchestra.run.smithi187:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-10-16T19:56:42.983 INFO:teuthology.orchestra.run.smithi187.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-10-16T19:56:42.983 INFO:teuthology.orchestra.run.smithi187.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-16T19:56:42.983 INFO:teuthology.orchestra.run.smithi187.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-16T19:56:42.983 INFO:teuthology.orchestra.run.smithi187.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-16T19:56:42.984 INFO:teuthology.orchestra.run.smithi187.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-16T19:56:42.984 INFO:teuthology.orchestra.run.smithi187.stdout: = sunit=0 swidth=0 blks 2023-10-16T19:56:42.984 INFO:teuthology.orchestra.run.smithi187.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-16T19:56:42.984 INFO:teuthology.orchestra.run.smithi187.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-16T19:56:42.984 INFO:teuthology.orchestra.run.smithi187.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-16T19:56:42.985 INFO:teuthology.orchestra.run.smithi187.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-16T19:56:43.406 INFO:teuthology.orchestra.run.smithi187.stdout:Discarding blocks...Done. 2023-10-16T19:56:43.408 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi187.front.sepia.ceph.com -o noatime 2023-10-16T19:56:43.409 DEBUG:teuthology.orchestra.run.smithi187:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-10-16T19:56:43.499 DEBUG:teuthology.orchestra.run.smithi187:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-10-16T19:56:43.532 DEBUG:teuthology.orchestra.run.smithi187:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-10-16T19:56:43.600 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-16T19:56:43.601 INFO:tasks.ceph:role: osd.6 2023-10-16T19:56:43.601 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi187.front.sepia.ceph.com 2023-10-16T19:56:43.601 DEBUG:teuthology.orchestra.run.smithi187:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-10-16T19:56:43.677 INFO:teuthology.orchestra.run.smithi187.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-10-16T19:56:43.677 INFO:teuthology.orchestra.run.smithi187.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-16T19:56:43.677 INFO:teuthology.orchestra.run.smithi187.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-16T19:56:43.677 INFO:teuthology.orchestra.run.smithi187.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-16T19:56:43.678 INFO:teuthology.orchestra.run.smithi187.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-16T19:56:43.678 INFO:teuthology.orchestra.run.smithi187.stdout: = sunit=0 swidth=0 blks 2023-10-16T19:56:43.678 INFO:teuthology.orchestra.run.smithi187.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-16T19:56:43.678 INFO:teuthology.orchestra.run.smithi187.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-16T19:56:43.678 INFO:teuthology.orchestra.run.smithi187.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-16T19:56:43.679 INFO:teuthology.orchestra.run.smithi187.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-16T19:56:44.119 INFO:teuthology.orchestra.run.smithi187.stdout:Discarding blocks...Done. 2023-10-16T19:56:44.120 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi187.front.sepia.ceph.com -o noatime 2023-10-16T19:56:44.121 DEBUG:teuthology.orchestra.run.smithi187:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-10-16T19:56:44.240 DEBUG:teuthology.orchestra.run.smithi187:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-10-16T19:56:44.276 DEBUG:teuthology.orchestra.run.smithi187:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-10-16T19:56:44.345 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-16T19:56:44.346 INFO:tasks.ceph:role: osd.7 2023-10-16T19:56:44.346 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi187.front.sepia.ceph.com 2023-10-16T19:56:44.347 DEBUG:teuthology.orchestra.run.smithi187:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-10-16T19:56:44.422 INFO:teuthology.orchestra.run.smithi187.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-10-16T19:56:44.423 INFO:teuthology.orchestra.run.smithi187.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-16T19:56:44.423 INFO:teuthology.orchestra.run.smithi187.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-16T19:56:44.424 INFO:teuthology.orchestra.run.smithi187.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-16T19:56:44.424 INFO:teuthology.orchestra.run.smithi187.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-16T19:56:44.424 INFO:teuthology.orchestra.run.smithi187.stdout: = sunit=0 swidth=0 blks 2023-10-16T19:56:44.425 INFO:teuthology.orchestra.run.smithi187.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-16T19:56:44.425 INFO:teuthology.orchestra.run.smithi187.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-16T19:56:44.425 INFO:teuthology.orchestra.run.smithi187.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-16T19:56:44.426 INFO:teuthology.orchestra.run.smithi187.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-16T19:56:44.875 INFO:teuthology.orchestra.run.smithi187.stdout:Discarding blocks...Done. 2023-10-16T19:56:44.877 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi187.front.sepia.ceph.com -o noatime 2023-10-16T19:56:44.877 DEBUG:teuthology.orchestra.run.smithi187:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-10-16T19:56:45.067 DEBUG:teuthology.orchestra.run.smithi187:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-10-16T19:56:45.107 DEBUG:teuthology.orchestra.run.smithi187:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-16T19:56:45.209 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:45.207+0000 7f494c0b1640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-10-16T19:56:45.213 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:45.211+0000 7f494c0b1640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-10-16T19:56:45.215 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:45.213+0000 7f494c0b1640 -1 memstore(/var/lib/ceph/osd/ceph-4) /var/lib/ceph/osd/ceph-4 2023-10-16T19:56:45.238 DEBUG:teuthology.orchestra.run.smithi187:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-10-16T19:56:45.266 DEBUG:teuthology.orchestra.run.smithi187:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-16T19:56:45.354 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:45.352+0000 7f672be74640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-10-16T19:56:45.356 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:45.354+0000 7f672be74640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-10-16T19:56:45.363 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:45.361+0000 7f672be74640 -1 memstore(/var/lib/ceph/osd/ceph-5) /var/lib/ceph/osd/ceph-5 2023-10-16T19:56:45.376 DEBUG:teuthology.orchestra.run.smithi187:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-10-16T19:56:45.403 DEBUG:teuthology.orchestra.run.smithi187:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-16T19:56:45.489 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:45.487+0000 7fb715119640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-10-16T19:56:45.490 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:45.487+0000 7fb715119640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-10-16T19:56:45.490 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:45.487+0000 7fb715119640 -1 memstore(/var/lib/ceph/osd/ceph-6) /var/lib/ceph/osd/ceph-6 2023-10-16T19:56:45.498 DEBUG:teuthology.orchestra.run.smithi187:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-10-16T19:56:45.525 DEBUG:teuthology.orchestra.run.smithi187:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-16T19:56:45.611 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:45.608+0000 7f06d9dd0640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-10-16T19:56:45.611 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:45.609+0000 7f06d9dd0640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-10-16T19:56:45.612 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:45.610+0000 7f06d9dd0640 -1 memstore(/var/lib/ceph/osd/ceph-7) /var/lib/ceph/osd/ceph-7 2023-10-16T19:56:45.618 DEBUG:teuthology.orchestra.run.smithi187:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-10-16T19:56:45.644 INFO:tasks.ceph:Reading keys from all nodes... 2023-10-16T19:56:45.645 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2023-10-16T19:56:45.645 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-10-16T19:56:45.678 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2023-10-16T19:56:45.678 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-10-16T19:56:45.747 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2023-10-16T19:56:45.748 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-10-16T19:56:45.817 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2023-10-16T19:56:45.817 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-10-16T19:56:45.885 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2023-10-16T19:56:45.886 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-10-16T19:56:45.953 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2023-10-16T19:56:45.953 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-10-16T19:56:46.020 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2023-10-16T19:56:46.021 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-10-16T19:56:46.088 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-10-16T19:56:46.089 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-10-16T19:56:46.116 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-10-16T19:56:46.117 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-10-16T19:56:46.183 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-10-16T19:56:46.184 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-10-16T19:56:46.251 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-10-16T19:56:46.251 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-10-16T19:56:46.318 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-10-16T19:56:46.318 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-10-16T19:56:46.384 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-10-16T19:56:46.385 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-10-16T19:56:46.451 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-10-16T19:56:46.452 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-10-16T19:56:46.518 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2023-10-16T19:56:46.518 DEBUG:teuthology.orchestra.run.smithi157:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-10-16T19:56:46.539 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2023-10-16T19:56:46.539 DEBUG:teuthology.orchestra.run.smithi157:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2023-10-16T19:56:46.598 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-10-16T19:56:46.599 DEBUG:teuthology.orchestra.run.smithi187:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-10-16T19:56:46.616 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-10-16T19:56:46.616 DEBUG:teuthology.orchestra.run.smithi187:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2023-10-16T19:56:46.672 INFO:tasks.ceph:Adding keys to all mons... 2023-10-16T19:56:46.673 DEBUG:teuthology.orchestra.run.smithi157:> sudo tee -a /etc/ceph/ceph.keyring 2023-10-16T19:56:46.675 DEBUG:teuthology.orchestra.run.smithi187:> sudo tee -a /etc/ceph/ceph.keyring 2023-10-16T19:56:46.715 INFO:teuthology.orchestra.run.smithi157.stdout:[mgr.y] 2023-10-16T19:56:46.715 INFO:teuthology.orchestra.run.smithi157.stdout: key = AQB3lS1lC6nDGxAAPKV8NiSzXbhI8JZzSScWFg== 2023-10-16T19:56:46.716 INFO:teuthology.orchestra.run.smithi157.stdout:[mds.a] 2023-10-16T19:56:46.716 INFO:teuthology.orchestra.run.smithi157.stdout: key = AQB3lS1lg7HmIxAAzjktpvL1qdxxP736JQ/B0A== 2023-10-16T19:56:46.716 INFO:teuthology.orchestra.run.smithi157.stdout:[mds.c] 2023-10-16T19:56:46.716 INFO:teuthology.orchestra.run.smithi157.stdout: key = AQB3lS1lEdo+KxAAg6zuFpNBTBGWZbxZToJZDw== 2023-10-16T19:56:46.717 INFO:teuthology.orchestra.run.smithi157.stdout:[osd.0] 2023-10-16T19:56:46.717 INFO:teuthology.orchestra.run.smithi157.stdout: key = AQB5lS1lmL7jKxAAM+VgKsIpDnnAwCe9ezIGFQ== 2023-10-16T19:56:46.718 INFO:teuthology.orchestra.run.smithi157.stdout:[osd.1] 2023-10-16T19:56:46.718 INFO:teuthology.orchestra.run.smithi157.stdout: key = AQB5lS1lH+QGMxAAOfeAzFe+r8lGhw8r66GGFw== 2023-10-16T19:56:46.718 INFO:teuthology.orchestra.run.smithi157.stdout:[osd.2] 2023-10-16T19:56:46.719 INFO:teuthology.orchestra.run.smithi157.stdout: key = AQB5lS1lfiI3OhAAgdf82Usxjk0dRac2WV8f/w== 2023-10-16T19:56:46.719 INFO:teuthology.orchestra.run.smithi157.stdout:[osd.3] 2023-10-16T19:56:46.719 INFO:teuthology.orchestra.run.smithi157.stdout: key = AQB6lS1lOPeqBRAAuNRDLPQUWrQ+WwgkaDJ5Zw== 2023-10-16T19:56:46.719 INFO:teuthology.orchestra.run.smithi157.stdout:[mgr.x] 2023-10-16T19:56:46.720 INFO:teuthology.orchestra.run.smithi157.stdout: key = AQB3lS1lmnp9IBAAnnnk+mwDhlku9vubS/Hkaw== 2023-10-16T19:56:46.720 INFO:teuthology.orchestra.run.smithi157.stdout:[mds.b] 2023-10-16T19:56:46.720 INFO:teuthology.orchestra.run.smithi157.stdout: key = AQB3lS1lhtZiMBAADscNDtPmUIViU0gQIvx7pQ== 2023-10-16T19:56:46.720 INFO:teuthology.orchestra.run.smithi157.stdout:[mds.d] 2023-10-16T19:56:46.720 INFO:teuthology.orchestra.run.smithi157.stdout: key = AQB3lS1lj4qxNxAAb70WUiRoKTkx896oK0nwHg== 2023-10-16T19:56:46.721 INFO:teuthology.orchestra.run.smithi157.stdout:[osd.4] 2023-10-16T19:56:46.721 INFO:teuthology.orchestra.run.smithi157.stdout: key = AQB9lS1l1zRsDBAAAljtwEGSG9IwA1BxkbjciQ== 2023-10-16T19:56:46.721 INFO:teuthology.orchestra.run.smithi157.stdout:[osd.5] 2023-10-16T19:56:46.721 INFO:teuthology.orchestra.run.smithi157.stdout: key = AQB9lS1lopEQFRAApkT4aNUF8lbz766O65ZjMQ== 2023-10-16T19:56:46.721 INFO:teuthology.orchestra.run.smithi157.stdout:[osd.6] 2023-10-16T19:56:46.722 INFO:teuthology.orchestra.run.smithi157.stdout: key = AQB9lS1leeUaHRAAtcKqYz0FmFZIhJ10sBzVfA== 2023-10-16T19:56:46.722 INFO:teuthology.orchestra.run.smithi157.stdout:[osd.7] 2023-10-16T19:56:46.722 INFO:teuthology.orchestra.run.smithi157.stdout: key = AQB9lS1lkUZZJBAAB7glunBFU7rYChfDb1Ex8g== 2023-10-16T19:56:46.722 INFO:teuthology.orchestra.run.smithi157.stdout:[client.0] 2023-10-16T19:56:46.722 INFO:teuthology.orchestra.run.smithi157.stdout: key = AQB4lS1lDEZnABAAgwyj245ITd68cbde9kGXLg== 2023-10-16T19:56:46.723 INFO:teuthology.orchestra.run.smithi157.stdout:[client.2] 2023-10-16T19:56:46.723 INFO:teuthology.orchestra.run.smithi157.stdout: key = AQB4lS1lf98kBhAAxq6Iriv7Zfp6ExayRb4L2w== 2023-10-16T19:56:46.723 INFO:teuthology.orchestra.run.smithi157.stdout:[client.1] 2023-10-16T19:56:46.723 INFO:teuthology.orchestra.run.smithi157.stdout: key = AQB4lS1ltpqBCRAAyIq5zPLOOlOBOB4m946UIQ== 2023-10-16T19:56:46.723 INFO:teuthology.orchestra.run.smithi157.stdout:[client.3] 2023-10-16T19:56:46.723 INFO:teuthology.orchestra.run.smithi157.stdout: key = AQB4lS1lMVA2DxAA3k8Muyp1xzRDV1J/eMcGWw== 2023-10-16T19:56:46.737 INFO:teuthology.orchestra.run.smithi187.stdout:[mgr.y] 2023-10-16T19:56:46.737 INFO:teuthology.orchestra.run.smithi187.stdout: key = AQB3lS1lC6nDGxAAPKV8NiSzXbhI8JZzSScWFg== 2023-10-16T19:56:46.737 INFO:teuthology.orchestra.run.smithi187.stdout:[mds.a] 2023-10-16T19:56:46.738 INFO:teuthology.orchestra.run.smithi187.stdout: key = AQB3lS1lg7HmIxAAzjktpvL1qdxxP736JQ/B0A== 2023-10-16T19:56:46.738 INFO:teuthology.orchestra.run.smithi187.stdout:[mds.c] 2023-10-16T19:56:46.738 INFO:teuthology.orchestra.run.smithi187.stdout: key = AQB3lS1lEdo+KxAAg6zuFpNBTBGWZbxZToJZDw== 2023-10-16T19:56:46.738 INFO:teuthology.orchestra.run.smithi187.stdout:[osd.0] 2023-10-16T19:56:46.738 INFO:teuthology.orchestra.run.smithi187.stdout: key = AQB5lS1lmL7jKxAAM+VgKsIpDnnAwCe9ezIGFQ== 2023-10-16T19:56:46.739 INFO:teuthology.orchestra.run.smithi187.stdout:[osd.1] 2023-10-16T19:56:46.739 INFO:teuthology.orchestra.run.smithi187.stdout: key = AQB5lS1lH+QGMxAAOfeAzFe+r8lGhw8r66GGFw== 2023-10-16T19:56:46.739 INFO:teuthology.orchestra.run.smithi187.stdout:[osd.2] 2023-10-16T19:56:46.739 INFO:teuthology.orchestra.run.smithi187.stdout: key = AQB5lS1lfiI3OhAAgdf82Usxjk0dRac2WV8f/w== 2023-10-16T19:56:46.739 INFO:teuthology.orchestra.run.smithi187.stdout:[osd.3] 2023-10-16T19:56:46.740 INFO:teuthology.orchestra.run.smithi187.stdout: key = AQB6lS1lOPeqBRAAuNRDLPQUWrQ+WwgkaDJ5Zw== 2023-10-16T19:56:46.740 INFO:teuthology.orchestra.run.smithi187.stdout:[mgr.x] 2023-10-16T19:56:46.740 INFO:teuthology.orchestra.run.smithi187.stdout: key = AQB3lS1lmnp9IBAAnnnk+mwDhlku9vubS/Hkaw== 2023-10-16T19:56:46.740 INFO:teuthology.orchestra.run.smithi187.stdout:[mds.b] 2023-10-16T19:56:46.740 INFO:teuthology.orchestra.run.smithi187.stdout: key = AQB3lS1lhtZiMBAADscNDtPmUIViU0gQIvx7pQ== 2023-10-16T19:56:46.741 INFO:teuthology.orchestra.run.smithi187.stdout:[mds.d] 2023-10-16T19:56:46.741 INFO:teuthology.orchestra.run.smithi187.stdout: key = AQB3lS1lj4qxNxAAb70WUiRoKTkx896oK0nwHg== 2023-10-16T19:56:46.741 INFO:teuthology.orchestra.run.smithi187.stdout:[osd.4] 2023-10-16T19:56:46.741 INFO:teuthology.orchestra.run.smithi187.stdout: key = AQB9lS1l1zRsDBAAAljtwEGSG9IwA1BxkbjciQ== 2023-10-16T19:56:46.741 INFO:teuthology.orchestra.run.smithi187.stdout:[osd.5] 2023-10-16T19:56:46.742 INFO:teuthology.orchestra.run.smithi187.stdout: key = AQB9lS1lopEQFRAApkT4aNUF8lbz766O65ZjMQ== 2023-10-16T19:56:46.742 INFO:teuthology.orchestra.run.smithi187.stdout:[osd.6] 2023-10-16T19:56:46.742 INFO:teuthology.orchestra.run.smithi187.stdout: key = AQB9lS1leeUaHRAAtcKqYz0FmFZIhJ10sBzVfA== 2023-10-16T19:56:46.742 INFO:teuthology.orchestra.run.smithi187.stdout:[osd.7] 2023-10-16T19:56:46.742 INFO:teuthology.orchestra.run.smithi187.stdout: key = AQB9lS1lkUZZJBAAB7glunBFU7rYChfDb1Ex8g== 2023-10-16T19:56:46.743 INFO:teuthology.orchestra.run.smithi187.stdout:[client.0] 2023-10-16T19:56:46.743 INFO:teuthology.orchestra.run.smithi187.stdout: key = AQB4lS1lDEZnABAAgwyj245ITd68cbde9kGXLg== 2023-10-16T19:56:46.743 INFO:teuthology.orchestra.run.smithi187.stdout:[client.2] 2023-10-16T19:56:46.743 INFO:teuthology.orchestra.run.smithi187.stdout: key = AQB4lS1lf98kBhAAxq6Iriv7Zfp6ExayRb4L2w== 2023-10-16T19:56:46.743 INFO:teuthology.orchestra.run.smithi187.stdout:[client.1] 2023-10-16T19:56:46.744 INFO:teuthology.orchestra.run.smithi187.stdout: key = AQB4lS1ltpqBCRAAyIq5zPLOOlOBOB4m946UIQ== 2023-10-16T19:56:46.744 INFO:teuthology.orchestra.run.smithi187.stdout:[client.3] 2023-10-16T19:56:46.744 INFO:teuthology.orchestra.run.smithi187.stdout: key = AQB4lS1lMVA2DxAA3k8Muyp1xzRDV1J/eMcGWw== 2023-10-16T19:56:46.745 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-16T19:56:46.768 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-16T19:56:46.838 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-16T19:56:46.840 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-16T19:56:46.898 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-16T19:56:46.900 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-16T19:56:46.956 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-16T19:56:46.958 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-16T19:56:47.011 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-16T19:56:47.014 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-16T19:56:47.067 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-16T19:56:47.069 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-16T19:56:47.122 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-16T19:56:47.124 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-16T19:56:47.177 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-16T19:56:47.180 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-16T19:56:47.253 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-16T19:56:47.256 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-16T19:56:47.330 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-16T19:56:47.333 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-16T19:56:47.435 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-16T19:56:47.437 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-16T19:56:47.548 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-16T19:56:47.551 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-16T19:56:47.625 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-16T19:56:47.628 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-16T19:56:47.879 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-16T19:56:47.882 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-16T19:56:47.958 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-16T19:56:47.961 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-16T19:56:48.053 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-16T19:56:48.055 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-16T19:56:48.130 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-16T19:56:48.133 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-16T19:56:48.214 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-16T19:56:48.217 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-16T19:56:48.312 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-10-16T19:56:48.313 DEBUG:teuthology.orchestra.run.smithi157:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-10-16T19:56:48.339 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-16T19:56:48.436 DEBUG:teuthology.orchestra.run.smithi157:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-10-16T19:56:48.462 DEBUG:teuthology.orchestra.run.smithi187:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-10-16T19:56:48.490 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-16T19:56:48.589 DEBUG:teuthology.orchestra.run.smithi187:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-10-16T19:56:48.616 DEBUG:teuthology.orchestra.run.smithi187:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-10-16T19:56:48.683 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-16T19:56:48.781 DEBUG:teuthology.orchestra.run.smithi187:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-10-16T19:56:48.808 DEBUG:teuthology.orchestra.run.smithi157:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-10-16T19:56:48.810 DEBUG:teuthology.orchestra.run.smithi187:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-10-16T19:56:48.865 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-10-16T19:56:48.869 INFO:tasks.ceph.mon.a:Restarting daemon 2023-10-16T19:56:48.870 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-10-16T19:56:48.872 INFO:tasks.ceph.mon.a:Started 2023-10-16T19:56:48.873 INFO:tasks.ceph.mon.b:Restarting daemon 2023-10-16T19:56:48.873 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-10-16T19:56:48.907 INFO:tasks.ceph.mon.b:Started 2023-10-16T19:56:48.908 INFO:tasks.ceph.mon.c:Restarting daemon 2023-10-16T19:56:48.909 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-10-16T19:56:48.911 INFO:tasks.ceph.mon.c:Started 2023-10-16T19:56:48.912 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-10-16T19:56:48.913 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-10-16T19:56:48.913 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-10-16T19:56:48.917 INFO:tasks.ceph.mgr.y:Started 2023-10-16T19:56:48.917 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-10-16T19:56:48.918 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-10-16T19:56:48.920 INFO:tasks.ceph.mgr.x:Started 2023-10-16T19:56:48.921 INFO:tasks.ceph:Setting crush tunables to default 2023-10-16T19:56:48.921 DEBUG:teuthology.orchestra.run.smithi157:> sudo ceph --cluster ceph osd crush tunables default 2023-10-16T19:56:49.046 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:56:49.044+0000 7fe2cc893700 1 Processor -- start 2023-10-16T19:56:49.047 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:56:49.044+0000 7fe2cc893700 1 -- start start 2023-10-16T19:56:49.050 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:56:49.045+0000 7fe2cc893700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fe2c81456a0 0x7fe2c80cb0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:56:49.050 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:56:49.045+0000 7fe2cc893700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fe2c8160450 0x7fe2c80c7160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:56:49.051 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:56:49.045+0000 7fe2cc893700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2c806e9b0 con 0x7fe2c80b2710 2023-10-16T19:56:49.051 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:56:49.045+0000 7fe2cc893700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2c81608d0 con 0x7fe2c81456a0 2023-10-16T19:56:49.051 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:56:49.045+0000 7fe2cc893700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2c80c79d0 con 0x7fe2c8160450 2023-10-16T19:56:49.051 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:56:49.045+0000 7fe2c659c700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fe2c81456a0 0x7fe2c80cb0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:56:49.052 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:56:49.045+0000 7fe2c659c700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fe2c81456a0 0x7fe2c80cb0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:45062/0 (socket says 172.21.15.157:45062) 2023-10-16T19:56:49.052 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:56:49.045+0000 7fe2c659c700 1 -- 172.21.15.157:0/88472512 learned_addr learned my addr 172.21.15.157:0/88472512 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:56:49.052 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:56:49.045+0000 7fe2c659c700 1 -- 172.21.15.157:0/88472512 >> v2:172.21.15.157:3300/0 conn(0x7fe2c81456a0 msgr2=0x7fe2c80cb0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-10-16T19:56:49.053 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:56:49.045+0000 7fe2c659c700 1 -- 172.21.15.157:0/88472512 >> v2:172.21.15.157:3300/0 conn(0x7fe2c81456a0 msgr2=0x7fe2c80cb0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-16T19:56:49.053 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:56:49.045+0000 7fe2c659c700 1 --2- 172.21.15.157:0/88472512 >> v2:172.21.15.157:3300/0 conn(0x7fe2c81456a0 0x7fe2c80cb0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-16T19:56:49.053 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:56:49.045+0000 7fe2c5d9b700 1 --2- 172.21.15.157:0/88472512 >> v2:172.21.15.187:3300/0 conn(0x7fe2c8160450 0x7fe2c80c7160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:56:49.053 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:56:49.045+0000 7fe2c659c700 1 --2- 172.21.15.157:0/88472512 >> v2:172.21.15.157:3300/0 conn(0x7fe2c81456a0 0x7fe2c80cb0f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-16T19:56:49.054 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:56:49.045+0000 7fe2c5d9b700 1 -- 172.21.15.157:0/88472512 >> v2:172.21.15.187:3300/0 conn(0x7fe2c8160450 msgr2=0x7fe2c80c7160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-10-16T19:56:49.054 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:56:49.045+0000 7fe2c5d9b700 1 -- 172.21.15.157:0/88472512 >> v2:172.21.15.187:3300/0 conn(0x7fe2c8160450 msgr2=0x7fe2c80c7160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-16T19:56:49.054 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:56:49.045+0000 7fe2c5d9b700 1 --2- 172.21.15.157:0/88472512 >> v2:172.21.15.187:3300/0 conn(0x7fe2c8160450 0x7fe2c80c7160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-16T19:56:49.055 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:56:49.045+0000 7fe2c5d9b700 1 --2- 172.21.15.157:0/88472512 >> v2:172.21.15.187:3300/0 conn(0x7fe2c8160450 0x7fe2c80c7160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-16T19:56:49.217 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:56:49.215+0000 7fe2c559a700 1 -- 172.21.15.157:0/88472512 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 793950922 0 0) 0x7fe2c806e9b0 con 0x7fe2c80b2710 2023-10-16T19:56:49.218 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:56:49.215+0000 7fe2c559a700 1 -- 172.21.15.157:0/88472512 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe2b40035b0 con 0x7fe2c80b2710 2023-10-16T19:56:49.223 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:56:49.217+0000 7fe2c559a700 1 -- 172.21.15.157:0/88472512 <== mon.1 v1:172.21.15.187:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3274995792 0 0) 0x7fe2b40035b0 con 0x7fe2c80b2710 2023-10-16T19:56:49.223 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:56:49.217+0000 7fe2c559a700 1 -- 172.21.15.157:0/88472512 >> v2:172.21.15.187:3300/0 conn(0x7fe2c8160450 msgr2=0x7fe2c80c7160 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-16T19:56:49.223 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:56:49.217+0000 7fe2c559a700 1 --2- 172.21.15.157:0/88472512 >> v2:172.21.15.187:3300/0 conn(0x7fe2c8160450 0x7fe2c80c7160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:56:49.224 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:56:49.217+0000 7fe2c559a700 1 -- 172.21.15.157:0/88472512 >> v2:172.21.15.157:3300/0 conn(0x7fe2c81456a0 msgr2=0x7fe2c80cb0f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-16T19:56:49.224 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:56:49.217+0000 7fe2c559a700 1 --2- 172.21.15.157:0/88472512 >> v2:172.21.15.157:3300/0 conn(0x7fe2c81456a0 0x7fe2c80cb0f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:56:49.224 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:56:49.217+0000 7fe2c559a700 1 -- 172.21.15.157:0/88472512 --> v1:172.21.15.187:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2c8145a80 con 0x7fe2c80b2710 2023-10-16T19:56:49.224 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:56:49.217+0000 7fe2c559a700 1 -- 172.21.15.157:0/88472512 <== mon.1 v1:172.21.15.187:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4021145519 0 0) 0x7fe2b8001670 con 0x7fe2c80b2710 2023-10-16T19:56:49.224 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:56:49.217+0000 7fe2c559a700 1 -- 172.21.15.157:0/88472512 >> v1:172.21.15.187:6789/0 conn(0x7fe2c80b2710 legacy=0x7fe2c806d730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:56:49.225 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:56:49.217+0000 7fe2c559a700 1 --2- 172.21.15.157:0/88472512 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe2b4003a00 0x7fe2b4003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:56:49.225 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:56:49.217+0000 7fe2c559a700 1 --2- 172.21.15.157:0/88472512 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe2b4004850 0x7fe2b4004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:56:49.225 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:56:49.217+0000 7fe2c559a700 1 --2- 172.21.15.157:0/88472512 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe2b4005210 0x7fe2b400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:56:49.225 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:56:49.217+0000 7fe2c559a700 1 -- 172.21.15.157:0/88472512 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2c81608d0 con 0x7fe2b4005210 2023-10-16T19:56:49.225 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:56:49.217+0000 7fe2c559a700 1 -- 172.21.15.157:0/88472512 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2c80c79d0 con 0x7fe2b4004850 2023-10-16T19:56:49.226 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:56:49.217+0000 7fe2c559a700 1 -- 172.21.15.157:0/88472512 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2b400c110 con 0x7fe2b4003a00 2023-10-16T19:56:49.226 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:56:49.217+0000 7fe2c659c700 1 --2- 172.21.15.157:0/88472512 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe2b4003a00 0x7fe2b4003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:56:49.226 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:56:49.217+0000 7fe2c6d9d700 1 --2- 172.21.15.157:0/88472512 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe2b4005210 0x7fe2b400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:56:49.226 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:56:49.217+0000 7fe2c5d9b700 1 --2- 172.21.15.157:0/88472512 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe2b4004850 0x7fe2b4004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:56:49.226 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:56:49.217+0000 7fe2c6d9d700 1 -- 172.21.15.157:0/88472512 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe2b4003a00 msgr2=0x7fe2b4003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:56:49.227 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:56:49.217+0000 7fe2c6d9d700 1 --2- 172.21.15.157:0/88472512 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe2b4003a00 0x7fe2b4003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:56:49.227 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:56:49.217+0000 7fe2c6d9d700 1 -- 172.21.15.157:0/88472512 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe2b4004850 msgr2=0x7fe2b4004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:56:49.227 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:56:49.217+0000 7fe2c6d9d700 1 --2- 172.21.15.157:0/88472512 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe2b4004850 0x7fe2b4004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:56:49.227 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:56:49.217+0000 7fe2c6d9d700 1 -- 172.21.15.157:0/88472512 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2b40035b0 con 0x7fe2b4005210 2023-10-16T19:56:49.228 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:56:49.217+0000 7fe2c659c700 1 --2- 172.21.15.157:0/88472512 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe2b4003a00 0x7fe2b4003e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T19:56:49.228 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:56:49.217+0000 7fe2c6d9d700 1 -- 172.21.15.157:0/88472512 reap_dead start 2023-10-16T19:56:49.228 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:56:49.218+0000 7fe2c6d9d700 1 --2- 172.21.15.157:0/88472512 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe2b4005210 0x7fe2b400ba10 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fe2b800c190 tx=0x7fe2b4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e530949a1c2a2af server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:56:49.229 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:56:49.218+0000 7fe2c559a700 1 -- 172.21.15.157:0/88472512 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2b8016070 con 0x7fe2b4005210 2023-10-16T19:56:49.229 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:56:49.218+0000 7fe2c559a700 1 -- 172.21.15.157:0/88472512 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2b800ca70 con 0x7fe2b4005210 2023-10-16T19:56:49.229 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:56:49.218+0000 7fe2c559a700 1 -- 172.21.15.157:0/88472512 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2b8007b60 con 0x7fe2b4005210 2023-10-16T19:56:49.230 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:56:49.218+0000 7fe2cc893700 1 -- 172.21.15.157:0/88472512 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe2b4005210 msgr2=0x7fe2b400ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:56:49.230 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:56:49.218+0000 7fe2cc893700 1 --2- 172.21.15.157:0/88472512 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe2b4005210 0x7fe2b400ba10 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fe2b800c190 tx=0x7fe2b4005880 comp rx=0 tx=0).stop 2023-10-16T19:56:49.230 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:56:49.219+0000 7fe2cc893700 1 -- 172.21.15.157:0/88472512 shutdown_connections 2023-10-16T19:56:49.231 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:56:49.219+0000 7fe2cc893700 1 --2- 172.21.15.157:0/88472512 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe2b4005210 0x7fe2b400ba10 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:56:49.231 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:56:49.219+0000 7fe2cc893700 1 -- 172.21.15.157:0/88472512 >> 172.21.15.157:0/88472512 conn(0x7fe2c80d0b30 msgr2=0x7fe2c80d0f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:56:49.232 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:56:49.219+0000 7fe2cc893700 1 -- 172.21.15.157:0/88472512 shutdown_connections 2023-10-16T19:56:49.232 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:56:49.219+0000 7fe2cc893700 1 -- 172.21.15.157:0/88472512 wait complete. 2023-10-16T19:56:49.232 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:56:49.220+0000 7fe2cc893700 1 Processor -- start 2023-10-16T19:56:49.233 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:56:49.220+0000 7fe2cc893700 1 -- start start 2023-10-16T19:56:49.236 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:56:49.221+0000 7fe2cc893700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe2b4005210 0x7fe2c81f3100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:56:49.236 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:56:49.221+0000 7fe2cc893700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe2c815b320 0x7fe2c81ef000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:56:49.236 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:56:49.221+0000 7fe2cc893700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe2c80ce7d0 0x7fe2c813fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:56:49.236 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:56:49.221+0000 7fe2cc893700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2c813c200 con 0x7fe2c80ce7d0 2023-10-16T19:56:49.237 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:56:49.221+0000 7fe2cc893700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2c813c4e0 con 0x7fe2b4005210 2023-10-16T19:56:49.237 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:56:49.221+0000 7fe2cc893700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2c815b7a0 con 0x7fe2c815b320 2023-10-16T19:56:49.237 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:56:49.221+0000 7fe2c659c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe2b4005210 0x7fe2c81f3100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:56:49.238 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:56:49.221+0000 7fe2c659c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe2b4005210 0x7fe2c81f3100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.157:40202/0 (socket says 172.21.15.157:40202) 2023-10-16T19:56:49.238 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:56:49.221+0000 7fe2c659c700 1 -- 172.21.15.157:0/2436784163 learned_addr learned my addr 172.21.15.157:0/2436784163 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:56:49.239 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:56:49.221+0000 7fe2c5d9b700 1 --2- 172.21.15.157:0/2436784163 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe2c815b320 0x7fe2c81ef000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:56:49.239 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:56:49.222+0000 7fe2c659c700 1 -- 172.21.15.157:0/2436784163 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe2c815b320 msgr2=0x7fe2c81ef000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:56:49.239 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:56:49.222+0000 7fe2c659c700 1 --2- 172.21.15.157:0/2436784163 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe2c815b320 0x7fe2c81ef000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:56:49.240 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:56:49.222+0000 7fe2c659c700 1 -- 172.21.15.157:0/2436784163 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe2c80ce7d0 msgr2=0x7fe2c813fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:56:49.240 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:56:49.222+0000 7fe2c659c700 1 --2- 172.21.15.157:0/2436784163 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe2c80ce7d0 0x7fe2c813fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:56:49.240 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:56:49.222+0000 7fe2c659c700 1 -- 172.21.15.157:0/2436784163 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2c81ef540 con 0x7fe2b4005210 2023-10-16T19:56:49.240 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:56:49.222+0000 7fe2c659c700 1 --2- 172.21.15.157:0/2436784163 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe2b4005210 0x7fe2c81f3100 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fe2c0007e00 tx=0x7fe2c000f430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:56:49.241 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:56:49.222+0000 7fe2beffd700 1 -- 172.21.15.157:0/2436784163 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2c000fe50 con 0x7fe2b4005210 2023-10-16T19:56:49.241 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:56:49.222+0000 7fe2beffd700 1 -- 172.21.15.157:0/2436784163 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2c0016400 con 0x7fe2b4005210 2023-10-16T19:56:49.242 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:56:49.222+0000 7fe2cc893700 1 -- 172.21.15.157:0/2436784163 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2c81ef810 con 0x7fe2b4005210 2023-10-16T19:56:49.242 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:56:49.222+0000 7fe2beffd700 1 -- 172.21.15.157:0/2436784163 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2c00167b0 con 0x7fe2b4005210 2023-10-16T19:56:49.243 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:56:49.222+0000 7fe2cc893700 1 -- 172.21.15.157:0/2436784163 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2c81efdd0 con 0x7fe2b4005210 2023-10-16T19:56:49.243 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:56:49.223+0000 7fe2beffd700 1 -- 172.21.15.157:0/2436784163 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fe2c0016910 con 0x7fe2b4005210 2023-10-16T19:56:49.243 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:56:49.223+0000 7fe2beffd700 1 -- 172.21.15.157:0/2436784163 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fe2c001f9a0 con 0x7fe2b4005210 2023-10-16T19:56:49.244 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:56:49.224+0000 7fe2cc893700 1 -- 172.21.15.157:0/2436784163 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2c806ec30 con 0x7fe2b4005210 2023-10-16T19:56:49.244 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:56:49.226+0000 7fe2beffd700 1 -- 172.21.15.157:0/2436784163 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7fe2c003eb40 con 0x7fe2b4005210 2023-10-16T19:56:49.304 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:56:49.301+0000 7fe2cc893700 1 -- 172.21.15.157:0/2436784163 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7fe2c804f400 con 0x7fe2b4005210 2023-10-16T19:56:49.307 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:56:49.305+0000 7fe2beffd700 1 -- 172.21.15.157:0/2436784163 <== mon.1 v2:172.21.15.187:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7fe2c002d070 con 0x7fe2b4005210 2023-10-16T19:56:49.309 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:56:49.306+0000 7fe2cc893700 1 -- 172.21.15.157:0/2436784163 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe2b4005210 msgr2=0x7fe2c81f3100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:56:49.310 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:56:49.306+0000 7fe2cc893700 1 --2- 172.21.15.157:0/2436784163 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe2b4005210 0x7fe2c81f3100 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fe2c0007e00 tx=0x7fe2c000f430 comp rx=0 tx=0).stop 2023-10-16T19:56:49.310 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:56:49.306+0000 7fe2cc893700 1 -- 172.21.15.157:0/2436784163 shutdown_connections 2023-10-16T19:56:49.311 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:56:49.306+0000 7fe2cc893700 1 --2- 172.21.15.157:0/2436784163 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe2b4005210 0x7fe2c81f3100 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:56:49.311 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:56:49.306+0000 7fe2cc893700 1 --2- 172.21.15.157:0/2436784163 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe2c80ce7d0 0x7fe2c813fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:56:49.311 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:56:49.306+0000 7fe2cc893700 1 --2- 172.21.15.157:0/2436784163 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe2c815b320 0x7fe2c81ef000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:56:49.312 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:56:49.306+0000 7fe2cc893700 1 -- 172.21.15.157:0/2436784163 >> 172.21.15.157:0/2436784163 conn(0x7fe2c80d0b30 msgr2=0x7fe2c806ada0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:56:49.312 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:56:49.306+0000 7fe2cc893700 1 -- 172.21.15.157:0/2436784163 shutdown_connections 2023-10-16T19:56:49.312 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:56:49.306+0000 7fe2cc893700 1 -- 172.21.15.157:0/2436784163 wait complete. 2023-10-16T19:56:49.313 INFO:teuthology.orchestra.run.smithi157.stderr:adjusted tunables profile to default 2023-10-16T19:56:49.321 INFO:tasks.ceph:check_enable_crimson: False 2023-10-16T19:56:49.321 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-10-16T19:56:49.322 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2023-10-16T19:56:49.323 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-10-16T19:56:49.332 INFO:tasks.ceph.mgr.x.smithi187.stderr:2023-10-16T19:56:49.330+0000 7f4832adf200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-16T19:56:49.339 INFO:tasks.ceph.mgr.y.smithi157.stderr:2023-10-16T19:56:49.336+0000 7fa085de0200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-16T19:56:49.350 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2023-10-16T19:56:49.350 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-10-16T19:56:49.397 INFO:tasks.ceph.mgr.x.smithi187.stderr:2023-10-16T19:56:49.394+0000 7f4832adf200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-16T19:56:49.407 INFO:tasks.ceph.mgr.y.smithi157.stderr:2023-10-16T19:56:49.405+0000 7fa085de0200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-16T19:56:49.416 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2023-10-16T19:56:49.417 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-10-16T19:56:49.472 INFO:tasks.ceph.mgr.x.smithi187.stderr:2023-10-16T19:56:49.470+0000 7f4832adf200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-16T19:56:49.483 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2023-10-16T19:56:49.484 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-10-16T19:56:49.488 INFO:tasks.ceph.mgr.y.smithi157.stderr:2023-10-16T19:56:49.486+0000 7fa085de0200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-16T19:56:49.516 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-10-16T19:56:49.517 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-10-16T19:56:49.544 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-10-16T19:56:49.544 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-10-16T19:56:49.554 INFO:tasks.ceph.mgr.x.smithi187.stderr:2023-10-16T19:56:49.551+0000 7f4832adf200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-16T19:56:49.573 INFO:tasks.ceph.mgr.y.smithi157.stderr:2023-10-16T19:56:49.570+0000 7fa085de0200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-16T19:56:49.581 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-10-16T19:56:49.581 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-10-16T19:56:49.647 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-10-16T19:56:49.648 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-10-16T19:56:49.702 INFO:tasks.ceph.mgr.x.smithi187.stderr:2023-10-16T19:56:49.700+0000 7f4832adf200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-16T19:56:49.716 INFO:tasks.ceph.mgr.y.smithi157.stderr:2023-10-16T19:56:49.714+0000 7fa085de0200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-16T19:56:49.769 DEBUG:teuthology.orchestra.run.smithi187:> sudo ceph --cluster ceph osd new 00000000-0000-0000-0000-000000000000 0 2023-10-16T19:56:49.940 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:49.928+0000 7f5367a09700 1 Processor -- start 2023-10-16T19:56:49.940 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:49.929+0000 7f5367a09700 1 -- start start 2023-10-16T19:56:49.941 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:49.929+0000 7f5367a09700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f5360072980 0x7f536006d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:56:49.941 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:49.929+0000 7f5367a09700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f53600ca900 0x7f53600cbe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:56:49.941 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:49.929+0000 7f5367a09700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f536006d8f0 con 0x7f53600cc370 2023-10-16T19:56:49.941 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:49.929+0000 7f5367a09700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5360070bd0 con 0x7f5360072980 2023-10-16T19:56:49.941 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:49.929+0000 7f5367a09700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f536006b860 con 0x7f53600ca900 2023-10-16T19:56:49.942 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:49.930+0000 7f5364fa4700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f53600ca900 0x7f53600cbe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:56:49.942 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:49.930+0000 7f5365fa6700 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7f53600cc370 0x7f536015f8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.187:45264/0 (socket says 172.21.15.187:45264) 2023-10-16T19:56:49.942 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:49.930+0000 7f5365fa6700 1 -- 172.21.15.187:0/2955205281 learned_addr learned my addr 172.21.15.187:0/2955205281 (peer_addr_for_me v1:172.21.15.187:0/0) 2023-10-16T19:56:49.942 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:49.930+0000 7f5357fff700 1 -- 172.21.15.187:0/2955205281 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 141684818 0 0) 0x7f5358001490 con 0x7f53600cc370 2023-10-16T19:56:49.943 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:49.930+0000 7f5357fff700 1 -- 172.21.15.187:0/2955205281 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f534c0035b0 con 0x7f53600cc370 2023-10-16T19:56:49.943 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:49.930+0000 7f5364fa4700 1 -- 172.21.15.187:0/2955205281 >> v2:172.21.15.157:3300/0 conn(0x7f5360072980 msgr2=0x7f536006d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:56:49.943 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:49.930+0000 7f5364fa4700 1 --2- 172.21.15.187:0/2955205281 >> v2:172.21.15.157:3300/0 conn(0x7f5360072980 0x7f536006d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:56:49.943 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:49.930+0000 7f5364fa4700 1 -- 172.21.15.187:0/2955205281 >> v1:172.21.15.187:6789/0 conn(0x7f53600cc370 legacy=0x7f536015f8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:56:49.943 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:49.930+0000 7f5364fa4700 1 -- 172.21.15.187:0/2955205281 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53600cad90 con 0x7f53600ca900 2023-10-16T19:56:49.944 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:49.930+0000 7f5364fa4700 1 --2- 172.21.15.187:0/2955205281 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f53600ca900 0x7f53600cbe30 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f5350009840 tx=0x7f5350009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=697d8766ba944b94 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:56:49.944 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:49.930+0000 7f5357fff700 1 -- 172.21.15.187:0/2955205281 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5350011830 con 0x7f53600ca900 2023-10-16T19:56:49.945 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:49.930+0000 7f5357fff700 1 -- 172.21.15.187:0/2955205281 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5350011990 con 0x7f53600ca900 2023-10-16T19:56:49.945 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:49.930+0000 7f5357fff700 1 -- 172.21.15.187:0/2955205281 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5350011d20 con 0x7f53600ca900 2023-10-16T19:56:49.945 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:49.931+0000 7f5367a09700 1 -- 172.21.15.187:0/2955205281 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f53600ca900 msgr2=0x7f53600cbe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:56:49.945 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:49.931+0000 7f5367a09700 1 --2- 172.21.15.187:0/2955205281 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f53600ca900 0x7f53600cbe30 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f5350009840 tx=0x7f5350009b50 comp rx=0 tx=0).stop 2023-10-16T19:56:49.945 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:49.931+0000 7f5367a09700 1 -- 172.21.15.187:0/2955205281 shutdown_connections 2023-10-16T19:56:49.946 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:49.931+0000 7f5367a09700 1 --2- 172.21.15.187:0/2955205281 >> v2:172.21.15.157:3300/0 conn(0x7f5360072980 0x7f536006d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:56:49.946 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:49.931+0000 7f5367a09700 1 --2- 172.21.15.187:0/2955205281 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f53600ca900 0x7f53600cbe30 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:56:49.946 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:49.931+0000 7f5367a09700 1 -- 172.21.15.187:0/2955205281 >> 172.21.15.187:0/2955205281 conn(0x7f536006c7e0 msgr2=0x7f536006cbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:56:49.946 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:49.931+0000 7f5367a09700 1 -- 172.21.15.187:0/2955205281 shutdown_connections 2023-10-16T19:56:49.946 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:49.931+0000 7f5367a09700 1 -- 172.21.15.187:0/2955205281 wait complete. 2023-10-16T19:56:49.947 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:49.932+0000 7f5367a09700 1 Processor -- start 2023-10-16T19:56:49.947 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:49.932+0000 7f5367a09700 1 -- start start 2023-10-16T19:56:49.947 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:49.933+0000 7f5367a09700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5360072980 0x7f53601f1400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:56:49.947 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:49.933+0000 7f5367a09700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f53600cc370 0x7f536015d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:56:49.947 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:49.933+0000 7f5367a09700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5360159750 0x7f536015a100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:56:49.948 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:49.933+0000 7f5367a09700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53601f2660 con 0x7f5360072980 2023-10-16T19:56:49.948 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:49.933+0000 7f5367a09700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53601f19f0 con 0x7f5360159750 2023-10-16T19:56:49.948 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:49.933+0000 7f5367a09700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53601f1cd0 con 0x7f53600cc370 2023-10-16T19:56:49.949 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:49.933+0000 7f5365fa6700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5360159750 0x7f536015a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:56:49.949 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:49.933+0000 7f5365fa6700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5360159750 0x7f536015a100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.187:42310/0 (socket says 172.21.15.187:42310) 2023-10-16T19:56:49.949 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:49.933+0000 7f5365fa6700 1 -- 172.21.15.187:0/361612358 learned_addr learned my addr 172.21.15.187:0/361612358 (peer_addr_for_me v2:172.21.15.187:0/0) 2023-10-16T19:56:49.949 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:49.933+0000 7f5364fa4700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f53600cc370 0x7f536015d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:56:49.950 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:49.933+0000 7f53657a5700 1 --2- 172.21.15.187:0/361612358 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5360072980 0x7f53601f1400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:56:49.950 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:49.933+0000 7f5365fa6700 1 -- 172.21.15.187:0/361612358 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f53600cc370 msgr2=0x7f536015d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:56:49.950 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:49.933+0000 7f5365fa6700 1 --2- 172.21.15.187:0/361612358 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f53600cc370 0x7f536015d140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:56:49.950 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:49.933+0000 7f5365fa6700 1 -- 172.21.15.187:0/361612358 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5360072980 msgr2=0x7f53601f1400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:56:49.951 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:49.933+0000 7f5365fa6700 1 --2- 172.21.15.187:0/361612358 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5360072980 0x7f53601f1400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:56:49.951 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:49.933+0000 7f5365fa6700 1 -- 172.21.15.187:0/361612358 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53500094a0 con 0x7f5360159750 2023-10-16T19:56:49.952 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:49.933+0000 7f53657a5700 1 --2- 172.21.15.187:0/361612358 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5360072980 0x7f53601f1400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T19:56:49.952 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:49.933+0000 7f5364fa4700 1 --2- 172.21.15.187:0/361612358 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f53600cc370 0x7f536015d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T19:56:49.952 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:49.933+0000 7f5365fa6700 1 --2- 172.21.15.187:0/361612358 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5360159750 0x7f536015a100 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f535800cb40 tx=0x7f535800ce50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:56:49.952 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:49.933+0000 7f5355ffb700 1 -- 172.21.15.187:0/361612358 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f535800aaa0 con 0x7f5360159750 2023-10-16T19:56:49.953 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:49.934+0000 7f5355ffb700 1 -- 172.21.15.187:0/361612358 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f535800ac00 con 0x7f5360159750 2023-10-16T19:56:49.953 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:49.934+0000 7f5355ffb700 1 -- 172.21.15.187:0/361612358 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5358012400 con 0x7f5360159750 2023-10-16T19:56:49.953 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:49.934+0000 7f5367a09700 1 -- 172.21.15.187:0/361612358 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53601f1fb0 con 0x7f5360159750 2023-10-16T19:56:49.953 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:49.934+0000 7f5355ffb700 1 -- 172.21.15.187:0/361612358 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f5358012560 con 0x7f5360159750 2023-10-16T19:56:49.953 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:49.934+0000 7f5367a09700 1 -- 172.21.15.187:0/361612358 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f536015ec90 con 0x7f5360159750 2023-10-16T19:56:49.954 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:49.934+0000 7f5355ffb700 1 -- 172.21.15.187:0/361612358 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f5358012d30 con 0x7f5360159750 2023-10-16T19:56:49.954 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:49.935+0000 7f5367a09700 1 -- 172.21.15.187:0/361612358 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53601f27d0 con 0x7f5360159750 2023-10-16T19:56:49.955 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:49.937+0000 7f5355ffb700 1 -- 172.21.15.187:0/361612358 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f53601f27d0 con 0x7f5360159750 2023-10-16T19:56:50.023 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.020+0000 7f5367a09700 1 -- 172.21.15.187:0/361612358 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 0} v 0) v1 -- 0x7f536004f400 con 0x7f5360159750 2023-10-16T19:56:50.025 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.023+0000 7f5355ffb700 1 -- 172.21.15.187:0/361612358 <== mon.1 v2:172.21.15.187:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f5358017070 con 0x7f5360159750 2023-10-16T19:56:50.026 INFO:teuthology.orchestra.run.smithi187.stdout:0 2023-10-16T19:56:50.027 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.024+0000 7f5367a09700 1 -- 172.21.15.187:0/361612358 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5360159750 msgr2=0x7f536015a100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:56:50.027 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.024+0000 7f5367a09700 1 --2- 172.21.15.187:0/361612358 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5360159750 0x7f536015a100 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f535800cb40 tx=0x7f535800ce50 comp rx=0 tx=0).stop 2023-10-16T19:56:50.027 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.024+0000 7f5367a09700 1 -- 172.21.15.187:0/361612358 shutdown_connections 2023-10-16T19:56:50.028 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.024+0000 7f5367a09700 1 --2- 172.21.15.187:0/361612358 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5360159750 0x7f536015a100 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:56:50.028 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.024+0000 7f5367a09700 1 --2- 172.21.15.187:0/361612358 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5360072980 0x7f53601f1400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:56:50.029 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.024+0000 7f5367a09700 1 --2- 172.21.15.187:0/361612358 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f53600cc370 0x7f536015d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:56:50.029 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.024+0000 7f5367a09700 1 -- 172.21.15.187:0/361612358 >> 172.21.15.187:0/361612358 conn(0x7f536006c7e0 msgr2=0x7f53600b5b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:56:50.029 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.024+0000 7f5367a09700 1 -- 172.21.15.187:0/361612358 shutdown_connections 2023-10-16T19:56:50.030 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.024+0000 7f5367a09700 1 -- 172.21.15.187:0/361612358 wait complete. 2023-10-16T19:56:50.039 DEBUG:teuthology.orchestra.run.smithi187:> sudo ceph --cluster ceph osd new 00000000-0000-0000-0000-000000000000 1 2023-10-16T19:56:50.127 INFO:tasks.ceph.mgr.x.smithi187.stderr:2023-10-16T19:56:50.124+0000 7f4832adf200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-16T19:56:50.160 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.157+0000 7f4953e9c700 1 Processor -- start 2023-10-16T19:56:50.160 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.157+0000 7f4953e9c700 1 -- start start 2023-10-16T19:56:50.163 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.159+0000 7f4953e9c700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f494c143bd0 0x7f494c0cef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:56:50.163 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.159+0000 7f4953e9c700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f494c0b2e20 0x7f494c071080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:56:50.163 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.159+0000 7f4953e9c700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f494c06e180 con 0x7f494c0cf4c0 2023-10-16T19:56:50.163 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.159+0000 7f4953e9c700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f494c143fb0 con 0x7f494c143bd0 2023-10-16T19:56:50.164 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.159+0000 7f4953e9c700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f494c144480 con 0x7f494c0b2e20 2023-10-16T19:56:50.164 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.159+0000 7f4952439700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f494c0b2e20 0x7f494c071080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:56:50.164 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.159+0000 7f4952439700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f494c0b2e20 0x7f494c071080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.187:42316/0 (socket says 172.21.15.187:42316) 2023-10-16T19:56:50.164 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.159+0000 7f4952439700 1 -- 172.21.15.187:0/1439008816 learned_addr learned my addr 172.21.15.187:0/1439008816 (peer_addr_for_me v2:172.21.15.187:0/0) 2023-10-16T19:56:50.164 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.159+0000 7f4951c38700 1 --2- 172.21.15.187:0/1439008816 >> v2:172.21.15.157:3300/0 conn(0x7f494c143bd0 0x7f494c0cef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:56:50.165 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.159+0000 7f4952439700 1 -- 172.21.15.187:0/1439008816 >> v2:172.21.15.157:3300/0 conn(0x7f494c143bd0 msgr2=0x7f494c0cef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:56:50.165 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.159+0000 7f4952439700 1 --2- 172.21.15.187:0/1439008816 >> v2:172.21.15.157:3300/0 conn(0x7f494c143bd0 0x7f494c0cef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:56:50.165 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.159+0000 7f4952439700 1 -- 172.21.15.187:0/1439008816 >> v1:172.21.15.157:6789/0 conn(0x7f494c0cf4c0 legacy=0x7f494c0b2710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:56:50.165 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.159+0000 7f4952439700 1 -- 172.21.15.187:0/1439008816 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f494c071c60 con 0x7f494c0b2e20 2023-10-16T19:56:50.165 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.159+0000 7f4952439700 1 --2- 172.21.15.187:0/1439008816 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f494c0b2e20 0x7f494c071080 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f494c0c7af0 tx=0x7f494400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=88665683cbdca3f7 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:56:50.165 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.160+0000 7f4950c36700 1 -- 172.21.15.187:0/1439008816 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f494400e070 con 0x7f494c0b2e20 2023-10-16T19:56:50.166 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.160+0000 7f4950c36700 1 -- 172.21.15.187:0/1439008816 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f494400b9c0 con 0x7f494c0b2e20 2023-10-16T19:56:50.167 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.160+0000 7f4950c36700 1 -- 172.21.15.187:0/1439008816 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f494400bd70 con 0x7f494c0b2e20 2023-10-16T19:56:50.167 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.160+0000 7f4953e9c700 1 -- 172.21.15.187:0/1439008816 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f494c0b2e20 msgr2=0x7f494c071080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:56:50.167 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.160+0000 7f4953e9c700 1 --2- 172.21.15.187:0/1439008816 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f494c0b2e20 0x7f494c071080 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f494c0c7af0 tx=0x7f494400b330 comp rx=0 tx=0).stop 2023-10-16T19:56:50.167 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.160+0000 7f4953e9c700 1 -- 172.21.15.187:0/1439008816 shutdown_connections 2023-10-16T19:56:50.167 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.160+0000 7f4953e9c700 1 --2- 172.21.15.187:0/1439008816 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f494c0b2e20 0x7f494c071080 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:56:50.168 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.160+0000 7f4953e9c700 1 --2- 172.21.15.187:0/1439008816 >> v2:172.21.15.157:3300/0 conn(0x7f494c143bd0 0x7f494c0cef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:56:50.168 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.160+0000 7f4953e9c700 1 -- 172.21.15.187:0/1439008816 >> 172.21.15.187:0/1439008816 conn(0x7f494c0d0b30 msgr2=0x7f494c0d0f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:56:50.168 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.160+0000 7f4953e9c700 1 -- 172.21.15.187:0/1439008816 shutdown_connections 2023-10-16T19:56:50.168 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.160+0000 7f4953e9c700 1 -- 172.21.15.187:0/1439008816 wait complete. 2023-10-16T19:56:50.171 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.162+0000 7f4953e9c700 1 Processor -- start 2023-10-16T19:56:50.171 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.162+0000 7f4953e9c700 1 -- start start 2023-10-16T19:56:50.171 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.164+0000 7f4953e9c700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f494c0b2e20 0x7f494c0b4690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:56:50.171 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.164+0000 7f4953e9c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f494c0cf4c0 0x7f494c1f2ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:56:50.172 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.164+0000 7f4953e9c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f494c143bd0 0x7f494c0cb6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:56:50.172 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.164+0000 7f4953e9c700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f494c0c9c10 con 0x7f494c143bd0 2023-10-16T19:56:50.172 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.164+0000 7f4953e9c700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f494c1371b0 con 0x7f494c0cf4c0 2023-10-16T19:56:50.172 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.164+0000 7f4953e9c700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f494c137490 con 0x7f494c0b2e20 2023-10-16T19:56:50.172 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.164+0000 7f4951437700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f494c0cf4c0 0x7f494c1f2ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:56:50.173 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.164+0000 7f4951437700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f494c0cf4c0 0x7f494c1f2ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.187:42320/0 (socket says 172.21.15.187:42320) 2023-10-16T19:56:50.173 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.164+0000 7f4951c38700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f494c0b2e20 0x7f494c0b4690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:56:50.173 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.164+0000 7f4951437700 1 -- 172.21.15.187:0/3267485174 learned_addr learned my addr 172.21.15.187:0/3267485174 (peer_addr_for_me v2:172.21.15.187:0/0) 2023-10-16T19:56:50.173 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.164+0000 7f4952439700 1 --2- 172.21.15.187:0/3267485174 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f494c143bd0 0x7f494c0cb6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:56:50.174 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.164+0000 7f4951437700 1 -- 172.21.15.187:0/3267485174 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f494c0b2e20 msgr2=0x7f494c0b4690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:56:50.174 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.164+0000 7f4951437700 1 --2- 172.21.15.187:0/3267485174 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f494c0b2e20 0x7f494c0b4690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:56:50.174 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.164+0000 7f4951437700 1 -- 172.21.15.187:0/3267485174 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f494c143bd0 msgr2=0x7f494c0cb6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:56:50.174 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.164+0000 7f4951437700 1 --2- 172.21.15.187:0/3267485174 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f494c143bd0 0x7f494c0cb6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:56:50.174 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.164+0000 7f4951437700 1 -- 172.21.15.187:0/3267485174 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4944009b30 con 0x7f494c0cf4c0 2023-10-16T19:56:50.175 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.164+0000 7f4951437700 1 --2- 172.21.15.187:0/3267485174 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f494c0cf4c0 0x7f494c1f2ca0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f493c00c4e0 tx=0x7f493c00c7f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:56:50.175 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.164+0000 7f49427fc700 1 -- 172.21.15.187:0/3267485174 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f493c0052d0 con 0x7f494c0cf4c0 2023-10-16T19:56:50.175 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.164+0000 7f49427fc700 1 -- 172.21.15.187:0/3267485174 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f493c005430 con 0x7f494c0cf4c0 2023-10-16T19:56:50.175 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.164+0000 7f49427fc700 1 -- 172.21.15.187:0/3267485174 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f493c0038c0 con 0x7f494c0cf4c0 2023-10-16T19:56:50.175 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.164+0000 7f4953e9c700 1 -- 172.21.15.187:0/3267485174 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f494c137770 con 0x7f494c0cf4c0 2023-10-16T19:56:50.176 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.164+0000 7f4953e9c700 1 -- 172.21.15.187:0/3267485174 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f494c1f31e0 con 0x7f494c0cf4c0 2023-10-16T19:56:50.176 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.165+0000 7f49427fc700 1 -- 172.21.15.187:0/3267485174 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f493c003d20 con 0x7f494c0cf4c0 2023-10-16T19:56:50.176 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.165+0000 7f49427fc700 1 -- 172.21.15.187:0/3267485174 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f493c011e30 con 0x7f494c0cf4c0 2023-10-16T19:56:50.176 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.165+0000 7f4953e9c700 1 -- 172.21.15.187:0/3267485174 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f494c1f3370 con 0x7f494c0cf4c0 2023-10-16T19:56:50.177 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.167+0000 7f49427fc700 1 -- 172.21.15.187:0/3267485174 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f493c017070 con 0x7f494c0cf4c0 2023-10-16T19:56:50.251 INFO:tasks.ceph.mgr.x.smithi187.stderr:2023-10-16T19:56:50.249+0000 7f4832adf200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-16T19:56:50.254 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.251+0000 7f4953e9c700 1 -- 172.21.15.187:0/3267485174 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 1} v 0) v1 -- 0x7f494c04f400 con 0x7f494c0cf4c0 2023-10-16T19:56:50.257 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.254+0000 7f49427fc700 1 -- 172.21.15.187:0/3267485174 <== mon.1 v2:172.21.15.187:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f493c011590 con 0x7f494c0cf4c0 2023-10-16T19:56:50.258 INFO:teuthology.orchestra.run.smithi187.stdout:1 2023-10-16T19:56:50.260 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.255+0000 7f4953e9c700 1 -- 172.21.15.187:0/3267485174 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f494c0cf4c0 msgr2=0x7f494c1f2ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:56:50.260 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.255+0000 7f4953e9c700 1 --2- 172.21.15.187:0/3267485174 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f494c0cf4c0 0x7f494c1f2ca0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f493c00c4e0 tx=0x7f493c00c7f0 comp rx=0 tx=0).stop 2023-10-16T19:56:50.261 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.255+0000 7f4953e9c700 1 -- 172.21.15.187:0/3267485174 shutdown_connections 2023-10-16T19:56:50.261 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.255+0000 7f4953e9c700 1 --2- 172.21.15.187:0/3267485174 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f494c143bd0 0x7f494c0cb6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:56:50.262 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.255+0000 7f4953e9c700 1 --2- 172.21.15.187:0/3267485174 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f494c0b2e20 0x7f494c0b4690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:56:50.263 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.255+0000 7f4953e9c700 1 --2- 172.21.15.187:0/3267485174 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f494c0cf4c0 0x7f494c1f2ca0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:56:50.263 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.255+0000 7f4953e9c700 1 -- 172.21.15.187:0/3267485174 >> 172.21.15.187:0/3267485174 conn(0x7f494c0d0b30 msgr2=0x7f494c0cff80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:56:50.263 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.256+0000 7f4953e9c700 1 -- 172.21.15.187:0/3267485174 shutdown_connections 2023-10-16T19:56:50.263 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.256+0000 7f4953e9c700 1 -- 172.21.15.187:0/3267485174 wait complete. 2023-10-16T19:56:50.270 DEBUG:teuthology.orchestra.run.smithi187:> sudo ceph --cluster ceph osd new 00000000-0000-0000-0000-000000000000 2 2023-10-16T19:56:50.318 INFO:tasks.ceph.mgr.y.smithi157.stderr:2023-10-16T19:56:50.314+0000 7fa085de0200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-16T19:56:50.357 INFO:tasks.ceph.mgr.x.smithi187.stderr:2023-10-16T19:56:50.354+0000 7f4832adf200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-16T19:56:50.390 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.387+0000 7f3333194700 1 Processor -- start 2023-10-16T19:56:50.390 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.387+0000 7f3333194700 1 -- start start 2023-10-16T19:56:50.398 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.388+0000 7f3333194700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f332c0b2710 0x7f332c0b2b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:56:50.398 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.388+0000 7f3333194700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f332c071080 0x7f332c071510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:56:50.398 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.388+0000 7f3333194700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f332c06e180 con 0x7f332c143bd0 2023-10-16T19:56:50.398 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.388+0000 7f3333194700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f332c0b30d0 con 0x7f332c071080 2023-10-16T19:56:50.399 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.388+0000 7f3333194700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f332c071a50 con 0x7f332c0b2710 2023-10-16T19:56:50.399 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.388+0000 7f332bfff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f332c0b2710 0x7f332c0b2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:56:50.399 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.388+0000 7f3330f30700 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7f332c143bd0 0x7f332c0cef80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.187:45284/0 (socket says 172.21.15.187:45284) 2023-10-16T19:56:50.399 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.388+0000 7f3330f30700 1 -- 172.21.15.187:0/509082498 learned_addr learned my addr 172.21.15.187:0/509082498 (peer_addr_for_me v1:172.21.15.187:0/0) 2023-10-16T19:56:50.400 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.388+0000 7f3331731700 1 --2- 172.21.15.187:0/509082498 >> v2:172.21.15.157:3300/0 conn(0x7f332c071080 0x7f332c071510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:56:50.400 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.388+0000 7f332bfff700 1 -- 172.21.15.187:0/509082498 >> v2:172.21.15.157:3300/0 conn(0x7f332c071080 msgr2=0x7f332c071510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:56:50.400 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.388+0000 7f332bfff700 1 --2- 172.21.15.187:0/509082498 >> v2:172.21.15.157:3300/0 conn(0x7f332c071080 0x7f332c071510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:56:50.400 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.388+0000 7f332bfff700 1 -- 172.21.15.187:0/509082498 >> v1:172.21.15.187:6789/0 conn(0x7f332c143bd0 legacy=0x7f332c0cef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:56:50.401 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.388+0000 7f332b7fe700 1 -- 172.21.15.187:0/509082498 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 899774733 0 0) 0x7f332c06e180 con 0x7f332c143bd0 2023-10-16T19:56:50.401 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.388+0000 7f332bfff700 1 -- 172.21.15.187:0/509082498 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f332c144480 con 0x7f332c0b2710 2023-10-16T19:56:50.401 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.388+0000 7f3331731700 1 --2- 172.21.15.187:0/509082498 >> v2:172.21.15.157:3300/0 conn(0x7f332c071080 0x7f332c071510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T19:56:50.401 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.389+0000 7f332bfff700 1 --2- 172.21.15.187:0/509082498 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f332c0b2710 0x7f332c0b2b90 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f332c0c7930 tx=0x7f331800bdc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=379ab7ac3eb8620 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:56:50.401 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.389+0000 7f332b7fe700 1 -- 172.21.15.187:0/509082498 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f331800dc70 con 0x7f332c0b2710 2023-10-16T19:56:50.401 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.389+0000 7f332b7fe700 1 -- 172.21.15.187:0/509082498 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f331800ddd0 con 0x7f332c0b2710 2023-10-16T19:56:50.402 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.389+0000 7f332b7fe700 1 -- 172.21.15.187:0/509082498 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3318010690 con 0x7f332c0b2710 2023-10-16T19:56:50.402 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.389+0000 7f3333194700 1 -- 172.21.15.187:0/509082498 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f332c0b2710 msgr2=0x7f332c0b2b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:56:50.402 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.389+0000 7f3333194700 1 --2- 172.21.15.187:0/509082498 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f332c0b2710 0x7f332c0b2b90 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f332c0c7930 tx=0x7f331800bdc0 comp rx=0 tx=0).stop 2023-10-16T19:56:50.402 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.389+0000 7f3333194700 1 -- 172.21.15.187:0/509082498 shutdown_connections 2023-10-16T19:56:50.402 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.389+0000 7f3333194700 1 --2- 172.21.15.187:0/509082498 >> v2:172.21.15.157:3300/0 conn(0x7f332c071080 0x7f332c071510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:56:50.403 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.389+0000 7f3333194700 1 --2- 172.21.15.187:0/509082498 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f332c0b2710 0x7f332c0b2b90 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:56:50.403 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.389+0000 7f3333194700 1 -- 172.21.15.187:0/509082498 >> 172.21.15.187:0/509082498 conn(0x7f332c0d0b30 msgr2=0x7f332c0d0f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:56:50.403 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.389+0000 7f3333194700 1 -- 172.21.15.187:0/509082498 shutdown_connections 2023-10-16T19:56:50.403 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.389+0000 7f3333194700 1 -- 172.21.15.187:0/509082498 wait complete. 2023-10-16T19:56:50.403 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.391+0000 7f3333194700 1 Processor -- start 2023-10-16T19:56:50.404 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.391+0000 7f3333194700 1 -- start start 2023-10-16T19:56:50.404 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.392+0000 7f3333194700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f332c071080 0x7f332c132060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:56:50.404 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.392+0000 7f3333194700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f332c0b2710 0x7f332c137bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:56:50.404 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.392+0000 7f3333194700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f332c143bd0 0x7f332c1380f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:56:50.405 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.392+0000 7f3333194700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f332c1325a0 con 0x7f332c143bd0 2023-10-16T19:56:50.405 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.392+0000 7f3333194700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f332c0cef40 con 0x7f332c0b2710 2023-10-16T19:56:50.406 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.392+0000 7f3333194700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f332c0cac40 con 0x7f332c071080 2023-10-16T19:56:50.406 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.392+0000 7f332bfff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f332c0b2710 0x7f332c137bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:56:50.406 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.392+0000 7f332bfff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f332c0b2710 0x7f332c137bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.187:42330/0 (socket says 172.21.15.187:42330) 2023-10-16T19:56:50.407 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.392+0000 7f332bfff700 1 -- 172.21.15.187:0/840762247 learned_addr learned my addr 172.21.15.187:0/840762247 (peer_addr_for_me v2:172.21.15.187:0/0) 2023-10-16T19:56:50.408 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.392+0000 7f3330f30700 1 --2- 172.21.15.187:0/840762247 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f332c071080 0x7f332c132060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:56:50.408 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.392+0000 7f3331731700 1 --2- 172.21.15.187:0/840762247 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f332c143bd0 0x7f332c1380f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:56:50.409 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.393+0000 7f332bfff700 1 -- 172.21.15.187:0/840762247 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f332c071080 msgr2=0x7f332c132060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:56:50.409 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.393+0000 7f332bfff700 1 --2- 172.21.15.187:0/840762247 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f332c071080 0x7f332c132060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:56:50.410 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.393+0000 7f332bfff700 1 -- 172.21.15.187:0/840762247 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f332c143bd0 msgr2=0x7f332c1380f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:56:50.410 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.393+0000 7f332bfff700 1 --2- 172.21.15.187:0/840762247 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f332c143bd0 0x7f332c1380f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:56:50.410 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.393+0000 7f332bfff700 1 -- 172.21.15.187:0/840762247 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f331800b740 con 0x7f332c0b2710 2023-10-16T19:56:50.411 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.393+0000 7f3330f30700 1 --2- 172.21.15.187:0/840762247 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f332c071080 0x7f332c132060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T19:56:50.411 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.393+0000 7f332bfff700 1 --2- 172.21.15.187:0/840762247 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f332c0b2710 0x7f332c137bb0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f331800b2c0 tx=0x7f3318004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:56:50.412 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.393+0000 7f33297fa700 1 -- 172.21.15.187:0/840762247 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f331801d070 con 0x7f332c0b2710 2023-10-16T19:56:50.412 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.393+0000 7f33297fa700 1 -- 172.21.15.187:0/840762247 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3318010680 con 0x7f332c0b2710 2023-10-16T19:56:50.412 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.393+0000 7f3333194700 1 -- 172.21.15.187:0/840762247 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f332c0cf1e0 con 0x7f332c0b2710 2023-10-16T19:56:50.413 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.393+0000 7f33297fa700 1 -- 172.21.15.187:0/840762247 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3318010a40 con 0x7f332c0b2710 2023-10-16T19:56:50.413 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.393+0000 7f3333194700 1 -- 172.21.15.187:0/840762247 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f332c0cf7a0 con 0x7f332c0b2710 2023-10-16T19:56:50.413 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.393+0000 7f33297fa700 1 -- 172.21.15.187:0/840762247 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f3318010ba0 con 0x7f332c0b2710 2023-10-16T19:56:50.414 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.393+0000 7f33297fa700 1 -- 172.21.15.187:0/840762247 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7f3318022890 con 0x7f332c0b2710 2023-10-16T19:56:50.414 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.394+0000 7f3333194700 1 -- 172.21.15.187:0/840762247 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f332c071f40 con 0x7f332c0b2710 2023-10-16T19:56:50.415 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.396+0000 7f33297fa700 1 -- 172.21.15.187:0/840762247 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f3318030060 con 0x7f332c0b2710 2023-10-16T19:56:50.435 INFO:tasks.ceph.mgr.y.smithi157.stderr:2023-10-16T19:56:50.431+0000 7fa085de0200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-16T19:56:50.441 INFO:tasks.ceph.mgr.x.smithi187.stderr:2023-10-16T19:56:50.439+0000 7f4832adf200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-16T19:56:50.481 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.478+0000 7f3333194700 1 -- 172.21.15.187:0/840762247 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 2} v 0) v1 -- 0x7f332c04f400 con 0x7f332c0b2710 2023-10-16T19:56:50.484 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.481+0000 7f33297fa700 1 -- 172.21.15.187:0/840762247 <== mon.1 v2:172.21.15.187:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f3318027070 con 0x7f332c0b2710 2023-10-16T19:56:50.484 INFO:teuthology.orchestra.run.smithi187.stdout:2 2023-10-16T19:56:50.486 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.482+0000 7f3333194700 1 -- 172.21.15.187:0/840762247 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f332c0b2710 msgr2=0x7f332c137bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:56:50.486 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.482+0000 7f3333194700 1 --2- 172.21.15.187:0/840762247 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f332c0b2710 0x7f332c137bb0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f331800b2c0 tx=0x7f3318004750 comp rx=0 tx=0).stop 2023-10-16T19:56:50.487 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.482+0000 7f3333194700 1 -- 172.21.15.187:0/840762247 shutdown_connections 2023-10-16T19:56:50.487 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.482+0000 7f3333194700 1 --2- 172.21.15.187:0/840762247 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f332c143bd0 0x7f332c1380f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:56:50.489 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.482+0000 7f3333194700 1 --2- 172.21.15.187:0/840762247 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f332c071080 0x7f332c132060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:56:50.489 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.482+0000 7f3333194700 1 --2- 172.21.15.187:0/840762247 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f332c0b2710 0x7f332c137bb0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:56:50.489 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.482+0000 7f3333194700 1 -- 172.21.15.187:0/840762247 >> 172.21.15.187:0/840762247 conn(0x7f332c0d0b30 msgr2=0x7f332c1582c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:56:50.489 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.482+0000 7f3333194700 1 -- 172.21.15.187:0/840762247 shutdown_connections 2023-10-16T19:56:50.490 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.482+0000 7f3333194700 1 -- 172.21.15.187:0/840762247 wait complete. 2023-10-16T19:56:50.497 DEBUG:teuthology.orchestra.run.smithi187:> sudo ceph --cluster ceph osd new 00000000-0000-0000-0000-000000000000 3 2023-10-16T19:56:50.525 INFO:tasks.ceph.mgr.y.smithi157.stderr:2023-10-16T19:56:50.522+0000 7fa085de0200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-16T19:56:50.605 INFO:tasks.ceph.mgr.y.smithi157.stderr:2023-10-16T19:56:50.602+0000 7fa085de0200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-16T19:56:50.626 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.623+0000 7f228f483700 1 Processor -- start 2023-10-16T19:56:50.627 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.624+0000 7f228f483700 1 -- start start 2023-10-16T19:56:50.629 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.624+0000 7f228f483700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f228815e090 0x7f228806b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:56:50.629 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.624+0000 7f228f483700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f228806ea10 0x7f22880afa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:56:50.630 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.624+0000 7f228f483700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f228806b6a0 con 0x7f22880affc0 2023-10-16T19:56:50.630 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.624+0000 7f228f483700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2288071b50 con 0x7f228815e090 2023-10-16T19:56:50.630 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.624+0000 7f228f483700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22880b0430 con 0x7f228806ea10 2023-10-16T19:56:50.630 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.625+0000 7f228d21f700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f228815e090 0x7f228806b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:56:50.631 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.625+0000 7f228ca1e700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f228806ea10 0x7f22880afa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:56:50.631 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.625+0000 7f228ca1e700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f228806ea10 0x7f22880afa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.187:34102/0 (socket says 172.21.15.187:34102) 2023-10-16T19:56:50.631 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.625+0000 7f228d21f700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f228815e090 0x7f228806b160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.187:42336/0 (socket says 172.21.15.187:42336) 2023-10-16T19:56:50.631 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.625+0000 7f228ca1e700 1 -- 172.21.15.187:0/1327070960 learned_addr learned my addr 172.21.15.187:0/1327070960 (peer_addr_for_me v2:172.21.15.187:0/0) 2023-10-16T19:56:50.631 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.625+0000 7f227ffff700 1 -- 172.21.15.187:0/1327070960 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3463784933 0 0) 0x7f228806b6a0 con 0x7f22880affc0 2023-10-16T19:56:50.632 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.625+0000 7f228ca1e700 1 -- 172.21.15.187:0/1327070960 >> v2:172.21.15.187:3300/0 conn(0x7f228815e090 msgr2=0x7f228806b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:56:50.632 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.625+0000 7f228ca1e700 1 --2- 172.21.15.187:0/1327070960 >> v2:172.21.15.187:3300/0 conn(0x7f228815e090 0x7f228806b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:56:50.632 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.625+0000 7f228ca1e700 1 -- 172.21.15.187:0/1327070960 >> v1:172.21.15.187:6789/0 conn(0x7f22880affc0 legacy=0x7f228815e470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:56:50.632 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.625+0000 7f228ca1e700 1 -- 172.21.15.187:0/1327070960 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2288072320 con 0x7f228806ea10 2023-10-16T19:56:50.632 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.625+0000 7f228ca1e700 1 --2- 172.21.15.187:0/1327070960 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f228806ea10 0x7f22880afa80 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f22780098f0 tx=0x7f2278009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=710fd2f8c78a2332 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:56:50.633 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.625+0000 7f227ffff700 1 -- 172.21.15.187:0/1327070960 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2278011830 con 0x7f228806ea10 2023-10-16T19:56:50.633 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.625+0000 7f227ffff700 1 -- 172.21.15.187:0/1327070960 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2278011990 con 0x7f228806ea10 2023-10-16T19:56:50.633 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.625+0000 7f227ffff700 1 -- 172.21.15.187:0/1327070960 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2278011d20 con 0x7f228806ea10 2023-10-16T19:56:50.633 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.626+0000 7f228f483700 1 -- 172.21.15.187:0/1327070960 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f228806ea10 msgr2=0x7f22880afa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:56:50.633 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.626+0000 7f228f483700 1 --2- 172.21.15.187:0/1327070960 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f228806ea10 0x7f22880afa80 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f22780098f0 tx=0x7f2278009c00 comp rx=0 tx=0).stop 2023-10-16T19:56:50.634 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.626+0000 7f228f483700 1 -- 172.21.15.187:0/1327070960 shutdown_connections 2023-10-16T19:56:50.634 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.626+0000 7f228f483700 1 --2- 172.21.15.187:0/1327070960 >> v2:172.21.15.187:3300/0 conn(0x7f228815e090 0x7f228806b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:56:50.634 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.626+0000 7f228f483700 1 --2- 172.21.15.187:0/1327070960 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f228806ea10 0x7f22880afa80 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:56:50.634 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.626+0000 7f228f483700 1 -- 172.21.15.187:0/1327070960 >> 172.21.15.187:0/1327070960 conn(0x7f22880d0b30 msgr2=0x7f22880d0f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:56:50.635 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.626+0000 7f228f483700 1 -- 172.21.15.187:0/1327070960 shutdown_connections 2023-10-16T19:56:50.635 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.626+0000 7f228f483700 1 -- 172.21.15.187:0/1327070960 wait complete. 2023-10-16T19:56:50.635 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.627+0000 7f228f483700 1 Processor -- start 2023-10-16T19:56:50.635 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.627+0000 7f228f483700 1 -- start start 2023-10-16T19:56:50.637 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.628+0000 7f228f483700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f228806ea10 0x7f2288159d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:56:50.638 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.628+0000 7f228f483700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f22880affc0 0x7f22880ae9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:56:50.638 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.628+0000 7f228f483700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f228815e090 0x7f22880aef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:56:50.638 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.628+0000 7f228f483700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22881584a0 con 0x7f22880affc0 2023-10-16T19:56:50.638 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.628+0000 7f228f483700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22880ce380 con 0x7f228815e090 2023-10-16T19:56:50.639 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.628+0000 7f228f483700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22881628f0 con 0x7f228806ea10 2023-10-16T19:56:50.639 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.628+0000 7f228d21f700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f228806ea10 0x7f2288159d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:56:50.639 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.628+0000 7f228da20700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f228815e090 0x7f22880aef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:56:50.639 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.628+0000 7f228d21f700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f228806ea10 0x7f2288159d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.187:34108/0 (socket says 172.21.15.187:34108) 2023-10-16T19:56:50.639 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.628+0000 7f228d21f700 1 -- 172.21.15.187:0/2755524830 learned_addr learned my addr 172.21.15.187:0/2755524830 (peer_addr_for_me v2:172.21.15.187:0/0) 2023-10-16T19:56:50.640 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.628+0000 7f228ca1e700 1 --2- 172.21.15.187:0/2755524830 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f22880affc0 0x7f22880ae9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:56:50.640 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.628+0000 7f228da20700 1 -- 172.21.15.187:0/2755524830 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f228806ea10 msgr2=0x7f2288159d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:56:50.640 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.628+0000 7f228da20700 1 --2- 172.21.15.187:0/2755524830 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f228806ea10 0x7f2288159d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:56:50.640 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.628+0000 7f228da20700 1 -- 172.21.15.187:0/2755524830 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f22880affc0 msgr2=0x7f22880ae9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:56:50.640 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.628+0000 7f228da20700 1 --2- 172.21.15.187:0/2755524830 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f22880affc0 0x7f22880ae9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:56:50.641 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.628+0000 7f228da20700 1 -- 172.21.15.187:0/2755524830 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2278009550 con 0x7f228815e090 2023-10-16T19:56:50.641 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.628+0000 7f228da20700 1 --2- 172.21.15.187:0/2755524830 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f228815e090 0x7f22880aef10 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f228000c7f0 tx=0x7f228000cb00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:56:50.641 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.629+0000 7f227dffb700 1 -- 172.21.15.187:0/2755524830 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2280003e30 con 0x7f228815e090 2023-10-16T19:56:50.641 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.629+0000 7f227dffb700 1 -- 172.21.15.187:0/2755524830 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2280005070 con 0x7f228815e090 2023-10-16T19:56:50.641 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.629+0000 7f228f483700 1 -- 172.21.15.187:0/2755524830 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22880ce8a0 con 0x7f228815e090 2023-10-16T19:56:50.642 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.629+0000 7f227dffb700 1 -- 172.21.15.187:0/2755524830 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2280005420 con 0x7f228815e090 2023-10-16T19:56:50.642 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.629+0000 7f227dffb700 1 -- 172.21.15.187:0/2755524830 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f2280012400 con 0x7f228815e090 2023-10-16T19:56:50.642 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.629+0000 7f228f483700 1 -- 172.21.15.187:0/2755524830 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2288162610 con 0x7f228815e090 2023-10-16T19:56:50.642 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.629+0000 7f227dffb700 1 -- 172.21.15.187:0/2755524830 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f2280012d20 con 0x7f228815e090 2023-10-16T19:56:50.642 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.630+0000 7f228f483700 1 -- 172.21.15.187:0/2755524830 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22880ce670 con 0x7f228815e090 2023-10-16T19:56:50.643 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.632+0000 7f227dffb700 1 -- 172.21.15.187:0/2755524830 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f22880ce670 con 0x7f228815e090 2023-10-16T19:56:50.719 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.716+0000 7f228f483700 1 -- 172.21.15.187:0/2755524830 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 3} v 0) v1 -- 0x7f22880cea30 con 0x7f228815e090 2023-10-16T19:56:50.722 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.719+0000 7f227dffb700 1 -- 172.21.15.187:0/2755524830 <== mon.1 v2:172.21.15.187:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f2280017070 con 0x7f228815e090 2023-10-16T19:56:50.722 INFO:teuthology.orchestra.run.smithi187.stdout:3 2023-10-16T19:56:50.723 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.720+0000 7f228f483700 1 -- 172.21.15.187:0/2755524830 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f228815e090 msgr2=0x7f22880aef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:56:50.723 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.720+0000 7f228f483700 1 --2- 172.21.15.187:0/2755524830 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f228815e090 0x7f22880aef10 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f228000c7f0 tx=0x7f228000cb00 comp rx=0 tx=0).stop 2023-10-16T19:56:50.723 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.720+0000 7f228f483700 1 -- 172.21.15.187:0/2755524830 shutdown_connections 2023-10-16T19:56:50.724 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.721+0000 7f228f483700 1 --2- 172.21.15.187:0/2755524830 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f228815e090 0x7f22880aef10 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:56:50.724 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.721+0000 7f228f483700 1 --2- 172.21.15.187:0/2755524830 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f228806ea10 0x7f2288159d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:56:50.724 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.721+0000 7f228f483700 1 --2- 172.21.15.187:0/2755524830 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f22880affc0 0x7f22880ae9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:56:50.724 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.721+0000 7f228f483700 1 -- 172.21.15.187:0/2755524830 >> 172.21.15.187:0/2755524830 conn(0x7f22880d0b30 msgr2=0x7f228815a290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:56:50.724 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.721+0000 7f228f483700 1 -- 172.21.15.187:0/2755524830 shutdown_connections 2023-10-16T19:56:50.725 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.721+0000 7f228f483700 1 -- 172.21.15.187:0/2755524830 wait complete. 2023-10-16T19:56:50.735 DEBUG:teuthology.orchestra.run.smithi187:> sudo ceph --cluster ceph osd new 00000000-0000-0000-0000-000000000000 4 2023-10-16T19:56:50.855 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.852+0000 7fcc49d75700 1 Processor -- start 2023-10-16T19:56:50.855 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.853+0000 7fcc49d75700 1 -- start start 2023-10-16T19:56:50.858 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.853+0000 7fcc49d75700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcc4415bed0 0x7fcc440b36b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:56:50.858 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.853+0000 7fcc49d75700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc4415c2b0 con 0x7fcc440d1610 2023-10-16T19:56:50.859 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.853+0000 7fcc49d75700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc4415f9e0 con 0x7fcc440b3bf0 2023-10-16T19:56:50.859 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.853+0000 7fcc49d75700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc440b4070 con 0x7fcc4415bed0 2023-10-16T19:56:50.859 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.853+0000 7fcc437fe700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcc4415bed0 0x7fcc440b36b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:56:50.859 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.853+0000 7fcc3bfff700 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7fcc440b3bf0 0x7fcc440d0f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.187:45310/0 (socket says 172.21.15.187:45310) 2023-10-16T19:56:50.859 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.853+0000 7fcc3bfff700 1 -- 172.21.15.187:0/980877905 learned_addr learned my addr 172.21.15.187:0/980877905 (peer_addr_for_me v1:172.21.15.187:0/0) 2023-10-16T19:56:50.860 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.854+0000 7fcc42ffd700 1 -- 172.21.15.187:0/980877905 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 10787952 0 0) 0x7fcc4415f9e0 con 0x7fcc440b3bf0 2023-10-16T19:56:50.860 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.854+0000 7fcc42ffd700 1 -- 172.21.15.187:0/980877905 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcc300035b0 con 0x7fcc440b3bf0 2023-10-16T19:56:50.860 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.854+0000 7fcc437fe700 1 -- 172.21.15.187:0/980877905 >> v1:172.21.15.187:6789/0 conn(0x7fcc440b3bf0 legacy=0x7fcc440d0f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:56:50.860 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.854+0000 7fcc437fe700 1 -- 172.21.15.187:0/980877905 >> v1:172.21.15.157:6789/0 conn(0x7fcc440d1610 legacy=0x7fcc4406fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:56:50.860 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.854+0000 7fcc437fe700 1 -- 172.21.15.187:0/980877905 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc4415fcc0 con 0x7fcc4415bed0 2023-10-16T19:56:50.861 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.854+0000 7fcc437fe700 1 --2- 172.21.15.187:0/980877905 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcc4415bed0 0x7fcc440b36b0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fcc34009870 tx=0x7fcc34009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=49a9de9b3804fbf6 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:56:50.861 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.854+0000 7fcc42ffd700 1 -- 172.21.15.187:0/980877905 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc34011830 con 0x7fcc4415bed0 2023-10-16T19:56:50.861 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.854+0000 7fcc42ffd700 1 -- 172.21.15.187:0/980877905 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc34011990 con 0x7fcc4415bed0 2023-10-16T19:56:50.861 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.854+0000 7fcc42ffd700 1 -- 172.21.15.187:0/980877905 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc34011d20 con 0x7fcc4415bed0 2023-10-16T19:56:50.861 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.855+0000 7fcc49d75700 1 -- 172.21.15.187:0/980877905 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcc4415bed0 msgr2=0x7fcc440b36b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:56:50.862 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.855+0000 7fcc49d75700 1 --2- 172.21.15.187:0/980877905 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcc4415bed0 0x7fcc440b36b0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fcc34009870 tx=0x7fcc34009b80 comp rx=0 tx=0).stop 2023-10-16T19:56:50.862 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.855+0000 7fcc49d75700 1 -- 172.21.15.187:0/980877905 shutdown_connections 2023-10-16T19:56:50.862 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.855+0000 7fcc49d75700 1 --2- 172.21.15.187:0/980877905 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcc4415bed0 0x7fcc440b36b0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:56:50.862 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.855+0000 7fcc49d75700 1 -- 172.21.15.187:0/980877905 >> 172.21.15.187:0/980877905 conn(0x7fcc440ce6b0 msgr2=0x7fcc440ceac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:56:50.862 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.855+0000 7fcc49d75700 1 -- 172.21.15.187:0/980877905 shutdown_connections 2023-10-16T19:56:50.863 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.855+0000 7fcc49d75700 1 -- 172.21.15.187:0/980877905 wait complete. 2023-10-16T19:56:50.863 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.856+0000 7fcc49d75700 1 Processor -- start 2023-10-16T19:56:50.863 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.856+0000 7fcc49d75700 1 -- start start 2023-10-16T19:56:50.865 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.857+0000 7fcc49d75700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcc440b3bf0 0x7fcc440b2cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:56:50.865 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.857+0000 7fcc49d75700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcc440d1610 0x7fcc4415ec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:56:50.865 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.857+0000 7fcc49d75700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcc4415bed0 0x7fcc441596b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:56:50.866 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.857+0000 7fcc49d75700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc441f1210 con 0x7fcc440d1610 2023-10-16T19:56:50.866 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.857+0000 7fcc49d75700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc440abe10 con 0x7fcc440b3bf0 2023-10-16T19:56:50.866 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.857+0000 7fcc49d75700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc440ac0b0 con 0x7fcc4415bed0 2023-10-16T19:56:50.866 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.857+0000 7fcc437fe700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcc440b3bf0 0x7fcc440b2cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:56:50.866 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.857+0000 7fcc43fff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcc4415bed0 0x7fcc441596b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:56:50.867 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.857+0000 7fcc437fe700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcc440b3bf0 0x7fcc440b2cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.187:42354/0 (socket says 172.21.15.187:42354) 2023-10-16T19:56:50.867 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.857+0000 7fcc437fe700 1 -- 172.21.15.187:0/1049867697 learned_addr learned my addr 172.21.15.187:0/1049867697 (peer_addr_for_me v2:172.21.15.187:0/0) 2023-10-16T19:56:50.867 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.857+0000 7fcc3bfff700 1 --2- 172.21.15.187:0/1049867697 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcc440d1610 0x7fcc4415ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:56:50.867 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.857+0000 7fcc437fe700 1 -- 172.21.15.187:0/1049867697 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcc4415bed0 msgr2=0x7fcc441596b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:56:50.867 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.857+0000 7fcc437fe700 1 --2- 172.21.15.187:0/1049867697 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcc4415bed0 0x7fcc441596b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:56:50.868 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.857+0000 7fcc437fe700 1 -- 172.21.15.187:0/1049867697 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcc440d1610 msgr2=0x7fcc4415ec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:56:50.868 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.857+0000 7fcc437fe700 1 --2- 172.21.15.187:0/1049867697 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcc440d1610 0x7fcc4415ec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:56:50.868 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.857+0000 7fcc437fe700 1 -- 172.21.15.187:0/1049867697 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc340094a0 con 0x7fcc440b3bf0 2023-10-16T19:56:50.868 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.857+0000 7fcc43fff700 1 --2- 172.21.15.187:0/1049867697 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcc4415bed0 0x7fcc441596b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T19:56:50.868 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.857+0000 7fcc437fe700 1 --2- 172.21.15.187:0/1049867697 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcc440b3bf0 0x7fcc440b2cb0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fcc340097c0 tx=0x7fcc34004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:56:50.869 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.857+0000 7fcc40ff9700 1 -- 172.21.15.187:0/1049867697 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc34004590 con 0x7fcc440b3bf0 2023-10-16T19:56:50.869 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.857+0000 7fcc40ff9700 1 -- 172.21.15.187:0/1049867697 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc340036a0 con 0x7fcc440b3bf0 2023-10-16T19:56:50.869 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.857+0000 7fcc40ff9700 1 -- 172.21.15.187:0/1049867697 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc34003a30 con 0x7fcc440b3bf0 2023-10-16T19:56:50.869 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.858+0000 7fcc49d75700 1 -- 172.21.15.187:0/1049867697 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc440ac390 con 0x7fcc440b3bf0 2023-10-16T19:56:50.869 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.858+0000 7fcc49d75700 1 -- 172.21.15.187:0/1049867697 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc440ac950 con 0x7fcc440b3bf0 2023-10-16T19:56:50.870 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.858+0000 7fcc40ff9700 1 -- 172.21.15.187:0/1049867697 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fcc3402e450 con 0x7fcc440b3bf0 2023-10-16T19:56:50.870 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.858+0000 7fcc40ff9700 1 -- 172.21.15.187:0/1049867697 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7fcc3402ec10 con 0x7fcc440b3bf0 2023-10-16T19:56:50.870 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.858+0000 7fcc49d75700 1 -- 172.21.15.187:0/1049867697 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc4406b300 con 0x7fcc440b3bf0 2023-10-16T19:56:50.870 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.860+0000 7fcc40ff9700 1 -- 172.21.15.187:0/1049867697 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7fcc34015020 con 0x7fcc440b3bf0 2023-10-16T19:56:50.897 INFO:tasks.ceph.mgr.x.smithi187.stderr:2023-10-16T19:56:50.895+0000 7f4832adf200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-16T19:56:50.946 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.944+0000 7fcc49d75700 1 -- 172.21.15.187:0/1049867697 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 4} v 0) v1 -- 0x7fcc4404f400 con 0x7fcc440b3bf0 2023-10-16T19:56:50.950 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.948+0000 7fcc40ff9700 1 -- 172.21.15.187:0/1049867697 <== mon.1 v2:172.21.15.187:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7fcc3402e7d0 con 0x7fcc440b3bf0 2023-10-16T19:56:50.950 INFO:teuthology.orchestra.run.smithi187.stdout:4 2023-10-16T19:56:50.951 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.949+0000 7fcc49d75700 1 -- 172.21.15.187:0/1049867697 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcc440b3bf0 msgr2=0x7fcc440b2cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:56:50.951 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.949+0000 7fcc49d75700 1 --2- 172.21.15.187:0/1049867697 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcc440b3bf0 0x7fcc440b2cb0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fcc340097c0 tx=0x7fcc34004750 comp rx=0 tx=0).stop 2023-10-16T19:56:50.952 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.949+0000 7fcc49d75700 1 -- 172.21.15.187:0/1049867697 shutdown_connections 2023-10-16T19:56:50.952 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.949+0000 7fcc49d75700 1 --2- 172.21.15.187:0/1049867697 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcc440b3bf0 0x7fcc440b2cb0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:56:50.952 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.949+0000 7fcc49d75700 1 --2- 172.21.15.187:0/1049867697 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcc4415bed0 0x7fcc441596b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:56:50.952 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.949+0000 7fcc49d75700 1 --2- 172.21.15.187:0/1049867697 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcc440d1610 0x7fcc4415ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:56:50.953 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.949+0000 7fcc49d75700 1 -- 172.21.15.187:0/1049867697 >> 172.21.15.187:0/1049867697 conn(0x7fcc440ce6b0 msgr2=0x7fcc440d0200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:56:50.953 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.949+0000 7fcc49d75700 1 -- 172.21.15.187:0/1049867697 shutdown_connections 2023-10-16T19:56:50.953 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:50.949+0000 7fcc49d75700 1 -- 172.21.15.187:0/1049867697 wait complete. 2023-10-16T19:56:50.964 DEBUG:teuthology.orchestra.run.smithi187:> sudo ceph --cluster ceph osd new 00000000-0000-0000-0000-000000000000 5 2023-10-16T19:56:51.035 INFO:tasks.ceph.mgr.y.smithi157.stderr:2023-10-16T19:56:51.032+0000 7fa085de0200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-16T19:56:51.088 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:51.083+0000 7fc52977f700 1 Processor -- start 2023-10-16T19:56:51.088 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:51.083+0000 7fc52977f700 1 -- start start 2023-10-16T19:56:51.089 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:51.083+0000 7fc52977f700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc524143bd0 0x7fc5240cef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:56:51.089 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:51.083+0000 7fc52977f700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fc5240b2e20 0x7fc524071080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:56:51.089 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:51.083+0000 7fc52977f700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc52406e180 con 0x7fc5240cf4c0 2023-10-16T19:56:51.089 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:51.083+0000 7fc52977f700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc524143fb0 con 0x7fc5240b2e20 2023-10-16T19:56:51.090 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:51.083+0000 7fc52977f700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc524144480 con 0x7fc524143bd0 2023-10-16T19:56:51.090 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:51.084+0000 7fc522ffd700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc524143bd0 0x7fc5240cef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:56:51.090 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:51.084+0000 7fc5227fc700 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7fc5240cf4c0 0x7fc5240b2710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.187:45322/0 (socket says 172.21.15.187:45322) 2023-10-16T19:56:51.090 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:51.084+0000 7fc522ffd700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc524143bd0 0x7fc5240cef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.187:34126/0 (socket says 172.21.15.187:34126) 2023-10-16T19:56:51.090 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:51.084+0000 7fc5227fc700 1 -- 172.21.15.187:0/1096822184 learned_addr learned my addr 172.21.15.187:0/1096822184 (peer_addr_for_me v1:172.21.15.187:0/0) 2023-10-16T19:56:51.091 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:51.084+0000 7fc5237fe700 1 --2- 172.21.15.187:0/1096822184 >> v2:172.21.15.157:3300/0 conn(0x7fc5240b2e20 0x7fc524071080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:56:51.091 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:51.084+0000 7fc521ffb700 1 -- 172.21.15.187:0/1096822184 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2200597088 0 0) 0x7fc52406e180 con 0x7fc5240cf4c0 2023-10-16T19:56:51.091 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:51.084+0000 7fc521ffb700 1 -- 172.21.15.187:0/1096822184 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc50c0035b0 con 0x7fc5240cf4c0 2023-10-16T19:56:51.091 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:51.084+0000 7fc522ffd700 1 -- 172.21.15.187:0/1096822184 >> v2:172.21.15.157:3300/0 conn(0x7fc5240b2e20 msgr2=0x7fc524071080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:56:51.091 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:51.084+0000 7fc522ffd700 1 --2- 172.21.15.187:0/1096822184 >> v2:172.21.15.157:3300/0 conn(0x7fc5240b2e20 0x7fc524071080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:56:51.092 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:51.084+0000 7fc522ffd700 1 -- 172.21.15.187:0/1096822184 >> v1:172.21.15.187:6789/0 conn(0x7fc5240cf4c0 legacy=0x7fc5240b2710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:56:51.092 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:51.084+0000 7fc522ffd700 1 -- 172.21.15.187:0/1096822184 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc524071c60 con 0x7fc524143bd0 2023-10-16T19:56:51.092 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:51.084+0000 7fc5237fe700 1 --2- 172.21.15.187:0/1096822184 >> v2:172.21.15.157:3300/0 conn(0x7fc5240b2e20 0x7fc524071080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T19:56:51.092 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:51.084+0000 7fc522ffd700 1 --2- 172.21.15.187:0/1096822184 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc524143bd0 0x7fc5240cef80 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fc514009840 tx=0x7fc514009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1c9f41a744a20fee server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:56:51.092 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:51.084+0000 7fc521ffb700 1 -- 172.21.15.187:0/1096822184 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc51400f8a0 con 0x7fc524143bd0 2023-10-16T19:56:51.093 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:51.084+0000 7fc521ffb700 1 -- 172.21.15.187:0/1096822184 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc51400fa00 con 0x7fc524143bd0 2023-10-16T19:56:51.093 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:51.084+0000 7fc521ffb700 1 -- 172.21.15.187:0/1096822184 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc51400fd90 con 0x7fc524143bd0 2023-10-16T19:56:51.093 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:51.085+0000 7fc52977f700 1 -- 172.21.15.187:0/1096822184 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc524143bd0 msgr2=0x7fc5240cef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:56:51.093 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:51.085+0000 7fc52977f700 1 --2- 172.21.15.187:0/1096822184 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc524143bd0 0x7fc5240cef80 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fc514009840 tx=0x7fc514009b50 comp rx=0 tx=0).stop 2023-10-16T19:56:51.093 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:51.085+0000 7fc52977f700 1 -- 172.21.15.187:0/1096822184 shutdown_connections 2023-10-16T19:56:51.094 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:51.085+0000 7fc52977f700 1 --2- 172.21.15.187:0/1096822184 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc524143bd0 0x7fc5240cef80 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:56:51.094 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:51.085+0000 7fc52977f700 1 --2- 172.21.15.187:0/1096822184 >> v2:172.21.15.157:3300/0 conn(0x7fc5240b2e20 0x7fc524071080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:56:51.094 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:51.085+0000 7fc52977f700 1 -- 172.21.15.187:0/1096822184 >> 172.21.15.187:0/1096822184 conn(0x7fc5240d0b30 msgr2=0x7fc5240d0f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:56:51.094 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:51.085+0000 7fc52977f700 1 -- 172.21.15.187:0/1096822184 shutdown_connections 2023-10-16T19:56:51.094 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:51.085+0000 7fc52977f700 1 -- 172.21.15.187:0/1096822184 wait complete. 2023-10-16T19:56:51.097 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:51.086+0000 7fc52977f700 1 Processor -- start 2023-10-16T19:56:51.097 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:51.086+0000 7fc52977f700 1 -- start start 2023-10-16T19:56:51.097 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:51.087+0000 7fc52977f700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc5240b2e20 0x7fc5241f6590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:56:51.097 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:51.087+0000 7fc52977f700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc5240cf4c0 0x7fc5241f4660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:56:51.098 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:51.087+0000 7fc52977f700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc524143bd0 0x7fc5241f6b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:56:51.098 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:51.087+0000 7fc52977f700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5240c9af0 con 0x7fc5240b2e20 2023-10-16T19:56:51.098 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:51.087+0000 7fc52977f700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5241f75c0 con 0x7fc5240cf4c0 2023-10-16T19:56:51.098 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:51.087+0000 7fc52977f700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5241f78a0 con 0x7fc524143bd0 2023-10-16T19:56:51.099 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:51.087+0000 7fc5227fc700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc5240cf4c0 0x7fc5241f4660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:56:51.099 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:51.087+0000 7fc5237fe700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc524143bd0 0x7fc5241f6b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:56:51.099 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:51.087+0000 7fc5237fe700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc524143bd0 0x7fc5241f6b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.187:34136/0 (socket says 172.21.15.187:34136) 2023-10-16T19:56:51.099 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:51.087+0000 7fc5237fe700 1 -- 172.21.15.187:0/2477134216 learned_addr learned my addr 172.21.15.187:0/2477134216 (peer_addr_for_me v2:172.21.15.187:0/0) 2023-10-16T19:56:51.099 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:51.087+0000 7fc522ffd700 1 --2- 172.21.15.187:0/2477134216 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc5240b2e20 0x7fc5241f6590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:56:51.100 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:51.087+0000 7fc5237fe700 1 -- 172.21.15.187:0/2477134216 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc5240cf4c0 msgr2=0x7fc5241f4660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:56:51.100 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:51.087+0000 7fc5237fe700 1 --2- 172.21.15.187:0/2477134216 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc5240cf4c0 0x7fc5241f4660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:56:51.100 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:51.087+0000 7fc5237fe700 1 -- 172.21.15.187:0/2477134216 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc5240b2e20 msgr2=0x7fc5241f6590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:56:51.100 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:51.087+0000 7fc5237fe700 1 --2- 172.21.15.187:0/2477134216 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc5240b2e20 0x7fc5241f6590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:56:51.100 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:51.087+0000 7fc5237fe700 1 -- 172.21.15.187:0/2477134216 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5140094a0 con 0x7fc524143bd0 2023-10-16T19:56:51.100 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:51.088+0000 7fc5237fe700 1 --2- 172.21.15.187:0/2477134216 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc524143bd0 0x7fc5241f6b40 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fc51c007ef0 tx=0x7fc51c00d3b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:56:51.101 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:51.088+0000 7fc50b7fe700 1 -- 172.21.15.187:0/2477134216 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc51c00dd80 con 0x7fc524143bd0 2023-10-16T19:56:51.101 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:51.088+0000 7fc50b7fe700 1 -- 172.21.15.187:0/2477134216 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc51c00f040 con 0x7fc524143bd0 2023-10-16T19:56:51.101 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:51.088+0000 7fc50b7fe700 1 -- 172.21.15.187:0/2477134216 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc51c003c60 con 0x7fc524143bd0 2023-10-16T19:56:51.101 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:51.088+0000 7fc52977f700 1 -- 172.21.15.187:0/2477134216 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5240c9780 con 0x7fc524143bd0 2023-10-16T19:56:51.101 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:51.088+0000 7fc52977f700 1 -- 172.21.15.187:0/2477134216 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5240c93c0 con 0x7fc524143bd0 2023-10-16T19:56:51.102 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:51.088+0000 7fc50b7fe700 1 -- 172.21.15.187:0/2477134216 <== mon.2 v2:172.21.15.187:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fc51c004330 con 0x7fc524143bd0 2023-10-16T19:56:51.102 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:51.088+0000 7fc50b7fe700 1 -- 172.21.15.187:0/2477134216 <== mon.2 v2:172.21.15.187:3301/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7fc51c0159c0 con 0x7fc524143bd0 2023-10-16T19:56:51.102 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:51.089+0000 7fc52977f700 1 -- 172.21.15.187:0/2477134216 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc52404f400 con 0x7fc524143bd0 2023-10-16T19:56:51.102 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:51.091+0000 7fc50b7fe700 1 -- 172.21.15.187:0/2477134216 <== mon.2 v2:172.21.15.187:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7fc51c01a070 con 0x7fc524143bd0 2023-10-16T19:56:51.176 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:51.174+0000 7fc52977f700 1 -- 172.21.15.187:0/2477134216 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 5} v 0) v1 -- 0x7fc5240c9c30 con 0x7fc524143bd0 2023-10-16T19:56:51.180 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:51.177+0000 7fc50b7fe700 1 -- 172.21.15.187:0/2477134216 <== mon.2 v2:172.21.15.187:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7fc51c003dc0 con 0x7fc524143bd0 2023-10-16T19:56:51.180 INFO:teuthology.orchestra.run.smithi187.stdout:5 2023-10-16T19:56:51.181 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:51.178+0000 7fc52977f700 1 -- 172.21.15.187:0/2477134216 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc524143bd0 msgr2=0x7fc5241f6b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:56:51.181 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:51.178+0000 7fc52977f700 1 --2- 172.21.15.187:0/2477134216 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc524143bd0 0x7fc5241f6b40 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fc51c007ef0 tx=0x7fc51c00d3b0 comp rx=0 tx=0).stop 2023-10-16T19:56:51.181 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:51.178+0000 7fc52977f700 1 -- 172.21.15.187:0/2477134216 shutdown_connections 2023-10-16T19:56:51.182 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:51.178+0000 7fc52977f700 1 --2- 172.21.15.187:0/2477134216 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc524143bd0 0x7fc5241f6b40 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:56:51.182 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:51.178+0000 7fc52977f700 1 --2- 172.21.15.187:0/2477134216 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc5240b2e20 0x7fc5241f6590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:56:51.182 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:51.178+0000 7fc52977f700 1 --2- 172.21.15.187:0/2477134216 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc5240cf4c0 0x7fc5241f4660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:56:51.182 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:51.178+0000 7fc52977f700 1 -- 172.21.15.187:0/2477134216 >> 172.21.15.187:0/2477134216 conn(0x7fc5240d0b30 msgr2=0x7fc5241584d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:56:51.182 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:51.179+0000 7fc52977f700 1 -- 172.21.15.187:0/2477134216 shutdown_connections 2023-10-16T19:56:51.183 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:51.179+0000 7fc52977f700 1 -- 172.21.15.187:0/2477134216 wait complete. 2023-10-16T19:56:51.193 DEBUG:teuthology.orchestra.run.smithi187:> sudo ceph --cluster ceph osd new 00000000-0000-0000-0000-000000000000 6 2023-10-16T19:56:51.332 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:51.329+0000 7f4d573ec700 1 Processor -- start 2023-10-16T19:56:51.334 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:51.329+0000 7f4d573ec700 1 -- start start 2023-10-16T19:56:51.334 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:51.331+0000 7f4d573ec700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f4d50157850 0x7f4d500ca050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:56:51.335 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:51.331+0000 7f4d573ec700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f4d50157c30 0x7f4d500ca590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:56:51.335 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:51.331+0000 7f4d573ec700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d5006c8f0 con 0x7f4d5006cd80 2023-10-16T19:56:51.335 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:51.331+0000 7f4d573ec700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d5015b1e0 con 0x7f4d50157850 2023-10-16T19:56:51.335 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:51.331+0000 7f4d573ec700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d5006c2a0 con 0x7f4d50157c30 2023-10-16T19:56:51.335 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:51.331+0000 7f4d54987700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f4d50157c30 0x7f4d500ca590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:56:51.336 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:51.331+0000 7f4d54987700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f4d50157c30 0x7f4d500ca590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.187:42372/0 (socket says 172.21.15.187:42372) 2023-10-16T19:56:51.336 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:51.331+0000 7f4d54987700 1 -- 172.21.15.187:0/3767577256 learned_addr learned my addr 172.21.15.187:0/3767577256 (peer_addr_for_me v2:172.21.15.187:0/0) 2023-10-16T19:56:51.336 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:51.331+0000 7f4d54987700 1 -- 172.21.15.187:0/3767577256 >> v2:172.21.15.157:3300/0 conn(0x7f4d50157850 msgr2=0x7f4d500ca050 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-16T19:56:51.336 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:51.331+0000 7f4d54987700 1 --2- 172.21.15.187:0/3767577256 >> v2:172.21.15.157:3300/0 conn(0x7f4d50157850 0x7f4d500ca050 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:56:51.336 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:51.331+0000 7f4d54987700 1 -- 172.21.15.187:0/3767577256 >> v1:172.21.15.187:6789/0 conn(0x7f4d5006cd80 legacy=0x7f4d5015a4b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-16T19:56:51.337 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:51.331+0000 7f4d54987700 1 -- 172.21.15.187:0/3767577256 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d5006c580 con 0x7f4d50157c30 2023-10-16T19:56:51.337 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:51.332+0000 7f4d54987700 1 --2- 172.21.15.187:0/3767577256 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4d50157c30 0x7f4d500ca590 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f4d50072440 tx=0x7f4d40009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b1f251f4effed38a server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:56:51.338 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:51.332+0000 7f4d4ffff700 1 -- 172.21.15.187:0/3767577256 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d40004230 con 0x7f4d50157c30 2023-10-16T19:56:51.338 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:51.332+0000 7f4d4ffff700 1 -- 172.21.15.187:0/3767577256 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d40004390 con 0x7f4d50157c30 2023-10-16T19:56:51.338 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:51.332+0000 7f4d4ffff700 1 -- 172.21.15.187:0/3767577256 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d4000b6d0 con 0x7f4d50157c30 2023-10-16T19:56:51.338 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:51.333+0000 7f4d573ec700 1 -- 172.21.15.187:0/3767577256 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4d50157c30 msgr2=0x7f4d500ca590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:56:51.339 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:51.333+0000 7f4d573ec700 1 --2- 172.21.15.187:0/3767577256 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4d50157c30 0x7f4d500ca590 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f4d50072440 tx=0x7f4d40009e30 comp rx=0 tx=0).stop 2023-10-16T19:56:51.339 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:51.333+0000 7f4d573ec700 1 -- 172.21.15.187:0/3767577256 shutdown_connections 2023-10-16T19:56:51.339 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:51.333+0000 7f4d573ec700 1 --2- 172.21.15.187:0/3767577256 >> v2:172.21.15.157:3300/0 conn(0x7f4d50157850 0x7f4d500ca050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:56:51.339 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:51.333+0000 7f4d573ec700 1 --2- 172.21.15.187:0/3767577256 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4d50157c30 0x7f4d500ca590 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:56:51.339 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:51.333+0000 7f4d573ec700 1 -- 172.21.15.187:0/3767577256 >> 172.21.15.187:0/3767577256 conn(0x7f4d5006aa30 msgr2=0x7f4d5006ae40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:56:51.340 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:51.333+0000 7f4d573ec700 1 -- 172.21.15.187:0/3767577256 shutdown_connections 2023-10-16T19:56:51.340 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:51.333+0000 7f4d573ec700 1 -- 172.21.15.187:0/3767577256 wait complete. 2023-10-16T19:56:51.340 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:51.335+0000 7f4d573ec700 1 Processor -- start 2023-10-16T19:56:51.342 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:51.335+0000 7f4d573ec700 1 -- start start 2023-10-16T19:56:51.342 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:51.336+0000 7f4d573ec700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4d5006cd80 0x7f4d50203ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:56:51.342 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:51.336+0000 7f4d573ec700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4d50157850 0x7f4d501568e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:56:51.342 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:51.336+0000 7f4d573ec700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4d50157c30 0x7f4d500b00e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:56:51.343 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:51.336+0000 7f4d573ec700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d50156fc0 con 0x7f4d5006cd80 2023-10-16T19:56:51.343 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:51.336+0000 7f4d573ec700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d50142860 con 0x7f4d50157c30 2023-10-16T19:56:51.343 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:51.336+0000 7f4d573ec700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d50141ec0 con 0x7f4d50157850 2023-10-16T19:56:51.343 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:51.336+0000 7f4d55188700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4d5006cd80 0x7f4d50203ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:56:51.343 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:51.336+0000 7f4d55188700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4d5006cd80 0x7f4d50203ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.187:35822/0 (socket says 172.21.15.187:35822) 2023-10-16T19:56:51.344 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:51.336+0000 7f4d55188700 1 -- 172.21.15.187:0/2416610451 learned_addr learned my addr 172.21.15.187:0/2416610451 (peer_addr_for_me v2:172.21.15.187:0/0) 2023-10-16T19:56:51.344 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:51.337+0000 7f4d55989700 1 --2- 172.21.15.187:0/2416610451 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4d50157c30 0x7f4d500b00e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:56:51.344 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:51.337+0000 7f4d55188700 1 -- 172.21.15.187:0/2416610451 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4d50157850 msgr2=0x7f4d501568e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-16T19:56:51.344 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:51.337+0000 7f4d55188700 1 --2- 172.21.15.187:0/2416610451 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4d50157850 0x7f4d501568e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:56:51.344 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:51.337+0000 7f4d55188700 1 -- 172.21.15.187:0/2416610451 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4d50157c30 msgr2=0x7f4d500b00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:56:51.345 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:51.337+0000 7f4d55188700 1 --2- 172.21.15.187:0/2416610451 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4d50157c30 0x7f4d500b00e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:56:51.345 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:51.337+0000 7f4d55188700 1 -- 172.21.15.187:0/2416610451 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d40009550 con 0x7f4d5006cd80 2023-10-16T19:56:51.345 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:51.337+0000 7f4d55188700 1 --2- 172.21.15.187:0/2416610451 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4d5006cd80 0x7f4d50203ea0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f4d4400b550 tx=0x7f4d4400b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:56:51.345 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:51.337+0000 7f4d4dffb700 1 -- 172.21.15.187:0/2416610451 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d44011830 con 0x7f4d5006cd80 2023-10-16T19:56:51.345 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:51.337+0000 7f4d4dffb700 1 -- 172.21.15.187:0/2416610451 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d440119b0 con 0x7f4d5006cd80 2023-10-16T19:56:51.345 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:51.337+0000 7f4d573ec700 1 -- 172.21.15.187:0/2416610451 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d501421a0 con 0x7f4d5006cd80 2023-10-16T19:56:51.346 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:51.338+0000 7f4d573ec700 1 -- 172.21.15.187:0/2416610451 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d500b0620 con 0x7f4d5006cd80 2023-10-16T19:56:51.346 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:51.338+0000 7f4d4dffb700 1 -- 172.21.15.187:0/2416610451 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d44011d60 con 0x7f4d5006cd80 2023-10-16T19:56:51.346 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:51.338+0000 7f4d4dffb700 1 -- 172.21.15.187:0/2416610451 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f4d4401a700 con 0x7f4d5006cd80 2023-10-16T19:56:51.346 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:51.338+0000 7f4d4dffb700 1 -- 172.21.15.187:0/2416610451 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7f4d44010380 con 0x7f4d5006cd80 2023-10-16T19:56:51.347 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:51.339+0000 7f4d573ec700 1 -- 172.21.15.187:0/2416610451 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d5004f400 con 0x7f4d5006cd80 2023-10-16T19:56:51.347 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:51.341+0000 7f4d4dffb700 1 -- 172.21.15.187:0/2416610451 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f4d44039b40 con 0x7f4d5006cd80 2023-10-16T19:56:51.434 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:51.432+0000 7f4d573ec700 1 -- 172.21.15.187:0/2416610451 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 6} v 0) v1 -- 0x7f4d500cd5d0 con 0x7f4d5006cd80 2023-10-16T19:56:51.436 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:51.434+0000 7f4d4dffb700 1 -- 172.21.15.187:0/2416610451 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f4d44028030 con 0x7f4d5006cd80 2023-10-16T19:56:51.436 INFO:teuthology.orchestra.run.smithi187.stdout:6 2023-10-16T19:56:51.437 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:51.435+0000 7f4d573ec700 1 -- 172.21.15.187:0/2416610451 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4d5006cd80 msgr2=0x7f4d50203ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:56:51.438 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:51.435+0000 7f4d573ec700 1 --2- 172.21.15.187:0/2416610451 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4d5006cd80 0x7f4d50203ea0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f4d4400b550 tx=0x7f4d4400b910 comp rx=0 tx=0).stop 2023-10-16T19:56:51.438 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:51.435+0000 7f4d573ec700 1 -- 172.21.15.187:0/2416610451 shutdown_connections 2023-10-16T19:56:51.438 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:51.435+0000 7f4d573ec700 1 --2- 172.21.15.187:0/2416610451 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4d50157c30 0x7f4d500b00e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:56:51.438 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:51.435+0000 7f4d573ec700 1 --2- 172.21.15.187:0/2416610451 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4d5006cd80 0x7f4d50203ea0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:56:51.438 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:51.435+0000 7f4d573ec700 1 --2- 172.21.15.187:0/2416610451 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4d50157850 0x7f4d501568e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:56:51.439 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:51.435+0000 7f4d573ec700 1 -- 172.21.15.187:0/2416610451 >> 172.21.15.187:0/2416610451 conn(0x7f4d5006aa30 msgr2=0x7f4d50158040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:56:51.439 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:51.436+0000 7f4d573ec700 1 -- 172.21.15.187:0/2416610451 shutdown_connections 2023-10-16T19:56:51.439 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:51.436+0000 7f4d573ec700 1 -- 172.21.15.187:0/2416610451 wait complete. 2023-10-16T19:56:51.450 DEBUG:teuthology.orchestra.run.smithi187:> sudo ceph --cluster ceph osd new 00000000-0000-0000-0000-000000000000 7 2023-10-16T19:56:51.555 INFO:tasks.ceph.mgr.x.smithi187.stderr:2023-10-16T19:56:51.553+0000 7f4832adf200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-16T19:56:51.574 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:51.572+0000 7ff4f3222700 1 Processor -- start 2023-10-16T19:56:51.574 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:51.572+0000 7ff4f3222700 1 -- start start 2023-10-16T19:56:51.578 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:51.573+0000 7ff4f3222700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff4ec143bd0 0x7ff4ec0cef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:56:51.578 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:51.573+0000 7ff4f3222700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4ec06e180 con 0x7ff4ec0b2e20 2023-10-16T19:56:51.578 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:51.573+0000 7ff4f3222700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4ec144480 con 0x7ff4ec0cf4c0 2023-10-16T19:56:51.578 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:51.573+0000 7ff4f3222700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4ec143fb0 con 0x7ff4ec143bd0 2023-10-16T19:56:51.579 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:51.573+0000 7ff4f0fbe700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff4ec143bd0 0x7ff4ec0cef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:56:51.579 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:51.573+0000 7ff4ebfff700 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7ff4ec0cf4c0 0x7ff4ec0b2710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.187:45342/0 (socket says 172.21.15.187:45342) 2023-10-16T19:56:51.579 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:51.573+0000 7ff4ebfff700 1 -- 172.21.15.187:0/3623935624 learned_addr learned my addr 172.21.15.187:0/3623935624 (peer_addr_for_me v1:172.21.15.187:0/0) 2023-10-16T19:56:51.579 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:51.574+0000 7ff4f0fbe700 1 -- 172.21.15.187:0/3623935624 >> v1:172.21.15.187:6789/0 conn(0x7ff4ec0cf4c0 legacy=0x7ff4ec0b2710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:56:51.580 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:51.574+0000 7ff4f0fbe700 1 -- 172.21.15.187:0/3623935624 >> v1:172.21.15.157:6789/0 conn(0x7ff4ec0b2e20 legacy=0x7ff4ec071080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:56:51.580 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:51.574+0000 7ff4eb7fe700 1 -- 172.21.15.187:0/3623935624 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2850588918 0 0) 0x7ff4ec144480 con 0x7ff4ec0cf4c0 2023-10-16T19:56:51.580 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:51.574+0000 7ff4f0fbe700 1 -- 172.21.15.187:0/3623935624 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4ec071c60 con 0x7ff4ec143bd0 2023-10-16T19:56:51.581 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:51.574+0000 7ff4f0fbe700 1 --2- 172.21.15.187:0/3623935624 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff4ec143bd0 0x7ff4ec0cef80 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7ff4e0009870 tx=0x7ff4e0009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f832e7794b2de659 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:56:51.581 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:51.574+0000 7ff4eb7fe700 1 -- 172.21.15.187:0/3623935624 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4e0011830 con 0x7ff4ec143bd0 2023-10-16T19:56:51.581 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:51.574+0000 7ff4eb7fe700 1 -- 172.21.15.187:0/3623935624 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4e0011990 con 0x7ff4ec143bd0 2023-10-16T19:56:51.581 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:51.574+0000 7ff4eb7fe700 1 -- 172.21.15.187:0/3623935624 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4e0011d20 con 0x7ff4ec143bd0 2023-10-16T19:56:51.582 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:51.575+0000 7ff4f3222700 1 -- 172.21.15.187:0/3623935624 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff4ec143bd0 msgr2=0x7ff4ec0cef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:56:51.582 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:51.575+0000 7ff4f3222700 1 --2- 172.21.15.187:0/3623935624 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff4ec143bd0 0x7ff4ec0cef80 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7ff4e0009870 tx=0x7ff4e0009b80 comp rx=0 tx=0).stop 2023-10-16T19:56:51.582 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:51.575+0000 7ff4f3222700 1 -- 172.21.15.187:0/3623935624 shutdown_connections 2023-10-16T19:56:51.582 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:51.575+0000 7ff4f3222700 1 --2- 172.21.15.187:0/3623935624 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff4ec143bd0 0x7ff4ec0cef80 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:56:51.582 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:51.575+0000 7ff4f3222700 1 -- 172.21.15.187:0/3623935624 >> 172.21.15.187:0/3623935624 conn(0x7ff4ec0d0b30 msgr2=0x7ff4ec0d0f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:56:51.583 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:51.575+0000 7ff4f3222700 1 -- 172.21.15.187:0/3623935624 shutdown_connections 2023-10-16T19:56:51.583 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:51.575+0000 7ff4f3222700 1 -- 172.21.15.187:0/3623935624 wait complete. 2023-10-16T19:56:51.585 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:51.576+0000 7ff4f3222700 1 Processor -- start 2023-10-16T19:56:51.586 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:51.576+0000 7ff4f3222700 1 -- start start 2023-10-16T19:56:51.586 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:51.577+0000 7ff4f3222700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff4ec0b2e20 0x7ff4ec1f0870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:56:51.586 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:51.577+0000 7ff4f3222700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff4ec0cf4c0 0x7ff4ec13f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:56:51.586 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:51.577+0000 7ff4f3222700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff4ec143bd0 0x7ff4ec0b4640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:56:51.587 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:51.577+0000 7ff4f3222700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4ec15cfc0 con 0x7ff4ec0cf4c0 2023-10-16T19:56:51.587 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:51.578+0000 7ff4f3222700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4ec1f0db0 con 0x7ff4ec143bd0 2023-10-16T19:56:51.587 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:51.578+0000 7ff4f3222700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4ec0b5020 con 0x7ff4ec0b2e20 2023-10-16T19:56:51.587 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:51.578+0000 7ff4f0fbe700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff4ec0b2e20 0x7ff4ec1f0870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:56:51.587 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:51.578+0000 7ff4f0fbe700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff4ec0b2e20 0x7ff4ec1f0870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.187:34152/0 (socket says 172.21.15.187:34152) 2023-10-16T19:56:51.588 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:51.578+0000 7ff4f0fbe700 1 -- 172.21.15.187:0/3263665809 learned_addr learned my addr 172.21.15.187:0/3263665809 (peer_addr_for_me v2:172.21.15.187:0/0) 2023-10-16T19:56:51.588 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:51.578+0000 7ff4ebfff700 1 --2- 172.21.15.187:0/3263665809 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff4ec0cf4c0 0x7ff4ec13f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:56:51.588 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:51.578+0000 7ff4f17bf700 1 --2- 172.21.15.187:0/3263665809 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff4ec143bd0 0x7ff4ec0b4640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:56:51.589 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:51.578+0000 7ff4f0fbe700 1 -- 172.21.15.187:0/3263665809 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff4ec143bd0 msgr2=0x7ff4ec0b4640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:56:51.589 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:51.578+0000 7ff4f0fbe700 1 --2- 172.21.15.187:0/3263665809 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff4ec143bd0 0x7ff4ec0b4640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:56:51.589 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:51.578+0000 7ff4f0fbe700 1 -- 172.21.15.187:0/3263665809 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff4ec0cf4c0 msgr2=0x7ff4ec13f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:56:51.589 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:51.578+0000 7ff4f0fbe700 1 --2- 172.21.15.187:0/3263665809 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff4ec0cf4c0 0x7ff4ec13f4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:56:51.590 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:51.578+0000 7ff4f0fbe700 1 -- 172.21.15.187:0/3263665809 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4e00094a0 con 0x7ff4ec0b2e20 2023-10-16T19:56:51.590 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:51.578+0000 7ff4f17bf700 1 --2- 172.21.15.187:0/3263665809 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff4ec143bd0 0x7ff4ec0b4640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T19:56:51.590 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:51.578+0000 7ff4ebfff700 1 --2- 172.21.15.187:0/3263665809 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff4ec0cf4c0 0x7ff4ec13f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T19:56:51.590 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:51.578+0000 7ff4f0fbe700 1 --2- 172.21.15.187:0/3263665809 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff4ec0b2e20 0x7ff4ec1f0870 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7ff4e00097c0 tx=0x7ff4e0004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:56:51.590 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:51.578+0000 7ff4e97fa700 1 -- 172.21.15.187:0/3263665809 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4e00036a0 con 0x7ff4ec0b2e20 2023-10-16T19:56:51.591 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:51.578+0000 7ff4e97fa700 1 -- 172.21.15.187:0/3263665809 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4e0021070 con 0x7ff4ec0b2e20 2023-10-16T19:56:51.591 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:51.578+0000 7ff4e97fa700 1 -- 172.21.15.187:0/3263665809 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4e0003a20 con 0x7ff4ec0b2e20 2023-10-16T19:56:51.591 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:51.578+0000 7ff4f3222700 1 -- 172.21.15.187:0/3263665809 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4ec15c900 con 0x7ff4ec0b2e20 2023-10-16T19:56:51.591 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:51.578+0000 7ff4f3222700 1 -- 172.21.15.187:0/3263665809 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4ec0b5300 con 0x7ff4ec0b2e20 2023-10-16T19:56:51.591 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:51.578+0000 7ff4e97fa700 1 -- 172.21.15.187:0/3263665809 <== mon.2 v2:172.21.15.187:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7ff4e001d640 con 0x7ff4ec0b2e20 2023-10-16T19:56:51.592 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:51.579+0000 7ff4e97fa700 1 -- 172.21.15.187:0/3263665809 <== mon.2 v2:172.21.15.187:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7ff4e0023070 con 0x7ff4ec0b2e20 2023-10-16T19:56:51.592 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:51.579+0000 7ff4f3222700 1 -- 172.21.15.187:0/3263665809 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4ec04f400 con 0x7ff4ec0b2e20 2023-10-16T19:56:51.592 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:51.581+0000 7ff4e97fa700 1 -- 172.21.15.187:0/3263665809 <== mon.2 v2:172.21.15.187:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7ff4e0046b40 con 0x7ff4ec0b2e20 2023-10-16T19:56:51.629 INFO:tasks.ceph.mgr.x.smithi187.stderr:2023-10-16T19:56:51.626+0000 7f4832adf200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-16T19:56:51.667 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:51.664+0000 7ff4f3222700 1 -- 172.21.15.187:0/3263665809 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 7} v 0) v1 -- 0x7ff4ec06d430 con 0x7ff4ec0b2e20 2023-10-16T19:56:51.671 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:51.669+0000 7ff4e97fa700 1 -- 172.21.15.187:0/3263665809 <== mon.2 v2:172.21.15.187:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7ff4e0035070 con 0x7ff4ec0b2e20 2023-10-16T19:56:51.672 INFO:teuthology.orchestra.run.smithi187.stdout:7 2023-10-16T19:56:51.673 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:51.670+0000 7ff4f3222700 1 -- 172.21.15.187:0/3263665809 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff4ec0b2e20 msgr2=0x7ff4ec1f0870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:56:51.673 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:51.670+0000 7ff4f3222700 1 --2- 172.21.15.187:0/3263665809 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff4ec0b2e20 0x7ff4ec1f0870 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7ff4e00097c0 tx=0x7ff4e0004750 comp rx=0 tx=0).stop 2023-10-16T19:56:51.673 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:51.670+0000 7ff4f3222700 1 -- 172.21.15.187:0/3263665809 shutdown_connections 2023-10-16T19:56:51.674 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:51.670+0000 7ff4f3222700 1 --2- 172.21.15.187:0/3263665809 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff4ec143bd0 0x7ff4ec0b4640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:56:51.674 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:51.670+0000 7ff4f3222700 1 --2- 172.21.15.187:0/3263665809 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff4ec0b2e20 0x7ff4ec1f0870 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:56:51.674 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:51.670+0000 7ff4f3222700 1 --2- 172.21.15.187:0/3263665809 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff4ec0cf4c0 0x7ff4ec13f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:56:51.674 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:51.670+0000 7ff4f3222700 1 -- 172.21.15.187:0/3263665809 >> 172.21.15.187:0/3263665809 conn(0x7ff4ec0d0b30 msgr2=0x7ff4ec159560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:56:51.675 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:51.670+0000 7ff4f3222700 1 -- 172.21.15.187:0/3263665809 shutdown_connections 2023-10-16T19:56:51.675 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-16T19:56:51.670+0000 7ff4f3222700 1 -- 172.21.15.187:0/3263665809 wait complete. 2023-10-16T19:56:51.685 INFO:tasks.ceph.osd.0:Restarting daemon 2023-10-16T19:56:51.686 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-10-16T19:56:51.689 INFO:tasks.ceph.osd.0:Started 2023-10-16T19:56:51.689 INFO:tasks.ceph.osd.1:Restarting daemon 2023-10-16T19:56:51.689 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-10-16T19:56:51.692 INFO:tasks.ceph.osd.1:Started 2023-10-16T19:56:51.692 INFO:tasks.ceph.osd.2:Restarting daemon 2023-10-16T19:56:51.693 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-10-16T19:56:51.695 INFO:tasks.ceph.mgr.y.smithi157.stderr:2023-10-16T19:56:51.691+0000 7fa085de0200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-16T19:56:51.696 INFO:tasks.ceph.osd.2:Started 2023-10-16T19:56:51.696 INFO:tasks.ceph.osd.3:Restarting daemon 2023-10-16T19:56:51.697 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-10-16T19:56:51.699 INFO:tasks.ceph.osd.3:Started 2023-10-16T19:56:51.699 INFO:tasks.ceph.osd.4:Restarting daemon 2023-10-16T19:56:51.699 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-10-16T19:56:51.702 INFO:tasks.ceph.osd.4:Started 2023-10-16T19:56:51.702 INFO:tasks.ceph.osd.5:Restarting daemon 2023-10-16T19:56:51.702 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-10-16T19:56:51.704 INFO:tasks.ceph.osd.5:Started 2023-10-16T19:56:51.706 INFO:tasks.ceph.osd.6:Restarting daemon 2023-10-16T19:56:51.707 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-10-16T19:56:51.709 INFO:tasks.ceph.osd.6:Started 2023-10-16T19:56:51.710 INFO:tasks.ceph.osd.7:Restarting daemon 2023-10-16T19:56:51.710 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-10-16T19:56:51.712 INFO:tasks.ceph.osd.7:Started 2023-10-16T19:56:51.713 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T19:56:51.780 INFO:tasks.ceph.osd.1.smithi157.stderr:2023-10-16T19:56:51.778+0000 7f58b290c640 -1 Falling back to public interface 2023-10-16T19:56:51.787 INFO:tasks.ceph.osd.4.smithi187.stderr:2023-10-16T19:56:51.785+0000 7f7100dec640 -1 Falling back to public interface 2023-10-16T19:56:51.788 INFO:tasks.ceph.osd.5.smithi187.stderr:2023-10-16T19:56:51.785+0000 7ff9e79a5640 -1 Falling back to public interface 2023-10-16T19:56:51.788 INFO:tasks.ceph.osd.5.smithi187.stderr:2023-10-16T19:56:51.785+0000 7ff9ded63700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6801/0: (98) Address already in use 2023-10-16T19:56:51.788 INFO:tasks.ceph.osd.5.smithi187.stderr:2023-10-16T19:56:51.785+0000 7ff9ded63700 -1 PosixStack listen unable to listen on v1:0.0.0.0:6804/0: (98) Address already in use 2023-10-16T19:56:51.789 INFO:tasks.ceph.osd.5.smithi187.stderr:2023-10-16T19:56:51.786+0000 7ff9ded63700 -1 PosixStack listen unable to listen on v1:0.0.0.0:6809/0: (98) Address already in use 2023-10-16T19:56:51.796 INFO:tasks.ceph.mgr.y.smithi157.stderr:2023-10-16T19:56:51.794+0000 7fa085de0200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-16T19:56:51.797 INFO:tasks.ceph.osd.6.smithi187.stderr:2023-10-16T19:56:51.795+0000 7f62590b3640 -1 Falling back to public interface 2023-10-16T19:56:51.798 INFO:tasks.ceph.osd.1.smithi157.stderr:2023-10-16T19:56:51.796+0000 7f58b290c640 -1 osd.1 0 log_to_monitors true 2023-10-16T19:56:51.801 INFO:tasks.ceph.osd.5.smithi187.stderr:2023-10-16T19:56:51.799+0000 7ff9e79a5640 -1 osd.5 0 log_to_monitors true 2023-10-16T19:56:51.802 INFO:tasks.ceph.osd.4.smithi187.stderr:2023-10-16T19:56:51.799+0000 7f7100dec640 -1 osd.4 0 log_to_monitors true 2023-10-16T19:56:51.804 INFO:tasks.ceph.osd.0.smithi157.stderr:2023-10-16T19:56:51.801+0000 7f8b85492640 -1 Falling back to public interface 2023-10-16T19:56:51.805 INFO:tasks.ceph.osd.3.smithi157.stderr:2023-10-16T19:56:51.803+0000 7f0367540640 -1 Falling back to public interface 2023-10-16T19:56:51.809 INFO:tasks.ceph.osd.2.smithi157.stderr:2023-10-16T19:56:51.807+0000 7fc3e6ee5640 -1 Falling back to public interface 2023-10-16T19:56:51.816 INFO:tasks.ceph.osd.6.smithi187.stderr:2023-10-16T19:56:51.814+0000 7f62590b3640 -1 osd.6 0 log_to_monitors true 2023-10-16T19:56:51.819 INFO:tasks.ceph.osd.0.smithi157.stderr:2023-10-16T19:56:51.817+0000 7f8b85492640 -1 osd.0 0 log_to_monitors true 2023-10-16T19:56:51.821 INFO:tasks.ceph.osd.3.smithi157.stderr:2023-10-16T19:56:51.819+0000 7f0367540640 -1 osd.3 0 log_to_monitors true 2023-10-16T19:56:51.822 INFO:tasks.ceph.osd.7.smithi187.stderr:2023-10-16T19:56:51.820+0000 7f1b4a5e5640 -1 Falling back to public interface 2023-10-16T19:56:51.830 INFO:tasks.ceph.osd.2.smithi157.stderr:2023-10-16T19:56:51.828+0000 7fc3e6ee5640 -1 osd.2 0 log_to_monitors true 2023-10-16T19:56:51.836 INFO:tasks.ceph.osd.7.smithi187.stderr:2023-10-16T19:56:51.834+0000 7f1b4a5e5640 -1 osd.7 0 log_to_monitors true 2023-10-16T19:56:51.872 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:56:51.869+0000 7f11edd48700 1 Processor -- start 2023-10-16T19:56:51.872 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:56:51.869+0000 7f11edd48700 1 -- start start 2023-10-16T19:56:51.874 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:56:51.870+0000 7f11edd48700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f11e815dce0 0x7f11e806d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:56:51.875 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:56:51.870+0000 7f11edd48700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f11e80b3da0 0x7f11e8167b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:56:51.875 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:56:51.870+0000 7f11edd48700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11e80ce610 con 0x7f11e80d1a90 2023-10-16T19:56:51.875 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:56:51.870+0000 7f11edd48700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11e80b13c0 con 0x7f11e80b3da0 2023-10-16T19:56:51.875 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:56:51.870+0000 7f11edd48700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11e80d1f50 con 0x7f11e815dce0 2023-10-16T19:56:51.876 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:56:51.870+0000 7f11e7fff700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f11e80b3da0 0x7f11e8167b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:56:51.876 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:56:51.870+0000 7f11e7fff700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f11e80b3da0 0x7f11e8167b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:45146/0 (socket says 172.21.15.157:45146) 2023-10-16T19:56:51.876 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:56:51.870+0000 7f11e7fff700 1 -- 172.21.15.157:0/3350584639 learned_addr learned my addr 172.21.15.157:0/3350584639 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:56:51.876 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:56:51.870+0000 7f11e77fe700 1 --2- 172.21.15.157:0/3350584639 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f11e815dce0 0x7f11e806d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:56:51.876 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:56:51.871+0000 7f11e7fff700 1 -- 172.21.15.157:0/3350584639 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f11e815dce0 msgr2=0x7f11e806d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:56:51.877 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:56:51.871+0000 7f11e7fff700 1 --2- 172.21.15.157:0/3350584639 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f11e815dce0 0x7f11e806d2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:56:51.877 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:56:51.871+0000 7f11e7fff700 1 -- 172.21.15.157:0/3350584639 >> v1:172.21.15.187:6789/0 conn(0x7f11e80d1a90 legacy=0x7f11e80b3690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:56:51.877 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:56:51.871+0000 7f11e7fff700 1 -- 172.21.15.157:0/3350584639 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11e80d2230 con 0x7f11e80b3da0 2023-10-16T19:56:51.877 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:56:51.871+0000 7f11e7fff700 1 --2- 172.21.15.157:0/3350584639 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f11e80b3da0 0x7f11e8167b10 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f11d8009e50 tx=0x7f11d800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecba8011dd76002a server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:56:51.877 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:56:51.871+0000 7f11e67fc700 1 -- 172.21.15.157:0/3350584639 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11d800e070 con 0x7f11e80b3da0 2023-10-16T19:56:51.878 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:56:51.871+0000 7f11e67fc700 1 -- 172.21.15.157:0/3350584639 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11d800b910 con 0x7f11e80b3da0 2023-10-16T19:56:51.878 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:56:51.871+0000 7f11e67fc700 1 -- 172.21.15.157:0/3350584639 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11d800bcc0 con 0x7f11e80b3da0 2023-10-16T19:56:51.878 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:56:51.872+0000 7f11edd48700 1 -- 172.21.15.157:0/3350584639 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f11e80b3da0 msgr2=0x7f11e8167b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:56:51.878 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:56:51.872+0000 7f11edd48700 1 --2- 172.21.15.157:0/3350584639 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f11e80b3da0 0x7f11e8167b10 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f11d8009e50 tx=0x7f11d800b330 comp rx=0 tx=0).stop 2023-10-16T19:56:51.878 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:56:51.872+0000 7f11edd48700 1 -- 172.21.15.157:0/3350584639 shutdown_connections 2023-10-16T19:56:51.879 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:56:51.872+0000 7f11edd48700 1 --2- 172.21.15.157:0/3350584639 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f11e815dce0 0x7f11e806d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:56:51.879 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:56:51.872+0000 7f11edd48700 1 --2- 172.21.15.157:0/3350584639 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f11e80b3da0 0x7f11e8167b10 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:56:51.879 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:56:51.872+0000 7f11edd48700 1 -- 172.21.15.157:0/3350584639 >> 172.21.15.157:0/3350584639 conn(0x7f11e806e300 msgr2=0x7f11e806e6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:56:51.879 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:56:51.872+0000 7f11edd48700 1 -- 172.21.15.157:0/3350584639 shutdown_connections 2023-10-16T19:56:51.879 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:56:51.872+0000 7f11edd48700 1 -- 172.21.15.157:0/3350584639 wait complete. 2023-10-16T19:56:51.882 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:56:51.873+0000 7f11edd48700 1 Processor -- start 2023-10-16T19:56:51.882 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:56:51.873+0000 7f11edd48700 1 -- start start 2023-10-16T19:56:51.882 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:56:51.874+0000 7f11edd48700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f11e80b3da0 0x7f11e80c6860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:56:51.883 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:56:51.874+0000 7f11edd48700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f11e80d1a90 0x7f11e80ae8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:56:51.883 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:56:51.874+0000 7f11edd48700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f11e815dce0 0x7f11e80aedf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:56:51.883 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:56:51.874+0000 7f11edd48700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11e81f45f0 con 0x7f11e80b3da0 2023-10-16T19:56:51.883 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:56:51.874+0000 7f11edd48700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11e80b57e0 con 0x7f11e815dce0 2023-10-16T19:56:51.883 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:56:51.874+0000 7f11edd48700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11e80b5ac0 con 0x7f11e80d1a90 2023-10-16T19:56:51.884 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:56:51.874+0000 7f11e77fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f11e80b3da0 0x7f11e80c6860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:56:51.884 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:56:51.874+0000 7f11e77fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f11e80b3da0 0x7f11e80c6860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:45148/0 (socket says 172.21.15.157:45148) 2023-10-16T19:56:51.884 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:56:51.874+0000 7f11e77fe700 1 -- 172.21.15.157:0/1231672945 learned_addr learned my addr 172.21.15.157:0/1231672945 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:56:51.884 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:56:51.874+0000 7f11e6ffd700 1 --2- 172.21.15.157:0/1231672945 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f11e80d1a90 0x7f11e80ae8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:56:51.884 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:56:51.874+0000 7f11e7fff700 1 --2- 172.21.15.157:0/1231672945 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f11e815dce0 0x7f11e80aedf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:56:51.885 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:56:51.874+0000 7f11e77fe700 1 -- 172.21.15.157:0/1231672945 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f11e80d1a90 msgr2=0x7f11e80ae8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:56:51.885 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:56:51.874+0000 7f11e77fe700 1 --2- 172.21.15.157:0/1231672945 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f11e80d1a90 0x7f11e80ae8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:56:51.885 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:56:51.874+0000 7f11e77fe700 1 -- 172.21.15.157:0/1231672945 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f11e815dce0 msgr2=0x7f11e80aedf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:56:51.885 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:56:51.874+0000 7f11e77fe700 1 --2- 172.21.15.157:0/1231672945 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f11e815dce0 0x7f11e80aedf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:56:51.885 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:56:51.874+0000 7f11e77fe700 1 -- 172.21.15.157:0/1231672945 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11d8009b30 con 0x7f11e80b3da0 2023-10-16T19:56:51.886 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:56:51.874+0000 7f11e77fe700 1 --2- 172.21.15.157:0/1231672945 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f11e80b3da0 0x7f11e80c6860 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f11e000e870 tx=0x7f11e000eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:56:51.886 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:56:51.874+0000 7f11dffff700 1 -- 172.21.15.157:0/1231672945 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11e0009590 con 0x7f11e80b3da0 2023-10-16T19:56:51.886 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:56:51.874+0000 7f11dffff700 1 -- 172.21.15.157:0/1231672945 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11e0013680 con 0x7f11e80b3da0 2023-10-16T19:56:51.886 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:56:51.874+0000 7f11edd48700 1 -- 172.21.15.157:0/1231672945 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11e80b5da0 con 0x7f11e80b3da0 2023-10-16T19:56:51.886 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:56:51.874+0000 7f11dffff700 1 -- 172.21.15.157:0/1231672945 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11e00139f0 con 0x7f11e80b3da0 2023-10-16T19:56:51.887 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:56:51.874+0000 7f11edd48700 1 -- 172.21.15.157:0/1231672945 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11e80c6da0 con 0x7f11e80b3da0 2023-10-16T19:56:51.887 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:56:51.875+0000 7f11dffff700 1 -- 172.21.15.157:0/1231672945 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f11e0005a20 con 0x7f11e80b3da0 2023-10-16T19:56:51.887 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:56:51.875+0000 7f11dffff700 1 -- 172.21.15.157:0/1231672945 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f11e00066b0 con 0x7f11e80b3da0 2023-10-16T19:56:51.887 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:56:51.875+0000 7f11edd48700 1 -- 172.21.15.157:0/1231672945 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11e80b63f0 con 0x7f11e80b3da0 2023-10-16T19:56:51.887 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:56:51.877+0000 7f11dffff700 1 -- 172.21.15.157:0/1231672945 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f11e0021060 con 0x7f11e80b3da0 2023-10-16T19:56:51.949 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:56:51.947+0000 7f11edd48700 1 -- 172.21.15.157:0/1231672945 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f11e80d24e0 con 0x7f11e80b3da0 2023-10-16T19:56:51.950 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:56:51.948+0000 7f11dffff700 1 -- 172.21.15.157:0/1231672945 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f11e0017070 con 0x7f11e80b3da0 2023-10-16T19:56:51.951 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-10-16T19:56:51.951 INFO:teuthology.orchestra.run.smithi157.stdout:{"epoch":10,"fsid":"28199dc9-64d5-479e-83c6-21f097c33d39","created":"2023-10-16T19:56:49.201889+0000","modified":"2023-10-16T19:56:51.666728+0000","last_up_change":"0.000000","last_in_change":"2023-10-16T19:56:51.666728+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T19:56:51.952 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:56:51.949+0000 7f11edd48700 1 -- 172.21.15.157:0/1231672945 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f11e80b3da0 msgr2=0x7f11e80c6860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:56:51.952 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:56:51.949+0000 7f11edd48700 1 --2- 172.21.15.157:0/1231672945 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f11e80b3da0 0x7f11e80c6860 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f11e000e870 tx=0x7f11e000eb80 comp rx=0 tx=0).stop 2023-10-16T19:56:51.952 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:56:51.949+0000 7f11edd48700 1 -- 172.21.15.157:0/1231672945 shutdown_connections 2023-10-16T19:56:51.952 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:56:51.949+0000 7f11edd48700 1 --2- 172.21.15.157:0/1231672945 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f11e815dce0 0x7f11e80aedf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:56:51.953 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:56:51.949+0000 7f11edd48700 1 --2- 172.21.15.157:0/1231672945 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f11e80b3da0 0x7f11e80c6860 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:56:51.953 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:56:51.949+0000 7f11edd48700 1 --2- 172.21.15.157:0/1231672945 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f11e80d1a90 0x7f11e80ae8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:56:51.953 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:56:51.949+0000 7f11edd48700 1 -- 172.21.15.157:0/1231672945 >> 172.21.15.157:0/1231672945 conn(0x7f11e806e300 msgr2=0x7f11e80b34d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:56:51.953 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:56:51.949+0000 7f11edd48700 1 -- 172.21.15.157:0/1231672945 shutdown_connections 2023-10-16T19:56:51.953 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:56:51.949+0000 7f11edd48700 1 -- 172.21.15.157:0/1231672945 wait complete. 2023-10-16T19:56:51.963 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-10-16T19:56:51.964 INFO:tasks.ceph:Waiting for OSDs to come up 2023-10-16T19:56:52.370 INFO:tasks.ceph.mgr.x.smithi187.stderr:2023-10-16T19:56:52.368+0000 7f4832adf200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-16T19:56:52.448 INFO:tasks.ceph.mgr.x.smithi187.stderr:2023-10-16T19:56:52.445+0000 7f4832adf200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-16T19:56:52.507 INFO:tasks.ceph.mgr.y.smithi157.stderr:2023-10-16T19:56:52.505+0000 7fa085de0200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-16T19:56:52.584 INFO:tasks.ceph.mgr.y.smithi157.stderr:2023-10-16T19:56:52.582+0000 7fa085de0200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-16T19:56:52.590 INFO:tasks.ceph.mgr.x.smithi187.stderr:2023-10-16T19:56:52.588+0000 7f4832adf200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-16T19:56:52.724 INFO:tasks.ceph.mgr.y.smithi157.stderr:2023-10-16T19:56:52.722+0000 7fa085de0200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-16T19:56:52.768 DEBUG:teuthology.orchestra.run.smithi157:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-16T19:56:52.827 INFO:tasks.ceph.mgr.x.smithi187.stderr:2023-10-16T19:56:52.824+0000 7f4832adf200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-16T19:56:52.882 INFO:teuthology.misc.health.smithi157.stderr:2023-10-16T19:56:52.880+0000 7f473a2e6700 1 Processor -- start 2023-10-16T19:56:52.882 INFO:teuthology.misc.health.smithi157.stderr:2023-10-16T19:56:52.880+0000 7f473a2e6700 1 -- start start 2023-10-16T19:56:52.884 INFO:teuthology.misc.health.smithi157.stderr:2023-10-16T19:56:52.880+0000 7f473a2e6700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f47340ceb40 0x7f47340cf780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:56:52.884 INFO:teuthology.misc.health.smithi157.stderr:2023-10-16T19:56:52.880+0000 7f473a2e6700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47340d1f90 con 0x7f473415e130 2023-10-16T19:56:52.885 INFO:teuthology.misc.health.smithi157.stderr:2023-10-16T19:56:52.880+0000 7f473a2e6700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47340d2270 con 0x7f473415dd50 2023-10-16T19:56:52.885 INFO:teuthology.misc.health.smithi157.stderr:2023-10-16T19:56:52.880+0000 7f473a2e6700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47340cc200 con 0x7f47340ceb40 2023-10-16T19:56:52.885 INFO:teuthology.misc.health.smithi157.stderr:2023-10-16T19:56:52.880+0000 7f47337fe700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f47340ceb40 0x7f47340cf780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:56:52.885 INFO:teuthology.misc.health.smithi157.stderr:2023-10-16T19:56:52.881+0000 7f4738883700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f473415e130 0x7f47340cc630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:54830/0 (socket says 172.21.15.157:54830) 2023-10-16T19:56:52.885 INFO:teuthology.misc.health.smithi157.stderr:2023-10-16T19:56:52.881+0000 7f4738883700 1 -- 172.21.15.157:0/1291416696 learned_addr learned my addr 172.21.15.157:0/1291416696 (peer_addr_for_me v1:172.21.15.157:0/0) 2023-10-16T19:56:52.886 INFO:teuthology.misc.health.smithi157.stderr:2023-10-16T19:56:52.881+0000 7f47337fe700 1 -- 172.21.15.157:0/1291416696 >> v1:172.21.15.187:6789/0 conn(0x7f473415dd50 legacy=0x7f47340ce430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:56:52.886 INFO:teuthology.misc.health.smithi157.stderr:2023-10-16T19:56:52.881+0000 7f47337fe700 1 -- 172.21.15.157:0/1291416696 >> v1:172.21.15.157:6789/0 conn(0x7f473415e130 legacy=0x7f47340cc630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:56:52.886 INFO:teuthology.misc.health.smithi157.stderr:2023-10-16T19:56:52.881+0000 7f47337fe700 1 -- 172.21.15.157:0/1291416696 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47340d2550 con 0x7f47340ceb40 2023-10-16T19:56:52.886 INFO:teuthology.misc.health.smithi157.stderr:2023-10-16T19:56:52.881+0000 7f4732ffd700 1 -- 172.21.15.157:0/1291416696 <== mon.0 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2481162393 0 0) 0x7f47340d1f90 con 0x7f473415e130 2023-10-16T19:56:52.886 INFO:teuthology.misc.health.smithi157.stderr:2023-10-16T19:56:52.881+0000 7f47337fe700 1 --2- 172.21.15.157:0/1291416696 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f47340ceb40 0x7f47340cf780 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f4728009840 tx=0x7f4728009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1cd32324602cb9c server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:56:52.887 INFO:teuthology.misc.health.smithi157.stderr:2023-10-16T19:56:52.881+0000 7f4732ffd700 1 -- 172.21.15.157:0/1291416696 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4728011830 con 0x7f47340ceb40 2023-10-16T19:56:52.887 INFO:teuthology.misc.health.smithi157.stderr:2023-10-16T19:56:52.881+0000 7f4732ffd700 1 -- 172.21.15.157:0/1291416696 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4728011990 con 0x7f47340ceb40 2023-10-16T19:56:52.887 INFO:teuthology.misc.health.smithi157.stderr:2023-10-16T19:56:52.881+0000 7f4732ffd700 1 -- 172.21.15.157:0/1291416696 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4728011d20 con 0x7f47340ceb40 2023-10-16T19:56:52.887 INFO:teuthology.misc.health.smithi157.stderr:2023-10-16T19:56:52.882+0000 7f473a2e6700 1 -- 172.21.15.157:0/1291416696 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f47340ceb40 msgr2=0x7f47340cf780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:56:52.887 INFO:teuthology.misc.health.smithi157.stderr:2023-10-16T19:56:52.882+0000 7f473a2e6700 1 --2- 172.21.15.157:0/1291416696 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f47340ceb40 0x7f47340cf780 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f4728009840 tx=0x7f4728009b50 comp rx=0 tx=0).stop 2023-10-16T19:56:52.888 INFO:teuthology.misc.health.smithi157.stderr:2023-10-16T19:56:52.882+0000 7f473a2e6700 1 -- 172.21.15.157:0/1291416696 shutdown_connections 2023-10-16T19:56:52.888 INFO:teuthology.misc.health.smithi157.stderr:2023-10-16T19:56:52.882+0000 7f473a2e6700 1 --2- 172.21.15.157:0/1291416696 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f47340ceb40 0x7f47340cf780 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:56:52.888 INFO:teuthology.misc.health.smithi157.stderr:2023-10-16T19:56:52.882+0000 7f473a2e6700 1 -- 172.21.15.157:0/1291416696 >> 172.21.15.157:0/1291416696 conn(0x7f473406e260 msgr2=0x7f473406e640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:56:52.888 INFO:teuthology.misc.health.smithi157.stderr:2023-10-16T19:56:52.882+0000 7f473a2e6700 1 -- 172.21.15.157:0/1291416696 shutdown_connections 2023-10-16T19:56:52.888 INFO:teuthology.misc.health.smithi157.stderr:2023-10-16T19:56:52.882+0000 7f473a2e6700 1 -- 172.21.15.157:0/1291416696 wait complete. 2023-10-16T19:56:52.891 INFO:teuthology.misc.health.smithi157.stderr:2023-10-16T19:56:52.883+0000 7f473a2e6700 1 Processor -- start 2023-10-16T19:56:52.891 INFO:teuthology.misc.health.smithi157.stderr:2023-10-16T19:56:52.883+0000 7f473a2e6700 1 -- start start 2023-10-16T19:56:52.891 INFO:teuthology.misc.health.smithi157.stderr:2023-10-16T19:56:52.884+0000 7f473a2e6700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f47340ceb40 0x7f47340c98d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:56:52.891 INFO:teuthology.misc.health.smithi157.stderr:2023-10-16T19:56:52.884+0000 7f473a2e6700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f473415dd50 0x7f47340c7c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:56:52.892 INFO:teuthology.misc.health.smithi157.stderr:2023-10-16T19:56:52.884+0000 7f473a2e6700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f473415e130 0x7f47340c8170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:56:52.892 INFO:teuthology.misc.health.smithi157.stderr:2023-10-16T19:56:52.884+0000 7f473a2e6700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47340c87d0 con 0x7f473415dd50 2023-10-16T19:56:52.892 INFO:teuthology.misc.health.smithi157.stderr:2023-10-16T19:56:52.884+0000 7f473a2e6700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47340b5800 con 0x7f47340ceb40 2023-10-16T19:56:52.892 INFO:teuthology.misc.health.smithi157.stderr:2023-10-16T19:56:52.884+0000 7f473a2e6700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47340b5ae0 con 0x7f473415e130 2023-10-16T19:56:52.892 INFO:teuthology.misc.health.smithi157.stderr:2023-10-16T19:56:52.884+0000 7f47337fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f473415dd50 0x7f47340c7c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:56:52.893 INFO:teuthology.misc.health.smithi157.stderr:2023-10-16T19:56:52.884+0000 7f47337fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f473415dd50 0x7f47340c7c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:45162/0 (socket says 172.21.15.157:45162) 2023-10-16T19:56:52.893 INFO:teuthology.misc.health.smithi157.stderr:2023-10-16T19:56:52.884+0000 7f47337fe700 1 -- 172.21.15.157:0/2438453399 learned_addr learned my addr 172.21.15.157:0/2438453399 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:56:52.893 INFO:teuthology.misc.health.smithi157.stderr:2023-10-16T19:56:52.884+0000 7f4733fff700 1 --2- 172.21.15.157:0/2438453399 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f47340ceb40 0x7f47340c98d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:56:52.893 INFO:teuthology.misc.health.smithi157.stderr:2023-10-16T19:56:52.884+0000 7f4738883700 1 --2- 172.21.15.157:0/2438453399 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f473415e130 0x7f47340c8170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:56:52.893 INFO:teuthology.misc.health.smithi157.stderr:2023-10-16T19:56:52.884+0000 7f47337fe700 1 -- 172.21.15.157:0/2438453399 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f473415e130 msgr2=0x7f47340c8170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:56:52.893 INFO:teuthology.misc.health.smithi157.stderr:2023-10-16T19:56:52.884+0000 7f47337fe700 1 --2- 172.21.15.157:0/2438453399 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f473415e130 0x7f47340c8170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:56:52.894 INFO:teuthology.misc.health.smithi157.stderr:2023-10-16T19:56:52.884+0000 7f47337fe700 1 -- 172.21.15.157:0/2438453399 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f47340ceb40 msgr2=0x7f47340c98d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:56:52.894 INFO:teuthology.misc.health.smithi157.stderr:2023-10-16T19:56:52.884+0000 7f47337fe700 1 --2- 172.21.15.157:0/2438453399 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f47340ceb40 0x7f47340c98d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:56:52.894 INFO:teuthology.misc.health.smithi157.stderr:2023-10-16T19:56:52.884+0000 7f47337fe700 1 -- 172.21.15.157:0/2438453399 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47280094a0 con 0x7f473415dd50 2023-10-16T19:56:52.894 INFO:teuthology.misc.health.smithi157.stderr:2023-10-16T19:56:52.884+0000 7f47337fe700 1 --2- 172.21.15.157:0/2438453399 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f473415dd50 0x7f47340c7c30 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f47280090b0 tx=0x7f4728004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:56:52.894 INFO:teuthology.misc.health.smithi157.stderr:2023-10-16T19:56:52.885+0000 7f4730ff9700 1 -- 172.21.15.157:0/2438453399 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f472801a860 con 0x7f473415dd50 2023-10-16T19:56:52.895 INFO:teuthology.misc.health.smithi157.stderr:2023-10-16T19:56:52.885+0000 7f4730ff9700 1 -- 172.21.15.157:0/2438453399 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f472801a9e0 con 0x7f473415dd50 2023-10-16T19:56:52.895 INFO:teuthology.misc.health.smithi157.stderr:2023-10-16T19:56:52.885+0000 7f473a2e6700 1 -- 172.21.15.157:0/2438453399 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47340b5dc0 con 0x7f473415dd50 2023-10-16T19:56:52.895 INFO:teuthology.misc.health.smithi157.stderr:2023-10-16T19:56:52.885+0000 7f4730ff9700 1 -- 172.21.15.157:0/2438453399 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f472801ad90 con 0x7f473415dd50 2023-10-16T19:56:52.895 INFO:teuthology.misc.health.smithi157.stderr:2023-10-16T19:56:52.885+0000 7f473a2e6700 1 -- 172.21.15.157:0/2438453399 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47340c9e10 con 0x7f473415dd50 2023-10-16T19:56:52.895 INFO:teuthology.misc.health.smithi157.stderr:2023-10-16T19:56:52.885+0000 7f4730ff9700 1 -- 172.21.15.157:0/2438453399 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f4728022070 con 0x7f473415dd50 2023-10-16T19:56:52.896 INFO:teuthology.misc.health.smithi157.stderr:2023-10-16T19:56:52.885+0000 7f4730ff9700 1 -- 172.21.15.157:0/2438453399 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(11..11 src has 1..11) v4 ==== 1883+0+0 (secure 0 0 0) 0x7f4728024be0 con 0x7f473415dd50 2023-10-16T19:56:52.896 INFO:teuthology.misc.health.smithi157.stderr:2023-10-16T19:56:52.886+0000 7f473a2e6700 1 -- 172.21.15.157:0/2438453399 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47340b6280 con 0x7f473415dd50 2023-10-16T19:56:52.896 INFO:teuthology.misc.health.smithi157.stderr:2023-10-16T19:56:52.888+0000 7f4730ff9700 1 -- 172.21.15.157:0/2438453399 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f4728029070 con 0x7f473415dd50 2023-10-16T19:56:52.960 INFO:teuthology.misc.health.smithi157.stderr:2023-10-16T19:56:52.958+0000 7f473a2e6700 1 -- 172.21.15.157:0/2438453399 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f47340735c0 con 0x7f473415dd50 2023-10-16T19:56:52.961 INFO:teuthology.misc.health.smithi157.stderr:2023-10-16T19:56:52.959+0000 7f4730ff9700 1 -- 172.21.15.157:0/2438453399 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v11) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f4728015020 con 0x7f473415dd50 2023-10-16T19:56:52.962 INFO:teuthology.misc.health.smithi157.stdout: 2023-10-16T19:56:52.962 INFO:teuthology.misc.health.smithi157.stdout:{"epoch":11,"fsid":"28199dc9-64d5-479e-83c6-21f097c33d39","created":"2023-10-16T19:56:49.201889+0000","modified":"2023-10-16T19:56:52.667654+0000","last_up_change":"0.000000","last_in_change":"2023-10-16T19:56:51.666728+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":3,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T19:56:52.963 INFO:teuthology.misc.health.smithi157.stderr:2023-10-16T19:56:52.960+0000 7f473a2e6700 1 -- 172.21.15.157:0/2438453399 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f473415dd50 msgr2=0x7f47340c7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:56:52.963 INFO:teuthology.misc.health.smithi157.stderr:2023-10-16T19:56:52.960+0000 7f473a2e6700 1 --2- 172.21.15.157:0/2438453399 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f473415dd50 0x7f47340c7c30 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f47280090b0 tx=0x7f4728004750 comp rx=0 tx=0).stop 2023-10-16T19:56:52.963 INFO:teuthology.misc.health.smithi157.stderr:2023-10-16T19:56:52.960+0000 7f473a2e6700 1 -- 172.21.15.157:0/2438453399 shutdown_connections 2023-10-16T19:56:52.964 INFO:teuthology.misc.health.smithi157.stderr:2023-10-16T19:56:52.960+0000 7f473a2e6700 1 --2- 172.21.15.157:0/2438453399 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f47340ceb40 0x7f47340c98d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:56:52.964 INFO:teuthology.misc.health.smithi157.stderr:2023-10-16T19:56:52.960+0000 7f473a2e6700 1 --2- 172.21.15.157:0/2438453399 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f473415e130 0x7f47340c8170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:56:52.964 INFO:teuthology.misc.health.smithi157.stderr:2023-10-16T19:56:52.960+0000 7f473a2e6700 1 --2- 172.21.15.157:0/2438453399 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f473415dd50 0x7f47340c7c30 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:56:52.964 INFO:teuthology.misc.health.smithi157.stderr:2023-10-16T19:56:52.960+0000 7f473a2e6700 1 -- 172.21.15.157:0/2438453399 >> 172.21.15.157:0/2438453399 conn(0x7f473406e260 msgr2=0x7f47340b2920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:56:52.964 INFO:teuthology.misc.health.smithi157.stderr:2023-10-16T19:56:52.960+0000 7f473a2e6700 1 -- 172.21.15.157:0/2438453399 shutdown_connections 2023-10-16T19:56:52.965 INFO:teuthology.misc.health.smithi157.stderr:2023-10-16T19:56:52.960+0000 7f473a2e6700 1 -- 172.21.15.157:0/2438453399 wait complete. 2023-10-16T19:56:52.969 INFO:tasks.ceph.mgr.y.smithi157.stderr:2023-10-16T19:56:52.967+0000 7fa085de0200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-16T19:56:52.973 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-10-16T19:56:53.041 INFO:tasks.ceph.mgr.x.smithi187.stderr:2023-10-16T19:56:53.038+0000 7f4832adf200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-16T19:56:53.173 INFO:tasks.ceph.mgr.x.smithi187.stderr:2023-10-16T19:56:53.171+0000 7f4832adf200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-16T19:56:53.184 INFO:tasks.ceph.mgr.y.smithi157.stderr:2023-10-16T19:56:53.182+0000 7fa085de0200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-16T19:56:53.317 INFO:tasks.ceph.mgr.y.smithi157.stderr:2023-10-16T19:56:53.314+0000 7fa085de0200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-16T19:56:53.392 INFO:tasks.ceph.mgr.x.smithi187.stderr:2023-10-16T19:56:53.390+0000 7f4832adf200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-16T19:56:53.534 INFO:tasks.ceph.mgr.y.smithi157.stderr:2023-10-16T19:56:53.532+0000 7fa085de0200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-16T19:56:53.546 INFO:tasks.ceph.mgr.x.smithi187.stderr:2023-10-16T19:56:53.543+0000 7f4832adf200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-16T19:56:53.659 INFO:tasks.ceph.mgr.x.smithi187.stderr:2023-10-16T19:56:53.657+0000 7f4832adf200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-16T19:56:53.687 INFO:tasks.ceph.osd.1.smithi157.stderr:2023-10-16T19:56:53.685+0000 7f58a6cc4700 -1 osd.1 0 waiting for initial osdmap 2023-10-16T19:56:53.688 INFO:tasks.ceph.osd.1.smithi157.stderr:2023-10-16T19:56:53.686+0000 7f58a00a1700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-16T19:56:53.693 INFO:tasks.ceph.osd.5.smithi187.stderr:2023-10-16T19:56:53.691+0000 7ff9dbd5d700 -1 osd.5 0 waiting for initial osdmap 2023-10-16T19:56:53.694 INFO:tasks.ceph.osd.3.smithi157.stderr:2023-10-16T19:56:53.692+0000 7f035b8f8700 -1 osd.3 0 waiting for initial osdmap 2023-10-16T19:56:53.694 INFO:tasks.ceph.osd.2.smithi157.stderr:2023-10-16T19:56:53.692+0000 7fc3dba9e700 -1 osd.2 0 waiting for initial osdmap 2023-10-16T19:56:53.695 INFO:tasks.ceph.osd.4.smithi187.stderr:2023-10-16T19:56:53.693+0000 7f70f51a4700 -1 osd.4 0 waiting for initial osdmap 2023-10-16T19:56:53.695 INFO:tasks.ceph.osd.3.smithi157.stderr:2023-10-16T19:56:53.693+0000 7f0354cd5700 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-16T19:56:53.696 INFO:tasks.ceph.osd.5.smithi187.stderr:2023-10-16T19:56:53.693+0000 7ff9d513a700 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-16T19:56:53.696 INFO:tasks.ceph.osd.2.smithi157.stderr:2023-10-16T19:56:53.693+0000 7fc3d467a700 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-16T19:56:53.696 INFO:tasks.ceph.osd.7.smithi187.stderr:2023-10-16T19:56:53.694+0000 7f1b3e99d700 -1 osd.7 0 waiting for initial osdmap 2023-10-16T19:56:53.697 INFO:tasks.ceph.osd.4.smithi187.stderr:2023-10-16T19:56:53.694+0000 7f70ee581700 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-16T19:56:53.698 INFO:tasks.ceph.osd.0.smithi157.stderr:2023-10-16T19:56:53.695+0000 7f8b7a04b700 -1 osd.0 0 waiting for initial osdmap 2023-10-16T19:56:53.698 INFO:tasks.ceph.osd.7.smithi187.stderr:2023-10-16T19:56:53.695+0000 7f1b37d7a700 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-16T19:56:53.698 INFO:tasks.ceph.osd.0.smithi157.stderr:2023-10-16T19:56:53.696+0000 7f8b72c27700 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-16T19:56:53.699 INFO:tasks.ceph.osd.6.smithi187.stderr:2023-10-16T19:56:53.696+0000 7f624dc6c700 -1 osd.6 0 waiting for initial osdmap 2023-10-16T19:56:53.700 INFO:tasks.ceph.osd.6.smithi187.stderr:2023-10-16T19:56:53.698+0000 7f6246848700 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-16T19:56:53.700 INFO:tasks.ceph.mgr.y.smithi157.stderr:2023-10-16T19:56:53.698+0000 7fa085de0200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-16T19:56:53.817 INFO:tasks.ceph.mgr.y.smithi157.stderr:2023-10-16T19:56:53.815+0000 7fa085de0200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-16T19:56:53.989 INFO:tasks.ceph.mgr.x.smithi187.stderr:2023-10-16T19:56:53.987+0000 7f4832adf200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-16T19:56:54.088 INFO:tasks.ceph.mgr.x.smithi187.stderr:2023-10-16T19:56:54.086+0000 7f4832adf200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-16T19:56:54.141 INFO:tasks.ceph.mgr.y.smithi157.stderr:2023-10-16T19:56:54.139+0000 7fa085de0200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-16T19:56:54.240 INFO:tasks.ceph.mgr.y.smithi157.stderr:2023-10-16T19:56:54.237+0000 7fa085de0200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-16T19:56:54.274 INFO:tasks.ceph.mgr.x.smithi187.stderr:2023-10-16T19:56:54.272+0000 7f4832adf200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-16T19:56:54.425 INFO:tasks.ceph.mgr.y.smithi157.stderr:2023-10-16T19:56:54.423+0000 7fa085de0200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-16T19:56:54.867 INFO:tasks.ceph.mgr.x.smithi187.stderr:2023-10-16T19:56:54.864+0000 7f4832adf200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-16T19:56:55.028 INFO:tasks.ceph.mgr.y.smithi157.stderr:2023-10-16T19:56:55.026+0000 7fa085de0200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-16T19:56:55.900 INFO:tasks.ceph.mgr.x.smithi187.stderr:2023-10-16T19:56:55.898+0000 7f47eaa6d700 -1 mgr.server handle_report got status from non-daemon mon.b 2023-10-16T19:56:55.901 INFO:tasks.ceph.mgr.x.smithi187.stderr:2023-10-16T19:56:55.898+0000 7f47eaa6d700 -1 mgr.server handle_report got status from non-daemon mon.c 2023-10-16T19:56:59.780 DEBUG:teuthology.orchestra.run.smithi157:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-16T19:56:59.900 INFO:teuthology.misc.health.smithi157.stderr:2023-10-16T19:56:59.897+0000 7f83a07a6700 1 Processor -- start 2023-10-16T19:56:59.900 INFO:teuthology.misc.health.smithi157.stderr:2023-10-16T19:56:59.897+0000 7f83a07a6700 1 -- start start 2023-10-16T19:56:59.904 INFO:teuthology.misc.health.smithi157.stderr:2023-10-16T19:56:59.898+0000 7f83a07a6700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f8398159a50 0x7f83980b3fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:56:59.905 INFO:teuthology.misc.health.smithi157.stderr:2023-10-16T19:56:59.898+0000 7f83a07a6700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f839815f8b0 0x7f83980d09a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:56:59.905 INFO:teuthology.misc.health.smithi157.stderr:2023-10-16T19:56:59.898+0000 7f83a07a6700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f839815fe00 con 0x7f839815c850 2023-10-16T19:56:59.905 INFO:teuthology.misc.health.smithi157.stderr:2023-10-16T19:56:59.898+0000 7f83a07a6700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83980cf320 con 0x7f8398159a50 2023-10-16T19:56:59.905 INFO:teuthology.misc.health.smithi157.stderr:2023-10-16T19:56:59.898+0000 7f83a07a6700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83981600e0 con 0x7f839815f8b0 2023-10-16T19:56:59.906 INFO:teuthology.misc.health.smithi157.stderr:2023-10-16T19:56:59.898+0000 7f839ed43700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f839815c850 0x7f839815cca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:55026/0 (socket says 172.21.15.157:55026) 2023-10-16T19:56:59.906 INFO:teuthology.misc.health.smithi157.stderr:2023-10-16T19:56:59.898+0000 7f839ed43700 1 -- 172.21.15.157:0/3250034511 learned_addr learned my addr 172.21.15.157:0/3250034511 (peer_addr_for_me v1:172.21.15.157:0/0) 2023-10-16T19:56:59.906 INFO:teuthology.misc.health.smithi157.stderr:2023-10-16T19:56:59.899+0000 7f839e542700 1 --2- 172.21.15.157:0/3250034511 >> v2:172.21.15.187:3300/0 conn(0x7f8398159a50 0x7f83980b3fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:56:59.906 INFO:teuthology.misc.health.smithi157.stderr:2023-10-16T19:56:59.899+0000 7f839d540700 1 -- 172.21.15.157:0/3250034511 <== mon.0 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 549285990 0 0) 0x7f839815fe00 con 0x7f839815c850 2023-10-16T19:56:59.907 INFO:teuthology.misc.health.smithi157.stderr:2023-10-16T19:56:59.899+0000 7f839dd41700 1 --2- 172.21.15.157:0/3250034511 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f839815f8b0 0x7f83980d09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:56:59.907 INFO:teuthology.misc.health.smithi157.stderr:2023-10-16T19:56:59.899+0000 7f839d540700 1 -- 172.21.15.157:0/3250034511 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f83840035b0 con 0x7f839815c850 2023-10-16T19:56:59.907 INFO:teuthology.misc.health.smithi157.stderr:2023-10-16T19:56:59.899+0000 7f839d540700 1 -- 172.21.15.157:0/3250034511 <== mon.0 v1:172.21.15.157:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2639980675 0 0) 0x7f83840035b0 con 0x7f839815c850 2023-10-16T19:56:59.907 INFO:teuthology.misc.health.smithi157.stderr:2023-10-16T19:56:59.899+0000 7f839d540700 1 -- 172.21.15.157:0/3250034511 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f839815f8b0 msgr2=0x7f83980d09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:56:59.907 INFO:teuthology.misc.health.smithi157.stderr:2023-10-16T19:56:59.899+0000 7f839d540700 1 --2- 172.21.15.157:0/3250034511 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f839815f8b0 0x7f83980d09a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:56:59.908 INFO:teuthology.misc.health.smithi157.stderr:2023-10-16T19:56:59.899+0000 7f839d540700 1 -- 172.21.15.157:0/3250034511 >> v2:172.21.15.187:3300/0 conn(0x7f8398159a50 msgr2=0x7f83980b3fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:56:59.908 INFO:teuthology.misc.health.smithi157.stderr:2023-10-16T19:56:59.899+0000 7f839d540700 1 --2- 172.21.15.157:0/3250034511 >> v2:172.21.15.187:3300/0 conn(0x7f8398159a50 0x7f83980b3fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:56:59.908 INFO:teuthology.misc.health.smithi157.stderr:2023-10-16T19:56:59.899+0000 7f839d540700 1 -- 172.21.15.157:0/3250034511 --> v1:172.21.15.157:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83981603c0 con 0x7f839815c850 2023-10-16T19:56:59.908 INFO:teuthology.misc.health.smithi157.stderr:2023-10-16T19:56:59.899+0000 7f839d540700 1 -- 172.21.15.157:0/3250034511 <== mon.0 v1:172.21.15.157:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4021145519 0 0) 0x7f83900019f0 con 0x7f839815c850 2023-10-16T19:56:59.908 INFO:teuthology.misc.health.smithi157.stderr:2023-10-16T19:56:59.899+0000 7f839d540700 1 -- 172.21.15.157:0/3250034511 >> v1:172.21.15.157:6789/0 conn(0x7f839815c850 legacy=0x7f839815cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:56:59.909 INFO:teuthology.misc.health.smithi157.stderr:2023-10-16T19:56:59.899+0000 7f839d540700 1 --2- 172.21.15.157:0/3250034511 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8384003a70 0x7f8384003e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:56:59.909 INFO:teuthology.misc.health.smithi157.stderr:2023-10-16T19:56:59.899+0000 7f839d540700 1 --2- 172.21.15.157:0/3250034511 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8384004850 0x7f8384004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:56:59.909 INFO:teuthology.misc.health.smithi157.stderr:2023-10-16T19:56:59.899+0000 7f839d540700 1 --2- 172.21.15.157:0/3250034511 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f839815f8b0 0x7f8384005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:56:59.909 INFO:teuthology.misc.health.smithi157.stderr:2023-10-16T19:56:59.899+0000 7f839d540700 1 -- 172.21.15.157:0/3250034511 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83980cf320 con 0x7f8384003a70 2023-10-16T19:56:59.910 INFO:teuthology.misc.health.smithi157.stderr:2023-10-16T19:56:59.899+0000 7f839d540700 1 -- 172.21.15.157:0/3250034511 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83981600e0 con 0x7f8384004850 2023-10-16T19:56:59.910 INFO:teuthology.misc.health.smithi157.stderr:2023-10-16T19:56:59.899+0000 7f839d540700 1 -- 172.21.15.157:0/3250034511 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f838400ba10 con 0x7f839815f8b0 2023-10-16T19:56:59.910 INFO:teuthology.misc.health.smithi157.stderr:2023-10-16T19:56:59.899+0000 7f839dd41700 1 --2- 172.21.15.157:0/3250034511 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8384004850 0x7f8384004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:56:59.910 INFO:teuthology.misc.health.smithi157.stderr:2023-10-16T19:56:59.899+0000 7f839ed43700 1 --2- 172.21.15.157:0/3250034511 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f839815f8b0 0x7f8384005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:56:59.910 INFO:teuthology.misc.health.smithi157.stderr:2023-10-16T19:56:59.899+0000 7f839e542700 1 --2- 172.21.15.157:0/3250034511 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8384003a70 0x7f8384003e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:56:59.911 INFO:teuthology.misc.health.smithi157.stderr:2023-10-16T19:56:59.900+0000 7f839dd41700 1 -- 172.21.15.157:0/3250034511 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f839815f8b0 msgr2=0x7f8384005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:56:59.911 INFO:teuthology.misc.health.smithi157.stderr:2023-10-16T19:56:59.900+0000 7f839dd41700 1 --2- 172.21.15.157:0/3250034511 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f839815f8b0 0x7f8384005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:56:59.911 INFO:teuthology.misc.health.smithi157.stderr:2023-10-16T19:56:59.900+0000 7f839dd41700 1 -- 172.21.15.157:0/3250034511 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8384003a70 msgr2=0x7f8384003e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:56:59.911 INFO:teuthology.misc.health.smithi157.stderr:2023-10-16T19:56:59.900+0000 7f839dd41700 1 --2- 172.21.15.157:0/3250034511 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8384003a70 0x7f8384003e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:56:59.911 INFO:teuthology.misc.health.smithi157.stderr:2023-10-16T19:56:59.900+0000 7f839dd41700 1 -- 172.21.15.157:0/3250034511 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83840035b0 con 0x7f8384004850 2023-10-16T19:56:59.912 INFO:teuthology.misc.health.smithi157.stderr:2023-10-16T19:56:59.900+0000 7f839e542700 1 --2- 172.21.15.157:0/3250034511 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8384003a70 0x7f8384003e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T19:56:59.912 INFO:teuthology.misc.health.smithi157.stderr:2023-10-16T19:56:59.900+0000 7f839dd41700 1 --2- 172.21.15.157:0/3250034511 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8384004850 0x7f8384004cd0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f8394009b60 tx=0x7f8384005880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4d31ac07bb64e672 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:56:59.912 INFO:teuthology.misc.health.smithi157.stderr:2023-10-16T19:56:59.900+0000 7f839d540700 1 -- 172.21.15.157:0/3250034511 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f839400e6c0 con 0x7f8384004850 2023-10-16T19:56:59.912 INFO:teuthology.misc.health.smithi157.stderr:2023-10-16T19:56:59.900+0000 7f839d540700 1 -- 172.21.15.157:0/3250034511 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f839400e820 con 0x7f8384004850 2023-10-16T19:56:59.913 INFO:teuthology.misc.health.smithi157.stderr:2023-10-16T19:56:59.900+0000 7f839d540700 1 -- 172.21.15.157:0/3250034511 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f839400eb90 con 0x7f8384004850 2023-10-16T19:56:59.913 INFO:teuthology.misc.health.smithi157.stderr:2023-10-16T19:56:59.900+0000 7f83a07a6700 1 -- 172.21.15.157:0/3250034511 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8384004850 msgr2=0x7f8384004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:56:59.913 INFO:teuthology.misc.health.smithi157.stderr:2023-10-16T19:56:59.900+0000 7f83a07a6700 1 --2- 172.21.15.157:0/3250034511 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8384004850 0x7f8384004cd0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f8394009b60 tx=0x7f8384005880 comp rx=0 tx=0).stop 2023-10-16T19:56:59.913 INFO:teuthology.misc.health.smithi157.stderr:2023-10-16T19:56:59.900+0000 7f839ed43700 1 -- 172.21.15.157:0/3250034511 reap_dead start 2023-10-16T19:56:59.913 INFO:teuthology.misc.health.smithi157.stderr:2023-10-16T19:56:59.900+0000 7f83a07a6700 1 -- 172.21.15.157:0/3250034511 shutdown_connections 2023-10-16T19:56:59.914 INFO:teuthology.misc.health.smithi157.stderr:2023-10-16T19:56:59.900+0000 7f83a07a6700 1 -- 172.21.15.157:0/3250034511 >> 172.21.15.157:0/3250034511 conn(0x7f839806e260 msgr2=0x7f839806e640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:56:59.914 INFO:teuthology.misc.health.smithi157.stderr:2023-10-16T19:56:59.901+0000 7f83a07a6700 1 -- 172.21.15.157:0/3250034511 shutdown_connections 2023-10-16T19:56:59.914 INFO:teuthology.misc.health.smithi157.stderr:2023-10-16T19:56:59.901+0000 7f83a07a6700 1 -- 172.21.15.157:0/3250034511 wait complete. 2023-10-16T19:56:59.914 INFO:teuthology.misc.health.smithi157.stderr:2023-10-16T19:56:59.902+0000 7f83a07a6700 1 Processor -- start 2023-10-16T19:56:59.915 INFO:teuthology.misc.health.smithi157.stderr:2023-10-16T19:56:59.902+0000 7f83a07a6700 1 -- start start 2023-10-16T19:56:59.917 INFO:teuthology.misc.health.smithi157.stderr:2023-10-16T19:56:59.903+0000 7f83a07a6700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8384004850 0x7f8398150d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:56:59.918 INFO:teuthology.misc.health.smithi157.stderr:2023-10-16T19:56:59.903+0000 7f83a07a6700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f83981f3dd0 0x7f83980d1910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:56:59.918 INFO:teuthology.misc.health.smithi157.stderr:2023-10-16T19:56:59.903+0000 7f83a07a6700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f83980b70c0 0x7f839815e560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:56:59.918 INFO:teuthology.misc.health.smithi157.stderr:2023-10-16T19:56:59.903+0000 7f83a07a6700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f839806bb20 con 0x7f8384004850 2023-10-16T19:56:59.918 INFO:teuthology.misc.health.smithi157.stderr:2023-10-16T19:56:59.903+0000 7f83a07a6700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83980d2ac0 con 0x7f83980b70c0 2023-10-16T19:56:59.919 INFO:teuthology.misc.health.smithi157.stderr:2023-10-16T19:56:59.903+0000 7f83a07a6700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83980d2220 con 0x7f83981f3dd0 2023-10-16T19:56:59.919 INFO:teuthology.misc.health.smithi157.stderr:2023-10-16T19:56:59.903+0000 7f839e542700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8384004850 0x7f8398150d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:56:59.919 INFO:teuthology.misc.health.smithi157.stderr:2023-10-16T19:56:59.903+0000 7f839e542700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8384004850 0x7f8398150d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:45364/0 (socket says 172.21.15.157:45364) 2023-10-16T19:56:59.919 INFO:teuthology.misc.health.smithi157.stderr:2023-10-16T19:56:59.903+0000 7f839e542700 1 -- 172.21.15.157:0/1159415705 learned_addr learned my addr 172.21.15.157:0/1159415705 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:56:59.919 INFO:teuthology.misc.health.smithi157.stderr:2023-10-16T19:56:59.903+0000 7f839dd41700 1 --2- 172.21.15.157:0/1159415705 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f83981f3dd0 0x7f83980d1910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:56:59.920 INFO:teuthology.misc.health.smithi157.stderr:2023-10-16T19:56:59.903+0000 7f839ed43700 1 --2- 172.21.15.157:0/1159415705 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f83980b70c0 0x7f839815e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:56:59.920 INFO:teuthology.misc.health.smithi157.stderr:2023-10-16T19:56:59.903+0000 7f839e542700 1 -- 172.21.15.157:0/1159415705 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f83981f3dd0 msgr2=0x7f83980d1910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:56:59.920 INFO:teuthology.misc.health.smithi157.stderr:2023-10-16T19:56:59.903+0000 7f839e542700 1 --2- 172.21.15.157:0/1159415705 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f83981f3dd0 0x7f83980d1910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:56:59.920 INFO:teuthology.misc.health.smithi157.stderr:2023-10-16T19:56:59.903+0000 7f839e542700 1 -- 172.21.15.157:0/1159415705 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f83980b70c0 msgr2=0x7f839815e560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:56:59.920 INFO:teuthology.misc.health.smithi157.stderr:2023-10-16T19:56:59.903+0000 7f839e542700 1 --2- 172.21.15.157:0/1159415705 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f83980b70c0 0x7f839815e560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:56:59.921 INFO:teuthology.misc.health.smithi157.stderr:2023-10-16T19:56:59.903+0000 7f839e542700 1 -- 172.21.15.157:0/1159415705 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83980d2500 con 0x7f8384004850 2023-10-16T19:56:59.921 INFO:teuthology.misc.health.smithi157.stderr:2023-10-16T19:56:59.903+0000 7f839e542700 1 --2- 172.21.15.157:0/1159415705 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8384004850 0x7f8398150d80 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f8388011c30 tx=0x7f8388011f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:56:59.921 INFO:teuthology.misc.health.smithi157.stderr:2023-10-16T19:56:59.903+0000 7f838effd700 1 -- 172.21.15.157:0/1159415705 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f838800fa60 con 0x7f8384004850 2023-10-16T19:56:59.921 INFO:teuthology.misc.health.smithi157.stderr:2023-10-16T19:56:59.903+0000 7f838effd700 1 -- 172.21.15.157:0/1159415705 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f838800fbc0 con 0x7f8384004850 2023-10-16T19:56:59.922 INFO:teuthology.misc.health.smithi157.stderr:2023-10-16T19:56:59.903+0000 7f83a07a6700 1 -- 172.21.15.157:0/1159415705 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83980d27e0 con 0x7f8384004850 2023-10-16T19:56:59.922 INFO:teuthology.misc.health.smithi157.stderr:2023-10-16T19:56:59.903+0000 7f838effd700 1 -- 172.21.15.157:0/1159415705 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8388004020 con 0x7f8384004850 2023-10-16T19:56:59.922 INFO:teuthology.misc.health.smithi157.stderr:2023-10-16T19:56:59.903+0000 7f83a07a6700 1 -- 172.21.15.157:0/1159415705 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83980d1e50 con 0x7f8384004850 2023-10-16T19:56:59.922 INFO:teuthology.misc.health.smithi157.stderr:2023-10-16T19:56:59.904+0000 7f83a07a6700 1 -- 172.21.15.157:0/1159415705 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f839806be00 con 0x7f8384004850 2023-10-16T19:56:59.922 INFO:teuthology.misc.health.smithi157.stderr:2023-10-16T19:56:59.905+0000 7f838effd700 1 -- 172.21.15.157:0/1159415705 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f8388004180 con 0x7f8384004850 2023-10-16T19:56:59.923 INFO:teuthology.misc.health.smithi157.stderr:2023-10-16T19:56:59.905+0000 7f838effd700 1 --2- 172.21.15.157:0/1159415705 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f837c06af00 0x7f837c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:56:59.923 INFO:teuthology.misc.health.smithi157.stderr:2023-10-16T19:56:59.905+0000 7f838effd700 1 -- 172.21.15.157:0/1159415705 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f8388089790 con 0x7f8384004850 2023-10-16T19:56:59.923 INFO:teuthology.misc.health.smithi157.stderr:2023-10-16T19:56:59.905+0000 7f839dd41700 1 --2- 172.21.15.157:0/1159415705 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f837c06af00 0x7f837c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:56:59.923 INFO:teuthology.misc.health.smithi157.stderr:2023-10-16T19:56:59.906+0000 7f839dd41700 1 --2- 172.21.15.157:0/1159415705 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f837c06af00 0x7f837c06d3c0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f83981f41f0 tx=0x7f839401f040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:56:59.924 INFO:teuthology.misc.health.smithi157.stderr:2023-10-16T19:56:59.910+0000 7f838effd700 1 -- 172.21.15.157:0/1159415705 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8388054c20 con 0x7f8384004850 2023-10-16T19:57:00.100 INFO:teuthology.misc.health.smithi157.stderr:2023-10-16T19:57:00.098+0000 7f83a07a6700 1 -- 172.21.15.157:0/1159415705 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f83980735c0 con 0x7f8384004850 2023-10-16T19:57:00.101 INFO:teuthology.misc.health.smithi157.stderr:2023-10-16T19:57:00.099+0000 7f838effd700 1 -- 172.21.15.157:0/1159415705 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+12862 (secure 0 0 0) 0x7f8388022090 con 0x7f8384004850 2023-10-16T19:57:00.102 INFO:teuthology.misc.health.smithi157.stdout: 2023-10-16T19:57:00.102 INFO:teuthology.misc.health.smithi157.stdout:{"epoch":17,"fsid":"28199dc9-64d5-479e-83c6-21f097c33d39","created":"2023-10-16T19:56:49.201889+0000","modified":"2023-10-16T19:56:59.704669+0000","last_up_change":"2023-10-16T19:56:54.675673+0000","last_in_change":"2023-10-16T19:56:51.666728+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T19:56:56.932895+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":335785898},{"type":"v1","addr":"172.21.15.157:6809","nonce":335785898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":335785898},{"type":"v1","addr":"172.21.15.157:6811","nonce":335785898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6815","nonce":335785898},{"type":"v1","addr":"172.21.15.157:6817","nonce":335785898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":335785898},{"type":"v1","addr":"172.21.15.157:6813","nonce":335785898}]},"public_addr":"172.21.15.157:6809/335785898","cluster_addr":"172.21.15.157:6811/335785898","heartbeat_back_addr":"172.21.15.157:6817/335785898","heartbeat_front_addr":"172.21.15.157:6813/335785898","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":3482825047},{"type":"v1","addr":"172.21.15.157:6801","nonce":3482825047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":3482825047},{"type":"v1","addr":"172.21.15.157:6803","nonce":3482825047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":3482825047},{"type":"v1","addr":"172.21.15.157:6807","nonce":3482825047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":3482825047},{"type":"v1","addr":"172.21.15.157:6805","nonce":3482825047}]},"public_addr":"172.21.15.157:6801/3482825047","cluster_addr":"172.21.15.157:6803/3482825047","heartbeat_back_addr":"172.21.15.157:6807/3482825047","heartbeat_front_addr":"172.21.15.157:6805/3482825047","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":1118292389},{"type":"v1","addr":"172.21.15.157:6825","nonce":1118292389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":1118292389},{"type":"v1","addr":"172.21.15.157:6827","nonce":1118292389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":1118292389},{"type":"v1","addr":"172.21.15.157:6831","nonce":1118292389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":1118292389},{"type":"v1","addr":"172.21.15.157:6829","nonce":1118292389}]},"public_addr":"172.21.15.157:6825/1118292389","cluster_addr":"172.21.15.157:6827/1118292389","heartbeat_back_addr":"172.21.15.157:6831/1118292389","heartbeat_front_addr":"172.21.15.157:6829/1118292389","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":989329821},{"type":"v1","addr":"172.21.15.157:6816","nonce":989329821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":989329821},{"type":"v1","addr":"172.21.15.157:6819","nonce":989329821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":989329821},{"type":"v1","addr":"172.21.15.157:6823","nonce":989329821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":989329821},{"type":"v1","addr":"172.21.15.157:6821","nonce":989329821}]},"public_addr":"172.21.15.157:6816/989329821","cluster_addr":"172.21.15.157:6819/989329821","heartbeat_back_addr":"172.21.15.157:6823/989329821","heartbeat_front_addr":"172.21.15.157:6821/989329821","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":3841016811},{"type":"v1","addr":"172.21.15.187:6801","nonce":3841016811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6803","nonce":3841016811},{"type":"v1","addr":"172.21.15.187:6804","nonce":3841016811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6809","nonce":3841016811},{"type":"v1","addr":"172.21.15.187:6811","nonce":3841016811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":3841016811},{"type":"v1","addr":"172.21.15.187:6808","nonce":3841016811}]},"public_addr":"172.21.15.187:6801/3841016811","cluster_addr":"172.21.15.187:6804/3841016811","heartbeat_back_addr":"172.21.15.187:6811/3841016811","heartbeat_front_addr":"172.21.15.187:6808/3841016811","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":915130263},{"type":"v1","addr":"172.21.15.187:6805","nonce":915130263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6807","nonce":915130263},{"type":"v1","addr":"172.21.15.187:6810","nonce":915130263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":915130263},{"type":"v1","addr":"172.21.15.187:6815","nonce":915130263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":915130263},{"type":"v1","addr":"172.21.15.187:6813","nonce":915130263}]},"public_addr":"172.21.15.187:6805/915130263","cluster_addr":"172.21.15.187:6810/915130263","heartbeat_back_addr":"172.21.15.187:6815/915130263","heartbeat_front_addr":"172.21.15.187:6813/915130263","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":654976824},{"type":"v1","addr":"172.21.15.187:6817","nonce":654976824}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":654976824},{"type":"v1","addr":"172.21.15.187:6819","nonce":654976824}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":654976824},{"type":"v1","addr":"172.21.15.187:6823","nonce":654976824}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":654976824},{"type":"v1","addr":"172.21.15.187:6821","nonce":654976824}]},"public_addr":"172.21.15.187:6817/654976824","cluster_addr":"172.21.15.187:6819/654976824","heartbeat_back_addr":"172.21.15.187:6823/654976824","heartbeat_front_addr":"172.21.15.187:6821/654976824","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":4284059445},{"type":"v1","addr":"172.21.15.187:6825","nonce":4284059445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":4284059445},{"type":"v1","addr":"172.21.15.187:6827","nonce":4284059445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":4284059445},{"type":"v1","addr":"172.21.15.187:6831","nonce":4284059445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":4284059445},{"type":"v1","addr":"172.21.15.187:6829","nonce":4284059445}]},"public_addr":"172.21.15.187:6825/4284059445","cluster_addr":"172.21.15.187:6827/4284059445","heartbeat_back_addr":"172.21.15.187:6831/4284059445","heartbeat_front_addr":"172.21.15.187:6829/4284059445","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.819780+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.824193+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.849575+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.824806+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.809540+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.805093+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.866109+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.807372+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T19:57:00.104 INFO:teuthology.misc.health.smithi157.stderr:2023-10-16T19:57:00.101+0000 7f83a07a6700 1 -- 172.21.15.157:0/1159415705 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f837c06af00 msgr2=0x7f837c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:00.104 INFO:teuthology.misc.health.smithi157.stderr:2023-10-16T19:57:00.101+0000 7f83a07a6700 1 --2- 172.21.15.157:0/1159415705 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f837c06af00 0x7f837c06d3c0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f83981f41f0 tx=0x7f839401f040 comp rx=0 tx=0).stop 2023-10-16T19:57:00.104 INFO:teuthology.misc.health.smithi157.stderr:2023-10-16T19:57:00.101+0000 7f83a07a6700 1 -- 172.21.15.157:0/1159415705 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8384004850 msgr2=0x7f8398150d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:00.105 INFO:teuthology.misc.health.smithi157.stderr:2023-10-16T19:57:00.101+0000 7f83a07a6700 1 --2- 172.21.15.157:0/1159415705 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8384004850 0x7f8398150d80 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f8388011c30 tx=0x7f8388011f40 comp rx=0 tx=0).stop 2023-10-16T19:57:00.105 INFO:teuthology.misc.health.smithi157.stderr:2023-10-16T19:57:00.101+0000 7f83a07a6700 1 -- 172.21.15.157:0/1159415705 shutdown_connections 2023-10-16T19:57:00.105 INFO:teuthology.misc.health.smithi157.stderr:2023-10-16T19:57:00.101+0000 7f83a07a6700 1 --2- 172.21.15.157:0/1159415705 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f837c06af00 0x7f837c06d3c0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:00.105 INFO:teuthology.misc.health.smithi157.stderr:2023-10-16T19:57:00.101+0000 7f83a07a6700 1 --2- 172.21.15.157:0/1159415705 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f83980b70c0 0x7f839815e560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:00.105 INFO:teuthology.misc.health.smithi157.stderr:2023-10-16T19:57:00.101+0000 7f83a07a6700 1 --2- 172.21.15.157:0/1159415705 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8384004850 0x7f8398150d80 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:00.106 INFO:teuthology.misc.health.smithi157.stderr:2023-10-16T19:57:00.101+0000 7f83a07a6700 1 --2- 172.21.15.157:0/1159415705 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f83981f3dd0 0x7f83980d1910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:00.106 INFO:teuthology.misc.health.smithi157.stderr:2023-10-16T19:57:00.101+0000 7f83a07a6700 1 -- 172.21.15.157:0/1159415705 >> 172.21.15.157:0/1159415705 conn(0x7f839806e260 msgr2=0x7f83980b15f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:00.106 INFO:teuthology.misc.health.smithi157.stderr:2023-10-16T19:57:00.101+0000 7f83a07a6700 1 -- 172.21.15.157:0/1159415705 shutdown_connections 2023-10-16T19:57:00.106 INFO:teuthology.misc.health.smithi157.stderr:2023-10-16T19:57:00.101+0000 7f83a07a6700 1 -- 172.21.15.157:0/1159415705 wait complete. 2023-10-16T19:57:00.114 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-10-16T19:57:00.115 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-10-16T19:57:00.115 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-16T19:57:00.116 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-16T19:57:00.118 INFO:tasks.ceph.mds.a:Started 2023-10-16T19:57:00.118 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-16T19:57:00.119 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-16T19:57:00.121 INFO:tasks.ceph.mds.c:Started 2023-10-16T19:57:00.121 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-16T19:57:00.121 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-16T19:57:00.124 INFO:tasks.ceph.mds.b:Started 2023-10-16T19:57:00.124 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-16T19:57:00.124 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-16T19:57:00.128 INFO:tasks.ceph.mds.d:Started 2023-10-16T19:57:00.129 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-10-16T19:57:00.129 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T19:57:00.198 INFO:tasks.ceph.mds.a.smithi157.stdout:starting mds.a at 2023-10-16T19:57:00.198 INFO:tasks.ceph.mds.c.smithi157.stdout:starting mds.c at 2023-10-16T19:57:00.205 INFO:tasks.ceph.mds.b.smithi187.stdout:starting mds.b at 2023-10-16T19:57:00.206 INFO:tasks.ceph.mds.d.smithi187.stdout:starting mds.d at 2023-10-16T19:57:00.257 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.255+0000 7f1bf4da0700 1 Processor -- start 2023-10-16T19:57:00.258 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.255+0000 7f1bf4da0700 1 -- start start 2023-10-16T19:57:00.260 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.256+0000 7f1bf4da0700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f1bf015e260 0x7f1bf00b5810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:00.260 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.256+0000 7f1bf4da0700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1bf00d23d0 0x7f1bf00b76d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:00.260 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.256+0000 7f1bf4da0700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1bf00b61b0 con 0x7f1bf00b5d50 2023-10-16T19:57:00.260 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.256+0000 7f1bf4da0700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1bf00d3610 con 0x7f1bf015e260 2023-10-16T19:57:00.261 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.256+0000 7f1bf4da0700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bf00d2820 con 0x7f1bf00d23d0 2023-10-16T19:57:00.261 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.256+0000 7f1beed9d700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1bf00d23d0 0x7f1bf00b76d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:00.261 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.256+0000 7f1bee59c700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f1bf015e260 0x7f1bf00b5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:00.261 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.256+0000 7f1beed9d700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1bf00d23d0 0x7f1bf00b76d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.157:54708/0 (socket says 172.21.15.157:54708) 2023-10-16T19:57:00.261 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.256+0000 7f1bee59c700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f1bf015e260 0x7f1bf00b5810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.157:40506/0 (socket says 172.21.15.157:40506) 2023-10-16T19:57:00.262 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.256+0000 7f1beed9d700 1 -- 172.21.15.157:0/2374519742 learned_addr learned my addr 172.21.15.157:0/2374519742 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:57:00.262 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.257+0000 7f1bee59c700 1 -- 172.21.15.157:0/2374519742 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1bf00d23d0 msgr2=0x7f1bf00b76d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:57:00.262 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.257+0000 7f1bee59c700 1 --2- 172.21.15.157:0/2374519742 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1bf00d23d0 0x7f1bf00b76d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:00.262 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.257+0000 7f1bee59c700 1 -- 172.21.15.157:0/2374519742 >> v1:172.21.15.187:6789/0 conn(0x7f1bf00b5d50 legacy=0x7f1bf00d1cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:00.262 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.257+0000 7f1bee59c700 1 -- 172.21.15.157:0/2374519742 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bf00b7210 con 0x7f1bf015e260 2023-10-16T19:57:00.263 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.257+0000 7f1bed59a700 1 -- 172.21.15.157:0/2374519742 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1634858732 0 0) 0x7f1bf00b61b0 con 0x7f1bf00b5d50 2023-10-16T19:57:00.263 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.257+0000 7f1bee59c700 1 --2- 172.21.15.157:0/2374519742 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1bf015e260 0x7f1bf00b5810 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f1bf00d29c0 tx=0x7f1be800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fe526a26302839a3 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:00.263 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.257+0000 7f1bed59a700 1 -- 172.21.15.157:0/2374519742 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1be8016070 con 0x7f1bf015e260 2023-10-16T19:57:00.263 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.257+0000 7f1bed59a700 1 -- 172.21.15.157:0/2374519742 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1be800bb20 con 0x7f1bf015e260 2023-10-16T19:57:00.263 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.257+0000 7f1bed59a700 1 -- 172.21.15.157:0/2374519742 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1be800e070 con 0x7f1bf015e260 2023-10-16T19:57:00.264 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.257+0000 7f1bf4da0700 1 -- 172.21.15.157:0/2374519742 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1bf015e260 msgr2=0x7f1bf00b5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:00.264 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.257+0000 7f1bf4da0700 1 --2- 172.21.15.157:0/2374519742 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1bf015e260 0x7f1bf00b5810 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f1bf00d29c0 tx=0x7f1be800b330 comp rx=0 tx=0).stop 2023-10-16T19:57:00.264 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.258+0000 7f1bf4da0700 1 -- 172.21.15.157:0/2374519742 shutdown_connections 2023-10-16T19:57:00.264 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.258+0000 7f1bf4da0700 1 --2- 172.21.15.157:0/2374519742 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1bf00d23d0 0x7f1bf00b76d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:00.264 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.258+0000 7f1bf4da0700 1 --2- 172.21.15.157:0/2374519742 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1bf015e260 0x7f1bf00b5810 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:00.265 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.258+0000 7f1bf4da0700 1 -- 172.21.15.157:0/2374519742 >> 172.21.15.157:0/2374519742 conn(0x7f1bf00d0810 msgr2=0x7f1bf00d0bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:00.265 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.258+0000 7f1bf4da0700 1 -- 172.21.15.157:0/2374519742 shutdown_connections 2023-10-16T19:57:00.265 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.258+0000 7f1bf4da0700 1 -- 172.21.15.157:0/2374519742 wait complete. 2023-10-16T19:57:00.268 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.259+0000 7f1bf4da0700 1 Processor -- start 2023-10-16T19:57:00.268 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.259+0000 7f1bf4da0700 1 -- start start 2023-10-16T19:57:00.268 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.260+0000 7f1bf4da0700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1bf00b5d50 0x7f1bf01f7a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:00.268 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.260+0000 7f1bf4da0700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1bf00d23d0 0x7f1bf01e68a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:00.269 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.260+0000 7f1bf4da0700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1bf015e260 0x7f1bf00b9240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:00.269 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.260+0000 7f1bf4da0700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bf0151ab0 con 0x7f1bf00b5d50 2023-10-16T19:57:00.269 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.260+0000 7f1bf4da0700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bf01f6fe0 con 0x7f1bf015e260 2023-10-16T19:57:00.269 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.260+0000 7f1bf4da0700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bf01e7280 con 0x7f1bf00d23d0 2023-10-16T19:57:00.269 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.260+0000 7f1bee59c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1bf00b5d50 0x7f1bf01f7a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:00.269 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.260+0000 7f1bee59c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1bf00b5d50 0x7f1bf01f7a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:45404/0 (socket says 172.21.15.157:45404) 2023-10-16T19:57:00.270 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.260+0000 7f1bedd9b700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1bf00d23d0 0x7f1bf01e68a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:00.270 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.260+0000 7f1bee59c700 1 -- 172.21.15.157:0/383852487 learned_addr learned my addr 172.21.15.157:0/383852487 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:57:00.270 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.260+0000 7f1beed9d700 1 --2- 172.21.15.157:0/383852487 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1bf015e260 0x7f1bf00b9240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:00.270 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.260+0000 7f1bee59c700 1 -- 172.21.15.157:0/383852487 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1bf00d23d0 msgr2=0x7f1bf01e68a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:00.271 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.260+0000 7f1bee59c700 1 --2- 172.21.15.157:0/383852487 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1bf00d23d0 0x7f1bf01e68a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:00.271 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.260+0000 7f1bee59c700 1 -- 172.21.15.157:0/383852487 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1bf015e260 msgr2=0x7f1bf00b9240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:00.271 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.260+0000 7f1bee59c700 1 --2- 172.21.15.157:0/383852487 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1bf015e260 0x7f1bf00b9240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:00.271 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.260+0000 7f1bee59c700 1 -- 172.21.15.157:0/383852487 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1be8009a70 con 0x7f1bf00b5d50 2023-10-16T19:57:00.271 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.260+0000 7f1beed9d700 1 --2- 172.21.15.157:0/383852487 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1bf015e260 0x7f1bf00b9240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T19:57:00.272 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.260+0000 7f1bee59c700 1 --2- 172.21.15.157:0/383852487 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1bf00b5d50 0x7f1bf01f7a30 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f1be8014040 tx=0x7f1be8004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:00.272 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.260+0000 7f1bdeffd700 1 -- 172.21.15.157:0/383852487 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1be8016040 con 0x7f1bf00b5d50 2023-10-16T19:57:00.272 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.260+0000 7f1bdeffd700 1 -- 172.21.15.157:0/383852487 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1be80048a0 con 0x7f1bf00b5d50 2023-10-16T19:57:00.272 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.260+0000 7f1bf4da0700 1 -- 172.21.15.157:0/383852487 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bf01e7560 con 0x7f1bf00b5d50 2023-10-16T19:57:00.272 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.260+0000 7f1bdeffd700 1 -- 172.21.15.157:0/383852487 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1be801b680 con 0x7f1bf00b5d50 2023-10-16T19:57:00.272 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.260+0000 7f1bf4da0700 1 -- 172.21.15.157:0/383852487 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bf01f7510 con 0x7f1bf00b5d50 2023-10-16T19:57:00.273 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.261+0000 7f1bf4da0700 1 -- 172.21.15.157:0/383852487 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1bf004f400 con 0x7f1bf00b5d50 2023-10-16T19:57:00.273 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.262+0000 7f1bdeffd700 1 -- 172.21.15.157:0/383852487 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f1be801b7e0 con 0x7f1bf00b5d50 2023-10-16T19:57:00.273 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.262+0000 7f1bdeffd700 1 --2- 172.21.15.157:0/383852487 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f1bd006af00 0x7f1bd006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:00.273 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.262+0000 7f1bdeffd700 1 -- 172.21.15.157:0/383852487 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f1be808a840 con 0x7f1bf00b5d50 2023-10-16T19:57:00.273 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.262+0000 7f1bedd9b700 1 --2- 172.21.15.157:0/383852487 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f1bd006af00 0x7f1bd006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:00.274 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.263+0000 7f1bedd9b700 1 --2- 172.21.15.157:0/383852487 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f1bd006af00 0x7f1bd006d3c0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f1bf00c79f0 tx=0x7f1be4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:00.274 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.267+0000 7f1bdeffd700 1 -- 172.21.15.157:0/383852487 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1be8055cd0 con 0x7f1bf00b5d50 2023-10-16T19:57:00.456 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.454+0000 7f1bf4da0700 1 -- 172.21.15.157:0/383852487 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1bf00d2190 con 0x7f1bf00b5d50 2023-10-16T19:57:00.457 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.454+0000 7f1bdeffd700 1 -- 172.21.15.157:0/383852487 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+12862 (secure 0 0 0) 0x7f1be80592f0 con 0x7f1bf00b5d50 2023-10-16T19:57:00.457 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-10-16T19:57:00.457 INFO:teuthology.orchestra.run.smithi157.stdout:{"epoch":17,"fsid":"28199dc9-64d5-479e-83c6-21f097c33d39","created":"2023-10-16T19:56:49.201889+0000","modified":"2023-10-16T19:56:59.704669+0000","last_up_change":"2023-10-16T19:56:54.675673+0000","last_in_change":"2023-10-16T19:56:51.666728+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T19:56:56.932895+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":335785898},{"type":"v1","addr":"172.21.15.157:6809","nonce":335785898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":335785898},{"type":"v1","addr":"172.21.15.157:6811","nonce":335785898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6815","nonce":335785898},{"type":"v1","addr":"172.21.15.157:6817","nonce":335785898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":335785898},{"type":"v1","addr":"172.21.15.157:6813","nonce":335785898}]},"public_addr":"172.21.15.157:6809/335785898","cluster_addr":"172.21.15.157:6811/335785898","heartbeat_back_addr":"172.21.15.157:6817/335785898","heartbeat_front_addr":"172.21.15.157:6813/335785898","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":3482825047},{"type":"v1","addr":"172.21.15.157:6801","nonce":3482825047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":3482825047},{"type":"v1","addr":"172.21.15.157:6803","nonce":3482825047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":3482825047},{"type":"v1","addr":"172.21.15.157:6807","nonce":3482825047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":3482825047},{"type":"v1","addr":"172.21.15.157:6805","nonce":3482825047}]},"public_addr":"172.21.15.157:6801/3482825047","cluster_addr":"172.21.15.157:6803/3482825047","heartbeat_back_addr":"172.21.15.157:6807/3482825047","heartbeat_front_addr":"172.21.15.157:6805/3482825047","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":1118292389},{"type":"v1","addr":"172.21.15.157:6825","nonce":1118292389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":1118292389},{"type":"v1","addr":"172.21.15.157:6827","nonce":1118292389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":1118292389},{"type":"v1","addr":"172.21.15.157:6831","nonce":1118292389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":1118292389},{"type":"v1","addr":"172.21.15.157:6829","nonce":1118292389}]},"public_addr":"172.21.15.157:6825/1118292389","cluster_addr":"172.21.15.157:6827/1118292389","heartbeat_back_addr":"172.21.15.157:6831/1118292389","heartbeat_front_addr":"172.21.15.157:6829/1118292389","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":989329821},{"type":"v1","addr":"172.21.15.157:6816","nonce":989329821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":989329821},{"type":"v1","addr":"172.21.15.157:6819","nonce":989329821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":989329821},{"type":"v1","addr":"172.21.15.157:6823","nonce":989329821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":989329821},{"type":"v1","addr":"172.21.15.157:6821","nonce":989329821}]},"public_addr":"172.21.15.157:6816/989329821","cluster_addr":"172.21.15.157:6819/989329821","heartbeat_back_addr":"172.21.15.157:6823/989329821","heartbeat_front_addr":"172.21.15.157:6821/989329821","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":3841016811},{"type":"v1","addr":"172.21.15.187:6801","nonce":3841016811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6803","nonce":3841016811},{"type":"v1","addr":"172.21.15.187:6804","nonce":3841016811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6809","nonce":3841016811},{"type":"v1","addr":"172.21.15.187:6811","nonce":3841016811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":3841016811},{"type":"v1","addr":"172.21.15.187:6808","nonce":3841016811}]},"public_addr":"172.21.15.187:6801/3841016811","cluster_addr":"172.21.15.187:6804/3841016811","heartbeat_back_addr":"172.21.15.187:6811/3841016811","heartbeat_front_addr":"172.21.15.187:6808/3841016811","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":915130263},{"type":"v1","addr":"172.21.15.187:6805","nonce":915130263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6807","nonce":915130263},{"type":"v1","addr":"172.21.15.187:6810","nonce":915130263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":915130263},{"type":"v1","addr":"172.21.15.187:6815","nonce":915130263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":915130263},{"type":"v1","addr":"172.21.15.187:6813","nonce":915130263}]},"public_addr":"172.21.15.187:6805/915130263","cluster_addr":"172.21.15.187:6810/915130263","heartbeat_back_addr":"172.21.15.187:6815/915130263","heartbeat_front_addr":"172.21.15.187:6813/915130263","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":654976824},{"type":"v1","addr":"172.21.15.187:6817","nonce":654976824}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":654976824},{"type":"v1","addr":"172.21.15.187:6819","nonce":654976824}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":654976824},{"type":"v1","addr":"172.21.15.187:6823","nonce":654976824}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":654976824},{"type":"v1","addr":"172.21.15.187:6821","nonce":654976824}]},"public_addr":"172.21.15.187:6817/654976824","cluster_addr":"172.21.15.187:6819/654976824","heartbeat_back_addr":"172.21.15.187:6823/654976824","heartbeat_front_addr":"172.21.15.187:6821/654976824","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":4284059445},{"type":"v1","addr":"172.21.15.187:6825","nonce":4284059445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":4284059445},{"type":"v1","addr":"172.21.15.187:6827","nonce":4284059445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":4284059445},{"type":"v1","addr":"172.21.15.187:6831","nonce":4284059445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":4284059445},{"type":"v1","addr":"172.21.15.187:6829","nonce":4284059445}]},"public_addr":"172.21.15.187:6825/4284059445","cluster_addr":"172.21.15.187:6827/4284059445","heartbeat_back_addr":"172.21.15.187:6831/4284059445","heartbeat_front_addr":"172.21.15.187:6829/4284059445","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.819780+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.824193+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.849575+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.824806+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.809540+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.805093+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.866109+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.807372+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T19:57:00.459 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.456+0000 7f1bf4da0700 1 -- 172.21.15.157:0/383852487 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f1bd006af00 msgr2=0x7f1bd006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:00.459 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.456+0000 7f1bf4da0700 1 --2- 172.21.15.157:0/383852487 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f1bd006af00 0x7f1bd006d3c0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f1bf00c79f0 tx=0x7f1be4009040 comp rx=0 tx=0).stop 2023-10-16T19:57:00.460 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.456+0000 7f1bf4da0700 1 -- 172.21.15.157:0/383852487 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1bf00b5d50 msgr2=0x7f1bf01f7a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:00.460 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.456+0000 7f1bf4da0700 1 --2- 172.21.15.157:0/383852487 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1bf00b5d50 0x7f1bf01f7a30 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f1be8014040 tx=0x7f1be8004ad0 comp rx=0 tx=0).stop 2023-10-16T19:57:00.460 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.457+0000 7f1bf4da0700 1 -- 172.21.15.157:0/383852487 shutdown_connections 2023-10-16T19:57:00.460 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.457+0000 7f1bf4da0700 1 --2- 172.21.15.157:0/383852487 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f1bd006af00 0x7f1bd006d3c0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:00.460 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.457+0000 7f1bf4da0700 1 --2- 172.21.15.157:0/383852487 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1bf015e260 0x7f1bf00b9240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:00.461 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.457+0000 7f1bf4da0700 1 --2- 172.21.15.157:0/383852487 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1bf00b5d50 0x7f1bf01f7a30 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:00.461 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.457+0000 7f1bf4da0700 1 --2- 172.21.15.157:0/383852487 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1bf00d23d0 0x7f1bf01e68a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:00.461 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.457+0000 7f1bf4da0700 1 -- 172.21.15.157:0/383852487 >> 172.21.15.157:0/383852487 conn(0x7f1bf00d0810 msgr2=0x7f1bf00b5520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:00.461 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.457+0000 7f1bf4da0700 1 -- 172.21.15.157:0/383852487 shutdown_connections 2023-10-16T19:57:00.461 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.457+0000 7f1bf4da0700 1 -- 172.21.15.157:0/383852487 wait complete. 2023-10-16T19:57:00.471 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-16T19:56:56.932895+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-16T19:57:00.472 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-16T19:57:00.595 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.592+0000 7f0d4b593700 1 Processor -- start 2023-10-16T19:57:00.595 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.592+0000 7f0d4b593700 1 -- start start 2023-10-16T19:57:00.597 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.593+0000 7f0d4b593700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0d44071790 0x7f0d440b2b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:00.597 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.593+0000 7f0d4b593700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d4406e180 con 0x7f0d44143bd0 2023-10-16T19:57:00.598 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.593+0000 7f0d4b593700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d44144480 con 0x7f0d440b2710 2023-10-16T19:57:00.598 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.593+0000 7f0d4b593700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d440b30d0 con 0x7f0d44071790 2023-10-16T19:57:00.598 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.593+0000 7f0d4932f700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f0d44143bd0 0x7f0d440cef80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:55084/0 (socket says 172.21.15.157:55084) 2023-10-16T19:57:00.598 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.593+0000 7f0d4932f700 1 -- 172.21.15.157:0/1289512674 learned_addr learned my addr 172.21.15.157:0/1289512674 (peer_addr_for_me v1:172.21.15.157:0/0) 2023-10-16T19:57:00.599 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.593+0000 7f0d49b30700 1 --2- 172.21.15.157:0/1289512674 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0d44071790 0x7f0d440b2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:00.599 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.593+0000 7f0d3bfff700 1 -- 172.21.15.157:0/1289512674 <== mon.0 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3990179255 0 0) 0x7f0d4406e180 con 0x7f0d44143bd0 2023-10-16T19:57:00.599 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.594+0000 7f0d3bfff700 1 -- 172.21.15.157:0/1289512674 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0d300035b0 con 0x7f0d44143bd0 2023-10-16T19:57:00.599 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.594+0000 7f0d3bfff700 1 -- 172.21.15.157:0/1289512674 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3315513565 0 0) 0x7f0d44144480 con 0x7f0d440b2710 2023-10-16T19:57:00.599 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.594+0000 7f0d3bfff700 1 -- 172.21.15.157:0/1289512674 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0d4406e180 con 0x7f0d440b2710 2023-10-16T19:57:00.600 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.594+0000 7f0d49b30700 1 -- 172.21.15.157:0/1289512674 >> v1:172.21.15.187:6789/0 conn(0x7f0d440b2710 legacy=0x7f0d44071080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:00.600 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.594+0000 7f0d49b30700 1 -- 172.21.15.157:0/1289512674 >> v1:172.21.15.157:6789/0 conn(0x7f0d44143bd0 legacy=0x7f0d440cef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:00.600 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.594+0000 7f0d3bfff700 1 -- 172.21.15.157:0/1289512674 <== mon.0 v1:172.21.15.157:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 57893876 0 0) 0x7f0d300035b0 con 0x7f0d44143bd0 2023-10-16T19:57:00.600 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.594+0000 7f0d49b30700 1 -- 172.21.15.157:0/1289512674 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d44071c60 con 0x7f0d44071790 2023-10-16T19:57:00.600 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.594+0000 7f0d49b30700 1 --2- 172.21.15.157:0/1289512674 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0d44071790 0x7f0d440b2b90 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f0d3c009dc0 tx=0x7f0d3c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cd1a70edd171d1ac server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:00.601 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.594+0000 7f0d3bfff700 1 -- 172.21.15.157:0/1289512674 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d3c00e070 con 0x7f0d44071790 2023-10-16T19:57:00.601 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.594+0000 7f0d3bfff700 1 -- 172.21.15.157:0/1289512674 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d3c003a20 con 0x7f0d44071790 2023-10-16T19:57:00.601 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.594+0000 7f0d3bfff700 1 -- 172.21.15.157:0/1289512674 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d34001670 con 0x7f0d44071790 2023-10-16T19:57:00.601 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.595+0000 7f0d4b593700 1 -- 172.21.15.157:0/1289512674 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0d44071790 msgr2=0x7f0d440b2b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:00.601 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.595+0000 7f0d4b593700 1 --2- 172.21.15.157:0/1289512674 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0d44071790 0x7f0d440b2b90 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f0d3c009dc0 tx=0x7f0d3c00b330 comp rx=0 tx=0).stop 2023-10-16T19:57:00.602 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.595+0000 7f0d4b593700 1 -- 172.21.15.157:0/1289512674 shutdown_connections 2023-10-16T19:57:00.602 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.595+0000 7f0d4b593700 1 --2- 172.21.15.157:0/1289512674 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0d44071790 0x7f0d440b2b90 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:00.602 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.595+0000 7f0d4b593700 1 -- 172.21.15.157:0/1289512674 >> 172.21.15.157:0/1289512674 conn(0x7f0d440d0b30 msgr2=0x7f0d440d0f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:00.602 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.595+0000 7f0d4b593700 1 -- 172.21.15.157:0/1289512674 shutdown_connections 2023-10-16T19:57:00.602 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.595+0000 7f0d4b593700 1 -- 172.21.15.157:0/1289512674 wait complete. 2023-10-16T19:57:00.605 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.596+0000 7f0d4b593700 1 Processor -- start 2023-10-16T19:57:00.605 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.596+0000 7f0d4b593700 1 -- start start 2023-10-16T19:57:00.606 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.597+0000 7f0d4b593700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0d44071790 0x7f0d440c8930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:00.606 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.597+0000 7f0d4b593700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0d440b2710 0x7f0d441560d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:00.606 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.597+0000 7f0d4b593700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0d44143bd0 0x7f0d4413f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:00.606 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.597+0000 7f0d4b593700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d441f33c0 con 0x7f0d44071790 2023-10-16T19:57:00.606 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.597+0000 7f0d4b593700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d440c98b0 con 0x7f0d44143bd0 2023-10-16T19:57:00.607 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.597+0000 7f0d4b593700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d440c9010 con 0x7f0d440b2710 2023-10-16T19:57:00.607 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.597+0000 7f0d4932f700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0d44071790 0x7f0d440c8930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:00.607 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.597+0000 7f0d4932f700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0d44071790 0x7f0d440c8930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:45418/0 (socket says 172.21.15.157:45418) 2023-10-16T19:57:00.607 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.597+0000 7f0d4932f700 1 -- 172.21.15.157:0/2053629225 learned_addr learned my addr 172.21.15.157:0/2053629225 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:57:00.607 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.597+0000 7f0d49b30700 1 --2- 172.21.15.157:0/2053629225 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0d44143bd0 0x7f0d4413f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:00.608 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.597+0000 7f0d48b2e700 1 --2- 172.21.15.157:0/2053629225 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0d440b2710 0x7f0d441560d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:00.608 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.597+0000 7f0d4932f700 1 -- 172.21.15.157:0/2053629225 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0d440b2710 msgr2=0x7f0d441560d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:00.608 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.597+0000 7f0d4932f700 1 --2- 172.21.15.157:0/2053629225 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0d440b2710 0x7f0d441560d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:00.608 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.597+0000 7f0d4932f700 1 -- 172.21.15.157:0/2053629225 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0d44143bd0 msgr2=0x7f0d4413f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:00.608 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.597+0000 7f0d4932f700 1 --2- 172.21.15.157:0/2053629225 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0d44143bd0 0x7f0d4413f3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:00.609 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.597+0000 7f0d4932f700 1 -- 172.21.15.157:0/2053629225 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d3c009a70 con 0x7f0d44071790 2023-10-16T19:57:00.609 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.597+0000 7f0d49b30700 1 --2- 172.21.15.157:0/2053629225 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0d44143bd0 0x7f0d4413f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T19:57:00.609 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.597+0000 7f0d4932f700 1 --2- 172.21.15.157:0/2053629225 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0d44071790 0x7f0d440c8930 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f0d3400c700 tx=0x7f0d3400ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:00.609 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.597+0000 7f0d39ffb700 1 -- 172.21.15.157:0/2053629225 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d34004c80 con 0x7f0d44071790 2023-10-16T19:57:00.609 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.597+0000 7f0d39ffb700 1 -- 172.21.15.157:0/2053629225 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d34004de0 con 0x7f0d44071790 2023-10-16T19:57:00.610 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.597+0000 7f0d4b593700 1 -- 172.21.15.157:0/2053629225 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d440c92f0 con 0x7f0d44071790 2023-10-16T19:57:00.610 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.597+0000 7f0d39ffb700 1 -- 172.21.15.157:0/2053629225 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d34007310 con 0x7f0d44071790 2023-10-16T19:57:00.610 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.598+0000 7f0d4b593700 1 -- 172.21.15.157:0/2053629225 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d440b4a60 con 0x7f0d44071790 2023-10-16T19:57:00.610 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.598+0000 7f0d4b593700 1 -- 172.21.15.157:0/2053629225 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d440b48c0 con 0x7f0d44071790 2023-10-16T19:57:00.610 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.599+0000 7f0d39ffb700 1 -- 172.21.15.157:0/2053629225 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f0d34007470 con 0x7f0d44071790 2023-10-16T19:57:00.611 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.599+0000 7f0d39ffb700 1 --2- 172.21.15.157:0/2053629225 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f0d2806af00 0x7f0d2806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:00.611 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.599+0000 7f0d39ffb700 1 -- 172.21.15.157:0/2053629225 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f0d34088fb0 con 0x7f0d44071790 2023-10-16T19:57:00.611 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.599+0000 7f0d48b2e700 1 --2- 172.21.15.157:0/2053629225 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f0d2806af00 0x7f0d2806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:00.611 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.599+0000 7f0d48b2e700 1 --2- 172.21.15.157:0/2053629225 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f0d2806af00 0x7f0d2806d3c0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f0d40001220 tx=0x7f0d40009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:00.612 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.603+0000 7f0d39ffb700 1 -- 172.21.15.157:0/2053629225 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0d340bbca0 con 0x7f0d44071790 2023-10-16T19:57:00.795 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.793+0000 7f0d4b593700 1 -- 172.21.15.157:0/2053629225 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0d4404f400 con 0x7f0d44071790 2023-10-16T19:57:00.795 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.793+0000 7f0d39ffb700 1 -- 172.21.15.157:0/2053629225 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0d440b48c0 con 0x7f0d44071790 2023-10-16T19:57:00.796 INFO:teuthology.orchestra.run.smithi157.stdout:pg_num: 1 2023-10-16T19:57:00.798 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.795+0000 7f0d4b593700 1 -- 172.21.15.157:0/2053629225 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f0d2806af00 msgr2=0x7f0d2806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:00.798 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.795+0000 7f0d4b593700 1 --2- 172.21.15.157:0/2053629225 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f0d2806af00 0x7f0d2806d3c0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f0d40001220 tx=0x7f0d40009040 comp rx=0 tx=0).stop 2023-10-16T19:57:00.799 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.795+0000 7f0d4b593700 1 -- 172.21.15.157:0/2053629225 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0d44071790 msgr2=0x7f0d440c8930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:00.799 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.795+0000 7f0d4b593700 1 --2- 172.21.15.157:0/2053629225 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0d44071790 0x7f0d440c8930 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f0d3400c700 tx=0x7f0d3400ca10 comp rx=0 tx=0).stop 2023-10-16T19:57:00.799 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.795+0000 7f0d4b593700 1 -- 172.21.15.157:0/2053629225 shutdown_connections 2023-10-16T19:57:00.800 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.795+0000 7f0d4b593700 1 --2- 172.21.15.157:0/2053629225 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f0d2806af00 0x7f0d2806d3c0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:00.800 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.795+0000 7f0d4b593700 1 --2- 172.21.15.157:0/2053629225 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0d44143bd0 0x7f0d4413f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:00.800 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.795+0000 7f0d4b593700 1 --2- 172.21.15.157:0/2053629225 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0d44071790 0x7f0d440c8930 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:00.801 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.795+0000 7f0d4b593700 1 --2- 172.21.15.157:0/2053629225 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0d440b2710 0x7f0d441560d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:00.801 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.795+0000 7f0d4b593700 1 -- 172.21.15.157:0/2053629225 >> 172.21.15.157:0/2053629225 conn(0x7f0d440d0b30 msgr2=0x7f0d440b1ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:00.801 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.795+0000 7f0d4b593700 1 -- 172.21.15.157:0/2053629225 shutdown_connections 2023-10-16T19:57:00.802 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.795+0000 7f0d4b593700 1 -- 172.21.15.157:0/2053629225 wait complete. 2023-10-16T19:57:00.810 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-16T19:57:00.931 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.928+0000 7fb527457700 1 Processor -- start 2023-10-16T19:57:00.931 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.929+0000 7fb527457700 1 -- start start 2023-10-16T19:57:00.937 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.929+0000 7fb527457700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fb5200b5f20 0x7fb5200cf2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:00.938 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.929+0000 7fb527457700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5200cee50 con 0x7fb52015de80 2023-10-16T19:57:00.938 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.929+0000 7fb527457700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5200cf820 con 0x7fb52015e260 2023-10-16T19:57:00.938 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.929+0000 7fb527457700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5200ce5f0 con 0x7fb5200b5f20 2023-10-16T19:57:00.938 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.929+0000 7fb5251f3700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7fb52015de80 0x7fb5200b5810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:55098/0 (socket says 172.21.15.157:55098) 2023-10-16T19:57:00.939 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.929+0000 7fb5251f3700 1 -- 172.21.15.157:0/1997657195 learned_addr learned my addr 172.21.15.157:0/1997657195 (peer_addr_for_me v1:172.21.15.157:0/0) 2023-10-16T19:57:00.939 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.930+0000 7fb5249f2700 1 --2- 172.21.15.157:0/1997657195 >> v2:172.21.15.187:3300/0 conn(0x7fb5200b5f20 0x7fb5200cf2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:00.940 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.930+0000 7fb517fff700 1 -- 172.21.15.157:0/1997657195 <== mon.0 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4037662042 0 0) 0x7fb5200cee50 con 0x7fb52015de80 2023-10-16T19:57:00.940 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.930+0000 7fb517fff700 1 -- 172.21.15.157:0/1997657195 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb50c0035b0 con 0x7fb52015de80 2023-10-16T19:57:00.940 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.930+0000 7fb517fff700 1 -- 172.21.15.157:0/1997657195 <== mon.0 v1:172.21.15.157:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1006810967 0 0) 0x7fb50c0035b0 con 0x7fb52015de80 2023-10-16T19:57:00.940 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.930+0000 7fb517fff700 1 -- 172.21.15.157:0/1997657195 >> v2:172.21.15.187:3300/0 conn(0x7fb5200b5f20 msgr2=0x7fb5200cf2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:57:00.940 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.930+0000 7fb517fff700 1 --2- 172.21.15.157:0/1997657195 >> v2:172.21.15.187:3300/0 conn(0x7fb5200b5f20 0x7fb5200cf2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:00.941 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.930+0000 7fb517fff700 1 -- 172.21.15.157:0/1997657195 >> v1:172.21.15.187:6789/0 conn(0x7fb52015e260 legacy=0x7fb520161cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:00.941 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.930+0000 7fb517fff700 1 -- 172.21.15.157:0/1997657195 --> v1:172.21.15.157:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb520162a40 con 0x7fb52015de80 2023-10-16T19:57:00.941 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.930+0000 7fb517fff700 1 -- 172.21.15.157:0/1997657195 <== mon.0 v1:172.21.15.157:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4021145519 0 0) 0x7fb510001670 con 0x7fb52015de80 2023-10-16T19:57:00.941 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.930+0000 7fb517fff700 1 -- 172.21.15.157:0/1997657195 >> v1:172.21.15.157:6789/0 conn(0x7fb52015de80 legacy=0x7fb5200b5810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:00.942 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.930+0000 7fb517fff700 1 --2- 172.21.15.157:0/1997657195 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb50c003a00 0x7fb50c003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:00.942 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.930+0000 7fb517fff700 1 --2- 172.21.15.157:0/1997657195 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb50c004850 0x7fb50c004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:00.942 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.930+0000 7fb517fff700 1 --2- 172.21.15.157:0/1997657195 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb50c005210 0x7fb50c00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:00.943 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.930+0000 7fb517fff700 1 -- 172.21.15.157:0/1997657195 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5200ce5f0 con 0x7fb50c003a00 2023-10-16T19:57:00.943 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.930+0000 7fb517fff700 1 -- 172.21.15.157:0/1997657195 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb50c00c0b0 con 0x7fb50c004850 2023-10-16T19:57:00.944 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.930+0000 7fb517fff700 1 -- 172.21.15.157:0/1997657195 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb50c00c270 con 0x7fb50c005210 2023-10-16T19:57:00.944 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.930+0000 7fb5251f3700 1 --2- 172.21.15.157:0/1997657195 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb50c003a00 0x7fb50c003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:00.944 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.930+0000 7fb5249f2700 1 --2- 172.21.15.157:0/1997657195 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb50c004850 0x7fb50c004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:00.945 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.930+0000 7fb5259f4700 1 --2- 172.21.15.157:0/1997657195 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb50c005210 0x7fb50c00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:00.945 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.930+0000 7fb5251f3700 1 -- 172.21.15.157:0/1997657195 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb50c005210 msgr2=0x7fb50c00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:57:00.945 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.930+0000 7fb5251f3700 1 --2- 172.21.15.157:0/1997657195 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb50c005210 0x7fb50c00ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:00.946 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.930+0000 7fb5251f3700 1 -- 172.21.15.157:0/1997657195 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb50c004850 msgr2=0x7fb50c004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:57:00.946 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.930+0000 7fb5251f3700 1 --2- 172.21.15.157:0/1997657195 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb50c004850 0x7fb50c004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:00.946 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.930+0000 7fb5259f4700 1 -- 172.21.15.157:0/1997657195 reap_dead start 2023-10-16T19:57:00.947 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.930+0000 7fb5251f3700 1 -- 172.21.15.157:0/1997657195 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb50c0035b0 con 0x7fb50c003a00 2023-10-16T19:57:00.947 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.931+0000 7fb5251f3700 1 --2- 172.21.15.157:0/1997657195 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb50c003a00 0x7fb50c003e20 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fb51000c240 tx=0x7fb50c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d62e5ff4a485465c server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:00.947 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.931+0000 7fb517fff700 1 -- 172.21.15.157:0/1997657195 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb510007c10 con 0x7fb50c003a00 2023-10-16T19:57:00.948 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.931+0000 7fb517fff700 1 -- 172.21.15.157:0/1997657195 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb51000cda0 con 0x7fb50c003a00 2023-10-16T19:57:00.948 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.931+0000 7fb517fff700 1 -- 172.21.15.157:0/1997657195 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb510005ba0 con 0x7fb50c003a00 2023-10-16T19:57:00.948 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.931+0000 7fb527457700 1 -- 172.21.15.157:0/1997657195 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb50c003a00 msgr2=0x7fb50c003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:00.948 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.931+0000 7fb527457700 1 --2- 172.21.15.157:0/1997657195 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb50c003a00 0x7fb50c003e20 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fb51000c240 tx=0x7fb50c005880 comp rx=0 tx=0).stop 2023-10-16T19:57:00.949 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.931+0000 7fb527457700 1 -- 172.21.15.157:0/1997657195 shutdown_connections 2023-10-16T19:57:00.949 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.931+0000 7fb527457700 1 --2- 172.21.15.157:0/1997657195 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb50c003a00 0x7fb50c003e20 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:00.949 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.931+0000 7fb527457700 1 -- 172.21.15.157:0/1997657195 >> 172.21.15.157:0/1997657195 conn(0x7fb5200d0810 msgr2=0x7fb5200d0bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:00.950 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.931+0000 7fb527457700 1 -- 172.21.15.157:0/1997657195 shutdown_connections 2023-10-16T19:57:00.950 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.931+0000 7fb527457700 1 -- 172.21.15.157:0/1997657195 wait complete. 2023-10-16T19:57:00.951 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.933+0000 7fb527457700 1 Processor -- start 2023-10-16T19:57:00.951 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.933+0000 7fb527457700 1 -- start start 2023-10-16T19:57:00.951 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.933+0000 7fb527457700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb50c003a00 0x7fb5201521f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:00.951 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.933+0000 7fb527457700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb52015f970 0x7fb52015fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:00.951 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.933+0000 7fb527457700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb52015a960 0x7fb52015ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:00.952 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.933+0000 7fb527457700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb52015b350 con 0x7fb52015a960 2023-10-16T19:57:00.952 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.933+0000 7fb527457700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb520160330 con 0x7fb52015f970 2023-10-16T19:57:00.952 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.933+0000 7fb527457700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5201f70b0 con 0x7fb50c003a00 2023-10-16T19:57:00.952 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.933+0000 7fb5259f4700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb52015a960 0x7fb52015ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:00.952 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.933+0000 7fb5259f4700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb52015a960 0x7fb52015ae10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:45442/0 (socket says 172.21.15.157:45442) 2023-10-16T19:57:00.953 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.933+0000 7fb5259f4700 1 -- 172.21.15.157:0/277286282 learned_addr learned my addr 172.21.15.157:0/277286282 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:57:00.953 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.933+0000 7fb5251f3700 1 --2- 172.21.15.157:0/277286282 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb50c003a00 0x7fb5201521f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:00.953 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.934+0000 7fb5249f2700 1 --2- 172.21.15.157:0/277286282 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb52015f970 0x7fb52015fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:00.953 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.934+0000 7fb5259f4700 1 -- 172.21.15.157:0/277286282 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb50c003a00 msgr2=0x7fb5201521f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:00.953 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.934+0000 7fb5259f4700 1 --2- 172.21.15.157:0/277286282 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb50c003a00 0x7fb5201521f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:00.954 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.934+0000 7fb5259f4700 1 -- 172.21.15.157:0/277286282 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb52015f970 msgr2=0x7fb52015fdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:00.954 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.934+0000 7fb5259f4700 1 --2- 172.21.15.157:0/277286282 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb52015f970 0x7fb52015fdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:00.954 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.934+0000 7fb5259f4700 1 -- 172.21.15.157:0/277286282 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5201f7300 con 0x7fb52015a960 2023-10-16T19:57:00.954 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.934+0000 7fb5259f4700 1 --2- 172.21.15.157:0/277286282 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb52015a960 0x7fb52015ae10 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fb52006a8e0 tx=0x7fb5180021b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:00.954 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.934+0000 7fb515ffb700 1 -- 172.21.15.157:0/277286282 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb518003c10 con 0x7fb52015a960 2023-10-16T19:57:00.955 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.934+0000 7fb515ffb700 1 -- 172.21.15.157:0/277286282 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb518003d90 con 0x7fb52015a960 2023-10-16T19:57:00.955 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.934+0000 7fb527457700 1 -- 172.21.15.157:0/277286282 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5201f75e0 con 0x7fb52015a960 2023-10-16T19:57:00.955 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.934+0000 7fb515ffb700 1 -- 172.21.15.157:0/277286282 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb518005310 con 0x7fb52015a960 2023-10-16T19:57:00.955 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.934+0000 7fb527457700 1 -- 172.21.15.157:0/277286282 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5201f7ba0 con 0x7fb52015a960 2023-10-16T19:57:00.956 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.935+0000 7fb527457700 1 -- 172.21.15.157:0/277286282 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb52004f400 con 0x7fb52015a960 2023-10-16T19:57:00.957 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.936+0000 7fb515ffb700 1 -- 172.21.15.157:0/277286282 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fb518005470 con 0x7fb52015a960 2023-10-16T19:57:00.957 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.936+0000 7fb515ffb700 1 --2- 172.21.15.157:0/277286282 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fb50406af00 0x7fb50406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:00.957 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.936+0000 7fb515ffb700 1 -- 172.21.15.157:0/277286282 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fb518089300 con 0x7fb52015a960 2023-10-16T19:57:00.958 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.936+0000 7fb5251f3700 1 --2- 172.21.15.157:0/277286282 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fb50406af00 0x7fb50406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:00.958 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.936+0000 7fb5251f3700 1 --2- 172.21.15.157:0/277286282 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fb50406af00 0x7fb50406d3c0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fb510000c00 tx=0x7fb510007000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:00.958 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:00.940+0000 7fb515ffb700 1 -- 172.21.15.157:0/277286282 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb518054700 con 0x7fb52015a960 2023-10-16T19:57:01.177 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:01.172+0000 7fb527457700 1 -- 172.21.15.157:0/277286282 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb5200d05f0 con 0x7fb52015a960 2023-10-16T19:57:01.178 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:01.172+0000 7fb515ffb700 1 -- 172.21.15.157:0/277286282 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1327 (secure 0 0 0) 0x7fb518057d20 con 0x7fb52015a960 2023-10-16T19:57:01.179 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-10-16T19:57:01.179 INFO:teuthology.orchestra.run.smithi157.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4245,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6835/1675699874","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6833","nonce":1675699874},{"type":"v1","addr":"172.21.15.157:6835","nonce":1675699874}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2023-10-16T19:57:01.181 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:01.175+0000 7fb527457700 1 -- 172.21.15.157:0/277286282 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fb50406af00 msgr2=0x7fb50406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:01.181 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:01.175+0000 7fb527457700 1 --2- 172.21.15.157:0/277286282 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fb50406af00 0x7fb50406d3c0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fb510000c00 tx=0x7fb510007000 comp rx=0 tx=0).stop 2023-10-16T19:57:01.181 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:01.175+0000 7fb527457700 1 -- 172.21.15.157:0/277286282 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb52015a960 msgr2=0x7fb52015ae10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:01.181 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:01.175+0000 7fb527457700 1 --2- 172.21.15.157:0/277286282 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb52015a960 0x7fb52015ae10 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fb52006a8e0 tx=0x7fb5180021b0 comp rx=0 tx=0).stop 2023-10-16T19:57:01.181 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:01.175+0000 7fb527457700 1 -- 172.21.15.157:0/277286282 shutdown_connections 2023-10-16T19:57:01.182 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:01.175+0000 7fb527457700 1 --2- 172.21.15.157:0/277286282 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb52015a960 0x7fb52015ae10 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:01.182 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:01.175+0000 7fb527457700 1 --2- 172.21.15.157:0/277286282 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb50c003a00 0x7fb5201521f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:01.182 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:01.175+0000 7fb527457700 1 --2- 172.21.15.157:0/277286282 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fb50406af00 0x7fb50406d3c0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:01.182 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:01.175+0000 7fb527457700 1 --2- 172.21.15.157:0/277286282 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb52015f970 0x7fb52015fdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:01.183 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:01.175+0000 7fb527457700 1 -- 172.21.15.157:0/277286282 >> 172.21.15.157:0/277286282 conn(0x7fb5200d0810 msgr2=0x7fb520161aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:01.183 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:01.175+0000 7fb527457700 1 -- 172.21.15.157:0/277286282 shutdown_connections 2023-10-16T19:57:01.183 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:01.175+0000 7fb527457700 1 -- 172.21.15.157:0/277286282 wait complete. 2023-10-16T19:57:01.184 INFO:teuthology.orchestra.run.smithi157.stderr:dumped fsmap epoch 2 2023-10-16T19:57:03.190 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-16T19:57:03.324 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:03.321+0000 7f39d0fa6700 1 Processor -- start 2023-10-16T19:57:03.324 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:03.321+0000 7f39d0fa6700 1 -- start start 2023-10-16T19:57:03.326 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:03.322+0000 7f39d0fa6700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f39cc15bf50 0x7f39cc0cef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:03.327 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:03.322+0000 7f39d0fa6700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f39cc0b76e0 0x7f39cc0cd870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:03.327 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:03.322+0000 7f39d0fa6700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39cc0cf920 con 0x7f39cc0cddb0 2023-10-16T19:57:03.327 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:03.322+0000 7f39d0fa6700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39cc0cc4b0 con 0x7f39cc15bf50 2023-10-16T19:57:03.327 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:03.322+0000 7f39d0fa6700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39cc0cfc00 con 0x7f39cc0b76e0 2023-10-16T19:57:03.328 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:03.322+0000 7f39ca59c700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f39cc15bf50 0x7f39cc0cef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:03.328 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:03.323+0000 7f39ca59c700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f39cc15bf50 0x7f39cc0cef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:45450/0 (socket says 172.21.15.157:45450) 2023-10-16T19:57:03.328 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:03.323+0000 7f39ca59c700 1 -- 172.21.15.157:0/2961186450 learned_addr learned my addr 172.21.15.157:0/2961186450 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:57:03.328 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:03.323+0000 7f39c9d9b700 1 --2- 172.21.15.157:0/2961186450 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f39cc0b76e0 0x7f39cc0cd870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:03.329 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:03.323+0000 7f39ca59c700 1 -- 172.21.15.157:0/2961186450 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f39cc0b76e0 msgr2=0x7f39cc0cd870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:57:03.329 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:03.323+0000 7f39ca59c700 1 --2- 172.21.15.157:0/2961186450 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f39cc0b76e0 0x7f39cc0cd870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:03.329 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:03.323+0000 7f39ca59c700 1 -- 172.21.15.157:0/2961186450 >> v1:172.21.15.187:6789/0 conn(0x7f39cc0cddb0 legacy=0x7f39cc15f8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:03.329 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:03.323+0000 7f39ca59c700 1 -- 172.21.15.157:0/2961186450 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39cc0cfee0 con 0x7f39cc15bf50 2023-10-16T19:57:03.329 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:03.323+0000 7f39ca59c700 1 --2- 172.21.15.157:0/2961186450 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f39cc15bf50 0x7f39cc0cef80 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f39c4009e50 tx=0x7f39c400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d41efe69ad28f111 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:03.329 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:03.323+0000 7f39c959a700 1 -- 172.21.15.157:0/2961186450 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39c400e070 con 0x7f39cc15bf50 2023-10-16T19:57:03.330 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:03.323+0000 7f39c959a700 1 -- 172.21.15.157:0/2961186450 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39c400b9c0 con 0x7f39cc15bf50 2023-10-16T19:57:03.330 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:03.323+0000 7f39c959a700 1 -- 172.21.15.157:0/2961186450 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39c400bd70 con 0x7f39cc15bf50 2023-10-16T19:57:03.330 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:03.324+0000 7f39d0fa6700 1 -- 172.21.15.157:0/2961186450 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f39cc15bf50 msgr2=0x7f39cc0cef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:03.330 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:03.324+0000 7f39d0fa6700 1 --2- 172.21.15.157:0/2961186450 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f39cc15bf50 0x7f39cc0cef80 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f39c4009e50 tx=0x7f39c400b330 comp rx=0 tx=0).stop 2023-10-16T19:57:03.330 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:03.324+0000 7f39d0fa6700 1 -- 172.21.15.157:0/2961186450 shutdown_connections 2023-10-16T19:57:03.331 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:03.324+0000 7f39d0fa6700 1 --2- 172.21.15.157:0/2961186450 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f39cc15bf50 0x7f39cc0cef80 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:03.331 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:03.324+0000 7f39d0fa6700 1 --2- 172.21.15.157:0/2961186450 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f39cc0b76e0 0x7f39cc0cd870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:03.331 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:03.324+0000 7f39d0fa6700 1 -- 172.21.15.157:0/2961186450 >> 172.21.15.157:0/2961186450 conn(0x7f39cc06e300 msgr2=0x7f39cc06e6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:03.331 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:03.324+0000 7f39d0fa6700 1 -- 172.21.15.157:0/2961186450 shutdown_connections 2023-10-16T19:57:03.331 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:03.324+0000 7f39d0fa6700 1 -- 172.21.15.157:0/2961186450 wait complete. 2023-10-16T19:57:03.334 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:03.325+0000 7f39d0fa6700 1 Processor -- start 2023-10-16T19:57:03.335 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:03.325+0000 7f39d0fa6700 1 -- start start 2023-10-16T19:57:03.335 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:03.326+0000 7f39d0fa6700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f39cc0b76e0 0x7f39cc0b56c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:03.335 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:03.326+0000 7f39d0fa6700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f39cc0cddb0 0x7f39cc1567d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:03.335 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:03.326+0000 7f39d0fa6700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f39cc15bf50 0x7f39cc15cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:03.335 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:03.326+0000 7f39d0fa6700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39cc0b68b0 con 0x7f39cc0cddb0 2023-10-16T19:57:03.336 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:03.326+0000 7f39d0fa6700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39cc0b5ca0 con 0x7f39cc0b76e0 2023-10-16T19:57:03.336 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:03.326+0000 7f39d0fa6700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39cc0b5f80 con 0x7f39cc15bf50 2023-10-16T19:57:03.336 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:03.326+0000 7f39c9d9b700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f39cc0cddb0 0x7f39cc1567d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:03.336 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:03.326+0000 7f39c9d9b700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f39cc0cddb0 0x7f39cc1567d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:45458/0 (socket says 172.21.15.157:45458) 2023-10-16T19:57:03.336 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:03.326+0000 7f39c9d9b700 1 -- 172.21.15.157:0/2786868599 learned_addr learned my addr 172.21.15.157:0/2786868599 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:57:03.337 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:03.326+0000 7f39ca59c700 1 --2- 172.21.15.157:0/2786868599 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f39cc0b76e0 0x7f39cc0b56c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:03.337 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:03.326+0000 7f39cad9d700 1 --2- 172.21.15.157:0/2786868599 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f39cc15bf50 0x7f39cc15cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:03.337 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:03.326+0000 7f39c9d9b700 1 -- 172.21.15.157:0/2786868599 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f39cc15bf50 msgr2=0x7f39cc15cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:03.337 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:03.326+0000 7f39c9d9b700 1 --2- 172.21.15.157:0/2786868599 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f39cc15bf50 0x7f39cc15cc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:03.337 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:03.326+0000 7f39c9d9b700 1 -- 172.21.15.157:0/2786868599 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f39cc0b76e0 msgr2=0x7f39cc0b56c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:03.338 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:03.326+0000 7f39c9d9b700 1 --2- 172.21.15.157:0/2786868599 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f39cc0b76e0 0x7f39cc0b56c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:03.338 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:03.326+0000 7f39c9d9b700 1 -- 172.21.15.157:0/2786868599 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39c4009b30 con 0x7f39cc0cddb0 2023-10-16T19:57:03.338 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:03.326+0000 7f39ca59c700 1 --2- 172.21.15.157:0/2786868599 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f39cc0b76e0 0x7f39cc0b56c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T19:57:03.338 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:03.326+0000 7f39cad9d700 1 --2- 172.21.15.157:0/2786868599 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f39cc15bf50 0x7f39cc15cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T19:57:03.338 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:03.327+0000 7f39c9d9b700 1 --2- 172.21.15.157:0/2786868599 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f39cc0cddb0 0x7f39cc1567d0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f39c000e810 tx=0x7f39c000ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:03.339 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:03.327+0000 7f39baffd700 1 -- 172.21.15.157:0/2786868599 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39c0013610 con 0x7f39cc0cddb0 2023-10-16T19:57:03.339 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:03.327+0000 7f39baffd700 1 -- 172.21.15.157:0/2786868599 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39c0013770 con 0x7f39cc0cddb0 2023-10-16T19:57:03.339 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:03.327+0000 7f39baffd700 1 -- 172.21.15.157:0/2786868599 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39c0013b20 con 0x7f39cc0cddb0 2023-10-16T19:57:03.339 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:03.327+0000 7f39d0fa6700 1 -- 172.21.15.157:0/2786868599 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39cc0b6260 con 0x7f39cc0cddb0 2023-10-16T19:57:03.340 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:03.327+0000 7f39d0fa6700 1 -- 172.21.15.157:0/2786868599 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39cc156d10 con 0x7f39cc0cddb0 2023-10-16T19:57:03.340 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:03.328+0000 7f39d0fa6700 1 -- 172.21.15.157:0/2786868599 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39cc0b6a60 con 0x7f39cc0cddb0 2023-10-16T19:57:03.340 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:03.328+0000 7f39baffd700 1 -- 172.21.15.157:0/2786868599 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f39c0013c80 con 0x7f39cc0cddb0 2023-10-16T19:57:03.340 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:03.328+0000 7f39baffd700 1 --2- 172.21.15.157:0/2786868599 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f39ac06af00 0x7f39ac06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:03.340 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:03.328+0000 7f39baffd700 1 -- 172.21.15.157:0/2786868599 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f39c0088ee0 con 0x7f39cc0cddb0 2023-10-16T19:57:03.340 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:03.329+0000 7f39ca59c700 1 --2- 172.21.15.157:0/2786868599 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f39ac06af00 0x7f39ac06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:03.341 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:03.329+0000 7f39ca59c700 1 --2- 172.21.15.157:0/2786868599 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f39ac06af00 0x7f39ac06d3c0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f39c4000f80 tx=0x7f39c4009000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:03.341 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:03.333+0000 7f39baffd700 1 -- 172.21.15.157:0/2786868599 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f39cc0b6a60 con 0x7f39cc0cddb0 2023-10-16T19:57:03.565 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:03.562+0000 7f39d0fa6700 1 -- 172.21.15.157:0/2786868599 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f39cc04f400 con 0x7f39cc0cddb0 2023-10-16T19:57:03.565 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:03.563+0000 7f39baffd700 1 -- 172.21.15.157:0/2786868599 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3700 (secure 0 0 0) 0x7f39c0021e90 con 0x7f39cc0cddb0 2023-10-16T19:57:03.566 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-10-16T19:57:03.566 INFO:teuthology.orchestra.run.smithi157.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/1319816297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6834","nonce":1319816297},{"type":"v1","addr":"172.21.15.187:6835","nonce":1319816297}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4242,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6834/3219992837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6832","nonce":3219992837},{"type":"v1","addr":"172.21.15.157:6834","nonce":3219992837}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4245,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6835/1675699874","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6833","nonce":1675699874},{"type":"v1","addr":"172.21.15.157:6835","nonce":1675699874}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4282,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6837/68705029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6836","nonce":68705029},{"type":"v1","addr":"172.21.15.187:6837","nonce":68705029}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[]} 2023-10-16T19:57:03.568 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:03.565+0000 7f39d0fa6700 1 -- 172.21.15.157:0/2786868599 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f39ac06af00 msgr2=0x7f39ac06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:03.568 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:03.565+0000 7f39d0fa6700 1 --2- 172.21.15.157:0/2786868599 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f39ac06af00 0x7f39ac06d3c0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f39c4000f80 tx=0x7f39c4009000 comp rx=0 tx=0).stop 2023-10-16T19:57:03.568 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:03.565+0000 7f39d0fa6700 1 -- 172.21.15.157:0/2786868599 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f39cc0cddb0 msgr2=0x7f39cc1567d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:03.568 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:03.565+0000 7f39d0fa6700 1 --2- 172.21.15.157:0/2786868599 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f39cc0cddb0 0x7f39cc1567d0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f39c000e810 tx=0x7f39c000ebd0 comp rx=0 tx=0).stop 2023-10-16T19:57:03.568 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:03.565+0000 7f39d0fa6700 1 -- 172.21.15.157:0/2786868599 shutdown_connections 2023-10-16T19:57:03.569 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:03.565+0000 7f39d0fa6700 1 --2- 172.21.15.157:0/2786868599 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f39ac06af00 0x7f39ac06d3c0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:03.569 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:03.565+0000 7f39d0fa6700 1 --2- 172.21.15.157:0/2786868599 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f39cc0b76e0 0x7f39cc0b56c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:03.569 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:03.565+0000 7f39d0fa6700 1 --2- 172.21.15.157:0/2786868599 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f39cc15bf50 0x7f39cc15cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:03.569 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:03.565+0000 7f39d0fa6700 1 --2- 172.21.15.157:0/2786868599 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f39cc0cddb0 0x7f39cc1567d0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:03.569 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:03.565+0000 7f39d0fa6700 1 -- 172.21.15.157:0/2786868599 >> 172.21.15.157:0/2786868599 conn(0x7f39cc06e300 msgr2=0x7f39cc0b2700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:03.570 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:03.565+0000 7f39d0fa6700 1 -- 172.21.15.157:0/2786868599 shutdown_connections 2023-10-16T19:57:03.570 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:03.565+0000 7f39d0fa6700 1 -- 172.21.15.157:0/2786868599 wait complete. 2023-10-16T19:57:03.570 INFO:teuthology.orchestra.run.smithi157.stderr:dumped fsmap epoch 3 2023-10-16T19:57:03.580 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T19:57:03.700 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:03.698+0000 7f44b3776700 1 Processor -- start 2023-10-16T19:57:03.701 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:03.698+0000 7f44b3776700 1 -- start start 2023-10-16T19:57:03.703 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:03.699+0000 7f44b3776700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f44ac15e2f0 0x7f44ac06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:03.703 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:03.699+0000 7f44b3776700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f44ac06af60 0x7f44ac0ce910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:03.704 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:03.699+0000 7f44b3776700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44ac0d08b0 con 0x7f44ac06de00 2023-10-16T19:57:03.704 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:03.699+0000 7f44b3776700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44ac1628f0 con 0x7f44ac15e2f0 2023-10-16T19:57:03.704 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:03.699+0000 7f44b3776700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44ac162bd0 con 0x7f44ac06af60 2023-10-16T19:57:03.704 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:03.699+0000 7f44b1512700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f44ac15e2f0 0x7f44ac06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:03.704 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:03.699+0000 7f44b1512700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f44ac15e2f0 0x7f44ac06d0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:45464/0 (socket says 172.21.15.157:45464) 2023-10-16T19:57:03.705 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:03.699+0000 7f44b1512700 1 -- 172.21.15.157:0/1958454636 learned_addr learned my addr 172.21.15.157:0/1958454636 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:57:03.705 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:03.699+0000 7f44b1d13700 1 --2- 172.21.15.157:0/1958454636 >> v2:172.21.15.187:3300/0 conn(0x7f44ac06af60 0x7f44ac0ce910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:03.705 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:03.699+0000 7f44b1512700 1 -- 172.21.15.157:0/1958454636 >> v2:172.21.15.187:3300/0 conn(0x7f44ac06af60 msgr2=0x7f44ac0ce910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:57:03.705 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:03.699+0000 7f44b1512700 1 --2- 172.21.15.157:0/1958454636 >> v2:172.21.15.187:3300/0 conn(0x7f44ac06af60 0x7f44ac0ce910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:03.706 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:03.699+0000 7f44b1512700 1 -- 172.21.15.157:0/1958454636 >> v1:172.21.15.187:6789/0 conn(0x7f44ac06de00 legacy=0x7f44ac06a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:03.706 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:03.699+0000 7f44b1512700 1 -- 172.21.15.157:0/1958454636 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44ac0d05d0 con 0x7f44ac15e2f0 2023-10-16T19:57:03.706 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:03.700+0000 7f44b1512700 1 --2- 172.21.15.157:0/1958454636 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f44ac15e2f0 0x7f44ac06d0f0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f44ac06fbf0 tx=0x7f449c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d505eb121b039433 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:03.706 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:03.700+0000 7f44a3fff700 1 -- 172.21.15.157:0/1958454636 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f449c011830 con 0x7f44ac15e2f0 2023-10-16T19:57:03.706 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:03.700+0000 7f44a3fff700 1 -- 172.21.15.157:0/1958454636 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f449c011990 con 0x7f44ac15e2f0 2023-10-16T19:57:03.707 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:03.700+0000 7f44a3fff700 1 -- 172.21.15.157:0/1958454636 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f449c011d20 con 0x7f44ac15e2f0 2023-10-16T19:57:03.707 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:03.700+0000 7f44b3776700 1 -- 172.21.15.157:0/1958454636 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f44ac15e2f0 msgr2=0x7f44ac06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:03.707 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:03.700+0000 7f44b3776700 1 --2- 172.21.15.157:0/1958454636 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f44ac15e2f0 0x7f44ac06d0f0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f44ac06fbf0 tx=0x7f449c009bd0 comp rx=0 tx=0).stop 2023-10-16T19:57:03.707 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:03.700+0000 7f44b3776700 1 -- 172.21.15.157:0/1958454636 shutdown_connections 2023-10-16T19:57:03.707 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:03.700+0000 7f44b3776700 1 --2- 172.21.15.157:0/1958454636 >> v2:172.21.15.187:3300/0 conn(0x7f44ac06af60 0x7f44ac0ce910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:03.708 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:03.700+0000 7f44b3776700 1 --2- 172.21.15.157:0/1958454636 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f44ac15e2f0 0x7f44ac06d0f0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:03.708 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:03.700+0000 7f44b3776700 1 -- 172.21.15.157:0/1958454636 >> 172.21.15.157:0/1958454636 conn(0x7f44ac0cd4e0 msgr2=0x7f44ac0cd8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:03.708 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:03.700+0000 7f44b3776700 1 -- 172.21.15.157:0/1958454636 shutdown_connections 2023-10-16T19:57:03.708 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:03.700+0000 7f44b3776700 1 -- 172.21.15.157:0/1958454636 wait complete. 2023-10-16T19:57:03.711 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:03.702+0000 7f44b3776700 1 Processor -- start 2023-10-16T19:57:03.711 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:03.702+0000 7f44b3776700 1 -- start start 2023-10-16T19:57:03.711 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:03.702+0000 7f44b3776700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f44ac06af60 0x7f44ac0afae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:03.712 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:03.702+0000 7f44b3776700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f44ac06de00 0x7f44ac158120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:03.712 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:03.702+0000 7f44b3776700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f44ac15e2f0 0x7f44ac157b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:03.712 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:03.702+0000 7f44b3776700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44ac1f4ce0 con 0x7f44ac15e2f0 2023-10-16T19:57:03.712 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:03.702+0000 7f44b3776700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44ac0b00c0 con 0x7f44ac06de00 2023-10-16T19:57:03.712 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:03.702+0000 7f44b3776700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44ac0b6770 con 0x7f44ac06af60 2023-10-16T19:57:03.713 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:03.702+0000 7f44b1d13700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f44ac15e2f0 0x7f44ac157b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:03.713 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:03.702+0000 7f44b1d13700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f44ac15e2f0 0x7f44ac157b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:45474/0 (socket says 172.21.15.157:45474) 2023-10-16T19:57:03.713 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:03.702+0000 7f44b1d13700 1 -- 172.21.15.157:0/1418760868 learned_addr learned my addr 172.21.15.157:0/1418760868 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:57:03.713 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:03.703+0000 7f44b1512700 1 --2- 172.21.15.157:0/1418760868 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f44ac06af60 0x7f44ac0afae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:03.713 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:03.703+0000 7f44b0d11700 1 --2- 172.21.15.157:0/1418760868 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f44ac06de00 0x7f44ac158120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:03.714 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:03.703+0000 7f44b1d13700 1 -- 172.21.15.157:0/1418760868 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f44ac06af60 msgr2=0x7f44ac0afae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:03.714 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:03.703+0000 7f44b1d13700 1 --2- 172.21.15.157:0/1418760868 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f44ac06af60 0x7f44ac0afae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:03.714 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:03.703+0000 7f44b1d13700 1 -- 172.21.15.157:0/1418760868 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f44ac06de00 msgr2=0x7f44ac158120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:03.714 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:03.703+0000 7f44b1d13700 1 --2- 172.21.15.157:0/1418760868 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f44ac06de00 0x7f44ac158120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:03.714 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:03.703+0000 7f44b1d13700 1 -- 172.21.15.157:0/1418760868 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f449c009550 con 0x7f44ac15e2f0 2023-10-16T19:57:03.715 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:03.703+0000 7f44b1d13700 1 --2- 172.21.15.157:0/1418760868 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f44ac15e2f0 0x7f44ac157b20 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f44a4009cb0 tx=0x7f44a400c0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:03.715 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:03.703+0000 7f44a1ffb700 1 -- 172.21.15.157:0/1418760868 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44a4009b20 con 0x7f44ac15e2f0 2023-10-16T19:57:03.715 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:03.703+0000 7f44a1ffb700 1 -- 172.21.15.157:0/1418760868 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44a400f040 con 0x7f44ac15e2f0 2023-10-16T19:57:03.715 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:03.703+0000 7f44b3776700 1 -- 172.21.15.157:0/1418760868 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44ac0b47b0 con 0x7f44ac15e2f0 2023-10-16T19:57:03.716 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:03.703+0000 7f44a1ffb700 1 -- 172.21.15.157:0/1418760868 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44a400cd30 con 0x7f44ac15e2f0 2023-10-16T19:57:03.716 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:03.703+0000 7f44b3776700 1 -- 172.21.15.157:0/1418760868 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44ac0b4d70 con 0x7f44ac15e2f0 2023-10-16T19:57:03.716 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:03.704+0000 7f44b3776700 1 -- 172.21.15.157:0/1418760868 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44ac1f4e20 con 0x7f44ac15e2f0 2023-10-16T19:57:03.716 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:03.705+0000 7f44a1ffb700 1 -- 172.21.15.157:0/1418760868 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f44a4014480 con 0x7f44ac15e2f0 2023-10-16T19:57:03.716 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:03.705+0000 7f44a1ffb700 1 --2- 172.21.15.157:0/1418760868 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f449006af00 0x7f449006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:03.717 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:03.705+0000 7f44a1ffb700 1 -- 172.21.15.157:0/1418760868 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f44a4089d50 con 0x7f44ac15e2f0 2023-10-16T19:57:03.717 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:03.705+0000 7f44b1512700 1 --2- 172.21.15.157:0/1418760868 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f449006af00 0x7f449006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:03.717 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:03.706+0000 7f44b1512700 1 --2- 172.21.15.157:0/1418760868 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f449006af00 0x7f449006d3c0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f449c014040 tx=0x7f449c008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:03.717 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:03.709+0000 7f44a1ffb700 1 -- 172.21.15.157:0/1418760868 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f44ac1f4e20 con 0x7f44ac15e2f0 2023-10-16T19:57:03.903 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:03.901+0000 7f44b3776700 1 -- 172.21.15.157:0/1418760868 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f44ac1f4e20 con 0x7f44ac15e2f0 2023-10-16T19:57:03.904 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:03.902+0000 7f44a1ffb700 1 -- 172.21.15.157:0/1418760868 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+12862 (secure 0 0 0) 0x7f44ac1f4e20 con 0x7f44ac15e2f0 2023-10-16T19:57:03.905 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-10-16T19:57:03.905 INFO:teuthology.orchestra.run.smithi157.stdout:{"epoch":17,"fsid":"28199dc9-64d5-479e-83c6-21f097c33d39","created":"2023-10-16T19:56:49.201889+0000","modified":"2023-10-16T19:56:59.704669+0000","last_up_change":"2023-10-16T19:56:54.675673+0000","last_in_change":"2023-10-16T19:56:51.666728+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T19:56:56.932895+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":335785898},{"type":"v1","addr":"172.21.15.157:6809","nonce":335785898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":335785898},{"type":"v1","addr":"172.21.15.157:6811","nonce":335785898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6815","nonce":335785898},{"type":"v1","addr":"172.21.15.157:6817","nonce":335785898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":335785898},{"type":"v1","addr":"172.21.15.157:6813","nonce":335785898}]},"public_addr":"172.21.15.157:6809/335785898","cluster_addr":"172.21.15.157:6811/335785898","heartbeat_back_addr":"172.21.15.157:6817/335785898","heartbeat_front_addr":"172.21.15.157:6813/335785898","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":3482825047},{"type":"v1","addr":"172.21.15.157:6801","nonce":3482825047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":3482825047},{"type":"v1","addr":"172.21.15.157:6803","nonce":3482825047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":3482825047},{"type":"v1","addr":"172.21.15.157:6807","nonce":3482825047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":3482825047},{"type":"v1","addr":"172.21.15.157:6805","nonce":3482825047}]},"public_addr":"172.21.15.157:6801/3482825047","cluster_addr":"172.21.15.157:6803/3482825047","heartbeat_back_addr":"172.21.15.157:6807/3482825047","heartbeat_front_addr":"172.21.15.157:6805/3482825047","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":1118292389},{"type":"v1","addr":"172.21.15.157:6825","nonce":1118292389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":1118292389},{"type":"v1","addr":"172.21.15.157:6827","nonce":1118292389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":1118292389},{"type":"v1","addr":"172.21.15.157:6831","nonce":1118292389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":1118292389},{"type":"v1","addr":"172.21.15.157:6829","nonce":1118292389}]},"public_addr":"172.21.15.157:6825/1118292389","cluster_addr":"172.21.15.157:6827/1118292389","heartbeat_back_addr":"172.21.15.157:6831/1118292389","heartbeat_front_addr":"172.21.15.157:6829/1118292389","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":989329821},{"type":"v1","addr":"172.21.15.157:6816","nonce":989329821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":989329821},{"type":"v1","addr":"172.21.15.157:6819","nonce":989329821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":989329821},{"type":"v1","addr":"172.21.15.157:6823","nonce":989329821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":989329821},{"type":"v1","addr":"172.21.15.157:6821","nonce":989329821}]},"public_addr":"172.21.15.157:6816/989329821","cluster_addr":"172.21.15.157:6819/989329821","heartbeat_back_addr":"172.21.15.157:6823/989329821","heartbeat_front_addr":"172.21.15.157:6821/989329821","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":3841016811},{"type":"v1","addr":"172.21.15.187:6801","nonce":3841016811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6803","nonce":3841016811},{"type":"v1","addr":"172.21.15.187:6804","nonce":3841016811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6809","nonce":3841016811},{"type":"v1","addr":"172.21.15.187:6811","nonce":3841016811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":3841016811},{"type":"v1","addr":"172.21.15.187:6808","nonce":3841016811}]},"public_addr":"172.21.15.187:6801/3841016811","cluster_addr":"172.21.15.187:6804/3841016811","heartbeat_back_addr":"172.21.15.187:6811/3841016811","heartbeat_front_addr":"172.21.15.187:6808/3841016811","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":915130263},{"type":"v1","addr":"172.21.15.187:6805","nonce":915130263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6807","nonce":915130263},{"type":"v1","addr":"172.21.15.187:6810","nonce":915130263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":915130263},{"type":"v1","addr":"172.21.15.187:6815","nonce":915130263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":915130263},{"type":"v1","addr":"172.21.15.187:6813","nonce":915130263}]},"public_addr":"172.21.15.187:6805/915130263","cluster_addr":"172.21.15.187:6810/915130263","heartbeat_back_addr":"172.21.15.187:6815/915130263","heartbeat_front_addr":"172.21.15.187:6813/915130263","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":654976824},{"type":"v1","addr":"172.21.15.187:6817","nonce":654976824}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":654976824},{"type":"v1","addr":"172.21.15.187:6819","nonce":654976824}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":654976824},{"type":"v1","addr":"172.21.15.187:6823","nonce":654976824}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":654976824},{"type":"v1","addr":"172.21.15.187:6821","nonce":654976824}]},"public_addr":"172.21.15.187:6817/654976824","cluster_addr":"172.21.15.187:6819/654976824","heartbeat_back_addr":"172.21.15.187:6823/654976824","heartbeat_front_addr":"172.21.15.187:6821/654976824","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":4284059445},{"type":"v1","addr":"172.21.15.187:6825","nonce":4284059445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":4284059445},{"type":"v1","addr":"172.21.15.187:6827","nonce":4284059445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":4284059445},{"type":"v1","addr":"172.21.15.187:6831","nonce":4284059445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":4284059445},{"type":"v1","addr":"172.21.15.187:6829","nonce":4284059445}]},"public_addr":"172.21.15.187:6825/4284059445","cluster_addr":"172.21.15.187:6827/4284059445","heartbeat_back_addr":"172.21.15.187:6831/4284059445","heartbeat_front_addr":"172.21.15.187:6829/4284059445","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.819780+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.824193+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.849575+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.824806+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.809540+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.805093+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.866109+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.807372+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T19:57:03.907 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:03.904+0000 7f44b3776700 1 -- 172.21.15.157:0/1418760868 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f449006af00 msgr2=0x7f449006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:03.907 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:03.904+0000 7f44b3776700 1 --2- 172.21.15.157:0/1418760868 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f449006af00 0x7f449006d3c0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f449c014040 tx=0x7f449c008030 comp rx=0 tx=0).stop 2023-10-16T19:57:03.907 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:03.904+0000 7f44b3776700 1 -- 172.21.15.157:0/1418760868 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f44ac15e2f0 msgr2=0x7f44ac157b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:03.908 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:03.904+0000 7f44b3776700 1 --2- 172.21.15.157:0/1418760868 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f44ac15e2f0 0x7f44ac157b20 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f44a4009cb0 tx=0x7f44a400c0c0 comp rx=0 tx=0).stop 2023-10-16T19:57:03.908 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:03.904+0000 7f44b3776700 1 -- 172.21.15.157:0/1418760868 shutdown_connections 2023-10-16T19:57:03.908 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:03.904+0000 7f44b3776700 1 --2- 172.21.15.157:0/1418760868 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f44ac15e2f0 0x7f44ac157b20 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:03.908 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:03.904+0000 7f44b3776700 1 --2- 172.21.15.157:0/1418760868 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f44ac06af60 0x7f44ac0afae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:03.908 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:03.904+0000 7f44b3776700 1 --2- 172.21.15.157:0/1418760868 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f449006af00 0x7f449006d3c0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:03.909 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:03.904+0000 7f44b3776700 1 --2- 172.21.15.157:0/1418760868 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f44ac06de00 0x7f44ac158120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:03.909 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:03.904+0000 7f44b3776700 1 -- 172.21.15.157:0/1418760868 >> 172.21.15.157:0/1418760868 conn(0x7f44ac0cd4e0 msgr2=0x7f44ac0cd8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:03.909 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:03.904+0000 7f44b3776700 1 -- 172.21.15.157:0/1418760868 shutdown_connections 2023-10-16T19:57:03.909 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:03.905+0000 7f44b3776700 1 -- 172.21.15.157:0/1418760868 wait complete. 2023-10-16T19:57:03.919 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-16T19:56:56.932895+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-16T19:57:03.919 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-16T19:57:04.043 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.041+0000 7f0086f0f700 1 Processor -- start 2023-10-16T19:57:04.044 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.041+0000 7f0086f0f700 1 -- start start 2023-10-16T19:57:04.046 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.042+0000 7f0086f0f700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f00801456a0 0x7f00800cb0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:04.046 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.042+0000 7f0086f0f700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f00800b2710 0x7f00800b2ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:04.047 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.042+0000 7f0086f0f700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f008006e9b0 con 0x7f0080160450 2023-10-16T19:57:04.047 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.042+0000 7f0086f0f700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00800b30e0 con 0x7f00800b2710 2023-10-16T19:57:04.047 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.042+0000 7f0086f0f700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00801608d0 con 0x7f00801456a0 2023-10-16T19:57:04.047 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.042+0000 7f00854ac700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f00800b2710 0x7f00800b2ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:04.047 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.042+0000 7f00854ac700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f00800b2710 0x7f00800b2ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:45478/0 (socket says 172.21.15.157:45478) 2023-10-16T19:57:04.048 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.042+0000 7f007ffff700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f0080160450 0x7f00800c7160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:55150/0 (socket says 172.21.15.157:55150) 2023-10-16T19:57:04.048 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.042+0000 7f00854ac700 1 -- 172.21.15.157:0/1581813912 learned_addr learned my addr 172.21.15.157:0/1581813912 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:57:04.048 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.042+0000 7f0084cab700 1 --2- 172.21.15.157:0/1581813912 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f00801456a0 0x7f00800cb0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:04.048 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.042+0000 7f00854ac700 1 -- 172.21.15.157:0/1581813912 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f00801456a0 msgr2=0x7f00800cb0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:57:04.048 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.042+0000 7f00854ac700 1 --2- 172.21.15.157:0/1581813912 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f00801456a0 0x7f00800cb0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:04.049 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.042+0000 7f00854ac700 1 -- 172.21.15.157:0/1581813912 >> v1:172.21.15.157:6789/0 conn(0x7f0080160450 legacy=0x7f00800c7160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:04.049 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.042+0000 7f00854ac700 1 -- 172.21.15.157:0/1581813912 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0080145a80 con 0x7f00800b2710 2023-10-16T19:57:04.049 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.043+0000 7f00854ac700 1 --2- 172.21.15.157:0/1581813912 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f00800b2710 0x7f00800b2ba0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f0078009e50 tx=0x7f007800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87c0298d92d1c231 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:04.049 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.043+0000 7f007f7fe700 1 -- 172.21.15.157:0/1581813912 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f007800e070 con 0x7f00800b2710 2023-10-16T19:57:04.049 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.043+0000 7f007f7fe700 1 -- 172.21.15.157:0/1581813912 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f007800b9c0 con 0x7f00800b2710 2023-10-16T19:57:04.050 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.043+0000 7f007f7fe700 1 -- 172.21.15.157:0/1581813912 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f007800bd70 con 0x7f00800b2710 2023-10-16T19:57:04.050 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.043+0000 7f0086f0f700 1 -- 172.21.15.157:0/1581813912 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f00800b2710 msgr2=0x7f00800b2ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:04.050 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.043+0000 7f0086f0f700 1 --2- 172.21.15.157:0/1581813912 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f00800b2710 0x7f00800b2ba0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f0078009e50 tx=0x7f007800b330 comp rx=0 tx=0).stop 2023-10-16T19:57:04.050 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.043+0000 7f0086f0f700 1 -- 172.21.15.157:0/1581813912 shutdown_connections 2023-10-16T19:57:04.051 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.043+0000 7f0086f0f700 1 --2- 172.21.15.157:0/1581813912 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f00800b2710 0x7f00800b2ba0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:04.051 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.043+0000 7f0086f0f700 1 --2- 172.21.15.157:0/1581813912 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f00801456a0 0x7f00800cb0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:04.051 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.043+0000 7f0086f0f700 1 -- 172.21.15.157:0/1581813912 >> 172.21.15.157:0/1581813912 conn(0x7f00800d0b30 msgr2=0x7f00800d0f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:04.051 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.043+0000 7f0086f0f700 1 -- 172.21.15.157:0/1581813912 shutdown_connections 2023-10-16T19:57:04.052 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.043+0000 7f0086f0f700 1 -- 172.21.15.157:0/1581813912 wait complete. 2023-10-16T19:57:04.058 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.044+0000 7f0086f0f700 1 Processor -- start 2023-10-16T19:57:04.058 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.045+0000 7f0086f0f700 1 -- start start 2023-10-16T19:57:04.058 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.045+0000 7f0086f0f700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f00800b2710 0x7f008013a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:04.058 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.045+0000 7f0086f0f700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f00801456a0 0x7f00800b1a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:04.059 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.045+0000 7f0086f0f700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0080160450 0x7f00800b1f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:04.059 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.045+0000 7f0086f0f700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f008014d890 con 0x7f00801456a0 2023-10-16T19:57:04.059 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.045+0000 7f0086f0f700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00800b3b70 con 0x7f00800b2710 2023-10-16T19:57:04.059 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.045+0000 7f0086f0f700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00800b6570 con 0x7f0080160450 2023-10-16T19:57:04.059 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.046+0000 7f007ffff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f00801456a0 0x7f00800b1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:04.060 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.046+0000 7f007ffff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f00801456a0 0x7f00800b1a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:45486/0 (socket says 172.21.15.157:45486) 2023-10-16T19:57:04.060 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.046+0000 7f007ffff700 1 -- 172.21.15.157:0/778527187 learned_addr learned my addr 172.21.15.157:0/778527187 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:57:04.060 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.046+0000 7f00854ac700 1 --2- 172.21.15.157:0/778527187 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0080160450 0x7f00800b1f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:04.060 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.046+0000 7f0084cab700 1 --2- 172.21.15.157:0/778527187 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f00800b2710 0x7f008013a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:04.060 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.046+0000 7f007ffff700 1 -- 172.21.15.157:0/778527187 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0080160450 msgr2=0x7f00800b1f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:04.061 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.046+0000 7f007ffff700 1 --2- 172.21.15.157:0/778527187 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0080160450 0x7f00800b1f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:04.061 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.046+0000 7f007ffff700 1 -- 172.21.15.157:0/778527187 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f00800b2710 msgr2=0x7f008013a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:04.061 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.046+0000 7f007ffff700 1 --2- 172.21.15.157:0/778527187 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f00800b2710 0x7f008013a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:04.061 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.046+0000 7f007ffff700 1 -- 172.21.15.157:0/778527187 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0078009b30 con 0x7f00801456a0 2023-10-16T19:57:04.061 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.046+0000 7f007ffff700 1 --2- 172.21.15.157:0/778527187 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f00801456a0 0x7f00800b1a00 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f006c00c530 tx=0x7f006c00c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:04.061 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.046+0000 7f007d7fa700 1 -- 172.21.15.157:0/778527187 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f006c00cea0 con 0x7f00801456a0 2023-10-16T19:57:04.062 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.046+0000 7f007d7fa700 1 -- 172.21.15.157:0/778527187 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f006c005cb0 con 0x7f00801456a0 2023-10-16T19:57:04.062 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.046+0000 7f007d7fa700 1 -- 172.21.15.157:0/778527187 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f006c0072d0 con 0x7f00801456a0 2023-10-16T19:57:04.062 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.046+0000 7f0086f0f700 1 -- 172.21.15.157:0/778527187 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f008013aac0 con 0x7f00801456a0 2023-10-16T19:57:04.062 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.046+0000 7f0086f0f700 1 -- 172.21.15.157:0/778527187 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f008014da70 con 0x7f00801456a0 2023-10-16T19:57:04.062 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.047+0000 7f0086f0f700 1 -- 172.21.15.157:0/778527187 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00800b66b0 con 0x7f00801456a0 2023-10-16T19:57:04.063 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.047+0000 7f007d7fa700 1 -- 172.21.15.157:0/778527187 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f006c007430 con 0x7f00801456a0 2023-10-16T19:57:04.063 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.048+0000 7f007d7fa700 1 --2- 172.21.15.157:0/778527187 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f006406af00 0x7f006406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:04.063 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.048+0000 7f007d7fa700 1 -- 172.21.15.157:0/778527187 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f006c088420 con 0x7f00801456a0 2023-10-16T19:57:04.063 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.048+0000 7f0084cab700 1 --2- 172.21.15.157:0/778527187 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f006406af00 0x7f006406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:04.063 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.048+0000 7f0084cab700 1 --2- 172.21.15.157:0/778527187 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f006406af00 0x7f006406d3c0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f0074006b20 tx=0x7f0074008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:04.064 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.052+0000 7f007d7fa700 1 -- 172.21.15.157:0/778527187 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f00800b66b0 con 0x7f00801456a0 2023-10-16T19:57:04.244 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.241+0000 7f0086f0f700 1 -- 172.21.15.157:0/778527187 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f00800b66b0 con 0x7f00801456a0 2023-10-16T19:57:04.244 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.242+0000 7f007d7fa700 1 -- 172.21.15.157:0/778527187 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) v1 ==== 93+0+10 (secure 0 0 0) 0x7f00800b66b0 con 0x7f00801456a0 2023-10-16T19:57:04.245 INFO:teuthology.orchestra.run.smithi157.stdout:pg_num: 1 2023-10-16T19:57:04.247 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.244+0000 7f0086f0f700 1 -- 172.21.15.157:0/778527187 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f006406af00 msgr2=0x7f006406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:04.247 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.244+0000 7f0086f0f700 1 --2- 172.21.15.157:0/778527187 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f006406af00 0x7f006406d3c0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f0074006b20 tx=0x7f0074008040 comp rx=0 tx=0).stop 2023-10-16T19:57:04.247 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.244+0000 7f0086f0f700 1 -- 172.21.15.157:0/778527187 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f00801456a0 msgr2=0x7f00800b1a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:04.247 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.244+0000 7f0086f0f700 1 --2- 172.21.15.157:0/778527187 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f00801456a0 0x7f00800b1a00 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f006c00c530 tx=0x7f006c00c840 comp rx=0 tx=0).stop 2023-10-16T19:57:04.248 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.244+0000 7f0086f0f700 1 -- 172.21.15.157:0/778527187 shutdown_connections 2023-10-16T19:57:04.248 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.244+0000 7f0086f0f700 1 --2- 172.21.15.157:0/778527187 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f006406af00 0x7f006406d3c0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:04.248 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.244+0000 7f0086f0f700 1 --2- 172.21.15.157:0/778527187 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f00800b2710 0x7f008013a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:04.248 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.244+0000 7f0086f0f700 1 --2- 172.21.15.157:0/778527187 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0080160450 0x7f00800b1f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:04.248 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.244+0000 7f0086f0f700 1 --2- 172.21.15.157:0/778527187 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f00801456a0 0x7f00800b1a00 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:04.249 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.244+0000 7f0086f0f700 1 -- 172.21.15.157:0/778527187 >> 172.21.15.157:0/778527187 conn(0x7f00800d0b30 msgr2=0x7f00800d0f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:04.249 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.244+0000 7f0086f0f700 1 -- 172.21.15.157:0/778527187 shutdown_connections 2023-10-16T19:57:04.249 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.244+0000 7f0086f0f700 1 -- 172.21.15.157:0/778527187 wait complete. 2023-10-16T19:57:04.261 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-16T19:57:04.381 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.379+0000 7f2b7bcf4700 1 Processor -- start 2023-10-16T19:57:04.382 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.379+0000 7f2b7bcf4700 1 -- start start 2023-10-16T19:57:04.384 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.380+0000 7f2b7bcf4700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f2b7415bf50 0x7f2b740cef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:04.384 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.380+0000 7f2b7bcf4700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2b740b76e0 0x7f2b740cd870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:04.384 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.380+0000 7f2b7bcf4700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b740cf920 con 0x7f2b740cddb0 2023-10-16T19:57:04.384 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.380+0000 7f2b7bcf4700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b740cc4b0 con 0x7f2b7415bf50 2023-10-16T19:57:04.385 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.380+0000 7f2b7bcf4700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b740cfc00 con 0x7f2b740b76e0 2023-10-16T19:57:04.385 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.380+0000 7f2b79a90700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f2b7415bf50 0x7f2b740cef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:04.385 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.380+0000 7f2b79a90700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f2b7415bf50 0x7f2b740cef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:45492/0 (socket says 172.21.15.157:45492) 2023-10-16T19:57:04.385 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.380+0000 7f2b79a90700 1 -- 172.21.15.157:0/2000661704 learned_addr learned my addr 172.21.15.157:0/2000661704 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:57:04.385 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.380+0000 7f2b7928f700 1 --2- 172.21.15.157:0/2000661704 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2b740b76e0 0x7f2b740cd870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:04.386 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.380+0000 7f2b79a90700 1 -- 172.21.15.157:0/2000661704 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2b740b76e0 msgr2=0x7f2b740cd870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:57:04.386 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.380+0000 7f2b79a90700 1 --2- 172.21.15.157:0/2000661704 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2b740b76e0 0x7f2b740cd870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:04.386 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.380+0000 7f2b79a90700 1 -- 172.21.15.157:0/2000661704 >> v1:172.21.15.187:6789/0 conn(0x7f2b740cddb0 legacy=0x7f2b7415f8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:04.386 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.380+0000 7f2b79a90700 1 -- 172.21.15.157:0/2000661704 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b740cfee0 con 0x7f2b7415bf50 2023-10-16T19:57:04.386 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.380+0000 7f2b79a90700 1 --2- 172.21.15.157:0/2000661704 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2b7415bf50 0x7f2b740cef80 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f2b700098f0 tx=0x7f2b70009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=446129cf7c7c9138 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:04.387 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.380+0000 7f2b78a8e700 1 -- 172.21.15.157:0/2000661704 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b7000b8a0 con 0x7f2b7415bf50 2023-10-16T19:57:04.387 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.381+0000 7f2b78a8e700 1 -- 172.21.15.157:0/2000661704 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b7000ba00 con 0x7f2b7415bf50 2023-10-16T19:57:04.387 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.381+0000 7f2b78a8e700 1 -- 172.21.15.157:0/2000661704 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b7000bd90 con 0x7f2b7415bf50 2023-10-16T19:57:04.387 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.381+0000 7f2b7bcf4700 1 -- 172.21.15.157:0/2000661704 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2b7415bf50 msgr2=0x7f2b740cef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:04.387 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.381+0000 7f2b7bcf4700 1 --2- 172.21.15.157:0/2000661704 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2b7415bf50 0x7f2b740cef80 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f2b700098f0 tx=0x7f2b70009c00 comp rx=0 tx=0).stop 2023-10-16T19:57:04.388 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.381+0000 7f2b7bcf4700 1 -- 172.21.15.157:0/2000661704 shutdown_connections 2023-10-16T19:57:04.388 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.381+0000 7f2b7bcf4700 1 --2- 172.21.15.157:0/2000661704 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2b7415bf50 0x7f2b740cef80 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:04.388 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.381+0000 7f2b7bcf4700 1 --2- 172.21.15.157:0/2000661704 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2b740b76e0 0x7f2b740cd870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:04.388 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.381+0000 7f2b7bcf4700 1 -- 172.21.15.157:0/2000661704 >> 172.21.15.157:0/2000661704 conn(0x7f2b7406e300 msgr2=0x7f2b7406e6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:04.388 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.381+0000 7f2b7bcf4700 1 -- 172.21.15.157:0/2000661704 shutdown_connections 2023-10-16T19:57:04.389 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.381+0000 7f2b7bcf4700 1 -- 172.21.15.157:0/2000661704 wait complete. 2023-10-16T19:57:04.392 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.382+0000 7f2b7bcf4700 1 Processor -- start 2023-10-16T19:57:04.392 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.382+0000 7f2b7bcf4700 1 -- start start 2023-10-16T19:57:04.392 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.383+0000 7f2b7bcf4700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2b740b76e0 0x7f2b741f0c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:04.392 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.383+0000 7f2b7bcf4700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2b740cddb0 0x7f2b7415ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:04.393 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.383+0000 7f2b7bcf4700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2b7415bf50 0x7f2b74156aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:04.393 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.383+0000 7f2b7bcf4700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b740b12f0 con 0x7f2b740cddb0 2023-10-16T19:57:04.393 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.383+0000 7f2b7bcf4700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b741f4410 con 0x7f2b740b76e0 2023-10-16T19:57:04.393 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.383+0000 7f2b7bcf4700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b741f46f0 con 0x7f2b7415bf50 2023-10-16T19:57:04.393 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.383+0000 7f2b7928f700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2b740cddb0 0x7f2b7415ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:04.394 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.383+0000 7f2b7928f700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2b740cddb0 0x7f2b7415ecf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:45500/0 (socket says 172.21.15.157:45500) 2023-10-16T19:57:04.394 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.383+0000 7f2b7928f700 1 -- 172.21.15.157:0/306071509 learned_addr learned my addr 172.21.15.157:0/306071509 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:57:04.394 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.383+0000 7f2b79a90700 1 --2- 172.21.15.157:0/306071509 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2b740b76e0 0x7f2b741f0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:04.394 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.383+0000 7f2b7a291700 1 --2- 172.21.15.157:0/306071509 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2b7415bf50 0x7f2b74156aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:04.394 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.383+0000 7f2b7928f700 1 -- 172.21.15.157:0/306071509 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2b7415bf50 msgr2=0x7f2b74156aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:04.395 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.383+0000 7f2b7928f700 1 --2- 172.21.15.157:0/306071509 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2b7415bf50 0x7f2b74156aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:04.395 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.383+0000 7f2b7928f700 1 -- 172.21.15.157:0/306071509 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2b740b76e0 msgr2=0x7f2b741f0c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:04.395 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.383+0000 7f2b7928f700 1 --2- 172.21.15.157:0/306071509 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2b740b76e0 0x7f2b741f0c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:04.395 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.383+0000 7f2b7928f700 1 -- 172.21.15.157:0/306071509 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b70009550 con 0x7f2b740cddb0 2023-10-16T19:57:04.395 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.383+0000 7f2b79a90700 1 --2- 172.21.15.157:0/306071509 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2b740b76e0 0x7f2b741f0c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T19:57:04.396 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.383+0000 7f2b7a291700 1 --2- 172.21.15.157:0/306071509 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2b7415bf50 0x7f2b74156aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T19:57:04.396 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.383+0000 7f2b7928f700 1 --2- 172.21.15.157:0/306071509 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2b740cddb0 0x7f2b7415ecf0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f2b6400e810 tx=0x7f2b6400ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:04.396 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.384+0000 7f2b6a7fc700 1 -- 172.21.15.157:0/306071509 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b64013610 con 0x7f2b740cddb0 2023-10-16T19:57:04.396 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.384+0000 7f2b6a7fc700 1 -- 172.21.15.157:0/306071509 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b64013770 con 0x7f2b740cddb0 2023-10-16T19:57:04.396 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.384+0000 7f2b7bcf4700 1 -- 172.21.15.157:0/306071509 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b7415e4f0 con 0x7f2b740cddb0 2023-10-16T19:57:04.397 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.384+0000 7f2b6a7fc700 1 -- 172.21.15.157:0/306071509 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b64013b20 con 0x7f2b740cddb0 2023-10-16T19:57:04.397 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.384+0000 7f2b7bcf4700 1 -- 172.21.15.157:0/306071509 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b741f11c0 con 0x7f2b740cddb0 2023-10-16T19:57:04.397 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.385+0000 7f2b7bcf4700 1 -- 172.21.15.157:0/306071509 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b7404f400 con 0x7f2b740cddb0 2023-10-16T19:57:04.397 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.385+0000 7f2b6a7fc700 1 -- 172.21.15.157:0/306071509 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f2b64013c80 con 0x7f2b740cddb0 2023-10-16T19:57:04.397 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.385+0000 7f2b6a7fc700 1 --2- 172.21.15.157:0/306071509 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f2b5806af00 0x7f2b5806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:04.398 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.385+0000 7f2b6a7fc700 1 -- 172.21.15.157:0/306071509 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f2b64088f30 con 0x7f2b740cddb0 2023-10-16T19:57:04.398 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.386+0000 7f2b79a90700 1 --2- 172.21.15.157:0/306071509 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f2b5806af00 0x7f2b5806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:04.398 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.386+0000 7f2b79a90700 1 --2- 172.21.15.157:0/306071509 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f2b5806af00 0x7f2b5806d3c0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f2b7406c9f0 tx=0x7f2b70008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:04.398 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.390+0000 7f2b6a7fc700 1 -- 172.21.15.157:0/306071509 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2b64054340 con 0x7f2b740cddb0 2023-10-16T19:57:04.580 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.578+0000 7f2b7bcf4700 1 -- 172.21.15.157:0/306071509 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f2b740d0190 con 0x7f2b740cddb0 2023-10-16T19:57:04.580 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.578+0000 7f2b6a7fc700 1 -- 172.21.15.157:0/306071509 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v17) v1 ==== 84+0+65 (secure 0 0 0) 0x7f2b64057960 con 0x7f2b740cddb0 2023-10-16T19:57:04.581 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-10-16T19:57:04.581 INFO:teuthology.orchestra.run.smithi157.stdout:[ 2023-10-16T19:57:04.581 INFO:teuthology.orchestra.run.smithi157.stdout: { 2023-10-16T19:57:04.581 INFO:teuthology.orchestra.run.smithi157.stdout: "poolnum": 1, 2023-10-16T19:57:04.582 INFO:teuthology.orchestra.run.smithi157.stdout: "poolname": ".mgr" 2023-10-16T19:57:04.582 INFO:teuthology.orchestra.run.smithi157.stdout: } 2023-10-16T19:57:04.582 INFO:teuthology.orchestra.run.smithi157.stdout:] 2023-10-16T19:57:04.583 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.580+0000 7f2b7bcf4700 1 -- 172.21.15.157:0/306071509 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f2b5806af00 msgr2=0x7f2b5806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:04.584 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.580+0000 7f2b7bcf4700 1 --2- 172.21.15.157:0/306071509 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f2b5806af00 0x7f2b5806d3c0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f2b7406c9f0 tx=0x7f2b70008030 comp rx=0 tx=0).stop 2023-10-16T19:57:04.584 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.580+0000 7f2b7bcf4700 1 -- 172.21.15.157:0/306071509 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2b740cddb0 msgr2=0x7f2b7415ecf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:04.584 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.580+0000 7f2b7bcf4700 1 --2- 172.21.15.157:0/306071509 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2b740cddb0 0x7f2b7415ecf0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f2b6400e810 tx=0x7f2b6400ebd0 comp rx=0 tx=0).stop 2023-10-16T19:57:04.584 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.580+0000 7f2b7bcf4700 1 -- 172.21.15.157:0/306071509 shutdown_connections 2023-10-16T19:57:04.585 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.580+0000 7f2b7bcf4700 1 --2- 172.21.15.157:0/306071509 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f2b5806af00 0x7f2b5806d3c0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:04.585 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.580+0000 7f2b7bcf4700 1 --2- 172.21.15.157:0/306071509 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2b740b76e0 0x7f2b741f0c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:04.585 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.580+0000 7f2b7bcf4700 1 --2- 172.21.15.157:0/306071509 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2b7415bf50 0x7f2b74156aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:04.585 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.580+0000 7f2b7bcf4700 1 --2- 172.21.15.157:0/306071509 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2b740cddb0 0x7f2b7415ecf0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:04.585 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.580+0000 7f2b7bcf4700 1 -- 172.21.15.157:0/306071509 >> 172.21.15.157:0/306071509 conn(0x7f2b7406e300 msgr2=0x7f2b7415f830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:04.586 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.580+0000 7f2b7bcf4700 1 -- 172.21.15.157:0/306071509 shutdown_connections 2023-10-16T19:57:04.586 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.580+0000 7f2b7bcf4700 1 -- 172.21.15.157:0/306071509 wait complete. 2023-10-16T19:57:04.594 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-16T19:57:04.595 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-16T19:57:04.718 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.716+0000 7f689c5d7700 1 Processor -- start 2023-10-16T19:57:04.719 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.716+0000 7f689c5d7700 1 -- start start 2023-10-16T19:57:04.721 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.717+0000 7f689c5d7700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f6894071080 0x7f6894071530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:04.721 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.717+0000 7f689c5d7700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f68940b2710 0x7f68940b2b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:04.722 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.717+0000 7f689c5d7700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6894144430 con 0x7f68941439a0 2023-10-16T19:57:04.722 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.717+0000 7f689c5d7700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68940ce790 con 0x7f68940b2710 2023-10-16T19:57:04.722 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.717+0000 7f689c5d7700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68940b30c0 con 0x7f6894071080 2023-10-16T19:57:04.722 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.717+0000 7f689ab74700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f68940b2710 0x7f68940b2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:04.722 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.717+0000 7f689ab74700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f68940b2710 0x7f68940b2b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:45510/0 (socket says 172.21.15.157:45510) 2023-10-16T19:57:04.723 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.717+0000 7f689ab74700 1 -- 172.21.15.157:0/1858410511 learned_addr learned my addr 172.21.15.157:0/1858410511 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:57:04.723 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.718+0000 7f6899b72700 1 --2- 172.21.15.157:0/1858410511 >> v2:172.21.15.187:3300/0 conn(0x7f6894071080 0x7f6894071530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:04.723 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.718+0000 7f689ab74700 1 -- 172.21.15.157:0/1858410511 >> v2:172.21.15.187:3300/0 conn(0x7f6894071080 msgr2=0x7f6894071530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:57:04.723 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.718+0000 7f689ab74700 1 --2- 172.21.15.157:0/1858410511 >> v2:172.21.15.187:3300/0 conn(0x7f6894071080 0x7f6894071530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:04.723 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.718+0000 7f689ab74700 1 -- 172.21.15.157:0/1858410511 >> v1:172.21.15.187:6789/0 conn(0x7f68941439a0 legacy=0x7f68940cef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:57:04.724 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.718+0000 7f689ab74700 1 -- 172.21.15.157:0/1858410511 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6894071bf0 con 0x7f68940b2710 2023-10-16T19:57:04.724 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.718+0000 7f6899b72700 1 --2- 172.21.15.157:0/1858410511 >> v2:172.21.15.187:3300/0 conn(0x7f6894071080 0x7f6894071530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T19:57:04.724 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.718+0000 7f689ab74700 1 --2- 172.21.15.157:0/1858410511 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f68940b2710 0x7f68940b2b80 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f68940d1950 tx=0x7f688c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61bd66182bff7770 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:04.724 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.718+0000 7f6899371700 1 -- 172.21.15.157:0/1858410511 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f688c00e070 con 0x7f68940b2710 2023-10-16T19:57:04.724 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.718+0000 7f6899371700 1 -- 172.21.15.157:0/1858410511 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f688c003a20 con 0x7f68940b2710 2023-10-16T19:57:04.725 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.718+0000 7f6899371700 1 -- 172.21.15.157:0/1858410511 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f688c003dd0 con 0x7f68940b2710 2023-10-16T19:57:04.725 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.718+0000 7f689c5d7700 1 -- 172.21.15.157:0/1858410511 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f68940b2710 msgr2=0x7f68940b2b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:04.725 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.718+0000 7f689c5d7700 1 --2- 172.21.15.157:0/1858410511 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f68940b2710 0x7f68940b2b80 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f68940d1950 tx=0x7f688c00b330 comp rx=0 tx=0).stop 2023-10-16T19:57:04.725 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.718+0000 7f689c5d7700 1 -- 172.21.15.157:0/1858410511 shutdown_connections 2023-10-16T19:57:04.725 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.718+0000 7f689c5d7700 1 --2- 172.21.15.157:0/1858410511 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f68940b2710 0x7f68940b2b80 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:04.725 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.718+0000 7f689c5d7700 1 --2- 172.21.15.157:0/1858410511 >> v2:172.21.15.187:3300/0 conn(0x7f6894071080 0x7f6894071530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:04.726 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.718+0000 7f689c5d7700 1 -- 172.21.15.157:0/1858410511 >> 172.21.15.157:0/1858410511 conn(0x7f68940d0b30 msgr2=0x7f68940d0f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:04.726 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.719+0000 7f689c5d7700 1 -- 172.21.15.157:0/1858410511 shutdown_connections 2023-10-16T19:57:04.726 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.719+0000 7f689c5d7700 1 -- 172.21.15.157:0/1858410511 wait complete. 2023-10-16T19:57:04.729 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.720+0000 7f689c5d7700 1 Processor -- start 2023-10-16T19:57:04.729 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.720+0000 7f689c5d7700 1 -- start start 2023-10-16T19:57:04.729 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.720+0000 7f689c5d7700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6894071080 0x7f6894129b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:04.729 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.720+0000 7f689c5d7700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f68940b2710 0x7f68940b3640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:04.729 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.720+0000 7f689c5d7700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f68941439a0 0x7f689415e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:04.730 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.720+0000 7f689c5d7700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f689415d390 con 0x7f68941439a0 2023-10-16T19:57:04.730 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.720+0000 7f689c5d7700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68940b4630 con 0x7f68940b2710 2023-10-16T19:57:04.730 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.720+0000 7f689c5d7700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68940b3b80 con 0x7f6894071080 2023-10-16T19:57:04.730 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.721+0000 7f689ab74700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f68941439a0 0x7f689415e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:04.730 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.721+0000 7f689ab74700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f68941439a0 0x7f689415e9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:45516/0 (socket says 172.21.15.157:45516) 2023-10-16T19:57:04.731 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.721+0000 7f689ab74700 1 -- 172.21.15.157:0/3008966927 learned_addr learned my addr 172.21.15.157:0/3008966927 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:57:04.731 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.721+0000 7f6899b72700 1 --2- 172.21.15.157:0/3008966927 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f68940b2710 0x7f68940b3640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:04.731 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.721+0000 7f689a373700 1 --2- 172.21.15.157:0/3008966927 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6894071080 0x7f6894129b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:04.731 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.721+0000 7f689ab74700 1 -- 172.21.15.157:0/3008966927 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6894071080 msgr2=0x7f6894129b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:04.731 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.721+0000 7f689ab74700 1 --2- 172.21.15.157:0/3008966927 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6894071080 0x7f6894129b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:04.732 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.721+0000 7f689ab74700 1 -- 172.21.15.157:0/3008966927 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f68940b2710 msgr2=0x7f68940b3640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:04.732 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.721+0000 7f689ab74700 1 --2- 172.21.15.157:0/3008966927 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f68940b2710 0x7f68940b3640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:04.732 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.721+0000 7f689ab74700 1 -- 172.21.15.157:0/3008966927 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f688c009b30 con 0x7f68941439a0 2023-10-16T19:57:04.732 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.721+0000 7f689a373700 1 --2- 172.21.15.157:0/3008966927 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6894071080 0x7f6894129b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T19:57:04.732 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.721+0000 7f689ab74700 1 --2- 172.21.15.157:0/3008966927 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f68941439a0 0x7f689415e9c0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f688c015040 tx=0x7f688c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:04.733 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.721+0000 7f688affd700 1 -- 172.21.15.157:0/3008966927 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f688c004440 con 0x7f68941439a0 2023-10-16T19:57:04.733 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.721+0000 7f688affd700 1 -- 172.21.15.157:0/3008966927 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f688c0045a0 con 0x7f68941439a0 2023-10-16T19:57:04.733 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.721+0000 7f689c5d7700 1 -- 172.21.15.157:0/3008966927 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f689415cff0 con 0x7f68941439a0 2023-10-16T19:57:04.733 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.721+0000 7f688affd700 1 -- 172.21.15.157:0/3008966927 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f688c004950 con 0x7f68941439a0 2023-10-16T19:57:04.733 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.721+0000 7f689c5d7700 1 -- 172.21.15.157:0/3008966927 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68940b4070 con 0x7f68941439a0 2023-10-16T19:57:04.733 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.722+0000 7f689c5d7700 1 -- 172.21.15.157:0/3008966927 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f689415d4d0 con 0x7f68941439a0 2023-10-16T19:57:04.734 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.722+0000 7f688affd700 1 -- 172.21.15.157:0/3008966927 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f688c012430 con 0x7f68941439a0 2023-10-16T19:57:04.734 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.723+0000 7f688affd700 1 --2- 172.21.15.157:0/3008966927 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f687806af00 0x7f687806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:04.734 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.723+0000 7f688affd700 1 -- 172.21.15.157:0/3008966927 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f688c08a660 con 0x7f68941439a0 2023-10-16T19:57:04.734 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.723+0000 7f689a373700 1 --2- 172.21.15.157:0/3008966927 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f687806af00 0x7f687806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:04.734 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.723+0000 7f689a373700 1 --2- 172.21.15.157:0/3008966927 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f687806af00 0x7f687806d3c0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f6884009930 tx=0x7f6884008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:04.735 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.727+0000 7f688affd700 1 -- 172.21.15.157:0/3008966927 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f689415d4d0 con 0x7f68941439a0 2023-10-16T19:57:04.920 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.917+0000 7f689c5d7700 1 -- 172.21.15.157:0/3008966927 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f689415d4d0 con 0x7f68941439a0 2023-10-16T19:57:04.972 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.970+0000 7f688affd700 1 -- 172.21.15.157:0/3008966927 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v18) v1 ==== 138+0+0 (secure 0 0 0) 0x7f689415d4d0 con 0x7f68941439a0 2023-10-16T19:57:04.975 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.972+0000 7f689c5d7700 1 -- 172.21.15.157:0/3008966927 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f687806af00 msgr2=0x7f687806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:04.975 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.972+0000 7f689c5d7700 1 --2- 172.21.15.157:0/3008966927 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f687806af00 0x7f687806d3c0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f6884009930 tx=0x7f6884008040 comp rx=0 tx=0).stop 2023-10-16T19:57:04.975 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.972+0000 7f689c5d7700 1 -- 172.21.15.157:0/3008966927 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f68941439a0 msgr2=0x7f689415e9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:04.975 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.972+0000 7f689c5d7700 1 --2- 172.21.15.157:0/3008966927 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f68941439a0 0x7f689415e9c0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f688c015040 tx=0x7f688c004ad0 comp rx=0 tx=0).stop 2023-10-16T19:57:04.976 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.973+0000 7f689c5d7700 1 -- 172.21.15.157:0/3008966927 shutdown_connections 2023-10-16T19:57:04.976 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.973+0000 7f689c5d7700 1 --2- 172.21.15.157:0/3008966927 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f68941439a0 0x7f689415e9c0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:04.976 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.973+0000 7f689c5d7700 1 --2- 172.21.15.157:0/3008966927 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6894071080 0x7f6894129b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:04.977 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.973+0000 7f689c5d7700 1 --2- 172.21.15.157:0/3008966927 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f687806af00 0x7f687806d3c0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:04.977 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.973+0000 7f689c5d7700 1 --2- 172.21.15.157:0/3008966927 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f68940b2710 0x7f68940b3640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:04.977 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.973+0000 7f689c5d7700 1 -- 172.21.15.157:0/3008966927 >> 172.21.15.157:0/3008966927 conn(0x7f68940d0b30 msgr2=0x7f68940cdc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:04.977 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.973+0000 7f689c5d7700 1 -- 172.21.15.157:0/3008966927 shutdown_connections 2023-10-16T19:57:04.977 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:04.973+0000 7f689c5d7700 1 -- 172.21.15.157:0/3008966927 wait complete. 2023-10-16T19:57:04.978 INFO:teuthology.orchestra.run.smithi157.stderr:pool 'cephfs_metadata' created 2023-10-16T19:57:04.989 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-16T19:57:05.117 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:05.115+0000 7fdd138e4700 1 Processor -- start 2023-10-16T19:57:05.118 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:05.115+0000 7fdd138e4700 1 -- start start 2023-10-16T19:57:05.120 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:05.116+0000 7fdd138e4700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fdd0c0cb0f0 0x7fdd0c160450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:05.120 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:05.116+0000 7fdd138e4700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd0c06e9b0 con 0x7fdd0c1456a0 2023-10-16T19:57:05.120 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:05.116+0000 7fdd138e4700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd0c145a80 con 0x7fdd0c0b2710 2023-10-16T19:57:05.120 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:05.116+0000 7fdd138e4700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd0c0c79d0 con 0x7fdd0c0cb0f0 2023-10-16T19:57:05.120 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:05.116+0000 7fdd10e7f700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fdd0c0cb0f0 0x7fdd0c160450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:05.121 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:05.116+0000 7fdd11680700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7fdd0c1456a0 0x7fdd0c0c7160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:55192/0 (socket says 172.21.15.157:55192) 2023-10-16T19:57:05.121 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:05.116+0000 7fdd11680700 1 -- 172.21.15.157:0/2295462604 learned_addr learned my addr 172.21.15.157:0/2295462604 (peer_addr_for_me v1:172.21.15.157:0/0) 2023-10-16T19:57:05.121 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:05.116+0000 7fdd10e7f700 1 --2- 172.21.15.157:0/2295462604 >> v2:172.21.15.157:3300/0 conn(0x7fdd0c0cb0f0 0x7fdd0c160450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:45520/0 (socket says 172.21.15.157:45520) 2023-10-16T19:57:05.121 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:05.116+0000 7fdd10e7f700 1 -- 172.21.15.157:0/2295462604 >> v1:172.21.15.187:6789/0 conn(0x7fdd0c0b2710 legacy=0x7fdd0c06d730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:57:05.121 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:05.116+0000 7fdd10e7f700 1 -- 172.21.15.157:0/2295462604 >> v1:172.21.15.157:6789/0 conn(0x7fdd0c1456a0 legacy=0x7fdd0c0c7160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:05.122 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:05.116+0000 7fdd10e7f700 1 -- 172.21.15.157:0/2295462604 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd0c06ec50 con 0x7fdd0c0cb0f0 2023-10-16T19:57:05.122 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:05.116+0000 7fdd03fff700 1 -- 172.21.15.157:0/2295462604 <== mon.0 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1819066924 0 0) 0x7fdd0c06e9b0 con 0x7fdd0c1456a0 2023-10-16T19:57:05.122 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:05.116+0000 7fdd10e7f700 1 --2- 172.21.15.157:0/2295462604 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdd0c0cb0f0 0x7fdd0c160450 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fdd08009840 tx=0x7fdd08009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63fc0e7462433855 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:05.122 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:05.116+0000 7fdd03fff700 1 -- 172.21.15.157:0/2295462604 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd08004230 con 0x7fdd0c0cb0f0 2023-10-16T19:57:05.123 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:05.117+0000 7fdd03fff700 1 -- 172.21.15.157:0/2295462604 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd08004390 con 0x7fdd0c0cb0f0 2023-10-16T19:57:05.123 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:05.117+0000 7fdd03fff700 1 -- 172.21.15.157:0/2295462604 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd080036a0 con 0x7fdd0c0cb0f0 2023-10-16T19:57:05.123 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:05.117+0000 7fdd138e4700 1 -- 172.21.15.157:0/2295462604 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdd0c0cb0f0 msgr2=0x7fdd0c160450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:05.123 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:05.117+0000 7fdd138e4700 1 --2- 172.21.15.157:0/2295462604 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdd0c0cb0f0 0x7fdd0c160450 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fdd08009840 tx=0x7fdd08009b50 comp rx=0 tx=0).stop 2023-10-16T19:57:05.123 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:05.117+0000 7fdd138e4700 1 -- 172.21.15.157:0/2295462604 shutdown_connections 2023-10-16T19:57:05.123 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:05.117+0000 7fdd138e4700 1 --2- 172.21.15.157:0/2295462604 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdd0c0cb0f0 0x7fdd0c160450 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:05.124 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:05.117+0000 7fdd138e4700 1 -- 172.21.15.157:0/2295462604 >> 172.21.15.157:0/2295462604 conn(0x7fdd0c0d0b30 msgr2=0x7fdd0c0d0f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:05.124 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:05.117+0000 7fdd138e4700 1 -- 172.21.15.157:0/2295462604 shutdown_connections 2023-10-16T19:57:05.124 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:05.117+0000 7fdd138e4700 1 -- 172.21.15.157:0/2295462604 wait complete. 2023-10-16T19:57:05.127 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:05.118+0000 7fdd138e4700 1 Processor -- start 2023-10-16T19:57:05.128 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:05.118+0000 7fdd138e4700 1 -- start start 2023-10-16T19:57:05.128 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:05.119+0000 7fdd138e4700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdd0c0b2710 0x7fdd0c0b5a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:05.128 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:05.119+0000 7fdd138e4700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdd0c0cb0f0 0x7fdd0c15ca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:05.128 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:05.119+0000 7fdd138e4700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdd0c1456a0 0x7fdd0c0b06f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:05.129 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:05.119+0000 7fdd138e4700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd0c15cf50 con 0x7fdd0c1456a0 2023-10-16T19:57:05.129 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:05.119+0000 7fdd138e4700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd0c1f32c0 con 0x7fdd0c0cb0f0 2023-10-16T19:57:05.129 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:05.119+0000 7fdd138e4700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd0c15d180 con 0x7fdd0c0b2710 2023-10-16T19:57:05.129 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:05.119+0000 7fdd11e81700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdd0c1456a0 0x7fdd0c0b06f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:05.129 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:05.119+0000 7fdd11e81700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdd0c1456a0 0x7fdd0c0b06f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:45530/0 (socket says 172.21.15.157:45530) 2023-10-16T19:57:05.130 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:05.119+0000 7fdd11e81700 1 -- 172.21.15.157:0/2036755183 learned_addr learned my addr 172.21.15.157:0/2036755183 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:57:05.130 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:05.119+0000 7fdd10e7f700 1 --2- 172.21.15.157:0/2036755183 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdd0c0cb0f0 0x7fdd0c15ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:05.130 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:05.119+0000 7fdd11e81700 1 -- 172.21.15.157:0/2036755183 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdd0c0b2710 msgr2=0x7fdd0c0b5a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:05.130 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:05.119+0000 7fdd11680700 1 --2- 172.21.15.157:0/2036755183 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdd0c0b2710 0x7fdd0c0b5a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:05.130 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:05.119+0000 7fdd11e81700 1 --2- 172.21.15.157:0/2036755183 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdd0c0b2710 0x7fdd0c0b5a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:05.131 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:05.119+0000 7fdd11e81700 1 -- 172.21.15.157:0/2036755183 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdd0c0cb0f0 msgr2=0x7fdd0c15ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:05.131 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:05.119+0000 7fdd11e81700 1 --2- 172.21.15.157:0/2036755183 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdd0c0cb0f0 0x7fdd0c15ca10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:05.131 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:05.119+0000 7fdd11e81700 1 -- 172.21.15.157:0/2036755183 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd080094a0 con 0x7fdd0c1456a0 2023-10-16T19:57:05.131 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:05.119+0000 7fdd11e81700 1 --2- 172.21.15.157:0/2036755183 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdd0c1456a0 0x7fdd0c0b06f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fdd0400cc10 tx=0x7fdd0400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:05.131 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:05.120+0000 7fdd01ffb700 1 -- 172.21.15.157:0/2036755183 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd0400abb0 con 0x7fdd0c1456a0 2023-10-16T19:57:05.132 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:05.120+0000 7fdd01ffb700 1 -- 172.21.15.157:0/2036755183 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd0400ad10 con 0x7fdd0c1456a0 2023-10-16T19:57:05.132 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:05.120+0000 7fdd138e4700 1 -- 172.21.15.157:0/2036755183 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd0c1f2c70 con 0x7fdd0c1456a0 2023-10-16T19:57:05.132 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:05.120+0000 7fdd01ffb700 1 -- 172.21.15.157:0/2036755183 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd04012660 con 0x7fdd0c1456a0 2023-10-16T19:57:05.132 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:05.120+0000 7fdd138e4700 1 -- 172.21.15.157:0/2036755183 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd0c15d460 con 0x7fdd0c1456a0 2023-10-16T19:57:05.132 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:05.121+0000 7fdd138e4700 1 -- 172.21.15.157:0/2036755183 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd0c1f3430 con 0x7fdd0c1456a0 2023-10-16T19:57:05.132 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:05.121+0000 7fdd01ffb700 1 -- 172.21.15.157:0/2036755183 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fdd040127c0 con 0x7fdd0c1456a0 2023-10-16T19:57:05.133 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:05.121+0000 7fdd01ffb700 1 --2- 172.21.15.157:0/2036755183 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fdcf006af00 0x7fdcf006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:05.133 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:05.122+0000 7fdd01ffb700 1 -- 172.21.15.157:0/2036755183 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5227+0+0 (secure 0 0 0) 0x7fdd04089bd0 con 0x7fdd0c1456a0 2023-10-16T19:57:05.133 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:05.122+0000 7fdd11680700 1 --2- 172.21.15.157:0/2036755183 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fdcf006af00 0x7fdcf006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:05.133 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:05.122+0000 7fdd11680700 1 --2- 172.21.15.157:0/2036755183 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fdcf006af00 0x7fdcf006d3c0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fdcfc007fd0 tx=0x7fdcfc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:05.134 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:05.126+0000 7fdd01ffb700 1 -- 172.21.15.157:0/2036755183 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fdd04054e60 con 0x7fdd0c1456a0 2023-10-16T19:57:05.319 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:05.316+0000 7fdd138e4700 1 -- 172.21.15.157:0/2036755183 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fdd0c04f400 con 0x7fdd0c1456a0 2023-10-16T19:57:05.974 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:05.972+0000 7fdd01ffb700 1 -- 172.21.15.157:0/2036755183 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v19) v1 ==== 170+0+0 (secure 0 0 0) 0x7fdd04016070 con 0x7fdd0c1456a0 2023-10-16T19:57:05.977 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:05.975+0000 7fdd138e4700 1 -- 172.21.15.157:0/2036755183 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fdcf006af00 msgr2=0x7fdcf006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:05.978 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:05.975+0000 7fdd138e4700 1 --2- 172.21.15.157:0/2036755183 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fdcf006af00 0x7fdcf006d3c0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fdcfc007fd0 tx=0x7fdcfc009040 comp rx=0 tx=0).stop 2023-10-16T19:57:05.978 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:05.975+0000 7fdd138e4700 1 -- 172.21.15.157:0/2036755183 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdd0c1456a0 msgr2=0x7fdd0c0b06f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:05.978 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:05.975+0000 7fdd138e4700 1 --2- 172.21.15.157:0/2036755183 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdd0c1456a0 0x7fdd0c0b06f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fdd0400cc10 tx=0x7fdd0400a060 comp rx=0 tx=0).stop 2023-10-16T19:57:05.978 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:05.975+0000 7fdd138e4700 1 -- 172.21.15.157:0/2036755183 shutdown_connections 2023-10-16T19:57:05.979 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:05.975+0000 7fdd138e4700 1 --2- 172.21.15.157:0/2036755183 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdd0c1456a0 0x7fdd0c0b06f0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:05.979 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:05.975+0000 7fdd138e4700 1 --2- 172.21.15.157:0/2036755183 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdd0c0b2710 0x7fdd0c0b5a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:05.979 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:05.975+0000 7fdd138e4700 1 --2- 172.21.15.157:0/2036755183 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fdcf006af00 0x7fdcf006d3c0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:05.979 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:05.975+0000 7fdd138e4700 1 --2- 172.21.15.157:0/2036755183 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdd0c0cb0f0 0x7fdd0c15ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:05.980 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:05.975+0000 7fdd138e4700 1 -- 172.21.15.157:0/2036755183 >> 172.21.15.157:0/2036755183 conn(0x7fdd0c0d0b30 msgr2=0x7fdd0c0cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:05.981 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:05.976+0000 7fdd138e4700 1 -- 172.21.15.157:0/2036755183 shutdown_connections 2023-10-16T19:57:05.981 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:05.976+0000 7fdd138e4700 1 -- 172.21.15.157:0/2036755183 wait complete. 2023-10-16T19:57:05.983 INFO:teuthology.orchestra.run.smithi157.stderr:pool 'cephfs_data' created 2023-10-16T19:57:05.998 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-16T19:57:06.122 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:06.119+0000 7f3601036700 1 Processor -- start 2023-10-16T19:57:06.122 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:06.120+0000 7f3601036700 1 -- start start 2023-10-16T19:57:06.124 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:06.120+0000 7f3601036700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f35fc072980 0x7f35fc06d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:06.125 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:06.120+0000 7f3601036700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f35fc0cc540 0x7f35fc06a850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:06.125 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:06.120+0000 7f3601036700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35fc06d8f0 con 0x7f35fc0ca900 2023-10-16T19:57:06.125 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:06.120+0000 7f3601036700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35fc070bd0 con 0x7f35fc0cc540 2023-10-16T19:57:06.125 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:06.120+0000 7f3601036700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35fc0cad90 con 0x7f35fc072980 2023-10-16T19:57:06.125 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:06.120+0000 7f35fb59e700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f35fc0cc540 0x7f35fc06a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:06.126 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:06.120+0000 7f35fb59e700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f35fc0cc540 0x7f35fc06a850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:45538/0 (socket says 172.21.15.157:45538) 2023-10-16T19:57:06.126 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:06.120+0000 7f35fb59e700 1 -- 172.21.15.157:0/4138162561 learned_addr learned my addr 172.21.15.157:0/4138162561 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:57:06.126 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:06.121+0000 7f35fad9d700 1 --2- 172.21.15.157:0/4138162561 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f35fc072980 0x7f35fc06d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:06.126 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:06.121+0000 7f35fb59e700 1 -- 172.21.15.157:0/4138162561 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f35fc072980 msgr2=0x7f35fc06d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:57:06.126 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:06.121+0000 7f35fb59e700 1 --2- 172.21.15.157:0/4138162561 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f35fc072980 0x7f35fc06d3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:06.127 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:06.121+0000 7f35fb59e700 1 -- 172.21.15.157:0/4138162561 >> v1:172.21.15.187:6789/0 conn(0x7f35fc0ca900 legacy=0x7f35fc0cbe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:57:06.127 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:06.121+0000 7f35fb59e700 1 -- 172.21.15.157:0/4138162561 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35fc0cb070 con 0x7f35fc0cc540 2023-10-16T19:57:06.127 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:06.121+0000 7f35fb59e700 1 --2- 172.21.15.157:0/4138162561 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f35fc0cc540 0x7f35fc06a850 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f35f4009e50 tx=0x7f35f400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=991591a4c9c5f144 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:06.127 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:06.121+0000 7f35f9d9b700 1 -- 172.21.15.157:0/4138162561 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35f400e070 con 0x7f35fc0cc540 2023-10-16T19:57:06.127 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:06.121+0000 7f35f9d9b700 1 -- 172.21.15.157:0/4138162561 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35f4003a20 con 0x7f35fc0cc540 2023-10-16T19:57:06.128 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:06.121+0000 7f35f9d9b700 1 -- 172.21.15.157:0/4138162561 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35f4003dd0 con 0x7f35fc0cc540 2023-10-16T19:57:06.128 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:06.121+0000 7f3601036700 1 -- 172.21.15.157:0/4138162561 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f35fc0cc540 msgr2=0x7f35fc06a850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:06.128 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:06.121+0000 7f3601036700 1 --2- 172.21.15.157:0/4138162561 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f35fc0cc540 0x7f35fc06a850 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f35f4009e50 tx=0x7f35f400b330 comp rx=0 tx=0).stop 2023-10-16T19:57:06.128 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:06.121+0000 7f3601036700 1 -- 172.21.15.157:0/4138162561 shutdown_connections 2023-10-16T19:57:06.128 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:06.121+0000 7f3601036700 1 --2- 172.21.15.157:0/4138162561 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f35fc072980 0x7f35fc06d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:06.129 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:06.121+0000 7f3601036700 1 --2- 172.21.15.157:0/4138162561 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f35fc0cc540 0x7f35fc06a850 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:06.129 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:06.122+0000 7f3601036700 1 -- 172.21.15.157:0/4138162561 >> 172.21.15.157:0/4138162561 conn(0x7f35fc06c7e0 msgr2=0x7f35fc06cbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:06.129 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:06.122+0000 7f3601036700 1 -- 172.21.15.157:0/4138162561 shutdown_connections 2023-10-16T19:57:06.129 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:06.122+0000 7f3601036700 1 -- 172.21.15.157:0/4138162561 wait complete. 2023-10-16T19:57:06.133 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:06.123+0000 7f3601036700 1 Processor -- start 2023-10-16T19:57:06.133 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:06.123+0000 7f3601036700 1 -- start start 2023-10-16T19:57:06.133 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:06.124+0000 7f3601036700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f35fc072980 0x7f35fc1f3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:06.133 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:06.124+0000 7f3601036700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f35fc0cc540 0x7f35fc0ce890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:06.133 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:06.124+0000 7f3601036700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f35fc15ec70 0x7f35fc0c4030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:06.134 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:06.124+0000 7f3601036700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35fc0ad900 con 0x7f35fc072980 2023-10-16T19:57:06.134 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:06.124+0000 7f3601036700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35fc1f3b90 con 0x7f35fc15ec70 2023-10-16T19:57:06.134 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:06.124+0000 7f3601036700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35fc0adba0 con 0x7f35fc0cc540 2023-10-16T19:57:06.134 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:06.124+0000 7f35fad9d700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f35fc072980 0x7f35fc1f3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:06.135 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:06.124+0000 7f35fad9d700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f35fc072980 0x7f35fc1f3650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:45540/0 (socket says 172.21.15.157:45540) 2023-10-16T19:57:06.135 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:06.124+0000 7f35fad9d700 1 -- 172.21.15.157:0/2384015421 learned_addr learned my addr 172.21.15.157:0/2384015421 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:57:06.135 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:06.124+0000 7f35fa59c700 1 --2- 172.21.15.157:0/2384015421 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f35fc0cc540 0x7f35fc0ce890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:06.135 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:06.124+0000 7f35fb59e700 1 --2- 172.21.15.157:0/2384015421 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f35fc15ec70 0x7f35fc0c4030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:06.136 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:06.124+0000 7f35fad9d700 1 -- 172.21.15.157:0/2384015421 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f35fc0cc540 msgr2=0x7f35fc0ce890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:06.136 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:06.124+0000 7f35fad9d700 1 --2- 172.21.15.157:0/2384015421 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f35fc0cc540 0x7f35fc0ce890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:06.136 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:06.124+0000 7f35fad9d700 1 -- 172.21.15.157:0/2384015421 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f35fc15ec70 msgr2=0x7f35fc0c4030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:06.136 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:06.124+0000 7f35fad9d700 1 --2- 172.21.15.157:0/2384015421 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f35fc15ec70 0x7f35fc0c4030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:06.137 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:06.124+0000 7f35fad9d700 1 -- 172.21.15.157:0/2384015421 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35f4009b30 con 0x7f35fc072980 2023-10-16T19:57:06.137 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:06.124+0000 7f35fa59c700 1 --2- 172.21.15.157:0/2384015421 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f35fc0cc540 0x7f35fc0ce890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T19:57:06.137 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:06.124+0000 7f35fad9d700 1 --2- 172.21.15.157:0/2384015421 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f35fc072980 0x7f35fc1f3650 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f35f000c7f0 tx=0x7f35f000cb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:06.137 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:06.124+0000 7f35e37fe700 1 -- 172.21.15.157:0/2384015421 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35f0011800 con 0x7f35fc072980 2023-10-16T19:57:06.138 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:06.125+0000 7f35e37fe700 1 -- 172.21.15.157:0/2384015421 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35f0011960 con 0x7f35fc072980 2023-10-16T19:57:06.138 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:06.125+0000 7f3601036700 1 -- 172.21.15.157:0/2384015421 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35fc0ade80 con 0x7f35fc072980 2023-10-16T19:57:06.138 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:06.125+0000 7f35e37fe700 1 -- 172.21.15.157:0/2384015421 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35f0011cd0 con 0x7f35fc072980 2023-10-16T19:57:06.138 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:06.125+0000 7f3601036700 1 -- 172.21.15.157:0/2384015421 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35fc0cf120 con 0x7f35fc072980 2023-10-16T19:57:06.139 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:06.125+0000 7f3601036700 1 -- 172.21.15.157:0/2384015421 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35fc04f400 con 0x7f35fc072980 2023-10-16T19:57:06.139 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:06.126+0000 7f35e37fe700 1 -- 172.21.15.157:0/2384015421 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f35f0010350 con 0x7f35fc072980 2023-10-16T19:57:06.139 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:06.126+0000 7f35e37fe700 1 --2- 172.21.15.157:0/2384015421 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f35e806af00 0x7f35e806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:06.139 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:06.127+0000 7f35e37fe700 1 -- 172.21.15.157:0/2384015421 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f35f0089090 con 0x7f35fc072980 2023-10-16T19:57:06.139 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:06.127+0000 7f35fa59c700 1 --2- 172.21.15.157:0/2384015421 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f35e806af00 0x7f35e806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:06.140 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:06.127+0000 7f35fa59c700 1 --2- 172.21.15.157:0/2384015421 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f35e806af00 0x7f35e806d3c0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f35fc0b49b0 tx=0x7f35ec009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:06.141 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:06.131+0000 7f35e37fe700 1 -- 172.21.15.157:0/2384015421 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f35f00541b0 con 0x7f35fc072980 2023-10-16T19:57:06.365 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:06.362+0000 7f3601036700 1 -- 172.21.15.157:0/2384015421 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f35fc06d350 con 0x7f35fc072980 2023-10-16T19:57:06.913 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T19:57:06.916 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T19:57:06.998 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:06.996+0000 7f35e37fe700 1 -- 172.21.15.157:0/2384015421 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f35f00577d0 con 0x7f35fc072980 2023-10-16T19:57:07.005 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.003+0000 7f3601036700 1 -- 172.21.15.157:0/2384015421 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f35e806af00 msgr2=0x7f35e806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:07.005 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.003+0000 7f3601036700 1 --2- 172.21.15.157:0/2384015421 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f35e806af00 0x7f35e806d3c0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f35fc0b49b0 tx=0x7f35ec009040 comp rx=0 tx=0).stop 2023-10-16T19:57:07.005 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.003+0000 7f3601036700 1 -- 172.21.15.157:0/2384015421 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f35fc072980 msgr2=0x7f35fc1f3650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:07.006 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.003+0000 7f3601036700 1 --2- 172.21.15.157:0/2384015421 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f35fc072980 0x7f35fc1f3650 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f35f000c7f0 tx=0x7f35f000cb00 comp rx=0 tx=0).stop 2023-10-16T19:57:07.007 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.003+0000 7f3601036700 1 -- 172.21.15.157:0/2384015421 shutdown_connections 2023-10-16T19:57:07.007 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.003+0000 7f3601036700 1 --2- 172.21.15.157:0/2384015421 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f35e806af00 0x7f35e806d3c0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:07.008 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.003+0000 7f3601036700 1 --2- 172.21.15.157:0/2384015421 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f35fc15ec70 0x7f35fc0c4030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:07.008 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.003+0000 7f3601036700 1 --2- 172.21.15.157:0/2384015421 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f35fc072980 0x7f35fc1f3650 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:07.008 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.003+0000 7f3601036700 1 --2- 172.21.15.157:0/2384015421 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f35fc0cc540 0x7f35fc0ce890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:07.008 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.003+0000 7f3601036700 1 -- 172.21.15.157:0/2384015421 >> 172.21.15.157:0/2384015421 conn(0x7f35fc06c7e0 msgr2=0x7f35fc06cbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:07.009 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.003+0000 7f3601036700 1 -- 172.21.15.157:0/2384015421 shutdown_connections 2023-10-16T19:57:07.009 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.003+0000 7f3601036700 1 -- 172.21.15.157:0/2384015421 wait complete. 2023-10-16T19:57:07.009 INFO:teuthology.orchestra.run.smithi157.stderr:new fs with metadata pool 2 and data pool 3 2023-10-16T19:57:07.020 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T19:57:07.180 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.177+0000 7f72f9232700 1 Processor -- start 2023-10-16T19:57:07.180 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.177+0000 7f72f9232700 1 -- start start 2023-10-16T19:57:07.183 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.178+0000 7f72f9232700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f72f415e2f0 0x7f72f406d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:07.184 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.178+0000 7f72f9232700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f72f406de00 0x7f72f40ce910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:07.184 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.178+0000 7f72f9232700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f72f406a850 0x7f72f406ace0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:07.184 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.178+0000 7f72f9232700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72f406b220 con 0x7f72f406de00 2023-10-16T19:57:07.185 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.178+0000 7f72f9232700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72f40d08b0 con 0x7f72f415e2f0 2023-10-16T19:57:07.185 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.178+0000 7f72f9232700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72f41628f0 con 0x7f72f406a850 2023-10-16T19:57:07.185 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.178+0000 7f72f259c700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f72f406de00 0x7f72f40ce910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:07.185 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.178+0000 7f72f259c700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f72f406de00 0x7f72f40ce910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:45548/0 (socket says 172.21.15.157:45548) 2023-10-16T19:57:07.185 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.178+0000 7f72f259c700 1 -- 172.21.15.157:0/3584189591 learned_addr learned my addr 172.21.15.157:0/3584189591 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:57:07.186 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.178+0000 7f72f359e700 1 --2- 172.21.15.157:0/3584189591 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f72f406a850 0x7f72f406ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:07.186 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.178+0000 7f72f2d9d700 1 --2- 172.21.15.157:0/3584189591 >> v2:172.21.15.187:3300/0 conn(0x7f72f415e2f0 0x7f72f406d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:07.186 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.178+0000 7f72f259c700 1 -- 172.21.15.157:0/3584189591 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f72f406a850 msgr2=0x7f72f406ace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:57:07.186 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.178+0000 7f72f259c700 1 --2- 172.21.15.157:0/3584189591 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f72f406a850 0x7f72f406ace0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:07.187 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.178+0000 7f72f259c700 1 -- 172.21.15.157:0/3584189591 >> v2:172.21.15.187:3300/0 conn(0x7f72f415e2f0 msgr2=0x7f72f406d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:57:07.187 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.178+0000 7f72f259c700 1 --2- 172.21.15.157:0/3584189591 >> v2:172.21.15.187:3300/0 conn(0x7f72f415e2f0 0x7f72f406d0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:07.187 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.178+0000 7f72f259c700 1 -- 172.21.15.157:0/3584189591 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72f4162bd0 con 0x7f72f406de00 2023-10-16T19:57:07.187 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.178+0000 7f72f2d9d700 1 --2- 172.21.15.157:0/3584189591 >> v2:172.21.15.187:3300/0 conn(0x7f72f415e2f0 0x7f72f406d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T19:57:07.187 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.179+0000 7f72f259c700 1 --2- 172.21.15.157:0/3584189591 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f72f406de00 0x7f72f40ce910 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f72f40d1ad0 tx=0x7f72e4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66004bcfa2e2c95a server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:07.188 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.179+0000 7f72f1d9b700 1 -- 172.21.15.157:0/3584189591 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72e400b870 con 0x7f72f406de00 2023-10-16T19:57:07.188 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.179+0000 7f72f1d9b700 1 -- 172.21.15.157:0/3584189591 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72e400b9d0 con 0x7f72f406de00 2023-10-16T19:57:07.188 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.179+0000 7f72f1d9b700 1 -- 172.21.15.157:0/3584189591 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72e400bd60 con 0x7f72f406de00 2023-10-16T19:57:07.189 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.179+0000 7f72f9232700 1 -- 172.21.15.157:0/3584189591 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f72f406de00 msgr2=0x7f72f40ce910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:07.189 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.179+0000 7f72f9232700 1 --2- 172.21.15.157:0/3584189591 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f72f406de00 0x7f72f40ce910 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f72f40d1ad0 tx=0x7f72e4009bd0 comp rx=0 tx=0).stop 2023-10-16T19:57:07.189 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.179+0000 7f72f9232700 1 -- 172.21.15.157:0/3584189591 shutdown_connections 2023-10-16T19:57:07.189 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.179+0000 7f72f9232700 1 --2- 172.21.15.157:0/3584189591 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f72f406a850 0x7f72f406ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:07.190 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.179+0000 7f72f9232700 1 --2- 172.21.15.157:0/3584189591 >> v2:172.21.15.187:3300/0 conn(0x7f72f415e2f0 0x7f72f406d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:07.190 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.179+0000 7f72f9232700 1 --2- 172.21.15.157:0/3584189591 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f72f406de00 0x7f72f40ce910 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:07.190 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.179+0000 7f72f9232700 1 -- 172.21.15.157:0/3584189591 >> 172.21.15.157:0/3584189591 conn(0x7f72f40cd4e0 msgr2=0x7f72f40cd8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:07.190 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.179+0000 7f72f9232700 1 -- 172.21.15.157:0/3584189591 shutdown_connections 2023-10-16T19:57:07.191 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.179+0000 7f72f9232700 1 -- 172.21.15.157:0/3584189591 wait complete. 2023-10-16T19:57:07.191 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.181+0000 7f72f9232700 1 Processor -- start 2023-10-16T19:57:07.191 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.181+0000 7f72f9232700 1 -- start start 2023-10-16T19:57:07.196 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.182+0000 7f72f9232700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f72f406a850 0x7f72f4157520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:07.197 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.182+0000 7f72f9232700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f72f406de00 0x7f72f40b5c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:07.197 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.182+0000 7f72f9232700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f72f415e2f0 0x7f72f40b6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:07.197 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.182+0000 7f72f9232700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72f415b8e0 con 0x7f72f415e2f0 2023-10-16T19:57:07.198 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.182+0000 7f72f9232700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72f40c67a0 con 0x7f72f406a850 2023-10-16T19:57:07.198 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.182+0000 7f72f9232700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72f40c6a80 con 0x7f72f406de00 2023-10-16T19:57:07.199 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.182+0000 7f72f359e700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f72f415e2f0 0x7f72f40b6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:07.199 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.182+0000 7f72f359e700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f72f415e2f0 0x7f72f40b6180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:45556/0 (socket says 172.21.15.157:45556) 2023-10-16T19:57:07.199 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.182+0000 7f72f359e700 1 -- 172.21.15.157:0/3354196108 learned_addr learned my addr 172.21.15.157:0/3354196108 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:57:07.200 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.182+0000 7f72f259c700 1 --2- 172.21.15.157:0/3354196108 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f72f406de00 0x7f72f40b5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:07.200 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.182+0000 7f72f2d9d700 1 --2- 172.21.15.157:0/3354196108 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f72f406a850 0x7f72f4157520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:07.200 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.183+0000 7f72f359e700 1 -- 172.21.15.157:0/3354196108 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f72f406de00 msgr2=0x7f72f40b5c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:07.200 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.183+0000 7f72f359e700 1 --2- 172.21.15.157:0/3354196108 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f72f406de00 0x7f72f40b5c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:07.201 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.183+0000 7f72f359e700 1 -- 172.21.15.157:0/3354196108 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f72f406a850 msgr2=0x7f72f4157520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:07.201 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.183+0000 7f72f359e700 1 --2- 172.21.15.157:0/3354196108 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f72f406a850 0x7f72f4157520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:07.202 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.183+0000 7f72f359e700 1 -- 172.21.15.157:0/3354196108 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72e4009550 con 0x7f72f415e2f0 2023-10-16T19:57:07.202 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.183+0000 7f72f359e700 1 --2- 172.21.15.157:0/3354196108 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f72f415e2f0 0x7f72f40b6180 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f72ec00cb80 tx=0x7f72ec00cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:07.203 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.183+0000 7f72db7fe700 1 -- 172.21.15.157:0/3354196108 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72ec00a8e0 con 0x7f72f415e2f0 2023-10-16T19:57:07.203 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.183+0000 7f72db7fe700 1 -- 172.21.15.157:0/3354196108 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72ec00aa40 con 0x7f72f415e2f0 2023-10-16T19:57:07.203 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.183+0000 7f72f9232700 1 -- 172.21.15.157:0/3354196108 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72f40c6d60 con 0x7f72f415e2f0 2023-10-16T19:57:07.204 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.183+0000 7f72db7fe700 1 -- 172.21.15.157:0/3354196108 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72ec00ae30 con 0x7f72f415e2f0 2023-10-16T19:57:07.204 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.183+0000 7f72f9232700 1 -- 172.21.15.157:0/3354196108 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72f40c62e0 con 0x7f72f415e2f0 2023-10-16T19:57:07.204 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.184+0000 7f72f9232700 1 -- 172.21.15.157:0/3354196108 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72f40c6530 con 0x7f72f415e2f0 2023-10-16T19:57:07.205 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.184+0000 7f72db7fe700 1 -- 172.21.15.157:0/3354196108 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f72ec003a70 con 0x7f72f415e2f0 2023-10-16T19:57:07.205 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.185+0000 7f72db7fe700 1 --2- 172.21.15.157:0/3354196108 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f72e006af00 0x7f72e006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:07.206 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.185+0000 7f72db7fe700 1 -- 172.21.15.157:0/3354196108 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f72ec089550 con 0x7f72f415e2f0 2023-10-16T19:57:07.206 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.185+0000 7f72f2d9d700 1 --2- 172.21.15.157:0/3354196108 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f72e006af00 0x7f72e006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:07.206 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.185+0000 7f72f2d9d700 1 --2- 172.21.15.157:0/3354196108 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f72e006af00 0x7f72e006d3c0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f72e8006fd0 tx=0x7f72e8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:07.207 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.189+0000 7f72db7fe700 1 -- 172.21.15.157:0/3354196108 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f72ec054690 con 0x7f72f415e2f0 2023-10-16T19:57:07.382 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.379+0000 7f72f9232700 1 -- 172.21.15.157:0/3354196108 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f72f404f400 con 0x7f72f415e2f0 2023-10-16T19:57:07.383 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.380+0000 7f72db7fe700 1 -- 172.21.15.157:0/3354196108 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16530 (secure 0 0 0) 0x7f72ec057cb0 con 0x7f72f415e2f0 2023-10-16T19:57:07.384 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-10-16T19:57:07.384 INFO:teuthology.orchestra.run.smithi157.stdout:{"epoch":20,"fsid":"28199dc9-64d5-479e-83c6-21f097c33d39","created":"2023-10-16T19:56:49.201889+0000","modified":"2023-10-16T19:57:06.364316+0000","last_up_change":"2023-10-16T19:56:54.675673+0000","last_in_change":"2023-10-16T19:56:51.666728+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T19:56:56.932895+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-16T19:57:04.936105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-16T19:57:05.335279+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":335785898},{"type":"v1","addr":"172.21.15.157:6809","nonce":335785898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":335785898},{"type":"v1","addr":"172.21.15.157:6811","nonce":335785898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6815","nonce":335785898},{"type":"v1","addr":"172.21.15.157:6817","nonce":335785898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":335785898},{"type":"v1","addr":"172.21.15.157:6813","nonce":335785898}]},"public_addr":"172.21.15.157:6809/335785898","cluster_addr":"172.21.15.157:6811/335785898","heartbeat_back_addr":"172.21.15.157:6817/335785898","heartbeat_front_addr":"172.21.15.157:6813/335785898","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":3482825047},{"type":"v1","addr":"172.21.15.157:6801","nonce":3482825047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":3482825047},{"type":"v1","addr":"172.21.15.157:6803","nonce":3482825047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":3482825047},{"type":"v1","addr":"172.21.15.157:6807","nonce":3482825047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":3482825047},{"type":"v1","addr":"172.21.15.157:6805","nonce":3482825047}]},"public_addr":"172.21.15.157:6801/3482825047","cluster_addr":"172.21.15.157:6803/3482825047","heartbeat_back_addr":"172.21.15.157:6807/3482825047","heartbeat_front_addr":"172.21.15.157:6805/3482825047","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":1118292389},{"type":"v1","addr":"172.21.15.157:6825","nonce":1118292389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":1118292389},{"type":"v1","addr":"172.21.15.157:6827","nonce":1118292389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":1118292389},{"type":"v1","addr":"172.21.15.157:6831","nonce":1118292389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":1118292389},{"type":"v1","addr":"172.21.15.157:6829","nonce":1118292389}]},"public_addr":"172.21.15.157:6825/1118292389","cluster_addr":"172.21.15.157:6827/1118292389","heartbeat_back_addr":"172.21.15.157:6831/1118292389","heartbeat_front_addr":"172.21.15.157:6829/1118292389","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":989329821},{"type":"v1","addr":"172.21.15.157:6816","nonce":989329821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":989329821},{"type":"v1","addr":"172.21.15.157:6819","nonce":989329821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":989329821},{"type":"v1","addr":"172.21.15.157:6823","nonce":989329821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":989329821},{"type":"v1","addr":"172.21.15.157:6821","nonce":989329821}]},"public_addr":"172.21.15.157:6816/989329821","cluster_addr":"172.21.15.157:6819/989329821","heartbeat_back_addr":"172.21.15.157:6823/989329821","heartbeat_front_addr":"172.21.15.157:6821/989329821","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":3841016811},{"type":"v1","addr":"172.21.15.187:6801","nonce":3841016811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6803","nonce":3841016811},{"type":"v1","addr":"172.21.15.187:6804","nonce":3841016811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6809","nonce":3841016811},{"type":"v1","addr":"172.21.15.187:6811","nonce":3841016811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":3841016811},{"type":"v1","addr":"172.21.15.187:6808","nonce":3841016811}]},"public_addr":"172.21.15.187:6801/3841016811","cluster_addr":"172.21.15.187:6804/3841016811","heartbeat_back_addr":"172.21.15.187:6811/3841016811","heartbeat_front_addr":"172.21.15.187:6808/3841016811","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":915130263},{"type":"v1","addr":"172.21.15.187:6805","nonce":915130263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6807","nonce":915130263},{"type":"v1","addr":"172.21.15.187:6810","nonce":915130263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":915130263},{"type":"v1","addr":"172.21.15.187:6815","nonce":915130263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":915130263},{"type":"v1","addr":"172.21.15.187:6813","nonce":915130263}]},"public_addr":"172.21.15.187:6805/915130263","cluster_addr":"172.21.15.187:6810/915130263","heartbeat_back_addr":"172.21.15.187:6815/915130263","heartbeat_front_addr":"172.21.15.187:6813/915130263","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":654976824},{"type":"v1","addr":"172.21.15.187:6817","nonce":654976824}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":654976824},{"type":"v1","addr":"172.21.15.187:6819","nonce":654976824}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":654976824},{"type":"v1","addr":"172.21.15.187:6823","nonce":654976824}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":654976824},{"type":"v1","addr":"172.21.15.187:6821","nonce":654976824}]},"public_addr":"172.21.15.187:6817/654976824","cluster_addr":"172.21.15.187:6819/654976824","heartbeat_back_addr":"172.21.15.187:6823/654976824","heartbeat_front_addr":"172.21.15.187:6821/654976824","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":4284059445},{"type":"v1","addr":"172.21.15.187:6825","nonce":4284059445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":4284059445},{"type":"v1","addr":"172.21.15.187:6827","nonce":4284059445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":4284059445},{"type":"v1","addr":"172.21.15.187:6831","nonce":4284059445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":4284059445},{"type":"v1","addr":"172.21.15.187:6829","nonce":4284059445}]},"public_addr":"172.21.15.187:6825/4284059445","cluster_addr":"172.21.15.187:6827/4284059445","heartbeat_back_addr":"172.21.15.187:6831/4284059445","heartbeat_front_addr":"172.21.15.187:6829/4284059445","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.819780+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.824193+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.849575+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.824806+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.809540+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.805093+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.866109+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.807372+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T19:57:07.386 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.382+0000 7f72f9232700 1 -- 172.21.15.157:0/3354196108 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f72e006af00 msgr2=0x7f72e006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:07.387 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.383+0000 7f72f9232700 1 --2- 172.21.15.157:0/3354196108 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f72e006af00 0x7f72e006d3c0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f72e8006fd0 tx=0x7f72e8008040 comp rx=0 tx=0).stop 2023-10-16T19:57:07.387 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.383+0000 7f72f9232700 1 -- 172.21.15.157:0/3354196108 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f72f415e2f0 msgr2=0x7f72f40b6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:07.387 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.383+0000 7f72f9232700 1 --2- 172.21.15.157:0/3354196108 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f72f415e2f0 0x7f72f40b6180 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f72ec00cb80 tx=0x7f72ec00cf40 comp rx=0 tx=0).stop 2023-10-16T19:57:07.388 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.383+0000 7f72f9232700 1 -- 172.21.15.157:0/3354196108 shutdown_connections 2023-10-16T19:57:07.388 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.383+0000 7f72f9232700 1 --2- 172.21.15.157:0/3354196108 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f72e006af00 0x7f72e006d3c0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:07.389 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.383+0000 7f72f9232700 1 --2- 172.21.15.157:0/3354196108 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f72f406a850 0x7f72f4157520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:07.389 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.383+0000 7f72f9232700 1 --2- 172.21.15.157:0/3354196108 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f72f415e2f0 0x7f72f40b6180 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:07.389 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.383+0000 7f72f9232700 1 --2- 172.21.15.157:0/3354196108 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f72f406de00 0x7f72f40b5c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:07.390 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.383+0000 7f72f9232700 1 -- 172.21.15.157:0/3354196108 >> 172.21.15.157:0/3354196108 conn(0x7f72f40cd4e0 msgr2=0x7f72f40afaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:07.390 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.383+0000 7f72f9232700 1 -- 172.21.15.157:0/3354196108 shutdown_connections 2023-10-16T19:57:07.390 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.383+0000 7f72f9232700 1 -- 172.21.15.157:0/3354196108 wait complete. 2023-10-16T19:57:07.398 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T19:57:07.518 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.516+0000 7ff876ae7700 1 Processor -- start 2023-10-16T19:57:07.519 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.516+0000 7ff876ae7700 1 -- start start 2023-10-16T19:57:07.522 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.517+0000 7ff876ae7700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7ff87015bf50 0x7ff8700cef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:07.522 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.517+0000 7ff876ae7700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff8700b76e0 0x7ff8700cd870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:07.522 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.517+0000 7ff876ae7700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8700cf920 con 0x7ff8700cddb0 2023-10-16T19:57:07.522 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.517+0000 7ff876ae7700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8700cc4b0 con 0x7ff87015bf50 2023-10-16T19:57:07.523 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.517+0000 7ff876ae7700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8700cfc00 con 0x7ff8700b76e0 2023-10-16T19:57:07.523 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.517+0000 7ff874883700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7ff87015bf50 0x7ff8700cef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:07.523 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.517+0000 7ff874883700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7ff87015bf50 0x7ff8700cef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:45560/0 (socket says 172.21.15.157:45560) 2023-10-16T19:57:07.523 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.517+0000 7ff874883700 1 -- 172.21.15.157:0/1956139346 learned_addr learned my addr 172.21.15.157:0/1956139346 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:57:07.524 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.517+0000 7ff86ffff700 1 --2- 172.21.15.157:0/1956139346 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff8700b76e0 0x7ff8700cd870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:07.524 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.517+0000 7ff874883700 1 -- 172.21.15.157:0/1956139346 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff8700b76e0 msgr2=0x7ff8700cd870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:57:07.524 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.517+0000 7ff874883700 1 --2- 172.21.15.157:0/1956139346 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff8700b76e0 0x7ff8700cd870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:07.524 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.517+0000 7ff874883700 1 -- 172.21.15.157:0/1956139346 >> v1:172.21.15.187:6789/0 conn(0x7ff8700cddb0 legacy=0x7ff87015f8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:07.525 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.517+0000 7ff874883700 1 -- 172.21.15.157:0/1956139346 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8700cfee0 con 0x7ff87015bf50 2023-10-16T19:57:07.525 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.517+0000 7ff86ffff700 1 --2- 172.21.15.157:0/1956139346 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff8700b76e0 0x7ff8700cd870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T19:57:07.525 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.517+0000 7ff874883700 1 --2- 172.21.15.157:0/1956139346 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff87015bf50 0x7ff8700cef80 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff8640098f0 tx=0x7ff864009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de5d70ed97cfe361 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:07.526 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.517+0000 7ff86f7fe700 1 -- 172.21.15.157:0/1956139346 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff86400b8a0 con 0x7ff87015bf50 2023-10-16T19:57:07.526 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.517+0000 7ff86f7fe700 1 -- 172.21.15.157:0/1956139346 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff86400ba00 con 0x7ff87015bf50 2023-10-16T19:57:07.526 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.517+0000 7ff86f7fe700 1 -- 172.21.15.157:0/1956139346 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff86400bd90 con 0x7ff87015bf50 2023-10-16T19:57:07.527 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.518+0000 7ff876ae7700 1 -- 172.21.15.157:0/1956139346 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff87015bf50 msgr2=0x7ff8700cef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:07.527 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.518+0000 7ff876ae7700 1 --2- 172.21.15.157:0/1956139346 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff87015bf50 0x7ff8700cef80 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff8640098f0 tx=0x7ff864009c00 comp rx=0 tx=0).stop 2023-10-16T19:57:07.527 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.518+0000 7ff876ae7700 1 -- 172.21.15.157:0/1956139346 shutdown_connections 2023-10-16T19:57:07.527 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.518+0000 7ff876ae7700 1 --2- 172.21.15.157:0/1956139346 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff87015bf50 0x7ff8700cef80 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:07.528 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.518+0000 7ff876ae7700 1 --2- 172.21.15.157:0/1956139346 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff8700b76e0 0x7ff8700cd870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:07.528 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.518+0000 7ff876ae7700 1 -- 172.21.15.157:0/1956139346 >> 172.21.15.157:0/1956139346 conn(0x7ff87006e300 msgr2=0x7ff87006e6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:07.528 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.518+0000 7ff876ae7700 1 -- 172.21.15.157:0/1956139346 shutdown_connections 2023-10-16T19:57:07.528 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.518+0000 7ff876ae7700 1 -- 172.21.15.157:0/1956139346 wait complete. 2023-10-16T19:57:07.529 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.519+0000 7ff876ae7700 1 Processor -- start 2023-10-16T19:57:07.529 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.519+0000 7ff876ae7700 1 -- start start 2023-10-16T19:57:07.532 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.520+0000 7ff876ae7700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff8700b76e0 0x7ff8700b56c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:07.532 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.520+0000 7ff876ae7700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff8700cddb0 0x7ff8701567d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:07.532 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.520+0000 7ff876ae7700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff87015bf50 0x7ff87015cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:07.533 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.520+0000 7ff876ae7700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8700b68b0 con 0x7ff8700b76e0 2023-10-16T19:57:07.533 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.520+0000 7ff876ae7700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8700b5ca0 con 0x7ff8700cddb0 2023-10-16T19:57:07.533 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.520+0000 7ff876ae7700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8700b5f80 con 0x7ff87015bf50 2023-10-16T19:57:07.533 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.520+0000 7ff874883700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff8700b76e0 0x7ff8700b56c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:07.533 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.520+0000 7ff874883700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff8700b76e0 0x7ff8700b56c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:45566/0 (socket says 172.21.15.157:45566) 2023-10-16T19:57:07.534 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.520+0000 7ff874883700 1 -- 172.21.15.157:0/559241397 learned_addr learned my addr 172.21.15.157:0/559241397 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:57:07.534 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.520+0000 7ff875084700 1 --2- 172.21.15.157:0/559241397 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff87015bf50 0x7ff87015cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:07.534 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.520+0000 7ff86ffff700 1 --2- 172.21.15.157:0/559241397 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff8700cddb0 0x7ff8701567d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:07.534 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.520+0000 7ff874883700 1 -- 172.21.15.157:0/559241397 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff87015bf50 msgr2=0x7ff87015cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:07.534 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.520+0000 7ff874883700 1 --2- 172.21.15.157:0/559241397 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff87015bf50 0x7ff87015cc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:07.535 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.520+0000 7ff874883700 1 -- 172.21.15.157:0/559241397 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff8700cddb0 msgr2=0x7ff8701567d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:07.535 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.520+0000 7ff874883700 1 --2- 172.21.15.157:0/559241397 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff8700cddb0 0x7ff8701567d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:07.535 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.520+0000 7ff874883700 1 -- 172.21.15.157:0/559241397 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff864009550 con 0x7ff8700b76e0 2023-10-16T19:57:07.535 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.520+0000 7ff86ffff700 1 --2- 172.21.15.157:0/559241397 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff8700cddb0 0x7ff8701567d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T19:57:07.535 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.521+0000 7ff874883700 1 --2- 172.21.15.157:0/559241397 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff8700b76e0 0x7ff8700b56c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff864009c40 tx=0x7ff864004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:07.536 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.521+0000 7ff86d7fa700 1 -- 172.21.15.157:0/559241397 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8640036a0 con 0x7ff8700b76e0 2023-10-16T19:57:07.536 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.521+0000 7ff86d7fa700 1 -- 172.21.15.157:0/559241397 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff86401e070 con 0x7ff8700b76e0 2023-10-16T19:57:07.536 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.521+0000 7ff876ae7700 1 -- 172.21.15.157:0/559241397 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8700b6260 con 0x7ff8700b76e0 2023-10-16T19:57:07.536 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.521+0000 7ff86d7fa700 1 -- 172.21.15.157:0/559241397 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff864003a40 con 0x7ff8700b76e0 2023-10-16T19:57:07.536 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.521+0000 7ff876ae7700 1 -- 172.21.15.157:0/559241397 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff870156d10 con 0x7ff8700b76e0 2023-10-16T19:57:07.537 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.522+0000 7ff876ae7700 1 -- 172.21.15.157:0/559241397 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff87004f400 con 0x7ff8700b76e0 2023-10-16T19:57:07.537 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.522+0000 7ff86d7fa700 1 -- 172.21.15.157:0/559241397 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7ff864003ba0 con 0x7ff8700b76e0 2023-10-16T19:57:07.537 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.522+0000 7ff86d7fa700 1 --2- 172.21.15.157:0/559241397 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7ff85406af00 0x7ff85406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:07.537 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.522+0000 7ff86d7fa700 1 -- 172.21.15.157:0/559241397 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff864020070 con 0x7ff8700b76e0 2023-10-16T19:57:07.537 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.523+0000 7ff86ffff700 1 --2- 172.21.15.157:0/559241397 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7ff85406af00 0x7ff85406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:07.538 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.523+0000 7ff86ffff700 1 --2- 172.21.15.157:0/559241397 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7ff85406af00 0x7ff85406d3c0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7ff8700cbda0 tx=0x7ff85c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:07.538 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.527+0000 7ff86d7fa700 1 -- 172.21.15.157:0/559241397 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff864055c70 con 0x7ff8700b76e0 2023-10-16T19:57:07.721 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.719+0000 7ff876ae7700 1 -- 172.21.15.157:0/559241397 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff870159300 con 0x7ff8700b76e0 2023-10-16T19:57:07.722 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.720+0000 7ff86d7fa700 1 -- 172.21.15.157:0/559241397 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16530 (secure 0 0 0) 0x7ff864059290 con 0x7ff8700b76e0 2023-10-16T19:57:07.723 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-10-16T19:57:07.723 INFO:teuthology.orchestra.run.smithi157.stdout:{"epoch":20,"fsid":"28199dc9-64d5-479e-83c6-21f097c33d39","created":"2023-10-16T19:56:49.201889+0000","modified":"2023-10-16T19:57:06.364316+0000","last_up_change":"2023-10-16T19:56:54.675673+0000","last_in_change":"2023-10-16T19:56:51.666728+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T19:56:56.932895+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-16T19:57:04.936105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-16T19:57:05.335279+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":335785898},{"type":"v1","addr":"172.21.15.157:6809","nonce":335785898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":335785898},{"type":"v1","addr":"172.21.15.157:6811","nonce":335785898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6815","nonce":335785898},{"type":"v1","addr":"172.21.15.157:6817","nonce":335785898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":335785898},{"type":"v1","addr":"172.21.15.157:6813","nonce":335785898}]},"public_addr":"172.21.15.157:6809/335785898","cluster_addr":"172.21.15.157:6811/335785898","heartbeat_back_addr":"172.21.15.157:6817/335785898","heartbeat_front_addr":"172.21.15.157:6813/335785898","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":3482825047},{"type":"v1","addr":"172.21.15.157:6801","nonce":3482825047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":3482825047},{"type":"v1","addr":"172.21.15.157:6803","nonce":3482825047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":3482825047},{"type":"v1","addr":"172.21.15.157:6807","nonce":3482825047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":3482825047},{"type":"v1","addr":"172.21.15.157:6805","nonce":3482825047}]},"public_addr":"172.21.15.157:6801/3482825047","cluster_addr":"172.21.15.157:6803/3482825047","heartbeat_back_addr":"172.21.15.157:6807/3482825047","heartbeat_front_addr":"172.21.15.157:6805/3482825047","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":1118292389},{"type":"v1","addr":"172.21.15.157:6825","nonce":1118292389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":1118292389},{"type":"v1","addr":"172.21.15.157:6827","nonce":1118292389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":1118292389},{"type":"v1","addr":"172.21.15.157:6831","nonce":1118292389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":1118292389},{"type":"v1","addr":"172.21.15.157:6829","nonce":1118292389}]},"public_addr":"172.21.15.157:6825/1118292389","cluster_addr":"172.21.15.157:6827/1118292389","heartbeat_back_addr":"172.21.15.157:6831/1118292389","heartbeat_front_addr":"172.21.15.157:6829/1118292389","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":989329821},{"type":"v1","addr":"172.21.15.157:6816","nonce":989329821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":989329821},{"type":"v1","addr":"172.21.15.157:6819","nonce":989329821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":989329821},{"type":"v1","addr":"172.21.15.157:6823","nonce":989329821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":989329821},{"type":"v1","addr":"172.21.15.157:6821","nonce":989329821}]},"public_addr":"172.21.15.157:6816/989329821","cluster_addr":"172.21.15.157:6819/989329821","heartbeat_back_addr":"172.21.15.157:6823/989329821","heartbeat_front_addr":"172.21.15.157:6821/989329821","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":3841016811},{"type":"v1","addr":"172.21.15.187:6801","nonce":3841016811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6803","nonce":3841016811},{"type":"v1","addr":"172.21.15.187:6804","nonce":3841016811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6809","nonce":3841016811},{"type":"v1","addr":"172.21.15.187:6811","nonce":3841016811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":3841016811},{"type":"v1","addr":"172.21.15.187:6808","nonce":3841016811}]},"public_addr":"172.21.15.187:6801/3841016811","cluster_addr":"172.21.15.187:6804/3841016811","heartbeat_back_addr":"172.21.15.187:6811/3841016811","heartbeat_front_addr":"172.21.15.187:6808/3841016811","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":915130263},{"type":"v1","addr":"172.21.15.187:6805","nonce":915130263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6807","nonce":915130263},{"type":"v1","addr":"172.21.15.187:6810","nonce":915130263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":915130263},{"type":"v1","addr":"172.21.15.187:6815","nonce":915130263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":915130263},{"type":"v1","addr":"172.21.15.187:6813","nonce":915130263}]},"public_addr":"172.21.15.187:6805/915130263","cluster_addr":"172.21.15.187:6810/915130263","heartbeat_back_addr":"172.21.15.187:6815/915130263","heartbeat_front_addr":"172.21.15.187:6813/915130263","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":654976824},{"type":"v1","addr":"172.21.15.187:6817","nonce":654976824}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":654976824},{"type":"v1","addr":"172.21.15.187:6819","nonce":654976824}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":654976824},{"type":"v1","addr":"172.21.15.187:6823","nonce":654976824}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":654976824},{"type":"v1","addr":"172.21.15.187:6821","nonce":654976824}]},"public_addr":"172.21.15.187:6817/654976824","cluster_addr":"172.21.15.187:6819/654976824","heartbeat_back_addr":"172.21.15.187:6823/654976824","heartbeat_front_addr":"172.21.15.187:6821/654976824","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":4284059445},{"type":"v1","addr":"172.21.15.187:6825","nonce":4284059445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":4284059445},{"type":"v1","addr":"172.21.15.187:6827","nonce":4284059445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":4284059445},{"type":"v1","addr":"172.21.15.187:6831","nonce":4284059445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":4284059445},{"type":"v1","addr":"172.21.15.187:6829","nonce":4284059445}]},"public_addr":"172.21.15.187:6825/4284059445","cluster_addr":"172.21.15.187:6827/4284059445","heartbeat_back_addr":"172.21.15.187:6831/4284059445","heartbeat_front_addr":"172.21.15.187:6829/4284059445","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.819780+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.824193+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.849575+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.824806+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.809540+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.805093+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.866109+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.807372+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T19:57:07.725 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.722+0000 7ff876ae7700 1 -- 172.21.15.157:0/559241397 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7ff85406af00 msgr2=0x7ff85406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:07.725 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.722+0000 7ff876ae7700 1 --2- 172.21.15.157:0/559241397 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7ff85406af00 0x7ff85406d3c0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7ff8700cbda0 tx=0x7ff85c008040 comp rx=0 tx=0).stop 2023-10-16T19:57:07.726 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.722+0000 7ff876ae7700 1 -- 172.21.15.157:0/559241397 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff8700b76e0 msgr2=0x7ff8700b56c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:07.726 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.722+0000 7ff876ae7700 1 --2- 172.21.15.157:0/559241397 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff8700b76e0 0x7ff8700b56c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff864009c40 tx=0x7ff864004750 comp rx=0 tx=0).stop 2023-10-16T19:57:07.726 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.722+0000 7ff876ae7700 1 -- 172.21.15.157:0/559241397 shutdown_connections 2023-10-16T19:57:07.727 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.722+0000 7ff876ae7700 1 --2- 172.21.15.157:0/559241397 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff87015bf50 0x7ff87015cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:07.727 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.722+0000 7ff876ae7700 1 --2- 172.21.15.157:0/559241397 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff8700b76e0 0x7ff8700b56c0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:07.727 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.722+0000 7ff876ae7700 1 --2- 172.21.15.157:0/559241397 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7ff85406af00 0x7ff85406d3c0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:07.727 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.722+0000 7ff876ae7700 1 --2- 172.21.15.157:0/559241397 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff8700cddb0 0x7ff8701567d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:07.727 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.722+0000 7ff876ae7700 1 -- 172.21.15.157:0/559241397 >> 172.21.15.157:0/559241397 conn(0x7ff87006e300 msgr2=0x7ff8700b2700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:07.728 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.722+0000 7ff876ae7700 1 -- 172.21.15.157:0/559241397 shutdown_connections 2023-10-16T19:57:07.728 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.722+0000 7ff876ae7700 1 -- 172.21.15.157:0/559241397 wait complete. 2023-10-16T19:57:07.737 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-16T19:57:07.860 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.858+0000 7fafc25cf700 1 Processor -- start 2023-10-16T19:57:07.861 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.858+0000 7fafc25cf700 1 -- start start 2023-10-16T19:57:07.863 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.859+0000 7fafc25cf700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fafbc06b160 0x7fafbc0afa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:07.863 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.859+0000 7fafc25cf700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fafbc0affc0 0x7fafbc15e470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:07.864 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.859+0000 7fafc25cf700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafbc072320 con 0x7fafbc15e090 2023-10-16T19:57:07.864 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.859+0000 7fafc25cf700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafbc071b50 con 0x7fafbc06b160 2023-10-16T19:57:07.864 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.859+0000 7fafc25cf700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafbc0b03d0 con 0x7fafbc0affc0 2023-10-16T19:57:07.864 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.859+0000 7fafbb7fe700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fafbc06b160 0x7fafbc0afa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:07.864 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.859+0000 7fafbb7fe700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fafbc06b160 0x7fafbc0afa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:45576/0 (socket says 172.21.15.157:45576) 2023-10-16T19:57:07.865 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.859+0000 7fafbb7fe700 1 -- 172.21.15.157:0/2456777206 learned_addr learned my addr 172.21.15.157:0/2456777206 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:57:07.865 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.859+0000 7fafc0b6c700 1 --2- 172.21.15.157:0/2456777206 >> v2:172.21.15.187:3300/0 conn(0x7fafbc0affc0 0x7fafbc15e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:07.865 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.859+0000 7fafbb7fe700 1 -- 172.21.15.157:0/2456777206 >> v2:172.21.15.187:3300/0 conn(0x7fafbc0affc0 msgr2=0x7fafbc15e470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:57:07.865 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.859+0000 7fafbb7fe700 1 --2- 172.21.15.157:0/2456777206 >> v2:172.21.15.187:3300/0 conn(0x7fafbc0affc0 0x7fafbc15e470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:07.865 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.859+0000 7fafbb7fe700 1 -- 172.21.15.157:0/2456777206 >> v1:172.21.15.187:6789/0 conn(0x7fafbc15e090 legacy=0x7fafbc06ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:07.866 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.859+0000 7fafbb7fe700 1 -- 172.21.15.157:0/2456777206 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafbc071d60 con 0x7fafbc06b160 2023-10-16T19:57:07.866 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.859+0000 7fafbb7fe700 1 --2- 172.21.15.157:0/2456777206 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fafbc06b160 0x7fafbc0afa80 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fafbc161a20 tx=0x7fafa4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79d899b60f4655d6 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:07.866 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.860+0000 7fafbaffd700 1 -- 172.21.15.157:0/2456777206 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafa4011830 con 0x7fafbc06b160 2023-10-16T19:57:07.866 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.860+0000 7fafbaffd700 1 -- 172.21.15.157:0/2456777206 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafa4011990 con 0x7fafbc06b160 2023-10-16T19:57:07.867 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.860+0000 7fafbaffd700 1 -- 172.21.15.157:0/2456777206 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafa4011d20 con 0x7fafbc06b160 2023-10-16T19:57:07.867 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.860+0000 7fafc25cf700 1 -- 172.21.15.157:0/2456777206 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fafbc06b160 msgr2=0x7fafbc0afa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:07.867 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.860+0000 7fafc25cf700 1 --2- 172.21.15.157:0/2456777206 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fafbc06b160 0x7fafbc0afa80 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fafbc161a20 tx=0x7fafa4009bd0 comp rx=0 tx=0).stop 2023-10-16T19:57:07.867 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.860+0000 7fafc25cf700 1 -- 172.21.15.157:0/2456777206 shutdown_connections 2023-10-16T19:57:07.867 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.860+0000 7fafc25cf700 1 --2- 172.21.15.157:0/2456777206 >> v2:172.21.15.187:3300/0 conn(0x7fafbc0affc0 0x7fafbc15e470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:07.868 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.860+0000 7fafc25cf700 1 --2- 172.21.15.157:0/2456777206 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fafbc06b160 0x7fafbc0afa80 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:07.868 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.860+0000 7fafc25cf700 1 -- 172.21.15.157:0/2456777206 >> 172.21.15.157:0/2456777206 conn(0x7fafbc0d0b30 msgr2=0x7fafbc0d0f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:07.868 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.860+0000 7fafc25cf700 1 -- 172.21.15.157:0/2456777206 shutdown_connections 2023-10-16T19:57:07.868 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.860+0000 7fafc25cf700 1 -- 172.21.15.157:0/2456777206 wait complete. 2023-10-16T19:57:07.871 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.862+0000 7fafc25cf700 1 Processor -- start 2023-10-16T19:57:07.871 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.862+0000 7fafc25cf700 1 -- start start 2023-10-16T19:57:07.871 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.863+0000 7fafc25cf700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fafbc06b160 0x7fafbc15d210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:07.872 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.863+0000 7fafc25cf700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fafbc0affc0 0x7fafbc1f2d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:07.872 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.863+0000 7fafc25cf700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fafbc15e090 0x7fafbc1f3240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:07.872 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.863+0000 7fafc25cf700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafbc1f3780 con 0x7fafbc15e090 2023-10-16T19:57:07.872 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.863+0000 7fafc25cf700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafbc0d0950 con 0x7fafbc06b160 2023-10-16T19:57:07.873 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.863+0000 7fafc25cf700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafbc0b1400 con 0x7fafbc0affc0 2023-10-16T19:57:07.873 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.863+0000 7fafc0b6c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fafbc15e090 0x7fafbc1f3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:07.873 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.863+0000 7fafc0b6c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fafbc15e090 0x7fafbc1f3240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:45584/0 (socket says 172.21.15.157:45584) 2023-10-16T19:57:07.873 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.863+0000 7fafc0b6c700 1 -- 172.21.15.157:0/2712866153 learned_addr learned my addr 172.21.15.157:0/2712866153 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:57:07.873 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.863+0000 7fafbb7fe700 1 --2- 172.21.15.157:0/2712866153 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fafbc0affc0 0x7fafbc1f2d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:07.874 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.863+0000 7fafbbfff700 1 --2- 172.21.15.157:0/2712866153 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fafbc06b160 0x7fafbc15d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:07.874 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.863+0000 7fafc0b6c700 1 -- 172.21.15.157:0/2712866153 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fafbc0affc0 msgr2=0x7fafbc1f2d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:07.874 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.863+0000 7fafc0b6c700 1 --2- 172.21.15.157:0/2712866153 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fafbc0affc0 0x7fafbc1f2d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:07.874 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.863+0000 7fafc0b6c700 1 -- 172.21.15.157:0/2712866153 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fafbc06b160 msgr2=0x7fafbc15d210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:07.874 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.863+0000 7fafc0b6c700 1 --2- 172.21.15.157:0/2712866153 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fafbc06b160 0x7fafbc15d210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:07.875 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.863+0000 7fafc0b6c700 1 -- 172.21.15.157:0/2712866153 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafa4009550 con 0x7fafbc15e090 2023-10-16T19:57:07.875 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.863+0000 7fafc0b6c700 1 --2- 172.21.15.157:0/2712866153 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fafbc15e090 0x7fafbc1f3240 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fafb400efc0 tx=0x7fafb400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:07.875 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.863+0000 7fafb8ff9700 1 -- 172.21.15.157:0/2712866153 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafb4009ea0 con 0x7fafbc15e090 2023-10-16T19:57:07.875 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.863+0000 7fafb8ff9700 1 -- 172.21.15.157:0/2712866153 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafb400f040 con 0x7fafbc15e090 2023-10-16T19:57:07.875 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.863+0000 7fafc25cf700 1 -- 172.21.15.157:0/2712866153 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafbc0b0640 con 0x7fafbc15e090 2023-10-16T19:57:07.875 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.863+0000 7fafb8ff9700 1 -- 172.21.15.157:0/2712866153 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafb400ced0 con 0x7fafbc15e090 2023-10-16T19:57:07.876 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.864+0000 7fafc25cf700 1 -- 172.21.15.157:0/2712866153 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafbc0b0c00 con 0x7fafbc15e090 2023-10-16T19:57:07.876 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.865+0000 7fafc25cf700 1 -- 172.21.15.157:0/2712866153 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafbc0b07d0 con 0x7fafbc15e090 2023-10-16T19:57:07.876 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.865+0000 7fafb8ff9700 1 -- 172.21.15.157:0/2712866153 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fafb4014480 con 0x7fafbc15e090 2023-10-16T19:57:07.876 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.865+0000 7fafb8ff9700 1 --2- 172.21.15.157:0/2712866153 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7faf9c06af00 0x7faf9c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:07.876 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.865+0000 7fafb8ff9700 1 -- 172.21.15.157:0/2712866153 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fafb4089d10 con 0x7fafbc15e090 2023-10-16T19:57:07.877 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.865+0000 7fafbbfff700 1 --2- 172.21.15.157:0/2712866153 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7faf9c06af00 0x7faf9c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:07.877 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.866+0000 7fafbbfff700 1 --2- 172.21.15.157:0/2712866153 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7faf9c06af00 0x7faf9c06d3c0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fafac007fd0 tx=0x7fafac009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:07.877 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:07.870+0000 7fafb8ff9700 1 -- 172.21.15.157:0/2712866153 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fafb4054e50 con 0x7fafbc15e090 2023-10-16T19:57:08.111 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:08.108+0000 7fafc25cf700 1 -- 172.21.15.157:0/2712866153 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fafbc04f400 con 0x7fafbc15e090 2023-10-16T19:57:09.012 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:09.010+0000 7fafb8ff9700 1 -- 172.21.15.157:0/2712866153 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) v1 ==== 118+0+0 (secure 0 0 0) 0x7fafb40180b0 con 0x7fafbc15e090 2023-10-16T19:57:09.016 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:09.013+0000 7fafc25cf700 1 -- 172.21.15.157:0/2712866153 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7faf9c06af00 msgr2=0x7faf9c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:09.016 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:09.013+0000 7fafc25cf700 1 --2- 172.21.15.157:0/2712866153 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7faf9c06af00 0x7faf9c06d3c0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fafac007fd0 tx=0x7fafac009040 comp rx=0 tx=0).stop 2023-10-16T19:57:09.016 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:09.013+0000 7fafc25cf700 1 -- 172.21.15.157:0/2712866153 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fafbc15e090 msgr2=0x7fafbc1f3240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:09.016 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:09.013+0000 7fafc25cf700 1 --2- 172.21.15.157:0/2712866153 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fafbc15e090 0x7fafbc1f3240 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fafb400efc0 tx=0x7fafb400c3a0 comp rx=0 tx=0).stop 2023-10-16T19:57:09.017 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:09.013+0000 7fafc25cf700 1 -- 172.21.15.157:0/2712866153 shutdown_connections 2023-10-16T19:57:09.017 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:09.013+0000 7fafc25cf700 1 --2- 172.21.15.157:0/2712866153 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7faf9c06af00 0x7faf9c06d3c0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:09.017 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:09.013+0000 7fafc25cf700 1 --2- 172.21.15.157:0/2712866153 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fafbc06b160 0x7fafbc15d210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:09.017 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:09.013+0000 7fafc25cf700 1 --2- 172.21.15.157:0/2712866153 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fafbc15e090 0x7fafbc1f3240 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:09.017 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:09.013+0000 7fafc25cf700 1 --2- 172.21.15.157:0/2712866153 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fafbc0affc0 0x7fafbc1f2d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:09.018 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:09.013+0000 7fafc25cf700 1 -- 172.21.15.157:0/2712866153 >> 172.21.15.157:0/2712866153 conn(0x7fafbc0d0b30 msgr2=0x7fafbc1620c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:09.018 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:09.013+0000 7fafc25cf700 1 -- 172.21.15.157:0/2712866153 shutdown_connections 2023-10-16T19:57:09.018 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:09.013+0000 7fafc25cf700 1 -- 172.21.15.157:0/2712866153 wait complete. 2023-10-16T19:57:09.030 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['disabled']} 2023-10-16T19:57:09.031 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-16T19:57:09.163 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:09.161+0000 7f5cc1427700 1 Processor -- start 2023-10-16T19:57:09.164 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:09.161+0000 7f5cc1427700 1 -- start start 2023-10-16T19:57:09.166 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:09.162+0000 7f5cc1427700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f5cbc06c810 0x7f5cbc165ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:09.166 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:09.162+0000 7f5cc1427700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5cbc071080 con 0x7f5cbc0cb250 2023-10-16T19:57:09.166 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:09.162+0000 7f5cc1427700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5cbc071360 con 0x7f5cbc144450 2023-10-16T19:57:09.167 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:09.162+0000 7f5cc1427700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5cbc0cb700 con 0x7f5cbc06c810 2023-10-16T19:57:09.167 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:09.162+0000 7f5cbb7fe700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f5cbc06c810 0x7f5cbc165ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:09.167 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:09.162+0000 7f5cba7fc700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f5cbc0cb250 0x7f5cbc06c100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:55260/0 (socket says 172.21.15.157:55260) 2023-10-16T19:57:09.167 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:09.162+0000 7f5cba7fc700 1 -- 172.21.15.157:0/4065722974 learned_addr learned my addr 172.21.15.157:0/4065722974 (peer_addr_for_me v1:172.21.15.157:0/0) 2023-10-16T19:57:09.168 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:09.162+0000 7f5cbb7fe700 1 -- 172.21.15.157:0/4065722974 >> v1:172.21.15.187:6789/0 conn(0x7f5cbc144450 legacy=0x7f5cbc070810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:09.168 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:09.162+0000 7f5cbb7fe700 1 -- 172.21.15.157:0/4065722974 >> v1:172.21.15.157:6789/0 conn(0x7f5cbc0cb250 legacy=0x7f5cbc06c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:09.168 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:09.162+0000 7f5cbb7fe700 1 -- 172.21.15.157:0/4065722974 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cbc071640 con 0x7f5cbc06c810 2023-10-16T19:57:09.168 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:09.162+0000 7f5cb9ffb700 1 -- 172.21.15.157:0/4065722974 <== mon.0 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1042533556 0 0) 0x7f5cbc071080 con 0x7f5cbc0cb250 2023-10-16T19:57:09.169 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:09.162+0000 7f5cbb7fe700 1 --2- 172.21.15.157:0/4065722974 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5cbc06c810 0x7f5cbc165ae0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f5cb4009d90 tx=0x7f5cb400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35ebc413bb7da464 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:09.169 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:09.162+0000 7f5cb9ffb700 1 -- 172.21.15.157:0/4065722974 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cb400e070 con 0x7f5cbc06c810 2023-10-16T19:57:09.169 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:09.163+0000 7f5cb9ffb700 1 -- 172.21.15.157:0/4065722974 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cb400bbd0 con 0x7f5cbc06c810 2023-10-16T19:57:09.169 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:09.163+0000 7f5cb9ffb700 1 -- 172.21.15.157:0/4065722974 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cb4012430 con 0x7f5cbc06c810 2023-10-16T19:57:09.169 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:09.163+0000 7f5cc1427700 1 -- 172.21.15.157:0/4065722974 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5cbc06c810 msgr2=0x7f5cbc165ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:09.170 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:09.163+0000 7f5cc1427700 1 --2- 172.21.15.157:0/4065722974 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5cbc06c810 0x7f5cbc165ae0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f5cb4009d90 tx=0x7f5cb400b330 comp rx=0 tx=0).stop 2023-10-16T19:57:09.170 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:09.163+0000 7f5cc1427700 1 -- 172.21.15.157:0/4065722974 shutdown_connections 2023-10-16T19:57:09.170 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:09.163+0000 7f5cc1427700 1 --2- 172.21.15.157:0/4065722974 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5cbc06c810 0x7f5cbc165ae0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:09.170 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:09.163+0000 7f5cc1427700 1 -- 172.21.15.157:0/4065722974 >> 172.21.15.157:0/4065722974 conn(0x7f5cbc06ae80 msgr2=0x7f5cbc0b1690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:09.170 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:09.163+0000 7f5cc1427700 1 -- 172.21.15.157:0/4065722974 shutdown_connections 2023-10-16T19:57:09.171 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:09.163+0000 7f5cc1427700 1 -- 172.21.15.157:0/4065722974 wait complete. 2023-10-16T19:57:09.174 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:09.165+0000 7f5cc1427700 1 Processor -- start 2023-10-16T19:57:09.174 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:09.165+0000 7f5cc1427700 1 -- start start 2023-10-16T19:57:09.174 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:09.166+0000 7f5cc1427700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5cbc06c810 0x7f5cbc13a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:09.174 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:09.166+0000 7f5cc1427700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5cbc0cb250 0x7f5cbc13b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:09.175 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:09.166+0000 7f5cc1427700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5cbc144450 0x7f5cbc13d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:09.175 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:09.166+0000 7f5cc1427700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cbc13a980 con 0x7f5cbc06c810 2023-10-16T19:57:09.175 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:09.166+0000 7f5cc1427700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cbc13cbb0 con 0x7f5cbc144450 2023-10-16T19:57:09.175 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:09.166+0000 7f5cc1427700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cbc13bfa0 con 0x7f5cbc0cb250 2023-10-16T19:57:09.176 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:09.166+0000 7f5cbaffd700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5cbc06c810 0x7f5cbc13a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:09.176 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:09.166+0000 7f5cbaffd700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5cbc06c810 0x7f5cbc13a440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:45594/0 (socket says 172.21.15.157:45594) 2023-10-16T19:57:09.176 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:09.166+0000 7f5cbaffd700 1 -- 172.21.15.157:0/839534827 learned_addr learned my addr 172.21.15.157:0/839534827 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:57:09.176 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:09.166+0000 7f5cba7fc700 1 --2- 172.21.15.157:0/839534827 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5cbc0cb250 0x7f5cbc13b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:09.176 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:09.166+0000 7f5cbb7fe700 1 --2- 172.21.15.157:0/839534827 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5cbc144450 0x7f5cbc13d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:09.177 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:09.166+0000 7f5cbaffd700 1 -- 172.21.15.157:0/839534827 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5cbc0cb250 msgr2=0x7f5cbc13b4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:09.177 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:09.166+0000 7f5cbaffd700 1 --2- 172.21.15.157:0/839534827 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5cbc0cb250 0x7f5cbc13b4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:09.177 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:09.166+0000 7f5cbaffd700 1 -- 172.21.15.157:0/839534827 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5cbc144450 msgr2=0x7f5cbc13d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:09.177 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:09.166+0000 7f5cbaffd700 1 --2- 172.21.15.157:0/839534827 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5cbc144450 0x7f5cbc13d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:09.177 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:09.166+0000 7f5cbaffd700 1 -- 172.21.15.157:0/839534827 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cb4009a70 con 0x7f5cbc06c810 2023-10-16T19:57:09.178 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:09.166+0000 7f5cbaffd700 1 --2- 172.21.15.157:0/839534827 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5cbc06c810 0x7f5cbc13a440 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f5cb000c450 tx=0x7f5cb000c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:09.178 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:09.166+0000 7f5ca37fe700 1 -- 172.21.15.157:0/839534827 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cb00052d0 con 0x7f5cbc06c810 2023-10-16T19:57:09.178 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:09.166+0000 7f5ca37fe700 1 -- 172.21.15.157:0/839534827 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cb0005430 con 0x7f5cbc06c810 2023-10-16T19:57:09.178 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:09.166+0000 7f5cc1427700 1 -- 172.21.15.157:0/839534827 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cbc13c280 con 0x7f5cbc06c810 2023-10-16T19:57:09.178 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:09.166+0000 7f5ca37fe700 1 -- 172.21.15.157:0/839534827 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cb00038c0 con 0x7f5cbc06c810 2023-10-16T19:57:09.179 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:09.166+0000 7f5cc1427700 1 -- 172.21.15.157:0/839534827 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cbc13c840 con 0x7f5cbc06c810 2023-10-16T19:57:09.179 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:09.167+0000 7f5cc1427700 1 -- 172.21.15.157:0/839534827 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5cbc04f400 con 0x7f5cbc06c810 2023-10-16T19:57:09.179 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:09.168+0000 7f5ca37fe700 1 -- 172.21.15.157:0/839534827 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f5cb0003a20 con 0x7f5cbc06c810 2023-10-16T19:57:09.179 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:09.168+0000 7f5ca37fe700 1 --2- 172.21.15.157:0/839534827 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f5ca806af00 0x7f5ca806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:09.179 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:09.168+0000 7f5ca37fe700 1 -- 172.21.15.157:0/839534827 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5cb00889e0 con 0x7f5cbc06c810 2023-10-16T19:57:09.180 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:09.168+0000 7f5cba7fc700 1 --2- 172.21.15.157:0/839534827 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f5ca806af00 0x7f5ca806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:09.180 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:09.169+0000 7f5cba7fc700 1 --2- 172.21.15.157:0/839534827 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f5ca806af00 0x7f5ca806d3c0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f5cbc0b53a0 tx=0x7f5cac009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:09.180 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:09.172+0000 7f5ca37fe700 1 -- 172.21.15.157:0/839534827 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5cb0053a90 con 0x7f5cbc06c810 2023-10-16T19:57:09.413 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:09.411+0000 7f5cc1427700 1 -- 172.21.15.157:0/839534827 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f5cbc0cc420 con 0x7f5cbc06c810 2023-10-16T19:57:10.021 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.019+0000 7f5ca37fe700 1 -- 172.21.15.157:0/839534827 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) v1 ==== 122+0+0 (secure 0 0 0) 0x7f5cb00170c0 con 0x7f5cbc06c810 2023-10-16T19:57:10.025 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.022+0000 7f5cc1427700 1 -- 172.21.15.157:0/839534827 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f5ca806af00 msgr2=0x7f5ca806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:10.025 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.022+0000 7f5cc1427700 1 --2- 172.21.15.157:0/839534827 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f5ca806af00 0x7f5ca806d3c0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f5cbc0b53a0 tx=0x7f5cac009040 comp rx=0 tx=0).stop 2023-10-16T19:57:10.025 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.022+0000 7f5cc1427700 1 -- 172.21.15.157:0/839534827 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5cbc06c810 msgr2=0x7f5cbc13a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:10.025 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.022+0000 7f5cc1427700 1 --2- 172.21.15.157:0/839534827 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5cbc06c810 0x7f5cbc13a440 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f5cb000c450 tx=0x7f5cb000c810 comp rx=0 tx=0).stop 2023-10-16T19:57:10.025 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.022+0000 7f5cc1427700 1 -- 172.21.15.157:0/839534827 shutdown_connections 2023-10-16T19:57:10.026 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.022+0000 7f5cc1427700 1 --2- 172.21.15.157:0/839534827 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f5ca806af00 0x7f5ca806d3c0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:10.026 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.022+0000 7f5cc1427700 1 --2- 172.21.15.157:0/839534827 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5cbc144450 0x7f5cbc13d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:10.026 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.022+0000 7f5cc1427700 1 --2- 172.21.15.157:0/839534827 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5cbc06c810 0x7f5cbc13a440 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:10.026 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.022+0000 7f5cc1427700 1 --2- 172.21.15.157:0/839534827 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5cbc0cb250 0x7f5cbc13b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:10.027 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.022+0000 7f5cc1427700 1 -- 172.21.15.157:0/839534827 >> 172.21.15.157:0/839534827 conn(0x7f5cbc06ae80 msgr2=0x7f5cbc0ccaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:10.027 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.022+0000 7f5cc1427700 1 -- 172.21.15.157:0/839534827 shutdown_connections 2023-10-16T19:57:10.027 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.022+0000 7f5cc1427700 1 -- 172.21.15.157:0/839534827 wait complete. 2023-10-16T19:57:10.037 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-10-16T19:57:10.038 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-16T19:57:10.160 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.157+0000 7fb61049b700 1 Processor -- start 2023-10-16T19:57:10.160 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.157+0000 7fb61049b700 1 -- start start 2023-10-16T19:57:10.164 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.158+0000 7fb61049b700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb60806af60 0x7fb60806d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:10.164 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.158+0000 7fb61049b700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6080d08b0 con 0x7fb60806de00 2023-10-16T19:57:10.164 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.158+0000 7fb61049b700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6081628f0 con 0x7fb60815e2f0 2023-10-16T19:57:10.164 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.158+0000 7fb61049b700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb608162bd0 con 0x7fb60806af60 2023-10-16T19:57:10.164 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.158+0000 7fb60ea38700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7fb60806de00 0x7fb608070f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:55278/0 (socket says 172.21.15.157:55278) 2023-10-16T19:57:10.165 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.158+0000 7fb60ea38700 1 -- 172.21.15.157:0/433307615 learned_addr learned my addr 172.21.15.157:0/433307615 (peer_addr_for_me v1:172.21.15.157:0/0) 2023-10-16T19:57:10.165 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.158+0000 7fb60da36700 1 --2- 172.21.15.157:0/433307615 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb60806af60 0x7fb60806d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:10.165 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.158+0000 7fb60d235700 1 -- 172.21.15.157:0/433307615 <== mon.0 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 940999701 0 0) 0x7fb6080d08b0 con 0x7fb60806de00 2023-10-16T19:57:10.165 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.159+0000 7fb60d235700 1 -- 172.21.15.157:0/433307615 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb5f40035b0 con 0x7fb60806de00 2023-10-16T19:57:10.165 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.159+0000 7fb60d235700 1 -- 172.21.15.157:0/433307615 <== mon.0 v1:172.21.15.157:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2569199886 0 0) 0x7fb5f40035b0 con 0x7fb60806de00 2023-10-16T19:57:10.166 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.159+0000 7fb60d235700 1 -- 172.21.15.157:0/433307615 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb60806af60 msgr2=0x7fb60806d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:57:10.166 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.159+0000 7fb60d235700 1 --2- 172.21.15.157:0/433307615 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb60806af60 0x7fb60806d0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:10.166 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.159+0000 7fb60d235700 1 -- 172.21.15.157:0/433307615 >> v1:172.21.15.187:6789/0 conn(0x7fb60815e2f0 legacy=0x7fb60806a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:10.166 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.159+0000 7fb60d235700 1 -- 172.21.15.157:0/433307615 --> v1:172.21.15.157:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6080d05d0 con 0x7fb60806de00 2023-10-16T19:57:10.167 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.159+0000 7fb60d235700 1 -- 172.21.15.157:0/433307615 <== mon.0 v1:172.21.15.157:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4021145519 0 0) 0x7fb600001a40 con 0x7fb60806de00 2023-10-16T19:57:10.167 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.159+0000 7fb60d235700 1 -- 172.21.15.157:0/433307615 >> v1:172.21.15.157:6789/0 conn(0x7fb60806de00 legacy=0x7fb608070f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:10.167 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.159+0000 7fb60d235700 1 --2- 172.21.15.157:0/433307615 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb60806af60 0x7fb5f4003a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:10.167 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.159+0000 7fb60d235700 1 --2- 172.21.15.157:0/433307615 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb5f4003fb0 0x7fb5f4004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:10.167 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.159+0000 7fb60d235700 1 --2- 172.21.15.157:0/433307615 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb5f4004d90 0x7fb5f4005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:10.168 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.159+0000 7fb60d235700 1 -- 172.21.15.157:0/433307615 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb608162bd0 con 0x7fb5f4003fb0 2023-10-16T19:57:10.168 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.159+0000 7fb60d235700 1 -- 172.21.15.157:0/433307615 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5f400bba0 con 0x7fb5f4004d90 2023-10-16T19:57:10.168 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.159+0000 7fb60d235700 1 -- 172.21.15.157:0/433307615 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5f400bd60 con 0x7fb60806af60 2023-10-16T19:57:10.168 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.159+0000 7fb60da36700 1 --2- 172.21.15.157:0/433307615 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb5f4003fb0 0x7fb5f4004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:10.168 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.159+0000 7fb60e237700 1 --2- 172.21.15.157:0/433307615 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb60806af60 0x7fb5f4003a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:10.169 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.159+0000 7fb60ea38700 1 --2- 172.21.15.157:0/433307615 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb5f4004d90 0x7fb5f4005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:10.169 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.159+0000 7fb60da36700 1 -- 172.21.15.157:0/433307615 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb60806af60 msgr2=0x7fb5f4003a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:57:10.169 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.159+0000 7fb60da36700 1 --2- 172.21.15.157:0/433307615 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb60806af60 0x7fb5f4003a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:10.169 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.159+0000 7fb60da36700 1 -- 172.21.15.157:0/433307615 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb5f4004d90 msgr2=0x7fb5f4005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:57:10.169 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.159+0000 7fb60da36700 1 --2- 172.21.15.157:0/433307615 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb5f4004d90 0x7fb5f4005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:10.170 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.159+0000 7fb60da36700 1 -- 172.21.15.157:0/433307615 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5f40035b0 con 0x7fb5f4003fb0 2023-10-16T19:57:10.170 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.159+0000 7fb60da36700 1 --2- 172.21.15.157:0/433307615 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb5f4003fb0 0x7fb5f4004850 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fb604009b60 tx=0x7fb5f4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bffeae68d2efd8 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:10.170 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.160+0000 7fb60d235700 1 -- 172.21.15.157:0/433307615 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb60400e6c0 con 0x7fb5f4003fb0 2023-10-16T19:57:10.170 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.160+0000 7fb60d235700 1 -- 172.21.15.157:0/433307615 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb60400e820 con 0x7fb5f4003fb0 2023-10-16T19:57:10.170 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.160+0000 7fb60d235700 1 -- 172.21.15.157:0/433307615 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb60400eb90 con 0x7fb5f4003fb0 2023-10-16T19:57:10.171 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.160+0000 7fb61049b700 1 -- 172.21.15.157:0/433307615 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb5f4003fb0 msgr2=0x7fb5f4004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:10.171 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.160+0000 7fb61049b700 1 --2- 172.21.15.157:0/433307615 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb5f4003fb0 0x7fb5f4004850 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fb604009b60 tx=0x7fb5f4005880 comp rx=0 tx=0).stop 2023-10-16T19:57:10.171 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.160+0000 7fb60ea38700 1 -- 172.21.15.157:0/433307615 reap_dead start 2023-10-16T19:57:10.171 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.160+0000 7fb61049b700 1 -- 172.21.15.157:0/433307615 shutdown_connections 2023-10-16T19:57:10.171 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.160+0000 7fb61049b700 1 -- 172.21.15.157:0/433307615 >> 172.21.15.157:0/433307615 conn(0x7fb6080cd4e0 msgr2=0x7fb6080cd8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:10.172 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.160+0000 7fb61049b700 1 -- 172.21.15.157:0/433307615 shutdown_connections 2023-10-16T19:57:10.172 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.160+0000 7fb61049b700 1 -- 172.21.15.157:0/433307615 wait complete. 2023-10-16T19:57:10.172 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.161+0000 7fb61049b700 1 Processor -- start 2023-10-16T19:57:10.172 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.161+0000 7fb61049b700 1 -- start start 2023-10-16T19:57:10.175 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.162+0000 7fb61049b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb5f4003fb0 0x7fb608157ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:10.175 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.162+0000 7fb61049b700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb6080b4b20 0x7fb6080b3720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:10.175 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.162+0000 7fb61049b700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb6080b4fa0 0x7fb6080b0ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:10.175 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.162+0000 7fb61049b700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6080b4730 con 0x7fb6080b4b20 2023-10-16T19:57:10.176 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.162+0000 7fb61049b700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6080b4170 con 0x7fb5f4003fb0 2023-10-16T19:57:10.176 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.162+0000 7fb61049b700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6080b4450 con 0x7fb6080b4fa0 2023-10-16T19:57:10.176 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.162+0000 7fb60da36700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb6080b4b20 0x7fb6080b3720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:10.176 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.162+0000 7fb60da36700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb6080b4b20 0x7fb6080b3720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:45616/0 (socket says 172.21.15.157:45616) 2023-10-16T19:57:10.176 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.162+0000 7fb60da36700 1 -- 172.21.15.157:0/2665432036 learned_addr learned my addr 172.21.15.157:0/2665432036 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:57:10.177 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.162+0000 7fb60ea38700 1 --2- 172.21.15.157:0/2665432036 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb6080b4fa0 0x7fb6080b0ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:10.177 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.162+0000 7fb60e237700 1 --2- 172.21.15.157:0/2665432036 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb5f4003fb0 0x7fb608157ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:10.177 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.163+0000 7fb60da36700 1 -- 172.21.15.157:0/2665432036 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb6080b4fa0 msgr2=0x7fb6080b0ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:10.177 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.163+0000 7fb60da36700 1 --2- 172.21.15.157:0/2665432036 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb6080b4fa0 0x7fb6080b0ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:10.177 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.163+0000 7fb60da36700 1 -- 172.21.15.157:0/2665432036 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb5f4003fb0 msgr2=0x7fb608157ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:10.178 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.163+0000 7fb60da36700 1 --2- 172.21.15.157:0/2665432036 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb5f4003fb0 0x7fb608157ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:10.178 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.163+0000 7fb60da36700 1 -- 172.21.15.157:0/2665432036 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb60815eb90 con 0x7fb6080b4b20 2023-10-16T19:57:10.178 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.163+0000 7fb60e237700 1 --2- 172.21.15.157:0/2665432036 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb5f4003fb0 0x7fb608157ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T19:57:10.178 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.163+0000 7fb60da36700 1 --2- 172.21.15.157:0/2665432036 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb6080b4b20 0x7fb6080b3720 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb60400e4b0 tx=0x7fb6040047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:10.178 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.163+0000 7fb5faffd700 1 -- 172.21.15.157:0/2665432036 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb604021070 con 0x7fb6080b4b20 2023-10-16T19:57:10.178 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.163+0000 7fb5faffd700 1 -- 172.21.15.157:0/2665432036 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb604004580 con 0x7fb6080b4b20 2023-10-16T19:57:10.179 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.163+0000 7fb61049b700 1 -- 172.21.15.157:0/2665432036 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb60815ee70 con 0x7fb6080b4b20 2023-10-16T19:57:10.179 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.163+0000 7fb5faffd700 1 -- 172.21.15.157:0/2665432036 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb60400e6c0 con 0x7fb6080b4b20 2023-10-16T19:57:10.179 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.163+0000 7fb61049b700 1 -- 172.21.15.157:0/2665432036 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6080b3c60 con 0x7fb6080b4b20 2023-10-16T19:57:10.179 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.164+0000 7fb61049b700 1 -- 172.21.15.157:0/2665432036 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb60804f400 con 0x7fb6080b4b20 2023-10-16T19:57:10.179 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.164+0000 7fb5faffd700 1 -- 172.21.15.157:0/2665432036 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fb604025070 con 0x7fb6080b4b20 2023-10-16T19:57:10.180 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.164+0000 7fb5faffd700 1 --2- 172.21.15.157:0/2665432036 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fb5ec06af00 0x7fb5ec06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:10.180 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.165+0000 7fb5faffd700 1 -- 172.21.15.157:0/2665432036 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb60408a5f0 con 0x7fb6080b4b20 2023-10-16T19:57:10.180 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.165+0000 7fb60e237700 1 --2- 172.21.15.157:0/2665432036 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fb5ec06af00 0x7fb5ec06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:10.180 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.165+0000 7fb60e237700 1 --2- 172.21.15.157:0/2665432036 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fb5ec06af00 0x7fb5ec06d3c0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fb5fc000c00 tx=0x7fb5fc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:10.180 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.169+0000 7fb5faffd700 1 -- 172.21.15.157:0/2665432036 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb604055730 con 0x7fb6080b4b20 2023-10-16T19:57:10.402 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.400+0000 7fb61049b700 1 -- 172.21.15.157:0/2665432036 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb608158470 con 0x7fb6080b4b20 2023-10-16T19:57:10.403 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.401+0000 7fb5faffd700 1 -- 172.21.15.157:0/2665432036 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4913 (secure 0 0 0) 0x7fb604058d50 con 0x7fb6080b4b20 2023-10-16T19:57:10.403 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-10-16T19:57:10.404 INFO:teuthology.orchestra.run.smithi157.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/1319816297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6834","nonce":1319816297},{"type":"v1","addr":"172.21.15.187:6835","nonce":1319816297}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4242,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6834/3219992837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6832","nonce":3219992837},{"type":"v1","addr":"172.21.15.157:6834","nonce":3219992837}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4245,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6835/1675699874","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6833","nonce":1675699874},{"type":"v1","addr":"172.21.15.157:6835","nonce":1675699874}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-16T19:57:06.364669+0000","modified":"2023-10-16T19:57:09.412706+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4282":{"gid":4282,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.187:6837/68705029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6836","nonce":68705029},{"type":"v1","addr":"172.21.15.187:6837","nonce":68705029}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-16T19:57:10.405 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.403+0000 7fb61049b700 1 -- 172.21.15.157:0/2665432036 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fb5ec06af00 msgr2=0x7fb5ec06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:10.405 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.403+0000 7fb61049b700 1 --2- 172.21.15.157:0/2665432036 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fb5ec06af00 0x7fb5ec06d3c0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fb5fc000c00 tx=0x7fb5fc009040 comp rx=0 tx=0).stop 2023-10-16T19:57:10.406 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.403+0000 7fb61049b700 1 -- 172.21.15.157:0/2665432036 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb6080b4b20 msgr2=0x7fb6080b3720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:10.406 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.403+0000 7fb61049b700 1 --2- 172.21.15.157:0/2665432036 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb6080b4b20 0x7fb6080b3720 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb60400e4b0 tx=0x7fb6040047c0 comp rx=0 tx=0).stop 2023-10-16T19:57:10.406 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.403+0000 7fb61049b700 1 -- 172.21.15.157:0/2665432036 shutdown_connections 2023-10-16T19:57:10.406 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.403+0000 7fb61049b700 1 --2- 172.21.15.157:0/2665432036 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fb5ec06af00 0x7fb5ec06d3c0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:10.406 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.403+0000 7fb61049b700 1 --2- 172.21.15.157:0/2665432036 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb5f4003fb0 0x7fb608157ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:10.407 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.403+0000 7fb61049b700 1 --2- 172.21.15.157:0/2665432036 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb6080b4fa0 0x7fb6080b0ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:10.407 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.403+0000 7fb61049b700 1 --2- 172.21.15.157:0/2665432036 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb6080b4b20 0x7fb6080b3720 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:10.407 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.403+0000 7fb61049b700 1 -- 172.21.15.157:0/2665432036 >> 172.21.15.157:0/2665432036 conn(0x7fb6080cd4e0 msgr2=0x7fb6080b1e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:10.407 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.403+0000 7fb61049b700 1 -- 172.21.15.157:0/2665432036 shutdown_connections 2023-10-16T19:57:10.407 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.403+0000 7fb61049b700 1 -- 172.21.15.157:0/2665432036 wait complete. 2023-10-16T19:57:10.408 INFO:teuthology.orchestra.run.smithi157.stderr:dumped fsmap epoch 8 2023-10-16T19:57:10.417 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T19:57:10.541 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.536+0000 7fd166fdc700 1 Processor -- start 2023-10-16T19:57:10.541 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.536+0000 7fd166fdc700 1 -- start start 2023-10-16T19:57:10.541 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.536+0000 7fd166fdc700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fd16015b130 0x7fd160071f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:10.541 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.536+0000 7fd166fdc700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd16006d0f0 0x7fd1600cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:10.542 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.536+0000 7fd166fdc700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1600cefc0 con 0x7fd1600cbeb0 2023-10-16T19:57:10.542 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.536+0000 7fd166fdc700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1600b0050 con 0x7fd16015b130 2023-10-16T19:57:10.542 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.536+0000 7fd166fdc700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd16006e090 con 0x7fd16006d0f0 2023-10-16T19:57:10.542 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.537+0000 7fd15ffff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd16006d0f0 0x7fd1600cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:10.543 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.537+0000 7fd164d78700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fd16015b130 0x7fd160071f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:10.543 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.537+0000 7fd15ffff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd16006d0f0 0x7fd1600cb970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.157:54932/0 (socket says 172.21.15.157:54932) 2023-10-16T19:57:10.543 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.537+0000 7fd15ffff700 1 -- 172.21.15.157:0/724204449 learned_addr learned my addr 172.21.15.157:0/724204449 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:57:10.543 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.537+0000 7fd165579700 1 --1- 172.21.15.157:0/724204449 >> v1:172.21.15.187:6789/0 conn(0x7fd1600cbeb0 0x7fd16006eb20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.157:38992/0 (socket says 172.21.15.157:38992) 2023-10-16T19:57:10.544 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.537+0000 7fd15ffff700 1 -- 172.21.15.157:0/724204449 >> v2:172.21.15.187:3300/0 conn(0x7fd16015b130 msgr2=0x7fd160071f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:57:10.544 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.537+0000 7fd15ffff700 1 --2- 172.21.15.157:0/724204449 >> v2:172.21.15.187:3300/0 conn(0x7fd16015b130 0x7fd160071f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:10.544 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.537+0000 7fd15ffff700 1 -- 172.21.15.157:0/724204449 >> v1:172.21.15.187:6789/0 conn(0x7fd1600cbeb0 legacy=0x7fd16006eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:10.544 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.537+0000 7fd15ffff700 1 -- 172.21.15.157:0/724204449 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd16006d570 con 0x7fd16006d0f0 2023-10-16T19:57:10.545 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.537+0000 7fd15ffff700 1 --2- 172.21.15.157:0/724204449 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd16006d0f0 0x7fd1600cb970 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fd14c0098f0 tx=0x7fd14c009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3b097085e54fd897 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:10.545 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.537+0000 7fd15f7fe700 1 -- 172.21.15.157:0/724204449 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd14c011830 con 0x7fd16006d0f0 2023-10-16T19:57:10.545 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.537+0000 7fd15f7fe700 1 -- 172.21.15.157:0/724204449 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd14c011990 con 0x7fd16006d0f0 2023-10-16T19:57:10.545 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.537+0000 7fd15f7fe700 1 -- 172.21.15.157:0/724204449 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd14c011d20 con 0x7fd16006d0f0 2023-10-16T19:57:10.545 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.538+0000 7fd166fdc700 1 -- 172.21.15.157:0/724204449 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd16006d0f0 msgr2=0x7fd1600cb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:10.546 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.538+0000 7fd166fdc700 1 --2- 172.21.15.157:0/724204449 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd16006d0f0 0x7fd1600cb970 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fd14c0098f0 tx=0x7fd14c009c00 comp rx=0 tx=0).stop 2023-10-16T19:57:10.546 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.538+0000 7fd166fdc700 1 -- 172.21.15.157:0/724204449 shutdown_connections 2023-10-16T19:57:10.546 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.538+0000 7fd166fdc700 1 --2- 172.21.15.157:0/724204449 >> v2:172.21.15.187:3300/0 conn(0x7fd16015b130 0x7fd160071f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:10.546 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.538+0000 7fd166fdc700 1 --2- 172.21.15.157:0/724204449 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd16006d0f0 0x7fd1600cb970 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:10.547 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.538+0000 7fd166fdc700 1 -- 172.21.15.157:0/724204449 >> 172.21.15.157:0/724204449 conn(0x7fd1600cd4e0 msgr2=0x7fd1600cd8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:10.547 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.538+0000 7fd166fdc700 1 -- 172.21.15.157:0/724204449 shutdown_connections 2023-10-16T19:57:10.547 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.538+0000 7fd166fdc700 1 -- 172.21.15.157:0/724204449 wait complete. 2023-10-16T19:57:10.550 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.539+0000 7fd166fdc700 1 Processor -- start 2023-10-16T19:57:10.550 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.539+0000 7fd166fdc700 1 -- start start 2023-10-16T19:57:10.551 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.540+0000 7fd166fdc700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd16006d0f0 0x7fd16015b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:10.551 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.540+0000 7fd166fdc700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd1600cbeb0 0x7fd1600b60a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:10.551 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.540+0000 7fd166fdc700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd16015b130 0x7fd1600b65e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:10.551 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.540+0000 7fd166fdc700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1601ef660 con 0x7fd1600cbeb0 2023-10-16T19:57:10.552 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.540+0000 7fd166fdc700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1601ef940 con 0x7fd16015b130 2023-10-16T19:57:10.552 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.540+0000 7fd166fdc700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1601efc20 con 0x7fd16006d0f0 2023-10-16T19:57:10.552 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.540+0000 7fd15ffff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd1600cbeb0 0x7fd1600b60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:10.552 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.540+0000 7fd15ffff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd1600cbeb0 0x7fd1600b60a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:45630/0 (socket says 172.21.15.157:45630) 2023-10-16T19:57:10.553 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.540+0000 7fd15ffff700 1 -- 172.21.15.157:0/1621147318 learned_addr learned my addr 172.21.15.157:0/1621147318 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:57:10.553 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.540+0000 7fd164d78700 1 --2- 172.21.15.157:0/1621147318 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd16006d0f0 0x7fd16015b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:10.553 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.540+0000 7fd165579700 1 --2- 172.21.15.157:0/1621147318 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd16015b130 0x7fd1600b65e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:10.553 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.540+0000 7fd15ffff700 1 -- 172.21.15.157:0/1621147318 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd16006d0f0 msgr2=0x7fd16015b780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:10.554 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.540+0000 7fd15ffff700 1 --2- 172.21.15.157:0/1621147318 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd16006d0f0 0x7fd16015b780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:10.554 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.540+0000 7fd15ffff700 1 -- 172.21.15.157:0/1621147318 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd16015b130 msgr2=0x7fd1600b65e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:10.554 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.540+0000 7fd15ffff700 1 --2- 172.21.15.157:0/1621147318 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd16015b130 0x7fd1600b65e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:10.554 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.540+0000 7fd15ffff700 1 -- 172.21.15.157:0/1621147318 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd14c009550 con 0x7fd1600cbeb0 2023-10-16T19:57:10.555 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.540+0000 7fd165579700 1 --2- 172.21.15.157:0/1621147318 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd16015b130 0x7fd1600b65e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T19:57:10.555 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.541+0000 7fd15ffff700 1 --2- 172.21.15.157:0/1621147318 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd1600cbeb0 0x7fd1600b60a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fd14c014040 tx=0x7fd14c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:10.555 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.541+0000 7fd15d7fa700 1 -- 172.21.15.157:0/1621147318 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd14c0045d0 con 0x7fd1600cbeb0 2023-10-16T19:57:10.555 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.541+0000 7fd15d7fa700 1 -- 172.21.15.157:0/1621147318 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd14c01e070 con 0x7fd1600cbeb0 2023-10-16T19:57:10.555 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.541+0000 7fd166fdc700 1 -- 172.21.15.157:0/1621147318 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1601eff00 con 0x7fd1600cbeb0 2023-10-16T19:57:10.556 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.541+0000 7fd15d7fa700 1 -- 172.21.15.157:0/1621147318 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd14c0038a0 con 0x7fd1600cbeb0 2023-10-16T19:57:10.556 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.541+0000 7fd166fdc700 1 -- 172.21.15.157:0/1621147318 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd16015bea0 con 0x7fd1600cbeb0 2023-10-16T19:57:10.556 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.542+0000 7fd166fdc700 1 -- 172.21.15.157:0/1621147318 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1601f0420 con 0x7fd1600cbeb0 2023-10-16T19:57:10.556 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.542+0000 7fd15d7fa700 1 -- 172.21.15.157:0/1621147318 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fd14c003a00 con 0x7fd1600cbeb0 2023-10-16T19:57:10.556 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.543+0000 7fd15d7fa700 1 --2- 172.21.15.157:0/1621147318 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fd14406af00 0x7fd14406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:10.557 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.543+0000 7fd15d7fa700 1 -- 172.21.15.157:0/1621147318 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd14c08a290 con 0x7fd1600cbeb0 2023-10-16T19:57:10.557 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.543+0000 7fd164d78700 1 --2- 172.21.15.157:0/1621147318 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fd14406af00 0x7fd14406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:10.557 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.543+0000 7fd164d78700 1 --2- 172.21.15.157:0/1621147318 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fd14406af00 0x7fd14406d3c0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fd154009ad0 tx=0x7fd154008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:10.557 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.547+0000 7fd15d7fa700 1 -- 172.21.15.157:0/1621147318 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd1601f0420 con 0x7fd1600cbeb0 2023-10-16T19:57:10.737 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.735+0000 7fd166fdc700 1 -- 172.21.15.157:0/1621147318 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd1601f0420 con 0x7fd1600cbeb0 2023-10-16T19:57:10.738 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.736+0000 7fd15d7fa700 1 -- 172.21.15.157:0/1621147318 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16517 (secure 0 0 0) 0x7fd1601f0420 con 0x7fd1600cbeb0 2023-10-16T19:57:10.739 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-10-16T19:57:10.739 INFO:teuthology.orchestra.run.smithi157.stdout:{"epoch":21,"fsid":"28199dc9-64d5-479e-83c6-21f097c33d39","created":"2023-10-16T19:56:49.201889+0000","modified":"2023-10-16T19:57:07.988567+0000","last_up_change":"2023-10-16T19:56:54.675673+0000","last_in_change":"2023-10-16T19:56:51.666728+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T19:56:56.932895+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-16T19:57:04.936105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-16T19:57:05.335279+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":335785898},{"type":"v1","addr":"172.21.15.157:6809","nonce":335785898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":335785898},{"type":"v1","addr":"172.21.15.157:6811","nonce":335785898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6815","nonce":335785898},{"type":"v1","addr":"172.21.15.157:6817","nonce":335785898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":335785898},{"type":"v1","addr":"172.21.15.157:6813","nonce":335785898}]},"public_addr":"172.21.15.157:6809/335785898","cluster_addr":"172.21.15.157:6811/335785898","heartbeat_back_addr":"172.21.15.157:6817/335785898","heartbeat_front_addr":"172.21.15.157:6813/335785898","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":3482825047},{"type":"v1","addr":"172.21.15.157:6801","nonce":3482825047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":3482825047},{"type":"v1","addr":"172.21.15.157:6803","nonce":3482825047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":3482825047},{"type":"v1","addr":"172.21.15.157:6807","nonce":3482825047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":3482825047},{"type":"v1","addr":"172.21.15.157:6805","nonce":3482825047}]},"public_addr":"172.21.15.157:6801/3482825047","cluster_addr":"172.21.15.157:6803/3482825047","heartbeat_back_addr":"172.21.15.157:6807/3482825047","heartbeat_front_addr":"172.21.15.157:6805/3482825047","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":1118292389},{"type":"v1","addr":"172.21.15.157:6825","nonce":1118292389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":1118292389},{"type":"v1","addr":"172.21.15.157:6827","nonce":1118292389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":1118292389},{"type":"v1","addr":"172.21.15.157:6831","nonce":1118292389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":1118292389},{"type":"v1","addr":"172.21.15.157:6829","nonce":1118292389}]},"public_addr":"172.21.15.157:6825/1118292389","cluster_addr":"172.21.15.157:6827/1118292389","heartbeat_back_addr":"172.21.15.157:6831/1118292389","heartbeat_front_addr":"172.21.15.157:6829/1118292389","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":989329821},{"type":"v1","addr":"172.21.15.157:6816","nonce":989329821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":989329821},{"type":"v1","addr":"172.21.15.157:6819","nonce":989329821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":989329821},{"type":"v1","addr":"172.21.15.157:6823","nonce":989329821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":989329821},{"type":"v1","addr":"172.21.15.157:6821","nonce":989329821}]},"public_addr":"172.21.15.157:6816/989329821","cluster_addr":"172.21.15.157:6819/989329821","heartbeat_back_addr":"172.21.15.157:6823/989329821","heartbeat_front_addr":"172.21.15.157:6821/989329821","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":3841016811},{"type":"v1","addr":"172.21.15.187:6801","nonce":3841016811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6803","nonce":3841016811},{"type":"v1","addr":"172.21.15.187:6804","nonce":3841016811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6809","nonce":3841016811},{"type":"v1","addr":"172.21.15.187:6811","nonce":3841016811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":3841016811},{"type":"v1","addr":"172.21.15.187:6808","nonce":3841016811}]},"public_addr":"172.21.15.187:6801/3841016811","cluster_addr":"172.21.15.187:6804/3841016811","heartbeat_back_addr":"172.21.15.187:6811/3841016811","heartbeat_front_addr":"172.21.15.187:6808/3841016811","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":915130263},{"type":"v1","addr":"172.21.15.187:6805","nonce":915130263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6807","nonce":915130263},{"type":"v1","addr":"172.21.15.187:6810","nonce":915130263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":915130263},{"type":"v1","addr":"172.21.15.187:6815","nonce":915130263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":915130263},{"type":"v1","addr":"172.21.15.187:6813","nonce":915130263}]},"public_addr":"172.21.15.187:6805/915130263","cluster_addr":"172.21.15.187:6810/915130263","heartbeat_back_addr":"172.21.15.187:6815/915130263","heartbeat_front_addr":"172.21.15.187:6813/915130263","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":654976824},{"type":"v1","addr":"172.21.15.187:6817","nonce":654976824}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":654976824},{"type":"v1","addr":"172.21.15.187:6819","nonce":654976824}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":654976824},{"type":"v1","addr":"172.21.15.187:6823","nonce":654976824}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":654976824},{"type":"v1","addr":"172.21.15.187:6821","nonce":654976824}]},"public_addr":"172.21.15.187:6817/654976824","cluster_addr":"172.21.15.187:6819/654976824","heartbeat_back_addr":"172.21.15.187:6823/654976824","heartbeat_front_addr":"172.21.15.187:6821/654976824","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":4284059445},{"type":"v1","addr":"172.21.15.187:6825","nonce":4284059445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":4284059445},{"type":"v1","addr":"172.21.15.187:6827","nonce":4284059445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":4284059445},{"type":"v1","addr":"172.21.15.187:6831","nonce":4284059445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":4284059445},{"type":"v1","addr":"172.21.15.187:6829","nonce":4284059445}]},"public_addr":"172.21.15.187:6825/4284059445","cluster_addr":"172.21.15.187:6827/4284059445","heartbeat_back_addr":"172.21.15.187:6831/4284059445","heartbeat_front_addr":"172.21.15.187:6829/4284059445","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.819780+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.824193+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.849575+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.824806+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.809540+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.805093+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.866109+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.807372+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T19:57:10.741 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.738+0000 7fd166fdc700 1 -- 172.21.15.157:0/1621147318 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fd14406af00 msgr2=0x7fd14406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:10.741 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.738+0000 7fd166fdc700 1 --2- 172.21.15.157:0/1621147318 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fd14406af00 0x7fd14406d3c0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fd154009ad0 tx=0x7fd154008040 comp rx=0 tx=0).stop 2023-10-16T19:57:10.741 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.738+0000 7fd166fdc700 1 -- 172.21.15.157:0/1621147318 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd1600cbeb0 msgr2=0x7fd1600b60a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:10.741 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.738+0000 7fd166fdc700 1 --2- 172.21.15.157:0/1621147318 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd1600cbeb0 0x7fd1600b60a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fd14c014040 tx=0x7fd14c004750 comp rx=0 tx=0).stop 2023-10-16T19:57:10.741 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.738+0000 7fd166fdc700 1 -- 172.21.15.157:0/1621147318 shutdown_connections 2023-10-16T19:57:10.742 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.738+0000 7fd166fdc700 1 --2- 172.21.15.157:0/1621147318 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fd14406af00 0x7fd14406d3c0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:10.742 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.738+0000 7fd166fdc700 1 --2- 172.21.15.157:0/1621147318 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd16015b130 0x7fd1600b65e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:10.742 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.738+0000 7fd166fdc700 1 --2- 172.21.15.157:0/1621147318 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd16006d0f0 0x7fd16015b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:10.742 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.738+0000 7fd166fdc700 1 --2- 172.21.15.157:0/1621147318 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd1600cbeb0 0x7fd1600b60a0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:10.743 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.738+0000 7fd166fdc700 1 -- 172.21.15.157:0/1621147318 >> 172.21.15.157:0/1621147318 conn(0x7fd1600cd4e0 msgr2=0x7fd16006a850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:10.743 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.738+0000 7fd166fdc700 1 -- 172.21.15.157:0/1621147318 shutdown_connections 2023-10-16T19:57:10.743 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.738+0000 7fd166fdc700 1 -- 172.21.15.157:0/1621147318 wait complete. 2023-10-16T19:57:10.753 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-16T19:57:10.753 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-16T19:57:10.874 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.872+0000 7f6a983b0700 1 Processor -- start 2023-10-16T19:57:10.875 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.872+0000 7f6a983b0700 1 -- start start 2023-10-16T19:57:10.877 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.873+0000 7f6a983b0700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f6a9006af60 0x7f6a9006d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:10.878 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.873+0000 7f6a983b0700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a900d08b0 con 0x7f6a9015e2f0 2023-10-16T19:57:10.878 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.873+0000 7f6a983b0700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a901628f0 con 0x7f6a9006de00 2023-10-16T19:57:10.879 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.873+0000 7f6a983b0700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a90162bd0 con 0x7f6a9006af60 2023-10-16T19:57:10.879 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.873+0000 7f6a9594b700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f6a9006af60 0x7f6a9006d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:10.879 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.873+0000 7f6a9614c700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f6a9015e2f0 0x7f6a9006a850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:55308/0 (socket says 172.21.15.157:55308) 2023-10-16T19:57:10.880 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.873+0000 7f6a9614c700 1 -- 172.21.15.157:0/3290902306 learned_addr learned my addr 172.21.15.157:0/3290902306 (peer_addr_for_me v1:172.21.15.157:0/0) 2023-10-16T19:57:10.880 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.873+0000 7f6a9594b700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f6a9006af60 0x7f6a9006d0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:45638/0 (socket says 172.21.15.157:45638) 2023-10-16T19:57:10.880 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.873+0000 7f6a9594b700 1 -- 172.21.15.157:0/3290902306 >> v1:172.21.15.187:6789/0 conn(0x7f6a9006de00 legacy=0x7f6a90070f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:57:10.880 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.873+0000 7f6a9594b700 1 -- 172.21.15.157:0/3290902306 >> v1:172.21.15.157:6789/0 conn(0x7f6a9015e2f0 legacy=0x7f6a9006a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:10.880 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.873+0000 7f6a9594b700 1 -- 172.21.15.157:0/3290902306 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a900d05d0 con 0x7f6a9006af60 2023-10-16T19:57:10.881 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.873+0000 7f6a9514a700 1 -- 172.21.15.157:0/3290902306 <== mon.0 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3514337737 0 0) 0x7f6a900d08b0 con 0x7f6a9015e2f0 2023-10-16T19:57:10.881 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.873+0000 7f6a9594b700 1 --2- 172.21.15.157:0/3290902306 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6a9006af60 0x7f6a9006d0f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f6a80009840 tx=0x7f6a80009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c11b89d6e99bd89 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:10.881 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.873+0000 7f6a9514a700 1 -- 172.21.15.157:0/3290902306 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a80004230 con 0x7f6a9006af60 2023-10-16T19:57:10.881 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.873+0000 7f6a9514a700 1 -- 172.21.15.157:0/3290902306 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a80004390 con 0x7f6a9006af60 2023-10-16T19:57:10.881 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.873+0000 7f6a9514a700 1 -- 172.21.15.157:0/3290902306 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a800036a0 con 0x7f6a9006af60 2023-10-16T19:57:10.882 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.874+0000 7f6a983b0700 1 -- 172.21.15.157:0/3290902306 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6a9006af60 msgr2=0x7f6a9006d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:10.882 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.874+0000 7f6a983b0700 1 --2- 172.21.15.157:0/3290902306 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6a9006af60 0x7f6a9006d0f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f6a80009840 tx=0x7f6a80009b50 comp rx=0 tx=0).stop 2023-10-16T19:57:10.882 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.874+0000 7f6a983b0700 1 -- 172.21.15.157:0/3290902306 shutdown_connections 2023-10-16T19:57:10.882 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.874+0000 7f6a983b0700 1 --2- 172.21.15.157:0/3290902306 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6a9006af60 0x7f6a9006d0f0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:10.882 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.874+0000 7f6a983b0700 1 -- 172.21.15.157:0/3290902306 >> 172.21.15.157:0/3290902306 conn(0x7f6a900cd4e0 msgr2=0x7f6a900cd8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:10.883 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.874+0000 7f6a983b0700 1 -- 172.21.15.157:0/3290902306 shutdown_connections 2023-10-16T19:57:10.883 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.874+0000 7f6a983b0700 1 -- 172.21.15.157:0/3290902306 wait complete. 2023-10-16T19:57:10.883 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.875+0000 7f6a983b0700 1 Processor -- start 2023-10-16T19:57:10.883 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.875+0000 7f6a983b0700 1 -- start start 2023-10-16T19:57:10.886 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.876+0000 7f6a983b0700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6a9006af60 0x7f6a900b5130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:10.886 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.876+0000 7f6a983b0700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6a9006de00 0x7f6a901596a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:10.887 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.876+0000 7f6a983b0700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6a9015e2f0 0x7f6a9015c900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:10.887 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.876+0000 7f6a983b0700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a900c7360 con 0x7f6a9015e2f0 2023-10-16T19:57:10.887 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.876+0000 7f6a983b0700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a900c6070 con 0x7f6a9006de00 2023-10-16T19:57:10.887 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.876+0000 7f6a983b0700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a900c6ed0 con 0x7f6a9006af60 2023-10-16T19:57:10.887 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.876+0000 7f6a9694d700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6a9015e2f0 0x7f6a9015c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:10.888 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.876+0000 7f6a9694d700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6a9015e2f0 0x7f6a9015c900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:45646/0 (socket says 172.21.15.157:45646) 2023-10-16T19:57:10.888 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.876+0000 7f6a9694d700 1 -- 172.21.15.157:0/4232028555 learned_addr learned my addr 172.21.15.157:0/4232028555 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:57:10.888 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.876+0000 7f6a9614c700 1 --2- 172.21.15.157:0/4232028555 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6a9006af60 0x7f6a900b5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:10.888 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.876+0000 7f6a9594b700 1 --2- 172.21.15.157:0/4232028555 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6a9006de00 0x7f6a901596a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:10.889 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.876+0000 7f6a9694d700 1 -- 172.21.15.157:0/4232028555 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6a9006af60 msgr2=0x7f6a900b5130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:10.889 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.876+0000 7f6a9694d700 1 --2- 172.21.15.157:0/4232028555 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6a9006af60 0x7f6a900b5130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:10.889 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.876+0000 7f6a9694d700 1 -- 172.21.15.157:0/4232028555 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6a9006de00 msgr2=0x7f6a901596a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:10.890 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.876+0000 7f6a9694d700 1 --2- 172.21.15.157:0/4232028555 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6a9006de00 0x7f6a901596a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:10.890 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.876+0000 7f6a9694d700 1 -- 172.21.15.157:0/4232028555 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a800094a0 con 0x7f6a9015e2f0 2023-10-16T19:57:10.890 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.876+0000 7f6a9594b700 1 --2- 172.21.15.157:0/4232028555 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6a9006de00 0x7f6a901596a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T19:57:10.890 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.876+0000 7f6a9694d700 1 --2- 172.21.15.157:0/4232028555 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6a9015e2f0 0x7f6a9015c900 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f6a8800b9e0 tx=0x7f6a8800bcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:10.891 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.877+0000 7f6a86ffd700 1 -- 172.21.15.157:0/4232028555 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a8800c930 con 0x7f6a9015e2f0 2023-10-16T19:57:10.891 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.877+0000 7f6a86ffd700 1 -- 172.21.15.157:0/4232028555 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a8800cad0 con 0x7f6a9015e2f0 2023-10-16T19:57:10.891 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.877+0000 7f6a983b0700 1 -- 172.21.15.157:0/4232028555 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a900c62c0 con 0x7f6a9015e2f0 2023-10-16T19:57:10.891 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.877+0000 7f6a86ffd700 1 -- 172.21.15.157:0/4232028555 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a8800ce80 con 0x7f6a9015e2f0 2023-10-16T19:57:10.892 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.877+0000 7f6a983b0700 1 -- 172.21.15.157:0/4232028555 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a900c6880 con 0x7f6a9015e2f0 2023-10-16T19:57:10.892 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.877+0000 7f6a983b0700 1 -- 172.21.15.157:0/4232028555 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a900c7080 con 0x7f6a9015e2f0 2023-10-16T19:57:10.892 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.878+0000 7f6a86ffd700 1 -- 172.21.15.157:0/4232028555 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f6a88014440 con 0x7f6a9015e2f0 2023-10-16T19:57:10.892 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.878+0000 7f6a86ffd700 1 --2- 172.21.15.157:0/4232028555 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f6a7406af00 0x7f6a7406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:10.892 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.879+0000 7f6a86ffd700 1 -- 172.21.15.157:0/4232028555 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6a880890a0 con 0x7f6a9015e2f0 2023-10-16T19:57:10.893 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.879+0000 7f6a9614c700 1 --2- 172.21.15.157:0/4232028555 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f6a7406af00 0x7f6a7406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:10.893 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.879+0000 7f6a9614c700 1 --2- 172.21.15.157:0/4232028555 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f6a7406af00 0x7f6a7406d3c0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f6a8c000f60 tx=0x7f6a8c007e70 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:10.893 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:10.883+0000 7f6a86ffd700 1 -- 172.21.15.157:0/4232028555 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6a900c7080 con 0x7f6a9015e2f0 2023-10-16T19:57:11.069 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:11.067+0000 7f6a983b0700 1 -- 172.21.15.157:0/4232028555 --> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6a9015e6d0 con 0x7f6a7406af00 2023-10-16T19:57:11.077 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:11.075+0000 7f6a86ffd700 1 -- 172.21.15.157:0/4232028555 <== mgr.4100 v2:172.21.15.187:6832/2426285296 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+250117 (secure 0 0 0) 0x7f6a8c001290 con 0x7f6a7406af00 2023-10-16T19:57:11.081 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-10-16T19:57:11.083 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:11.078+0000 7f6a983b0700 1 -- 172.21.15.157:0/4232028555 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f6a7406af00 msgr2=0x7f6a7406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:11.083 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:11.078+0000 7f6a983b0700 1 --2- 172.21.15.157:0/4232028555 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f6a7406af00 0x7f6a7406d3c0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f6a8c000f60 tx=0x7f6a8c007e70 comp rx=0 tx=0).stop 2023-10-16T19:57:11.084 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:11.078+0000 7f6a983b0700 1 -- 172.21.15.157:0/4232028555 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6a9015e2f0 msgr2=0x7f6a9015c900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:11.084 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:11.078+0000 7f6a983b0700 1 --2- 172.21.15.157:0/4232028555 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6a9015e2f0 0x7f6a9015c900 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f6a8800b9e0 tx=0x7f6a8800bcf0 comp rx=0 tx=0).stop 2023-10-16T19:57:11.084 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:11.078+0000 7f6a983b0700 1 -- 172.21.15.157:0/4232028555 shutdown_connections 2023-10-16T19:57:11.084 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:11.078+0000 7f6a983b0700 1 --2- 172.21.15.157:0/4232028555 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6a9015e2f0 0x7f6a9015c900 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:11.085 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:11.078+0000 7f6a983b0700 1 --2- 172.21.15.157:0/4232028555 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6a9006af60 0x7f6a900b5130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:11.085 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:11.079+0000 7f6a983b0700 1 --2- 172.21.15.157:0/4232028555 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f6a7406af00 0x7f6a7406d3c0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:11.085 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:11.079+0000 7f6a983b0700 1 --2- 172.21.15.157:0/4232028555 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6a9006de00 0x7f6a901596a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:11.085 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:11.079+0000 7f6a983b0700 1 -- 172.21.15.157:0/4232028555 >> 172.21.15.157:0/4232028555 conn(0x7f6a900cd4e0 msgr2=0x7f6a900af870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:11.085 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:11.079+0000 7f6a983b0700 1 -- 172.21.15.157:0/4232028555 shutdown_connections 2023-10-16T19:57:11.086 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:11.079+0000 7f6a983b0700 1 -- 172.21.15.157:0/4232028555 wait complete. 2023-10-16T19:57:11.086 INFO:teuthology.orchestra.run.smithi157.stderr:dumped all 2023-10-16T19:57:11.093 INFO:teuthology.orchestra.run.smithi157.stdout:{"pg_ready":true,"pg_map":{"version":19,"stamp":"2023-10-16T19:57:10.891317+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":8,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":1585,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560914,"statfs":{"total":1600000000,"available":1598376609,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.919151"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-16T19:57:04.973649+0000","last_change":"2023-10-16T19:57:04.973649+0000","last_active":"2023-10-16T19:57:04.967702+0000","last_peered":"2023-10-16T19:57:04.967702+0000","last_clean":"2023-10-16T19:57:04.967702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:04.973649+0000","last_undegraded":"2023-10-16T19:57:04.973649+0000","last_fullsized":"2023-10-16T19:57:04.973649+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-16T19:57:04.974840+0000","last_change":"2023-10-16T19:57:04.974840+0000","last_active":"2023-10-16T19:57:04.967702+0000","last_peered":"2023-10-16T19:57:04.967702+0000","last_clean":"2023-10-16T19:57:04.967702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:04.974840+0000","last_undegraded":"2023-10-16T19:57:04.974840+0000","last_fullsized":"2023-10-16T19:57:04.974840+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-16T19:57:04.974328+0000","last_change":"2023-10-16T19:57:04.974328+0000","last_active":"2023-10-16T19:57:04.967702+0000","last_peered":"2023-10-16T19:57:04.967702+0000","last_clean":"2023-10-16T19:57:04.967702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:04.974328+0000","last_undegraded":"2023-10-16T19:57:04.974328+0000","last_fullsized":"2023-10-16T19:57:04.974328+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-16T19:57:04.975403+0000","last_change":"2023-10-16T19:57:04.975403+0000","last_active":"2023-10-16T19:57:04.967702+0000","last_peered":"2023-10-16T19:57:04.967702+0000","last_clean":"2023-10-16T19:57:04.967702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:04.975403+0000","last_undegraded":"2023-10-16T19:57:04.975403+0000","last_fullsized":"2023-10-16T19:57:04.975403+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-16T19:57:04.974498+0000","last_change":"2023-10-16T19:57:04.974498+0000","last_active":"2023-10-16T19:57:04.967702+0000","last_peered":"2023-10-16T19:57:04.967702+0000","last_clean":"2023-10-16T19:57:04.967702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:04.974498+0000","last_undegraded":"2023-10-16T19:57:04.974498+0000","last_fullsized":"2023-10-16T19:57:04.974498+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-16T19:57:04.974477+0000","last_change":"2023-10-16T19:57:04.974477+0000","last_active":"2023-10-16T19:57:04.967702+0000","last_peered":"2023-10-16T19:57:04.967702+0000","last_clean":"2023-10-16T19:57:04.967702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:04.974477+0000","last_undegraded":"2023-10-16T19:57:04.974477+0000","last_fullsized":"2023-10-16T19:57:04.974477+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-16T19:57:04.974484+0000","last_change":"2023-10-16T19:57:04.974484+0000","last_active":"2023-10-16T19:57:04.967702+0000","last_peered":"2023-10-16T19:57:04.967702+0000","last_clean":"2023-10-16T19:57:04.967702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:04.974484+0000","last_undegraded":"2023-10-16T19:57:04.974484+0000","last_fullsized":"2023-10-16T19:57:04.974484+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-16T19:57:04.977118+0000","last_change":"2023-10-16T19:57:04.977118+0000","last_active":"2023-10-16T19:57:04.967702+0000","last_peered":"2023-10-16T19:57:04.967702+0000","last_clean":"2023-10-16T19:57:04.967702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:04.977118+0000","last_undegraded":"2023-10-16T19:57:04.977118+0000","last_fullsized":"2023-10-16T19:57:04.977118+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-16T19:57:04.974103+0000","last_change":"2023-10-16T19:57:04.974103+0000","last_active":"2023-10-16T19:57:04.967702+0000","last_peered":"2023-10-16T19:57:04.967702+0000","last_clean":"2023-10-16T19:57:04.967702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:04.974103+0000","last_undegraded":"2023-10-16T19:57:04.974103+0000","last_fullsized":"2023-10-16T19:57:04.974103+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-16T19:57:04.976978+0000","last_change":"2023-10-16T19:57:04.976978+0000","last_active":"2023-10-16T19:57:04.967702+0000","last_peered":"2023-10-16T19:57:04.967702+0000","last_clean":"2023-10-16T19:57:04.967702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:04.976978+0000","last_undegraded":"2023-10-16T19:57:04.976978+0000","last_fullsized":"2023-10-16T19:57:04.976978+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-16T19:57:04.975501+0000","last_change":"2023-10-16T19:57:04.975501+0000","last_active":"2023-10-16T19:57:04.967702+0000","last_peered":"2023-10-16T19:57:04.967702+0000","last_clean":"2023-10-16T19:57:04.967702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:04.975501+0000","last_undegraded":"2023-10-16T19:57:04.975501+0000","last_fullsized":"2023-10-16T19:57:04.975501+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-16T19:57:04.973701+0000","last_change":"2023-10-16T19:57:04.973701+0000","last_active":"2023-10-16T19:57:04.967702+0000","last_peered":"2023-10-16T19:57:04.967702+0000","last_clean":"2023-10-16T19:57:04.967702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:04.973701+0000","last_undegraded":"2023-10-16T19:57:04.973701+0000","last_fullsized":"2023-10-16T19:57:04.973701+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-16T19:57:04.973640+0000","last_change":"2023-10-16T19:57:04.973640+0000","last_active":"2023-10-16T19:57:04.967702+0000","last_peered":"2023-10-16T19:57:04.967702+0000","last_clean":"2023-10-16T19:57:04.967702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:04.973640+0000","last_undegraded":"2023-10-16T19:57:04.973640+0000","last_fullsized":"2023-10-16T19:57:04.973640+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-16T19:57:04.976037+0000","last_change":"2023-10-16T19:57:04.976037+0000","last_active":"2023-10-16T19:57:04.967702+0000","last_peered":"2023-10-16T19:57:04.967702+0000","last_clean":"2023-10-16T19:57:04.967702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:04.976037+0000","last_undegraded":"2023-10-16T19:57:04.976037+0000","last_fullsized":"2023-10-16T19:57:04.976037+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-16T19:57:04.973680+0000","last_change":"2023-10-16T19:57:04.973680+0000","last_active":"2023-10-16T19:57:04.967702+0000","last_peered":"2023-10-16T19:57:04.967702+0000","last_clean":"2023-10-16T19:57:04.967702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:04.973680+0000","last_undegraded":"2023-10-16T19:57:04.973680+0000","last_fullsized":"2023-10-16T19:57:04.973680+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-16T19:57:04.977796+0000","last_change":"2023-10-16T19:57:04.977796+0000","last_active":"2023-10-16T19:57:04.967702+0000","last_peered":"2023-10-16T19:57:04.967702+0000","last_clean":"2023-10-16T19:57:04.967702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:04.977796+0000","last_undegraded":"2023-10-16T19:57:04.977796+0000","last_fullsized":"2023-10-16T19:57:04.977796+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-16T19:57:04.972878+0000","last_change":"2023-10-16T19:57:04.972878+0000","last_active":"2023-10-16T19:57:04.967702+0000","last_peered":"2023-10-16T19:57:04.967702+0000","last_clean":"2023-10-16T19:57:04.967702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:04.972878+0000","last_undegraded":"2023-10-16T19:57:04.972878+0000","last_fullsized":"2023-10-16T19:57:04.972878+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-16T19:57:04.975078+0000","last_change":"2023-10-16T19:57:04.975078+0000","last_active":"2023-10-16T19:57:04.967702+0000","last_peered":"2023-10-16T19:57:04.967702+0000","last_clean":"2023-10-16T19:57:04.967702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:04.975078+0000","last_undegraded":"2023-10-16T19:57:04.975078+0000","last_fullsized":"2023-10-16T19:57:04.975078+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-16T19:57:04.975630+0000","last_change":"2023-10-16T19:57:04.975630+0000","last_active":"2023-10-16T19:57:04.967702+0000","last_peered":"2023-10-16T19:57:04.967702+0000","last_clean":"2023-10-16T19:57:04.967702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:04.975630+0000","last_undegraded":"2023-10-16T19:57:04.975630+0000","last_fullsized":"2023-10-16T19:57:04.975630+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-16T19:57:04.977484+0000","last_change":"2023-10-16T19:57:04.977484+0000","last_active":"2023-10-16T19:57:04.967702+0000","last_peered":"2023-10-16T19:57:04.967702+0000","last_clean":"2023-10-16T19:57:04.967702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:04.977484+0000","last_undegraded":"2023-10-16T19:57:04.977484+0000","last_fullsized":"2023-10-16T19:57:04.977484+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-16T19:57:04.975685+0000","last_change":"2023-10-16T19:57:04.975685+0000","last_active":"2023-10-16T19:57:04.967702+0000","last_peered":"2023-10-16T19:57:04.967702+0000","last_clean":"2023-10-16T19:57:04.967702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:04.975685+0000","last_undegraded":"2023-10-16T19:57:04.975685+0000","last_fullsized":"2023-10-16T19:57:04.975685+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":162,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-16T19:57:00.898304+0000","last_change":"2023-10-16T19:56:58.775782+0000","last_active":"2023-10-16T19:57:00.898304+0000","last_peered":"2023-10-16T19:57:00.898304+0000","last_clean":"2023-10-16T19:57:00.898304+0000","last_became_active":"2023-10-16T19:56:58.775567+0000","last_became_peered":"2023-10-16T19:56:58.775567+0000","last_unstale":"2023-10-16T19:57:00.898304+0000","last_undegraded":"2023-10-16T19:57:00.898304+0000","last_fullsized":"2023-10-16T19:57:00.898304+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:56:57.693332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:56:57.693332+0000","last_clean_scrub_stamp":"2023-10-16T19:56:57.693332+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:10:23.849736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-16T19:57:04.974266+0000","last_change":"2023-10-16T19:57:04.974266+0000","last_active":"2023-10-16T19:57:04.967702+0000","last_peered":"2023-10-16T19:57:04.967702+0000","last_clean":"2023-10-16T19:57:04.967702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:04.974266+0000","last_undegraded":"2023-10-16T19:57:04.974266+0000","last_fullsized":"2023-10-16T19:57:04.974266+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-16T19:57:04.974682+0000","last_change":"2023-10-16T19:57:04.974682+0000","last_active":"2023-10-16T19:57:04.967702+0000","last_peered":"2023-10-16T19:57:04.967702+0000","last_clean":"2023-10-16T19:57:04.967702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:04.974682+0000","last_undegraded":"2023-10-16T19:57:04.974682+0000","last_fullsized":"2023-10-16T19:57:04.974682+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-16T19:57:04.975232+0000","last_change":"2023-10-16T19:57:04.975232+0000","last_active":"2023-10-16T19:57:04.967702+0000","last_peered":"2023-10-16T19:57:04.967702+0000","last_clean":"2023-10-16T19:57:04.967702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:04.975232+0000","last_undegraded":"2023-10-16T19:57:04.975232+0000","last_fullsized":"2023-10-16T19:57:04.975232+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-16T19:57:04.973273+0000","last_change":"2023-10-16T19:57:04.973273+0000","last_active":"2023-10-16T19:57:04.967702+0000","last_peered":"2023-10-16T19:57:04.967702+0000","last_clean":"2023-10-16T19:57:04.967702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:04.973273+0000","last_undegraded":"2023-10-16T19:57:04.973273+0000","last_fullsized":"2023-10-16T19:57:04.973273+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-16T19:57:04.975030+0000","last_change":"2023-10-16T19:57:04.975030+0000","last_active":"2023-10-16T19:57:04.967702+0000","last_peered":"2023-10-16T19:57:04.967702+0000","last_clean":"2023-10-16T19:57:04.967702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:04.975030+0000","last_undegraded":"2023-10-16T19:57:04.975030+0000","last_fullsized":"2023-10-16T19:57:04.975030+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-16T19:57:04.975439+0000","last_change":"2023-10-16T19:57:04.975439+0000","last_active":"2023-10-16T19:57:04.967702+0000","last_peered":"2023-10-16T19:57:04.967702+0000","last_clean":"2023-10-16T19:57:04.967702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:04.975439+0000","last_undegraded":"2023-10-16T19:57:04.975439+0000","last_fullsized":"2023-10-16T19:57:04.975439+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-16T19:57:04.975072+0000","last_change":"2023-10-16T19:57:04.975072+0000","last_active":"2023-10-16T19:57:04.967702+0000","last_peered":"2023-10-16T19:57:04.967702+0000","last_clean":"2023-10-16T19:57:04.967702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:04.975072+0000","last_undegraded":"2023-10-16T19:57:04.975072+0000","last_fullsized":"2023-10-16T19:57:04.975072+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-16T19:57:04.974558+0000","last_change":"2023-10-16T19:57:04.974558+0000","last_active":"2023-10-16T19:57:04.967702+0000","last_peered":"2023-10-16T19:57:04.967702+0000","last_clean":"2023-10-16T19:57:04.967702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:04.974558+0000","last_undegraded":"2023-10-16T19:57:04.974558+0000","last_fullsized":"2023-10-16T19:57:04.974558+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-16T19:57:04.977460+0000","last_change":"2023-10-16T19:57:04.977460+0000","last_active":"2023-10-16T19:57:04.967702+0000","last_peered":"2023-10-16T19:57:04.967702+0000","last_clean":"2023-10-16T19:57:04.967702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:04.977460+0000","last_undegraded":"2023-10-16T19:57:04.977460+0000","last_fullsized":"2023-10-16T19:57:04.977460+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-16T19:57:04.975874+0000","last_change":"2023-10-16T19:57:04.975874+0000","last_active":"2023-10-16T19:57:04.967702+0000","last_peered":"2023-10-16T19:57:04.967702+0000","last_clean":"2023-10-16T19:57:04.967702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:04.975874+0000","last_undegraded":"2023-10-16T19:57:04.975874+0000","last_fullsized":"2023-10-16T19:57:04.975874+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-16T19:57:04.977430+0000","last_change":"2023-10-16T19:57:04.977430+0000","last_active":"2023-10-16T19:57:04.967702+0000","last_peered":"2023-10-16T19:57:04.967702+0000","last_clean":"2023-10-16T19:57:04.967702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:04.977430+0000","last_undegraded":"2023-10-16T19:57:04.977430+0000","last_fullsized":"2023-10-16T19:57:04.977430+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574851,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":631,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194681,"statfs":{"total":200000000,"available":199353573,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46300000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41199999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60799999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70099999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":49,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195263,"statfs":{"total":200000000,"available":199949758,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58099999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35699999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48499999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574851,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":54,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195257,"statfs":{"total":200000000,"available":199943941,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38700000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34399999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40100000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48899999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]}]},{"osd":0,"up_from":13,"seq":55834574851,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":631,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194681,"statfs":{"total":200000000,"available":199353573,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.249}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34300000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32900000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52800000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42899999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45500000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":54,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195257,"statfs":{"total":200000000,"available":199943941,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45200000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33700000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52300000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65100000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.502}]}]},{"osd":3,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":54,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195257,"statfs":{"total":200000000,"available":199943941,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36699999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38300000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33400000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67400000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":54,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195257,"statfs":{"total":200000000,"available":199943941,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.622}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66000000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.371}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45200000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47899999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":54,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195257,"statfs":{"total":200000000,"available":199943941,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41399999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45800000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38700000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44400000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]}]}],"pool_statfs":[]}} 2023-10-16T19:57:11.099 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-16T19:57:11.223 INFO:tasks.ceph.mds.d.smithi187.stderr:2023-10-16T19:57:11.222+0000 7fb39fe99700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-16T19:57:11.253 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:11.251+0000 7f6f1bcff700 1 Processor -- start 2023-10-16T19:57:11.254 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:11.251+0000 7f6f1bcff700 1 -- start start 2023-10-16T19:57:11.256 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:11.252+0000 7f6f1bcff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f6f1415e2f0 0x7f6f1406d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:11.256 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:11.252+0000 7f6f1bcff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6f1406af60 0x7f6f140ce910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:11.256 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:11.252+0000 7f6f1bcff700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f140d08b0 con 0x7f6f1406de00 2023-10-16T19:57:11.257 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:11.252+0000 7f6f1bcff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f141628f0 con 0x7f6f1415e2f0 2023-10-16T19:57:11.257 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:11.252+0000 7f6f1bcff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f14162bd0 con 0x7f6f1406af60 2023-10-16T19:57:11.257 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:11.252+0000 7f6f1929a700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f6f1406de00 0x7f6f1406a850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:55322/0 (socket says 172.21.15.157:55322) 2023-10-16T19:57:11.257 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:11.252+0000 7f6f1929a700 1 -- 172.21.15.157:0/2867794306 learned_addr learned my addr 172.21.15.157:0/2867794306 (peer_addr_for_me v1:172.21.15.157:0/0) 2023-10-16T19:57:11.257 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:11.252+0000 7f6f1a29c700 1 --2- 172.21.15.157:0/2867794306 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6f1406af60 0x7f6f140ce910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:11.258 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:11.252+0000 7f6f19a9b700 1 --2- 172.21.15.157:0/2867794306 >> v2:172.21.15.187:3300/0 conn(0x7f6f1415e2f0 0x7f6f1406d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:11.258 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:11.252+0000 7f6f18a99700 1 -- 172.21.15.157:0/2867794306 <== mon.0 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 489213543 0 0) 0x7f6f140d08b0 con 0x7f6f1406de00 2023-10-16T19:57:11.258 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:11.252+0000 7f6f18a99700 1 -- 172.21.15.157:0/2867794306 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6f000035b0 con 0x7f6f1406de00 2023-10-16T19:57:11.258 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:11.252+0000 7f6f1a29c700 1 -- 172.21.15.157:0/2867794306 >> v2:172.21.15.187:3300/0 conn(0x7f6f1415e2f0 msgr2=0x7f6f1406d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:57:11.259 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:11.252+0000 7f6f1a29c700 1 --2- 172.21.15.157:0/2867794306 >> v2:172.21.15.187:3300/0 conn(0x7f6f1415e2f0 0x7f6f1406d0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:11.259 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:11.252+0000 7f6f1a29c700 1 -- 172.21.15.157:0/2867794306 >> v1:172.21.15.157:6789/0 conn(0x7f6f1406de00 legacy=0x7f6f1406a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:11.259 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:11.252+0000 7f6f18a99700 1 -- 172.21.15.157:0/2867794306 <== mon.0 v1:172.21.15.157:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2566491317 0 0) 0x7f6f000035b0 con 0x7f6f1406de00 2023-10-16T19:57:11.259 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:11.252+0000 7f6f1a29c700 1 -- 172.21.15.157:0/2867794306 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f140d05d0 con 0x7f6f1406af60 2023-10-16T19:57:11.259 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:11.252+0000 7f6f1a29c700 1 --2- 172.21.15.157:0/2867794306 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6f1406af60 0x7f6f140ce910 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f6f0c009d90 tx=0x7f6f0c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=89bc037e862516e4 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:11.260 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:11.253+0000 7f6f18a99700 1 -- 172.21.15.157:0/2867794306 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f0c00e070 con 0x7f6f1406af60 2023-10-16T19:57:11.260 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:11.253+0000 7f6f18a99700 1 -- 172.21.15.157:0/2867794306 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f0c003a70 con 0x7f6f1406af60 2023-10-16T19:57:11.260 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:11.253+0000 7f6f18a99700 1 -- 172.21.15.157:0/2867794306 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f04001670 con 0x7f6f1406af60 2023-10-16T19:57:11.260 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:11.253+0000 7f6f1bcff700 1 -- 172.21.15.157:0/2867794306 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6f1406af60 msgr2=0x7f6f140ce910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:11.260 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:11.253+0000 7f6f1bcff700 1 --2- 172.21.15.157:0/2867794306 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6f1406af60 0x7f6f140ce910 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f6f0c009d90 tx=0x7f6f0c00b330 comp rx=0 tx=0).stop 2023-10-16T19:57:11.261 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:11.253+0000 7f6f1bcff700 1 -- 172.21.15.157:0/2867794306 shutdown_connections 2023-10-16T19:57:11.261 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:11.253+0000 7f6f1bcff700 1 --2- 172.21.15.157:0/2867794306 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6f1406af60 0x7f6f140ce910 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:11.261 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:11.253+0000 7f6f1bcff700 1 --2- 172.21.15.157:0/2867794306 >> v2:172.21.15.187:3300/0 conn(0x7f6f1415e2f0 0x7f6f1406d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:11.261 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:11.253+0000 7f6f1bcff700 1 -- 172.21.15.157:0/2867794306 >> 172.21.15.157:0/2867794306 conn(0x7f6f140cd4e0 msgr2=0x7f6f140cd8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:11.261 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:11.253+0000 7f6f1bcff700 1 -- 172.21.15.157:0/2867794306 shutdown_connections 2023-10-16T19:57:11.262 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:11.253+0000 7f6f1bcff700 1 -- 172.21.15.157:0/2867794306 wait complete. 2023-10-16T19:57:11.265 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:11.255+0000 7f6f1bcff700 1 Processor -- start 2023-10-16T19:57:11.265 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:11.255+0000 7f6f1bcff700 1 -- start start 2023-10-16T19:57:11.265 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:11.256+0000 7f6f1bcff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6f1406af60 0x7f6f140b4770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:11.265 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:11.256+0000 7f6f1bcff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6f1406de00 0x7f6f141f34c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:11.265 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:11.256+0000 7f6f1bcff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6f1415e2f0 0x7f6f141f7210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:11.266 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:11.256+0000 7f6f1bcff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f140b56a0 con 0x7f6f1406af60 2023-10-16T19:57:11.266 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:11.256+0000 7f6f1bcff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f140b4e00 con 0x7f6f1415e2f0 2023-10-16T19:57:11.266 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:11.256+0000 7f6f1bcff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f140b50e0 con 0x7f6f1406de00 2023-10-16T19:57:11.266 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:11.256+0000 7f6f19a9b700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6f1406af60 0x7f6f140b4770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:11.267 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:11.256+0000 7f6f19a9b700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6f1406af60 0x7f6f140b4770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:45654/0 (socket says 172.21.15.157:45654) 2023-10-16T19:57:11.267 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:11.256+0000 7f6f19a9b700 1 -- 172.21.15.157:0/611977985 learned_addr learned my addr 172.21.15.157:0/611977985 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:57:11.267 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:11.256+0000 7f6f1929a700 1 --2- 172.21.15.157:0/611977985 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6f1406de00 0x7f6f141f34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:11.267 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:11.256+0000 7f6f19a9b700 1 -- 172.21.15.157:0/611977985 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6f1406de00 msgr2=0x7f6f141f34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:11.267 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:11.256+0000 7f6f19a9b700 1 --2- 172.21.15.157:0/611977985 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6f1406de00 0x7f6f141f34c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:11.268 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:11.256+0000 7f6f19a9b700 1 -- 172.21.15.157:0/611977985 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6f1415e2f0 msgr2=0x7f6f141f7210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:11.268 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:11.256+0000 7f6f1a29c700 1 --2- 172.21.15.157:0/611977985 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6f1415e2f0 0x7f6f141f7210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:11.268 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:11.256+0000 7f6f19a9b700 1 --2- 172.21.15.157:0/611977985 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6f1415e2f0 0x7f6f141f7210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:11.268 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:11.256+0000 7f6f19a9b700 1 -- 172.21.15.157:0/611977985 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f0c009a70 con 0x7f6f1406af60 2023-10-16T19:57:11.268 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:11.256+0000 7f6f1929a700 1 --2- 172.21.15.157:0/611977985 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6f1406de00 0x7f6f141f34c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T19:57:11.268 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:11.256+0000 7f6f19a9b700 1 --2- 172.21.15.157:0/611977985 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6f1406af60 0x7f6f140b4770 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f6f1000e870 tx=0x7f6f1000ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:11.269 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:11.256+0000 7f6f0a7fc700 1 -- 172.21.15.157:0/611977985 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f10009590 con 0x7f6f1406af60 2023-10-16T19:57:11.269 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:11.256+0000 7f6f0a7fc700 1 -- 172.21.15.157:0/611977985 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f1000ee70 con 0x7f6f1406af60 2023-10-16T19:57:11.269 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:11.256+0000 7f6f0a7fc700 1 -- 172.21.15.157:0/611977985 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f1000ca50 con 0x7f6f1406af60 2023-10-16T19:57:11.269 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:11.256+0000 7f6f1bcff700 1 -- 172.21.15.157:0/611977985 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f140b53c0 con 0x7f6f1406af60 2023-10-16T19:57:11.269 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:11.257+0000 7f6f1bcff700 1 -- 172.21.15.157:0/611977985 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f140b5f20 con 0x7f6f1406af60 2023-10-16T19:57:11.270 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:11.257+0000 7f6f1bcff700 1 -- 172.21.15.157:0/611977985 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f1404f400 con 0x7f6f1406af60 2023-10-16T19:57:11.270 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:11.258+0000 7f6f0a7fc700 1 -- 172.21.15.157:0/611977985 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f6f1000cbb0 con 0x7f6f1406af60 2023-10-16T19:57:11.270 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:11.258+0000 7f6f0a7fc700 1 --2- 172.21.15.157:0/611977985 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f6ef806af00 0x7f6ef806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:11.270 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:11.258+0000 7f6f0a7fc700 1 -- 172.21.15.157:0/611977985 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6f10089550 con 0x7f6f1406af60 2023-10-16T19:57:11.271 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:11.259+0000 7f6f1929a700 1 --2- 172.21.15.157:0/611977985 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f6ef806af00 0x7f6ef806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:11.271 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:11.259+0000 7f6f1929a700 1 --2- 172.21.15.157:0/611977985 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f6ef806af00 0x7f6ef806d3c0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f6f1415dd00 tx=0x7f6f04009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:11.271 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:11.263+0000 7f6f0a7fc700 1 -- 172.21.15.157:0/611977985 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6f10054600 con 0x7f6f1406af60 2023-10-16T19:57:11.451 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:11.449+0000 7f6f1bcff700 1 -- 172.21.15.157:0/611977985 --> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6f140b02a0 con 0x7f6ef806af00 2023-10-16T19:57:11.461 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:11.456+0000 7f6f0a7fc700 1 -- 172.21.15.157:0/611977985 <== mgr.4100 v2:172.21.15.187:6832/2426285296 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+250117 (secure 0 0 0) 0x7f6f04007d30 con 0x7f6ef806af00 2023-10-16T19:57:11.464 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-10-16T19:57:11.466 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:11.460+0000 7f6f1bcff700 1 -- 172.21.15.157:0/611977985 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f6ef806af00 msgr2=0x7f6ef806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:11.467 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:11.460+0000 7f6f1bcff700 1 --2- 172.21.15.157:0/611977985 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f6ef806af00 0x7f6ef806d3c0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f6f1415dd00 tx=0x7f6f04009040 comp rx=0 tx=0).stop 2023-10-16T19:57:11.467 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:11.460+0000 7f6f1bcff700 1 -- 172.21.15.157:0/611977985 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6f1406af60 msgr2=0x7f6f140b4770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:11.467 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:11.460+0000 7f6f1bcff700 1 --2- 172.21.15.157:0/611977985 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6f1406af60 0x7f6f140b4770 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f6f1000e870 tx=0x7f6f1000ec30 comp rx=0 tx=0).stop 2023-10-16T19:57:11.467 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:11.460+0000 7f6f1bcff700 1 -- 172.21.15.157:0/611977985 shutdown_connections 2023-10-16T19:57:11.468 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:11.460+0000 7f6f1bcff700 1 --2- 172.21.15.157:0/611977985 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f6ef806af00 0x7f6ef806d3c0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:11.468 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:11.460+0000 7f6f1bcff700 1 --2- 172.21.15.157:0/611977985 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6f1415e2f0 0x7f6f141f7210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:11.468 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:11.460+0000 7f6f1bcff700 1 --2- 172.21.15.157:0/611977985 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6f1406af60 0x7f6f140b4770 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:11.468 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:11.460+0000 7f6f1bcff700 1 --2- 172.21.15.157:0/611977985 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6f1406de00 0x7f6f141f34c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:11.468 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:11.460+0000 7f6f1bcff700 1 -- 172.21.15.157:0/611977985 >> 172.21.15.157:0/611977985 conn(0x7f6f140cd4e0 msgr2=0x7f6f1406a850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:11.469 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:11.460+0000 7f6f1bcff700 1 -- 172.21.15.157:0/611977985 shutdown_connections 2023-10-16T19:57:11.469 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:11.460+0000 7f6f1bcff700 1 -- 172.21.15.157:0/611977985 wait complete. 2023-10-16T19:57:11.469 INFO:teuthology.orchestra.run.smithi157.stderr:dumped all 2023-10-16T19:57:11.474 INFO:teuthology.orchestra.run.smithi157.stdout:{"pg_ready":true,"pg_map":{"version":19,"stamp":"2023-10-16T19:57:10.891317+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":8,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":1585,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560914,"statfs":{"total":1600000000,"available":1598376609,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.919151"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-16T19:57:04.973649+0000","last_change":"2023-10-16T19:57:04.973649+0000","last_active":"2023-10-16T19:57:04.967702+0000","last_peered":"2023-10-16T19:57:04.967702+0000","last_clean":"2023-10-16T19:57:04.967702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:04.973649+0000","last_undegraded":"2023-10-16T19:57:04.973649+0000","last_fullsized":"2023-10-16T19:57:04.973649+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-16T19:57:04.974840+0000","last_change":"2023-10-16T19:57:04.974840+0000","last_active":"2023-10-16T19:57:04.967702+0000","last_peered":"2023-10-16T19:57:04.967702+0000","last_clean":"2023-10-16T19:57:04.967702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:04.974840+0000","last_undegraded":"2023-10-16T19:57:04.974840+0000","last_fullsized":"2023-10-16T19:57:04.974840+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-16T19:57:04.974328+0000","last_change":"2023-10-16T19:57:04.974328+0000","last_active":"2023-10-16T19:57:04.967702+0000","last_peered":"2023-10-16T19:57:04.967702+0000","last_clean":"2023-10-16T19:57:04.967702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:04.974328+0000","last_undegraded":"2023-10-16T19:57:04.974328+0000","last_fullsized":"2023-10-16T19:57:04.974328+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-16T19:57:04.975403+0000","last_change":"2023-10-16T19:57:04.975403+0000","last_active":"2023-10-16T19:57:04.967702+0000","last_peered":"2023-10-16T19:57:04.967702+0000","last_clean":"2023-10-16T19:57:04.967702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:04.975403+0000","last_undegraded":"2023-10-16T19:57:04.975403+0000","last_fullsized":"2023-10-16T19:57:04.975403+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-16T19:57:04.974498+0000","last_change":"2023-10-16T19:57:04.974498+0000","last_active":"2023-10-16T19:57:04.967702+0000","last_peered":"2023-10-16T19:57:04.967702+0000","last_clean":"2023-10-16T19:57:04.967702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:04.974498+0000","last_undegraded":"2023-10-16T19:57:04.974498+0000","last_fullsized":"2023-10-16T19:57:04.974498+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-16T19:57:04.974477+0000","last_change":"2023-10-16T19:57:04.974477+0000","last_active":"2023-10-16T19:57:04.967702+0000","last_peered":"2023-10-16T19:57:04.967702+0000","last_clean":"2023-10-16T19:57:04.967702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:04.974477+0000","last_undegraded":"2023-10-16T19:57:04.974477+0000","last_fullsized":"2023-10-16T19:57:04.974477+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-16T19:57:04.974484+0000","last_change":"2023-10-16T19:57:04.974484+0000","last_active":"2023-10-16T19:57:04.967702+0000","last_peered":"2023-10-16T19:57:04.967702+0000","last_clean":"2023-10-16T19:57:04.967702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:04.974484+0000","last_undegraded":"2023-10-16T19:57:04.974484+0000","last_fullsized":"2023-10-16T19:57:04.974484+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-16T19:57:04.977118+0000","last_change":"2023-10-16T19:57:04.977118+0000","last_active":"2023-10-16T19:57:04.967702+0000","last_peered":"2023-10-16T19:57:04.967702+0000","last_clean":"2023-10-16T19:57:04.967702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:04.977118+0000","last_undegraded":"2023-10-16T19:57:04.977118+0000","last_fullsized":"2023-10-16T19:57:04.977118+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-16T19:57:04.974103+0000","last_change":"2023-10-16T19:57:04.974103+0000","last_active":"2023-10-16T19:57:04.967702+0000","last_peered":"2023-10-16T19:57:04.967702+0000","last_clean":"2023-10-16T19:57:04.967702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:04.974103+0000","last_undegraded":"2023-10-16T19:57:04.974103+0000","last_fullsized":"2023-10-16T19:57:04.974103+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-16T19:57:04.976978+0000","last_change":"2023-10-16T19:57:04.976978+0000","last_active":"2023-10-16T19:57:04.967702+0000","last_peered":"2023-10-16T19:57:04.967702+0000","last_clean":"2023-10-16T19:57:04.967702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:04.976978+0000","last_undegraded":"2023-10-16T19:57:04.976978+0000","last_fullsized":"2023-10-16T19:57:04.976978+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-16T19:57:04.975501+0000","last_change":"2023-10-16T19:57:04.975501+0000","last_active":"2023-10-16T19:57:04.967702+0000","last_peered":"2023-10-16T19:57:04.967702+0000","last_clean":"2023-10-16T19:57:04.967702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:04.975501+0000","last_undegraded":"2023-10-16T19:57:04.975501+0000","last_fullsized":"2023-10-16T19:57:04.975501+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-16T19:57:04.973701+0000","last_change":"2023-10-16T19:57:04.973701+0000","last_active":"2023-10-16T19:57:04.967702+0000","last_peered":"2023-10-16T19:57:04.967702+0000","last_clean":"2023-10-16T19:57:04.967702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:04.973701+0000","last_undegraded":"2023-10-16T19:57:04.973701+0000","last_fullsized":"2023-10-16T19:57:04.973701+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-16T19:57:04.973640+0000","last_change":"2023-10-16T19:57:04.973640+0000","last_active":"2023-10-16T19:57:04.967702+0000","last_peered":"2023-10-16T19:57:04.967702+0000","last_clean":"2023-10-16T19:57:04.967702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:04.973640+0000","last_undegraded":"2023-10-16T19:57:04.973640+0000","last_fullsized":"2023-10-16T19:57:04.973640+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-16T19:57:04.976037+0000","last_change":"2023-10-16T19:57:04.976037+0000","last_active":"2023-10-16T19:57:04.967702+0000","last_peered":"2023-10-16T19:57:04.967702+0000","last_clean":"2023-10-16T19:57:04.967702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:04.976037+0000","last_undegraded":"2023-10-16T19:57:04.976037+0000","last_fullsized":"2023-10-16T19:57:04.976037+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-16T19:57:04.973680+0000","last_change":"2023-10-16T19:57:04.973680+0000","last_active":"2023-10-16T19:57:04.967702+0000","last_peered":"2023-10-16T19:57:04.967702+0000","last_clean":"2023-10-16T19:57:04.967702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:04.973680+0000","last_undegraded":"2023-10-16T19:57:04.973680+0000","last_fullsized":"2023-10-16T19:57:04.973680+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-16T19:57:04.977796+0000","last_change":"2023-10-16T19:57:04.977796+0000","last_active":"2023-10-16T19:57:04.967702+0000","last_peered":"2023-10-16T19:57:04.967702+0000","last_clean":"2023-10-16T19:57:04.967702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:04.977796+0000","last_undegraded":"2023-10-16T19:57:04.977796+0000","last_fullsized":"2023-10-16T19:57:04.977796+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-16T19:57:04.972878+0000","last_change":"2023-10-16T19:57:04.972878+0000","last_active":"2023-10-16T19:57:04.967702+0000","last_peered":"2023-10-16T19:57:04.967702+0000","last_clean":"2023-10-16T19:57:04.967702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:04.972878+0000","last_undegraded":"2023-10-16T19:57:04.972878+0000","last_fullsized":"2023-10-16T19:57:04.972878+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-16T19:57:04.975078+0000","last_change":"2023-10-16T19:57:04.975078+0000","last_active":"2023-10-16T19:57:04.967702+0000","last_peered":"2023-10-16T19:57:04.967702+0000","last_clean":"2023-10-16T19:57:04.967702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:04.975078+0000","last_undegraded":"2023-10-16T19:57:04.975078+0000","last_fullsized":"2023-10-16T19:57:04.975078+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-16T19:57:04.975630+0000","last_change":"2023-10-16T19:57:04.975630+0000","last_active":"2023-10-16T19:57:04.967702+0000","last_peered":"2023-10-16T19:57:04.967702+0000","last_clean":"2023-10-16T19:57:04.967702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:04.975630+0000","last_undegraded":"2023-10-16T19:57:04.975630+0000","last_fullsized":"2023-10-16T19:57:04.975630+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-16T19:57:04.977484+0000","last_change":"2023-10-16T19:57:04.977484+0000","last_active":"2023-10-16T19:57:04.967702+0000","last_peered":"2023-10-16T19:57:04.967702+0000","last_clean":"2023-10-16T19:57:04.967702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:04.977484+0000","last_undegraded":"2023-10-16T19:57:04.977484+0000","last_fullsized":"2023-10-16T19:57:04.977484+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-16T19:57:04.975685+0000","last_change":"2023-10-16T19:57:04.975685+0000","last_active":"2023-10-16T19:57:04.967702+0000","last_peered":"2023-10-16T19:57:04.967702+0000","last_clean":"2023-10-16T19:57:04.967702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:04.975685+0000","last_undegraded":"2023-10-16T19:57:04.975685+0000","last_fullsized":"2023-10-16T19:57:04.975685+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":162,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-16T19:57:00.898304+0000","last_change":"2023-10-16T19:56:58.775782+0000","last_active":"2023-10-16T19:57:00.898304+0000","last_peered":"2023-10-16T19:57:00.898304+0000","last_clean":"2023-10-16T19:57:00.898304+0000","last_became_active":"2023-10-16T19:56:58.775567+0000","last_became_peered":"2023-10-16T19:56:58.775567+0000","last_unstale":"2023-10-16T19:57:00.898304+0000","last_undegraded":"2023-10-16T19:57:00.898304+0000","last_fullsized":"2023-10-16T19:57:00.898304+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:56:57.693332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:56:57.693332+0000","last_clean_scrub_stamp":"2023-10-16T19:56:57.693332+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:10:23.849736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-16T19:57:04.974266+0000","last_change":"2023-10-16T19:57:04.974266+0000","last_active":"2023-10-16T19:57:04.967702+0000","last_peered":"2023-10-16T19:57:04.967702+0000","last_clean":"2023-10-16T19:57:04.967702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:04.974266+0000","last_undegraded":"2023-10-16T19:57:04.974266+0000","last_fullsized":"2023-10-16T19:57:04.974266+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-16T19:57:04.974682+0000","last_change":"2023-10-16T19:57:04.974682+0000","last_active":"2023-10-16T19:57:04.967702+0000","last_peered":"2023-10-16T19:57:04.967702+0000","last_clean":"2023-10-16T19:57:04.967702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:04.974682+0000","last_undegraded":"2023-10-16T19:57:04.974682+0000","last_fullsized":"2023-10-16T19:57:04.974682+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-16T19:57:04.975232+0000","last_change":"2023-10-16T19:57:04.975232+0000","last_active":"2023-10-16T19:57:04.967702+0000","last_peered":"2023-10-16T19:57:04.967702+0000","last_clean":"2023-10-16T19:57:04.967702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:04.975232+0000","last_undegraded":"2023-10-16T19:57:04.975232+0000","last_fullsized":"2023-10-16T19:57:04.975232+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-16T19:57:04.973273+0000","last_change":"2023-10-16T19:57:04.973273+0000","last_active":"2023-10-16T19:57:04.967702+0000","last_peered":"2023-10-16T19:57:04.967702+0000","last_clean":"2023-10-16T19:57:04.967702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:04.973273+0000","last_undegraded":"2023-10-16T19:57:04.973273+0000","last_fullsized":"2023-10-16T19:57:04.973273+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-16T19:57:04.975030+0000","last_change":"2023-10-16T19:57:04.975030+0000","last_active":"2023-10-16T19:57:04.967702+0000","last_peered":"2023-10-16T19:57:04.967702+0000","last_clean":"2023-10-16T19:57:04.967702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:04.975030+0000","last_undegraded":"2023-10-16T19:57:04.975030+0000","last_fullsized":"2023-10-16T19:57:04.975030+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-16T19:57:04.975439+0000","last_change":"2023-10-16T19:57:04.975439+0000","last_active":"2023-10-16T19:57:04.967702+0000","last_peered":"2023-10-16T19:57:04.967702+0000","last_clean":"2023-10-16T19:57:04.967702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:04.975439+0000","last_undegraded":"2023-10-16T19:57:04.975439+0000","last_fullsized":"2023-10-16T19:57:04.975439+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-16T19:57:04.975072+0000","last_change":"2023-10-16T19:57:04.975072+0000","last_active":"2023-10-16T19:57:04.967702+0000","last_peered":"2023-10-16T19:57:04.967702+0000","last_clean":"2023-10-16T19:57:04.967702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:04.975072+0000","last_undegraded":"2023-10-16T19:57:04.975072+0000","last_fullsized":"2023-10-16T19:57:04.975072+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-16T19:57:04.974558+0000","last_change":"2023-10-16T19:57:04.974558+0000","last_active":"2023-10-16T19:57:04.967702+0000","last_peered":"2023-10-16T19:57:04.967702+0000","last_clean":"2023-10-16T19:57:04.967702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:04.974558+0000","last_undegraded":"2023-10-16T19:57:04.974558+0000","last_fullsized":"2023-10-16T19:57:04.974558+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-16T19:57:04.977460+0000","last_change":"2023-10-16T19:57:04.977460+0000","last_active":"2023-10-16T19:57:04.967702+0000","last_peered":"2023-10-16T19:57:04.967702+0000","last_clean":"2023-10-16T19:57:04.967702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:04.977460+0000","last_undegraded":"2023-10-16T19:57:04.977460+0000","last_fullsized":"2023-10-16T19:57:04.977460+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-16T19:57:04.975874+0000","last_change":"2023-10-16T19:57:04.975874+0000","last_active":"2023-10-16T19:57:04.967702+0000","last_peered":"2023-10-16T19:57:04.967702+0000","last_clean":"2023-10-16T19:57:04.967702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:04.975874+0000","last_undegraded":"2023-10-16T19:57:04.975874+0000","last_fullsized":"2023-10-16T19:57:04.975874+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-16T19:57:04.977430+0000","last_change":"2023-10-16T19:57:04.977430+0000","last_active":"2023-10-16T19:57:04.967702+0000","last_peered":"2023-10-16T19:57:04.967702+0000","last_clean":"2023-10-16T19:57:04.967702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:04.977430+0000","last_undegraded":"2023-10-16T19:57:04.977430+0000","last_fullsized":"2023-10-16T19:57:04.977430+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574851,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":631,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194681,"statfs":{"total":200000000,"available":199353573,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46300000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41199999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60799999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70099999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":49,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195263,"statfs":{"total":200000000,"available":199949758,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58099999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35699999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48499999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574851,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":54,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195257,"statfs":{"total":200000000,"available":199943941,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38700000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34399999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40100000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48899999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]}]},{"osd":0,"up_from":13,"seq":55834574851,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":631,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194681,"statfs":{"total":200000000,"available":199353573,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.249}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34300000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32900000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52800000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42899999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45500000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":54,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195257,"statfs":{"total":200000000,"available":199943941,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45200000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33700000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52300000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65100000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.502}]}]},{"osd":3,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":54,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195257,"statfs":{"total":200000000,"available":199943941,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36699999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38300000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33400000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67400000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":54,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195257,"statfs":{"total":200000000,"available":199943941,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.622}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66000000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.371}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45200000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47899999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":54,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195257,"statfs":{"total":200000000,"available":199943941,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41399999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45800000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38700000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44400000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]}]}],"pool_statfs":[]}} 2023-10-16T19:57:11.480 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-16T19:57:11.634 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:11.632+0000 7f0506e22700 1 Processor -- start 2023-10-16T19:57:11.635 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:11.632+0000 7f0506e22700 1 -- start start 2023-10-16T19:57:11.637 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:11.633+0000 7f0506e22700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f050015e2f0 0x7f050006d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:11.637 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:11.633+0000 7f0506e22700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f050006de00 0x7f05000ce910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:11.637 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:11.633+0000 7f0506e22700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05000d08b0 con 0x7f050006a850 2023-10-16T19:57:11.638 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:11.633+0000 7f0506e22700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05001628f0 con 0x7f050015e2f0 2023-10-16T19:57:11.638 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:11.633+0000 7f0506e22700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0500162bd0 con 0x7f050006de00 2023-10-16T19:57:11.638 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:11.633+0000 7f0504bbe700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f050015e2f0 0x7f050006d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:11.638 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:11.633+0000 7f05053bf700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f050006a850 0x7f0500070f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:55338/0 (socket says 172.21.15.157:55338) 2023-10-16T19:57:11.639 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:11.633+0000 7f05053bf700 1 -- 172.21.15.157:0/737635551 learned_addr learned my addr 172.21.15.157:0/737635551 (peer_addr_for_me v1:172.21.15.157:0/0) 2023-10-16T19:57:11.639 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:11.633+0000 7f04fffff700 1 --2- 172.21.15.157:0/737635551 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f050006de00 0x7f05000ce910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:11.639 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:11.633+0000 7f0504bbe700 1 -- 172.21.15.157:0/737635551 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f050006de00 msgr2=0x7f05000ce910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:57:11.639 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:11.633+0000 7f0504bbe700 1 --2- 172.21.15.157:0/737635551 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f050006de00 0x7f05000ce910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:11.640 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:11.633+0000 7f0504bbe700 1 -- 172.21.15.157:0/737635551 >> v1:172.21.15.157:6789/0 conn(0x7f050006a850 legacy=0x7f0500070f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:11.640 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:11.633+0000 7f0504bbe700 1 -- 172.21.15.157:0/737635551 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05000d05d0 con 0x7f050015e2f0 2023-10-16T19:57:11.640 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:11.633+0000 7f04ff7fe700 1 -- 172.21.15.157:0/737635551 <== mon.0 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3242349997 0 0) 0x7f05000d08b0 con 0x7f050006a850 2023-10-16T19:57:11.640 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:11.633+0000 7f0504bbe700 1 --2- 172.21.15.157:0/737635551 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f050015e2f0 0x7f050006d0f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f04f4009840 tx=0x7f04f4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8096a6c0431d7c7 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:11.641 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:11.633+0000 7f04ff7fe700 1 -- 172.21.15.157:0/737635551 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04f4011830 con 0x7f050015e2f0 2023-10-16T19:57:11.641 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:11.633+0000 7f04ff7fe700 1 -- 172.21.15.157:0/737635551 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04f4011990 con 0x7f050015e2f0 2023-10-16T19:57:11.641 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:11.633+0000 7f04ff7fe700 1 -- 172.21.15.157:0/737635551 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04f4011d20 con 0x7f050015e2f0 2023-10-16T19:57:11.641 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:11.634+0000 7f0506e22700 1 -- 172.21.15.157:0/737635551 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f050015e2f0 msgr2=0x7f050006d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:11.641 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:11.634+0000 7f0506e22700 1 --2- 172.21.15.157:0/737635551 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f050015e2f0 0x7f050006d0f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f04f4009840 tx=0x7f04f4009b50 comp rx=0 tx=0).stop 2023-10-16T19:57:11.642 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:11.634+0000 7f0506e22700 1 -- 172.21.15.157:0/737635551 shutdown_connections 2023-10-16T19:57:11.642 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:11.634+0000 7f0506e22700 1 --2- 172.21.15.157:0/737635551 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f050015e2f0 0x7f050006d0f0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:11.642 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:11.634+0000 7f0506e22700 1 --2- 172.21.15.157:0/737635551 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f050006de00 0x7f05000ce910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:11.642 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:11.634+0000 7f0506e22700 1 -- 172.21.15.157:0/737635551 >> 172.21.15.157:0/737635551 conn(0x7f05000cd4e0 msgr2=0x7f05000cd8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:11.642 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:11.634+0000 7f0506e22700 1 -- 172.21.15.157:0/737635551 shutdown_connections 2023-10-16T19:57:11.643 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:11.634+0000 7f0506e22700 1 -- 172.21.15.157:0/737635551 wait complete. 2023-10-16T19:57:11.645 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:11.635+0000 7f0506e22700 1 Processor -- start 2023-10-16T19:57:11.646 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:11.635+0000 7f0506e22700 1 -- start start 2023-10-16T19:57:11.646 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:11.636+0000 7f0506e22700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f050006a850 0x7f05000b3b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:11.646 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:11.636+0000 7f0506e22700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f050006de00 0x7f05000b2880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:11.646 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:11.636+0000 7f0506e22700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f050015e2f0 0x7f0500157890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:11.646 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:11.636+0000 7f0506e22700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05000b67d0 con 0x7f050015e2f0 2023-10-16T19:57:11.647 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:11.636+0000 7f0506e22700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05000b4250 con 0x7f050006de00 2023-10-16T19:57:11.647 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:11.636+0000 7f0506e22700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05000b4530 con 0x7f050006a850 2023-10-16T19:57:11.647 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:11.636+0000 7f05053bf700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f050015e2f0 0x7f0500157890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:11.647 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:11.636+0000 7f05053bf700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f050015e2f0 0x7f0500157890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:45672/0 (socket says 172.21.15.157:45672) 2023-10-16T19:57:11.647 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:11.636+0000 7f05053bf700 1 -- 172.21.15.157:0/1807721747 learned_addr learned my addr 172.21.15.157:0/1807721747 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:57:11.648 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:11.636+0000 7f0504bbe700 1 --2- 172.21.15.157:0/1807721747 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f050006a850 0x7f05000b3b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:11.648 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:11.636+0000 7f04fffff700 1 --2- 172.21.15.157:0/1807721747 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f050006de00 0x7f05000b2880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:11.648 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:11.636+0000 7f05053bf700 1 -- 172.21.15.157:0/1807721747 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f050006a850 msgr2=0x7f05000b3b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:11.648 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:11.637+0000 7f05053bf700 1 --2- 172.21.15.157:0/1807721747 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f050006a850 0x7f05000b3b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:11.649 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:11.637+0000 7f05053bf700 1 -- 172.21.15.157:0/1807721747 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f050006de00 msgr2=0x7f05000b2880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:11.649 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:11.637+0000 7f05053bf700 1 --2- 172.21.15.157:0/1807721747 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f050006de00 0x7f05000b2880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:11.649 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:11.637+0000 7f05053bf700 1 -- 172.21.15.157:0/1807721747 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04f40094a0 con 0x7f050015e2f0 2023-10-16T19:57:11.649 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:11.637+0000 7f04fffff700 1 --2- 172.21.15.157:0/1807721747 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f050006de00 0x7f05000b2880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T19:57:11.649 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:11.637+0000 7f05053bf700 1 --2- 172.21.15.157:0/1807721747 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f050015e2f0 0x7f0500157890 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f04f800cb40 tx=0x7f04f800cf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:11.650 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:11.637+0000 7f04fd7fa700 1 -- 172.21.15.157:0/1807721747 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04f800ab50 con 0x7f050015e2f0 2023-10-16T19:57:11.650 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:11.637+0000 7f04fd7fa700 1 -- 172.21.15.157:0/1807721747 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04f800acd0 con 0x7f050015e2f0 2023-10-16T19:57:11.650 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:11.637+0000 7f0506e22700 1 -- 172.21.15.157:0/1807721747 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05000b4810 con 0x7f050015e2f0 2023-10-16T19:57:11.650 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:11.637+0000 7f04fd7fa700 1 -- 172.21.15.157:0/1807721747 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04f8007310 con 0x7f050015e2f0 2023-10-16T19:57:11.650 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:11.637+0000 7f0506e22700 1 -- 172.21.15.157:0/1807721747 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05000b4dd0 con 0x7f050015e2f0 2023-10-16T19:57:11.651 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:11.638+0000 7f0506e22700 1 -- 172.21.15.157:0/1807721747 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05000c5a80 con 0x7f050015e2f0 2023-10-16T19:57:11.651 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:11.638+0000 7f04fd7fa700 1 -- 172.21.15.157:0/1807721747 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f04f8007470 con 0x7f050015e2f0 2023-10-16T19:57:11.651 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:11.639+0000 7f04fd7fa700 1 --2- 172.21.15.157:0/1807721747 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f04e406af00 0x7f04e406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:11.651 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:11.639+0000 7f04fd7fa700 1 -- 172.21.15.157:0/1807721747 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f04f80893f0 con 0x7f050015e2f0 2023-10-16T19:57:11.651 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:11.639+0000 7f0504bbe700 1 --2- 172.21.15.157:0/1807721747 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f04e406af00 0x7f04e406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:11.652 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:11.639+0000 7f0504bbe700 1 --2- 172.21.15.157:0/1807721747 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f04e406af00 0x7f04e406d3c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f04f40090b0 tx=0x7f04f401c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:11.652 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:11.643+0000 7f04fd7fa700 1 -- 172.21.15.157:0/1807721747 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f05000c5a80 con 0x7f050015e2f0 2023-10-16T19:57:11.829 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:11.827+0000 7f0506e22700 1 -- 172.21.15.157:0/1807721747 --> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f05000b02a0 con 0x7f04e406af00 2023-10-16T19:57:11.836 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:11.834+0000 7f04fd7fa700 1 -- 172.21.15.157:0/1807721747 <== mgr.4100 v2:172.21.15.187:6832/2426285296 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+250117 (secure 0 0 0) 0x7f04f4011b80 con 0x7f04e406af00 2023-10-16T19:57:11.839 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-10-16T19:57:11.842 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:11.837+0000 7f0506e22700 1 -- 172.21.15.157:0/1807721747 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f04e406af00 msgr2=0x7f04e406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:11.842 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:11.837+0000 7f0506e22700 1 --2- 172.21.15.157:0/1807721747 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f04e406af00 0x7f04e406d3c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f04f40090b0 tx=0x7f04f401c040 comp rx=0 tx=0).stop 2023-10-16T19:57:11.842 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:11.837+0000 7f0506e22700 1 -- 172.21.15.157:0/1807721747 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f050015e2f0 msgr2=0x7f0500157890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:11.842 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:11.837+0000 7f0506e22700 1 --2- 172.21.15.157:0/1807721747 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f050015e2f0 0x7f0500157890 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f04f800cb40 tx=0x7f04f800cf00 comp rx=0 tx=0).stop 2023-10-16T19:57:11.842 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:11.837+0000 7f0506e22700 1 -- 172.21.15.157:0/1807721747 shutdown_connections 2023-10-16T19:57:11.843 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:11.837+0000 7f0506e22700 1 --2- 172.21.15.157:0/1807721747 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f050015e2f0 0x7f0500157890 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:11.843 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:11.837+0000 7f0506e22700 1 --2- 172.21.15.157:0/1807721747 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f050006a850 0x7f05000b3b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:11.843 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:11.837+0000 7f0506e22700 1 --2- 172.21.15.157:0/1807721747 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f04e406af00 0x7f04e406d3c0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:11.843 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:11.837+0000 7f0506e22700 1 --2- 172.21.15.157:0/1807721747 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f050006de00 0x7f05000b2880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:11.843 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:11.837+0000 7f0506e22700 1 -- 172.21.15.157:0/1807721747 >> 172.21.15.157:0/1807721747 conn(0x7f05000cd4e0 msgr2=0x7f05000b0e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:11.844 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:11.837+0000 7f0506e22700 1 -- 172.21.15.157:0/1807721747 shutdown_connections 2023-10-16T19:57:11.844 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:11.837+0000 7f0506e22700 1 -- 172.21.15.157:0/1807721747 wait complete. 2023-10-16T19:57:11.844 INFO:teuthology.orchestra.run.smithi157.stderr:dumped all 2023-10-16T19:57:11.852 INFO:teuthology.orchestra.run.smithi157.stdout:{"pg_ready":true,"pg_map":{"version":19,"stamp":"2023-10-16T19:57:10.891317+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":8,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":1585,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560914,"statfs":{"total":1600000000,"available":1598376609,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.919151"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-16T19:57:04.973649+0000","last_change":"2023-10-16T19:57:04.973649+0000","last_active":"2023-10-16T19:57:04.967702+0000","last_peered":"2023-10-16T19:57:04.967702+0000","last_clean":"2023-10-16T19:57:04.967702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:04.973649+0000","last_undegraded":"2023-10-16T19:57:04.973649+0000","last_fullsized":"2023-10-16T19:57:04.973649+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-16T19:57:04.974840+0000","last_change":"2023-10-16T19:57:04.974840+0000","last_active":"2023-10-16T19:57:04.967702+0000","last_peered":"2023-10-16T19:57:04.967702+0000","last_clean":"2023-10-16T19:57:04.967702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:04.974840+0000","last_undegraded":"2023-10-16T19:57:04.974840+0000","last_fullsized":"2023-10-16T19:57:04.974840+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-16T19:57:04.974328+0000","last_change":"2023-10-16T19:57:04.974328+0000","last_active":"2023-10-16T19:57:04.967702+0000","last_peered":"2023-10-16T19:57:04.967702+0000","last_clean":"2023-10-16T19:57:04.967702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:04.974328+0000","last_undegraded":"2023-10-16T19:57:04.974328+0000","last_fullsized":"2023-10-16T19:57:04.974328+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-16T19:57:04.975403+0000","last_change":"2023-10-16T19:57:04.975403+0000","last_active":"2023-10-16T19:57:04.967702+0000","last_peered":"2023-10-16T19:57:04.967702+0000","last_clean":"2023-10-16T19:57:04.967702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:04.975403+0000","last_undegraded":"2023-10-16T19:57:04.975403+0000","last_fullsized":"2023-10-16T19:57:04.975403+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-16T19:57:04.974498+0000","last_change":"2023-10-16T19:57:04.974498+0000","last_active":"2023-10-16T19:57:04.967702+0000","last_peered":"2023-10-16T19:57:04.967702+0000","last_clean":"2023-10-16T19:57:04.967702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:04.974498+0000","last_undegraded":"2023-10-16T19:57:04.974498+0000","last_fullsized":"2023-10-16T19:57:04.974498+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-16T19:57:04.974477+0000","last_change":"2023-10-16T19:57:04.974477+0000","last_active":"2023-10-16T19:57:04.967702+0000","last_peered":"2023-10-16T19:57:04.967702+0000","last_clean":"2023-10-16T19:57:04.967702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:04.974477+0000","last_undegraded":"2023-10-16T19:57:04.974477+0000","last_fullsized":"2023-10-16T19:57:04.974477+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-16T19:57:04.974484+0000","last_change":"2023-10-16T19:57:04.974484+0000","last_active":"2023-10-16T19:57:04.967702+0000","last_peered":"2023-10-16T19:57:04.967702+0000","last_clean":"2023-10-16T19:57:04.967702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:04.974484+0000","last_undegraded":"2023-10-16T19:57:04.974484+0000","last_fullsized":"2023-10-16T19:57:04.974484+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-16T19:57:04.977118+0000","last_change":"2023-10-16T19:57:04.977118+0000","last_active":"2023-10-16T19:57:04.967702+0000","last_peered":"2023-10-16T19:57:04.967702+0000","last_clean":"2023-10-16T19:57:04.967702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:04.977118+0000","last_undegraded":"2023-10-16T19:57:04.977118+0000","last_fullsized":"2023-10-16T19:57:04.977118+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-16T19:57:04.974103+0000","last_change":"2023-10-16T19:57:04.974103+0000","last_active":"2023-10-16T19:57:04.967702+0000","last_peered":"2023-10-16T19:57:04.967702+0000","last_clean":"2023-10-16T19:57:04.967702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:04.974103+0000","last_undegraded":"2023-10-16T19:57:04.974103+0000","last_fullsized":"2023-10-16T19:57:04.974103+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-16T19:57:04.976978+0000","last_change":"2023-10-16T19:57:04.976978+0000","last_active":"2023-10-16T19:57:04.967702+0000","last_peered":"2023-10-16T19:57:04.967702+0000","last_clean":"2023-10-16T19:57:04.967702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:04.976978+0000","last_undegraded":"2023-10-16T19:57:04.976978+0000","last_fullsized":"2023-10-16T19:57:04.976978+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-16T19:57:04.975501+0000","last_change":"2023-10-16T19:57:04.975501+0000","last_active":"2023-10-16T19:57:04.967702+0000","last_peered":"2023-10-16T19:57:04.967702+0000","last_clean":"2023-10-16T19:57:04.967702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:04.975501+0000","last_undegraded":"2023-10-16T19:57:04.975501+0000","last_fullsized":"2023-10-16T19:57:04.975501+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-16T19:57:04.973701+0000","last_change":"2023-10-16T19:57:04.973701+0000","last_active":"2023-10-16T19:57:04.967702+0000","last_peered":"2023-10-16T19:57:04.967702+0000","last_clean":"2023-10-16T19:57:04.967702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:04.973701+0000","last_undegraded":"2023-10-16T19:57:04.973701+0000","last_fullsized":"2023-10-16T19:57:04.973701+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-16T19:57:04.973640+0000","last_change":"2023-10-16T19:57:04.973640+0000","last_active":"2023-10-16T19:57:04.967702+0000","last_peered":"2023-10-16T19:57:04.967702+0000","last_clean":"2023-10-16T19:57:04.967702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:04.973640+0000","last_undegraded":"2023-10-16T19:57:04.973640+0000","last_fullsized":"2023-10-16T19:57:04.973640+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-16T19:57:04.976037+0000","last_change":"2023-10-16T19:57:04.976037+0000","last_active":"2023-10-16T19:57:04.967702+0000","last_peered":"2023-10-16T19:57:04.967702+0000","last_clean":"2023-10-16T19:57:04.967702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:04.976037+0000","last_undegraded":"2023-10-16T19:57:04.976037+0000","last_fullsized":"2023-10-16T19:57:04.976037+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-16T19:57:04.973680+0000","last_change":"2023-10-16T19:57:04.973680+0000","last_active":"2023-10-16T19:57:04.967702+0000","last_peered":"2023-10-16T19:57:04.967702+0000","last_clean":"2023-10-16T19:57:04.967702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:04.973680+0000","last_undegraded":"2023-10-16T19:57:04.973680+0000","last_fullsized":"2023-10-16T19:57:04.973680+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-16T19:57:04.977796+0000","last_change":"2023-10-16T19:57:04.977796+0000","last_active":"2023-10-16T19:57:04.967702+0000","last_peered":"2023-10-16T19:57:04.967702+0000","last_clean":"2023-10-16T19:57:04.967702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:04.977796+0000","last_undegraded":"2023-10-16T19:57:04.977796+0000","last_fullsized":"2023-10-16T19:57:04.977796+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-16T19:57:04.972878+0000","last_change":"2023-10-16T19:57:04.972878+0000","last_active":"2023-10-16T19:57:04.967702+0000","last_peered":"2023-10-16T19:57:04.967702+0000","last_clean":"2023-10-16T19:57:04.967702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:04.972878+0000","last_undegraded":"2023-10-16T19:57:04.972878+0000","last_fullsized":"2023-10-16T19:57:04.972878+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-16T19:57:04.975078+0000","last_change":"2023-10-16T19:57:04.975078+0000","last_active":"2023-10-16T19:57:04.967702+0000","last_peered":"2023-10-16T19:57:04.967702+0000","last_clean":"2023-10-16T19:57:04.967702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:04.975078+0000","last_undegraded":"2023-10-16T19:57:04.975078+0000","last_fullsized":"2023-10-16T19:57:04.975078+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-16T19:57:04.975630+0000","last_change":"2023-10-16T19:57:04.975630+0000","last_active":"2023-10-16T19:57:04.967702+0000","last_peered":"2023-10-16T19:57:04.967702+0000","last_clean":"2023-10-16T19:57:04.967702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:04.975630+0000","last_undegraded":"2023-10-16T19:57:04.975630+0000","last_fullsized":"2023-10-16T19:57:04.975630+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-16T19:57:04.977484+0000","last_change":"2023-10-16T19:57:04.977484+0000","last_active":"2023-10-16T19:57:04.967702+0000","last_peered":"2023-10-16T19:57:04.967702+0000","last_clean":"2023-10-16T19:57:04.967702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:04.977484+0000","last_undegraded":"2023-10-16T19:57:04.977484+0000","last_fullsized":"2023-10-16T19:57:04.977484+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-16T19:57:04.975685+0000","last_change":"2023-10-16T19:57:04.975685+0000","last_active":"2023-10-16T19:57:04.967702+0000","last_peered":"2023-10-16T19:57:04.967702+0000","last_clean":"2023-10-16T19:57:04.967702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:04.975685+0000","last_undegraded":"2023-10-16T19:57:04.975685+0000","last_fullsized":"2023-10-16T19:57:04.975685+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":162,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-16T19:57:00.898304+0000","last_change":"2023-10-16T19:56:58.775782+0000","last_active":"2023-10-16T19:57:00.898304+0000","last_peered":"2023-10-16T19:57:00.898304+0000","last_clean":"2023-10-16T19:57:00.898304+0000","last_became_active":"2023-10-16T19:56:58.775567+0000","last_became_peered":"2023-10-16T19:56:58.775567+0000","last_unstale":"2023-10-16T19:57:00.898304+0000","last_undegraded":"2023-10-16T19:57:00.898304+0000","last_fullsized":"2023-10-16T19:57:00.898304+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:56:57.693332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:56:57.693332+0000","last_clean_scrub_stamp":"2023-10-16T19:56:57.693332+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:10:23.849736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-16T19:57:04.974266+0000","last_change":"2023-10-16T19:57:04.974266+0000","last_active":"2023-10-16T19:57:04.967702+0000","last_peered":"2023-10-16T19:57:04.967702+0000","last_clean":"2023-10-16T19:57:04.967702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:04.974266+0000","last_undegraded":"2023-10-16T19:57:04.974266+0000","last_fullsized":"2023-10-16T19:57:04.974266+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-16T19:57:04.974682+0000","last_change":"2023-10-16T19:57:04.974682+0000","last_active":"2023-10-16T19:57:04.967702+0000","last_peered":"2023-10-16T19:57:04.967702+0000","last_clean":"2023-10-16T19:57:04.967702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:04.974682+0000","last_undegraded":"2023-10-16T19:57:04.974682+0000","last_fullsized":"2023-10-16T19:57:04.974682+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-16T19:57:04.975232+0000","last_change":"2023-10-16T19:57:04.975232+0000","last_active":"2023-10-16T19:57:04.967702+0000","last_peered":"2023-10-16T19:57:04.967702+0000","last_clean":"2023-10-16T19:57:04.967702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:04.975232+0000","last_undegraded":"2023-10-16T19:57:04.975232+0000","last_fullsized":"2023-10-16T19:57:04.975232+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-16T19:57:04.973273+0000","last_change":"2023-10-16T19:57:04.973273+0000","last_active":"2023-10-16T19:57:04.967702+0000","last_peered":"2023-10-16T19:57:04.967702+0000","last_clean":"2023-10-16T19:57:04.967702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:04.973273+0000","last_undegraded":"2023-10-16T19:57:04.973273+0000","last_fullsized":"2023-10-16T19:57:04.973273+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-16T19:57:04.975030+0000","last_change":"2023-10-16T19:57:04.975030+0000","last_active":"2023-10-16T19:57:04.967702+0000","last_peered":"2023-10-16T19:57:04.967702+0000","last_clean":"2023-10-16T19:57:04.967702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:04.975030+0000","last_undegraded":"2023-10-16T19:57:04.975030+0000","last_fullsized":"2023-10-16T19:57:04.975030+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-16T19:57:04.975439+0000","last_change":"2023-10-16T19:57:04.975439+0000","last_active":"2023-10-16T19:57:04.967702+0000","last_peered":"2023-10-16T19:57:04.967702+0000","last_clean":"2023-10-16T19:57:04.967702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:04.975439+0000","last_undegraded":"2023-10-16T19:57:04.975439+0000","last_fullsized":"2023-10-16T19:57:04.975439+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-16T19:57:04.975072+0000","last_change":"2023-10-16T19:57:04.975072+0000","last_active":"2023-10-16T19:57:04.967702+0000","last_peered":"2023-10-16T19:57:04.967702+0000","last_clean":"2023-10-16T19:57:04.967702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:04.975072+0000","last_undegraded":"2023-10-16T19:57:04.975072+0000","last_fullsized":"2023-10-16T19:57:04.975072+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-16T19:57:04.974558+0000","last_change":"2023-10-16T19:57:04.974558+0000","last_active":"2023-10-16T19:57:04.967702+0000","last_peered":"2023-10-16T19:57:04.967702+0000","last_clean":"2023-10-16T19:57:04.967702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:04.974558+0000","last_undegraded":"2023-10-16T19:57:04.974558+0000","last_fullsized":"2023-10-16T19:57:04.974558+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-16T19:57:04.977460+0000","last_change":"2023-10-16T19:57:04.977460+0000","last_active":"2023-10-16T19:57:04.967702+0000","last_peered":"2023-10-16T19:57:04.967702+0000","last_clean":"2023-10-16T19:57:04.967702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:04.977460+0000","last_undegraded":"2023-10-16T19:57:04.977460+0000","last_fullsized":"2023-10-16T19:57:04.977460+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-16T19:57:04.975874+0000","last_change":"2023-10-16T19:57:04.975874+0000","last_active":"2023-10-16T19:57:04.967702+0000","last_peered":"2023-10-16T19:57:04.967702+0000","last_clean":"2023-10-16T19:57:04.967702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:04.975874+0000","last_undegraded":"2023-10-16T19:57:04.975874+0000","last_fullsized":"2023-10-16T19:57:04.975874+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-16T19:57:04.977430+0000","last_change":"2023-10-16T19:57:04.977430+0000","last_active":"2023-10-16T19:57:04.967702+0000","last_peered":"2023-10-16T19:57:04.967702+0000","last_clean":"2023-10-16T19:57:04.967702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:04.977430+0000","last_undegraded":"2023-10-16T19:57:04.977430+0000","last_fullsized":"2023-10-16T19:57:04.977430+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574851,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":631,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194681,"statfs":{"total":200000000,"available":199353573,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46300000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41199999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60799999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70099999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":49,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195263,"statfs":{"total":200000000,"available":199949758,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58099999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35699999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48499999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574851,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":54,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195257,"statfs":{"total":200000000,"available":199943941,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38700000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34399999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40100000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48899999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]}]},{"osd":0,"up_from":13,"seq":55834574851,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":631,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194681,"statfs":{"total":200000000,"available":199353573,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.249}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34300000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32900000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52800000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42899999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45500000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":54,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195257,"statfs":{"total":200000000,"available":199943941,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45200000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33700000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52300000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65100000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.502}]}]},{"osd":3,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":54,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195257,"statfs":{"total":200000000,"available":199943941,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36699999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38300000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33400000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67400000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":54,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195257,"statfs":{"total":200000000,"available":199943941,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.622}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66000000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.371}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45200000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47899999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":54,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195257,"statfs":{"total":200000000,"available":199943941,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41399999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45800000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38700000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44400000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]}]}],"pool_statfs":[]}} 2023-10-16T19:57:11.857 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3f is not active+clean 2023-10-16T19:57:11.857 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T19:57:05.971386+0000', 'last_change': '2023-10-16T19:57:05.971386+0000', 'last_active': '2023-10-16T19:57:05.971386+0000', 'last_peered': '2023-10-16T19:57:05.971386+0000', 'last_clean': '2023-10-16T19:57:05.971386+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T19:57:05.971386+0000', 'last_undegraded': '2023-10-16T19:57:05.971386+0000', 'last_fullsized': '2023-10-16T19:57:05.971386+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T19:57:05.971386+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T19:57:05.971386+0000', 'last_clean_scrub_stamp': '2023-10-16T19:57:05.971386+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T19:57:11.858 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3e is not active+clean 2023-10-16T19:57:11.858 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T19:57:05.971386+0000', 'last_change': '2023-10-16T19:57:05.971386+0000', 'last_active': '2023-10-16T19:57:05.971386+0000', 'last_peered': '2023-10-16T19:57:05.971386+0000', 'last_clean': '2023-10-16T19:57:05.971386+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T19:57:05.971386+0000', 'last_undegraded': '2023-10-16T19:57:05.971386+0000', 'last_fullsized': '2023-10-16T19:57:05.971386+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T19:57:05.971386+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T19:57:05.971386+0000', 'last_clean_scrub_stamp': '2023-10-16T19:57:05.971386+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T19:57:11.858 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3d is not active+clean 2023-10-16T19:57:11.859 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T19:57:05.971386+0000', 'last_change': '2023-10-16T19:57:05.971386+0000', 'last_active': '2023-10-16T19:57:05.971386+0000', 'last_peered': '2023-10-16T19:57:05.971386+0000', 'last_clean': '2023-10-16T19:57:05.971386+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T19:57:05.971386+0000', 'last_undegraded': '2023-10-16T19:57:05.971386+0000', 'last_fullsized': '2023-10-16T19:57:05.971386+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T19:57:05.971386+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T19:57:05.971386+0000', 'last_clean_scrub_stamp': '2023-10-16T19:57:05.971386+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T19:57:11.859 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3c is not active+clean 2023-10-16T19:57:11.859 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T19:57:05.971386+0000', 'last_change': '2023-10-16T19:57:05.971386+0000', 'last_active': '2023-10-16T19:57:05.971386+0000', 'last_peered': '2023-10-16T19:57:05.971386+0000', 'last_clean': '2023-10-16T19:57:05.971386+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T19:57:05.971386+0000', 'last_undegraded': '2023-10-16T19:57:05.971386+0000', 'last_fullsized': '2023-10-16T19:57:05.971386+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T19:57:05.971386+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T19:57:05.971386+0000', 'last_clean_scrub_stamp': '2023-10-16T19:57:05.971386+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T19:57:11.860 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3b is not active+clean 2023-10-16T19:57:11.860 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T19:57:05.971386+0000', 'last_change': '2023-10-16T19:57:05.971386+0000', 'last_active': '2023-10-16T19:57:05.971386+0000', 'last_peered': '2023-10-16T19:57:05.971386+0000', 'last_clean': '2023-10-16T19:57:05.971386+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T19:57:05.971386+0000', 'last_undegraded': '2023-10-16T19:57:05.971386+0000', 'last_fullsized': '2023-10-16T19:57:05.971386+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T19:57:05.971386+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T19:57:05.971386+0000', 'last_clean_scrub_stamp': '2023-10-16T19:57:05.971386+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T19:57:11.860 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3a is not active+clean 2023-10-16T19:57:11.861 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T19:57:05.971386+0000', 'last_change': '2023-10-16T19:57:05.971386+0000', 'last_active': '2023-10-16T19:57:05.971386+0000', 'last_peered': '2023-10-16T19:57:05.971386+0000', 'last_clean': '2023-10-16T19:57:05.971386+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T19:57:05.971386+0000', 'last_undegraded': '2023-10-16T19:57:05.971386+0000', 'last_fullsized': '2023-10-16T19:57:05.971386+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T19:57:05.971386+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T19:57:05.971386+0000', 'last_clean_scrub_stamp': '2023-10-16T19:57:05.971386+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T19:57:11.861 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.39 is not active+clean 2023-10-16T19:57:11.861 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T19:57:05.971386+0000', 'last_change': '2023-10-16T19:57:05.971386+0000', 'last_active': '2023-10-16T19:57:05.971386+0000', 'last_peered': '2023-10-16T19:57:05.971386+0000', 'last_clean': '2023-10-16T19:57:05.971386+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T19:57:05.971386+0000', 'last_undegraded': '2023-10-16T19:57:05.971386+0000', 'last_fullsized': '2023-10-16T19:57:05.971386+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T19:57:05.971386+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T19:57:05.971386+0000', 'last_clean_scrub_stamp': '2023-10-16T19:57:05.971386+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T19:57:11.862 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.38 is not active+clean 2023-10-16T19:57:11.862 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T19:57:05.971386+0000', 'last_change': '2023-10-16T19:57:05.971386+0000', 'last_active': '2023-10-16T19:57:05.971386+0000', 'last_peered': '2023-10-16T19:57:05.971386+0000', 'last_clean': '2023-10-16T19:57:05.971386+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T19:57:05.971386+0000', 'last_undegraded': '2023-10-16T19:57:05.971386+0000', 'last_fullsized': '2023-10-16T19:57:05.971386+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T19:57:05.971386+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T19:57:05.971386+0000', 'last_clean_scrub_stamp': '2023-10-16T19:57:05.971386+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T19:57:11.862 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.37 is not active+clean 2023-10-16T19:57:11.863 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T19:57:05.971386+0000', 'last_change': '2023-10-16T19:57:05.971386+0000', 'last_active': '2023-10-16T19:57:05.971386+0000', 'last_peered': '2023-10-16T19:57:05.971386+0000', 'last_clean': '2023-10-16T19:57:05.971386+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T19:57:05.971386+0000', 'last_undegraded': '2023-10-16T19:57:05.971386+0000', 'last_fullsized': '2023-10-16T19:57:05.971386+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T19:57:05.971386+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T19:57:05.971386+0000', 'last_clean_scrub_stamp': '2023-10-16T19:57:05.971386+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T19:57:11.863 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.36 is not active+clean 2023-10-16T19:57:11.863 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T19:57:05.971386+0000', 'last_change': '2023-10-16T19:57:05.971386+0000', 'last_active': '2023-10-16T19:57:05.971386+0000', 'last_peered': '2023-10-16T19:57:05.971386+0000', 'last_clean': '2023-10-16T19:57:05.971386+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T19:57:05.971386+0000', 'last_undegraded': '2023-10-16T19:57:05.971386+0000', 'last_fullsized': '2023-10-16T19:57:05.971386+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T19:57:05.971386+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T19:57:05.971386+0000', 'last_clean_scrub_stamp': '2023-10-16T19:57:05.971386+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T19:57:11.864 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.35 is not active+clean 2023-10-16T19:57:11.864 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T19:57:05.971386+0000', 'last_change': '2023-10-16T19:57:05.971386+0000', 'last_active': '2023-10-16T19:57:05.971386+0000', 'last_peered': '2023-10-16T19:57:05.971386+0000', 'last_clean': '2023-10-16T19:57:05.971386+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T19:57:05.971386+0000', 'last_undegraded': '2023-10-16T19:57:05.971386+0000', 'last_fullsized': '2023-10-16T19:57:05.971386+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T19:57:05.971386+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T19:57:05.971386+0000', 'last_clean_scrub_stamp': '2023-10-16T19:57:05.971386+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T19:57:11.864 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.34 is not active+clean 2023-10-16T19:57:11.865 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T19:57:05.971386+0000', 'last_change': '2023-10-16T19:57:05.971386+0000', 'last_active': '2023-10-16T19:57:05.971386+0000', 'last_peered': '2023-10-16T19:57:05.971386+0000', 'last_clean': '2023-10-16T19:57:05.971386+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T19:57:05.971386+0000', 'last_undegraded': '2023-10-16T19:57:05.971386+0000', 'last_fullsized': '2023-10-16T19:57:05.971386+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T19:57:05.971386+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T19:57:05.971386+0000', 'last_clean_scrub_stamp': '2023-10-16T19:57:05.971386+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T19:57:11.865 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.33 is not active+clean 2023-10-16T19:57:11.866 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T19:57:05.971386+0000', 'last_change': '2023-10-16T19:57:05.971386+0000', 'last_active': '2023-10-16T19:57:05.971386+0000', 'last_peered': '2023-10-16T19:57:05.971386+0000', 'last_clean': '2023-10-16T19:57:05.971386+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T19:57:05.971386+0000', 'last_undegraded': '2023-10-16T19:57:05.971386+0000', 'last_fullsized': '2023-10-16T19:57:05.971386+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T19:57:05.971386+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T19:57:05.971386+0000', 'last_clean_scrub_stamp': '2023-10-16T19:57:05.971386+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T19:57:11.867 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.32 is not active+clean 2023-10-16T19:57:11.867 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T19:57:05.971386+0000', 'last_change': '2023-10-16T19:57:05.971386+0000', 'last_active': '2023-10-16T19:57:05.971386+0000', 'last_peered': '2023-10-16T19:57:05.971386+0000', 'last_clean': '2023-10-16T19:57:05.971386+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T19:57:05.971386+0000', 'last_undegraded': '2023-10-16T19:57:05.971386+0000', 'last_fullsized': '2023-10-16T19:57:05.971386+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T19:57:05.971386+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T19:57:05.971386+0000', 'last_clean_scrub_stamp': '2023-10-16T19:57:05.971386+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T19:57:11.868 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.31 is not active+clean 2023-10-16T19:57:11.868 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T19:57:05.971386+0000', 'last_change': '2023-10-16T19:57:05.971386+0000', 'last_active': '2023-10-16T19:57:05.971386+0000', 'last_peered': '2023-10-16T19:57:05.971386+0000', 'last_clean': '2023-10-16T19:57:05.971386+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T19:57:05.971386+0000', 'last_undegraded': '2023-10-16T19:57:05.971386+0000', 'last_fullsized': '2023-10-16T19:57:05.971386+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T19:57:05.971386+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T19:57:05.971386+0000', 'last_clean_scrub_stamp': '2023-10-16T19:57:05.971386+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T19:57:11.868 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.30 is not active+clean 2023-10-16T19:57:11.869 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T19:57:05.971386+0000', 'last_change': '2023-10-16T19:57:05.971386+0000', 'last_active': '2023-10-16T19:57:05.971386+0000', 'last_peered': '2023-10-16T19:57:05.971386+0000', 'last_clean': '2023-10-16T19:57:05.971386+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T19:57:05.971386+0000', 'last_undegraded': '2023-10-16T19:57:05.971386+0000', 'last_fullsized': '2023-10-16T19:57:05.971386+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T19:57:05.971386+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T19:57:05.971386+0000', 'last_clean_scrub_stamp': '2023-10-16T19:57:05.971386+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T19:57:11.869 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2f is not active+clean 2023-10-16T19:57:11.869 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T19:57:05.971386+0000', 'last_change': '2023-10-16T19:57:05.971386+0000', 'last_active': '2023-10-16T19:57:05.971386+0000', 'last_peered': '2023-10-16T19:57:05.971386+0000', 'last_clean': '2023-10-16T19:57:05.971386+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T19:57:05.971386+0000', 'last_undegraded': '2023-10-16T19:57:05.971386+0000', 'last_fullsized': '2023-10-16T19:57:05.971386+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T19:57:05.971386+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T19:57:05.971386+0000', 'last_clean_scrub_stamp': '2023-10-16T19:57:05.971386+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T19:57:11.870 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2e is not active+clean 2023-10-16T19:57:11.870 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T19:57:05.971386+0000', 'last_change': '2023-10-16T19:57:05.971386+0000', 'last_active': '2023-10-16T19:57:05.971386+0000', 'last_peered': '2023-10-16T19:57:05.971386+0000', 'last_clean': '2023-10-16T19:57:05.971386+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T19:57:05.971386+0000', 'last_undegraded': '2023-10-16T19:57:05.971386+0000', 'last_fullsized': '2023-10-16T19:57:05.971386+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T19:57:05.971386+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T19:57:05.971386+0000', 'last_clean_scrub_stamp': '2023-10-16T19:57:05.971386+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T19:57:11.871 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2d is not active+clean 2023-10-16T19:57:11.871 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T19:57:05.971386+0000', 'last_change': '2023-10-16T19:57:05.971386+0000', 'last_active': '2023-10-16T19:57:05.971386+0000', 'last_peered': '2023-10-16T19:57:05.971386+0000', 'last_clean': '2023-10-16T19:57:05.971386+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T19:57:05.971386+0000', 'last_undegraded': '2023-10-16T19:57:05.971386+0000', 'last_fullsized': '2023-10-16T19:57:05.971386+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T19:57:05.971386+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T19:57:05.971386+0000', 'last_clean_scrub_stamp': '2023-10-16T19:57:05.971386+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T19:57:11.871 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.1f is not active+clean 2023-10-16T19:57:11.872 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2023-10-16T19:57:04.973649+0000', 'last_change': '2023-10-16T19:57:04.973649+0000', 'last_active': '2023-10-16T19:57:04.967702+0000', 'last_peered': '2023-10-16T19:57:04.967702+0000', 'last_clean': '2023-10-16T19:57:04.967702+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T19:57:04.973649+0000', 'last_undegraded': '2023-10-16T19:57:04.973649+0000', 'last_fullsized': '2023-10-16T19:57:04.973649+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T19:57:04.967702+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T19:57:04.967702+0000', 'last_clean_scrub_stamp': '2023-10-16T19:57:04.967702+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-16T19:57:11.872 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1e is not active+clean 2023-10-16T19:57:11.872 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T19:57:05.971386+0000', 'last_change': '2023-10-16T19:57:05.971386+0000', 'last_active': '2023-10-16T19:57:05.971386+0000', 'last_peered': '2023-10-16T19:57:05.971386+0000', 'last_clean': '2023-10-16T19:57:05.971386+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T19:57:05.971386+0000', 'last_undegraded': '2023-10-16T19:57:05.971386+0000', 'last_fullsized': '2023-10-16T19:57:05.971386+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T19:57:05.971386+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T19:57:05.971386+0000', 'last_clean_scrub_stamp': '2023-10-16T19:57:05.971386+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T19:57:11.873 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.1e is not active+clean 2023-10-16T19:57:11.873 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2023-10-16T19:57:04.974840+0000', 'last_change': '2023-10-16T19:57:04.974840+0000', 'last_active': '2023-10-16T19:57:04.967702+0000', 'last_peered': '2023-10-16T19:57:04.967702+0000', 'last_clean': '2023-10-16T19:57:04.967702+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T19:57:04.974840+0000', 'last_undegraded': '2023-10-16T19:57:04.974840+0000', 'last_fullsized': '2023-10-16T19:57:04.974840+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T19:57:04.967702+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T19:57:04.967702+0000', 'last_clean_scrub_stamp': '2023-10-16T19:57:04.967702+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-16T19:57:11.874 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1f is not active+clean 2023-10-16T19:57:11.874 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T19:57:05.971386+0000', 'last_change': '2023-10-16T19:57:05.971386+0000', 'last_active': '2023-10-16T19:57:05.971386+0000', 'last_peered': '2023-10-16T19:57:05.971386+0000', 'last_clean': '2023-10-16T19:57:05.971386+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T19:57:05.971386+0000', 'last_undegraded': '2023-10-16T19:57:05.971386+0000', 'last_fullsized': '2023-10-16T19:57:05.971386+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T19:57:05.971386+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T19:57:05.971386+0000', 'last_clean_scrub_stamp': '2023-10-16T19:57:05.971386+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T19:57:11.874 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.1d is not active+clean 2023-10-16T19:57:11.874 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2023-10-16T19:57:04.974328+0000', 'last_change': '2023-10-16T19:57:04.974328+0000', 'last_active': '2023-10-16T19:57:04.967702+0000', 'last_peered': '2023-10-16T19:57:04.967702+0000', 'last_clean': '2023-10-16T19:57:04.967702+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T19:57:04.974328+0000', 'last_undegraded': '2023-10-16T19:57:04.974328+0000', 'last_fullsized': '2023-10-16T19:57:04.974328+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T19:57:04.967702+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T19:57:04.967702+0000', 'last_clean_scrub_stamp': '2023-10-16T19:57:04.967702+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-16T19:57:11.875 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1c is not active+clean 2023-10-16T19:57:11.875 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T19:57:05.971386+0000', 'last_change': '2023-10-16T19:57:05.971386+0000', 'last_active': '2023-10-16T19:57:05.971386+0000', 'last_peered': '2023-10-16T19:57:05.971386+0000', 'last_clean': '2023-10-16T19:57:05.971386+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T19:57:05.971386+0000', 'last_undegraded': '2023-10-16T19:57:05.971386+0000', 'last_fullsized': '2023-10-16T19:57:05.971386+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T19:57:05.971386+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T19:57:05.971386+0000', 'last_clean_scrub_stamp': '2023-10-16T19:57:05.971386+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T19:57:11.877 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.1c is not active+clean 2023-10-16T19:57:11.877 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2023-10-16T19:57:04.975403+0000', 'last_change': '2023-10-16T19:57:04.975403+0000', 'last_active': '2023-10-16T19:57:04.967702+0000', 'last_peered': '2023-10-16T19:57:04.967702+0000', 'last_clean': '2023-10-16T19:57:04.967702+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T19:57:04.975403+0000', 'last_undegraded': '2023-10-16T19:57:04.975403+0000', 'last_fullsized': '2023-10-16T19:57:04.975403+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T19:57:04.967702+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T19:57:04.967702+0000', 'last_clean_scrub_stamp': '2023-10-16T19:57:04.967702+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-16T19:57:11.877 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1d is not active+clean 2023-10-16T19:57:11.878 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T19:57:05.971386+0000', 'last_change': '2023-10-16T19:57:05.971386+0000', 'last_active': '2023-10-16T19:57:05.971386+0000', 'last_peered': '2023-10-16T19:57:05.971386+0000', 'last_clean': '2023-10-16T19:57:05.971386+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T19:57:05.971386+0000', 'last_undegraded': '2023-10-16T19:57:05.971386+0000', 'last_fullsized': '2023-10-16T19:57:05.971386+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T19:57:05.971386+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T19:57:05.971386+0000', 'last_clean_scrub_stamp': '2023-10-16T19:57:05.971386+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T19:57:11.878 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.1b is not active+clean 2023-10-16T19:57:11.878 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2023-10-16T19:57:04.974498+0000', 'last_change': '2023-10-16T19:57:04.974498+0000', 'last_active': '2023-10-16T19:57:04.967702+0000', 'last_peered': '2023-10-16T19:57:04.967702+0000', 'last_clean': '2023-10-16T19:57:04.967702+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T19:57:04.974498+0000', 'last_undegraded': '2023-10-16T19:57:04.974498+0000', 'last_fullsized': '2023-10-16T19:57:04.974498+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T19:57:04.967702+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T19:57:04.967702+0000', 'last_clean_scrub_stamp': '2023-10-16T19:57:04.967702+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-16T19:57:11.879 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1a is not active+clean 2023-10-16T19:57:11.879 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T19:57:05.971386+0000', 'last_change': '2023-10-16T19:57:05.971386+0000', 'last_active': '2023-10-16T19:57:05.971386+0000', 'last_peered': '2023-10-16T19:57:05.971386+0000', 'last_clean': '2023-10-16T19:57:05.971386+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T19:57:05.971386+0000', 'last_undegraded': '2023-10-16T19:57:05.971386+0000', 'last_fullsized': '2023-10-16T19:57:05.971386+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T19:57:05.971386+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T19:57:05.971386+0000', 'last_clean_scrub_stamp': '2023-10-16T19:57:05.971386+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T19:57:11.879 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.1a is not active+clean 2023-10-16T19:57:11.880 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2023-10-16T19:57:04.974477+0000', 'last_change': '2023-10-16T19:57:04.974477+0000', 'last_active': '2023-10-16T19:57:04.967702+0000', 'last_peered': '2023-10-16T19:57:04.967702+0000', 'last_clean': '2023-10-16T19:57:04.967702+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T19:57:04.974477+0000', 'last_undegraded': '2023-10-16T19:57:04.974477+0000', 'last_fullsized': '2023-10-16T19:57:04.974477+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T19:57:04.967702+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T19:57:04.967702+0000', 'last_clean_scrub_stamp': '2023-10-16T19:57:04.967702+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-16T19:57:11.880 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1b is not active+clean 2023-10-16T19:57:11.880 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T19:57:05.971386+0000', 'last_change': '2023-10-16T19:57:05.971386+0000', 'last_active': '2023-10-16T19:57:05.971386+0000', 'last_peered': '2023-10-16T19:57:05.971386+0000', 'last_clean': '2023-10-16T19:57:05.971386+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T19:57:05.971386+0000', 'last_undegraded': '2023-10-16T19:57:05.971386+0000', 'last_fullsized': '2023-10-16T19:57:05.971386+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T19:57:05.971386+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T19:57:05.971386+0000', 'last_clean_scrub_stamp': '2023-10-16T19:57:05.971386+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T19:57:11.881 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.19 is not active+clean 2023-10-16T19:57:11.881 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2023-10-16T19:57:04.974484+0000', 'last_change': '2023-10-16T19:57:04.974484+0000', 'last_active': '2023-10-16T19:57:04.967702+0000', 'last_peered': '2023-10-16T19:57:04.967702+0000', 'last_clean': '2023-10-16T19:57:04.967702+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T19:57:04.974484+0000', 'last_undegraded': '2023-10-16T19:57:04.974484+0000', 'last_fullsized': '2023-10-16T19:57:04.974484+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T19:57:04.967702+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T19:57:04.967702+0000', 'last_clean_scrub_stamp': '2023-10-16T19:57:04.967702+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-16T19:57:11.881 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.18 is not active+clean 2023-10-16T19:57:11.882 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T19:57:05.971386+0000', 'last_change': '2023-10-16T19:57:05.971386+0000', 'last_active': '2023-10-16T19:57:05.971386+0000', 'last_peered': '2023-10-16T19:57:05.971386+0000', 'last_clean': '2023-10-16T19:57:05.971386+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T19:57:05.971386+0000', 'last_undegraded': '2023-10-16T19:57:05.971386+0000', 'last_fullsized': '2023-10-16T19:57:05.971386+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T19:57:05.971386+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T19:57:05.971386+0000', 'last_clean_scrub_stamp': '2023-10-16T19:57:05.971386+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T19:57:11.882 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.18 is not active+clean 2023-10-16T19:57:11.882 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2023-10-16T19:57:04.977118+0000', 'last_change': '2023-10-16T19:57:04.977118+0000', 'last_active': '2023-10-16T19:57:04.967702+0000', 'last_peered': '2023-10-16T19:57:04.967702+0000', 'last_clean': '2023-10-16T19:57:04.967702+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T19:57:04.977118+0000', 'last_undegraded': '2023-10-16T19:57:04.977118+0000', 'last_fullsized': '2023-10-16T19:57:04.977118+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T19:57:04.967702+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T19:57:04.967702+0000', 'last_clean_scrub_stamp': '2023-10-16T19:57:04.967702+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-16T19:57:11.883 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.19 is not active+clean 2023-10-16T19:57:11.883 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T19:57:05.971386+0000', 'last_change': '2023-10-16T19:57:05.971386+0000', 'last_active': '2023-10-16T19:57:05.971386+0000', 'last_peered': '2023-10-16T19:57:05.971386+0000', 'last_clean': '2023-10-16T19:57:05.971386+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T19:57:05.971386+0000', 'last_undegraded': '2023-10-16T19:57:05.971386+0000', 'last_fullsized': '2023-10-16T19:57:05.971386+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T19:57:05.971386+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T19:57:05.971386+0000', 'last_clean_scrub_stamp': '2023-10-16T19:57:05.971386+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T19:57:11.883 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.17 is not active+clean 2023-10-16T19:57:11.884 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2023-10-16T19:57:04.974103+0000', 'last_change': '2023-10-16T19:57:04.974103+0000', 'last_active': '2023-10-16T19:57:04.967702+0000', 'last_peered': '2023-10-16T19:57:04.967702+0000', 'last_clean': '2023-10-16T19:57:04.967702+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T19:57:04.974103+0000', 'last_undegraded': '2023-10-16T19:57:04.974103+0000', 'last_fullsized': '2023-10-16T19:57:04.974103+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T19:57:04.967702+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T19:57:04.967702+0000', 'last_clean_scrub_stamp': '2023-10-16T19:57:04.967702+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-16T19:57:11.884 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.16 is not active+clean 2023-10-16T19:57:11.884 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T19:57:05.971386+0000', 'last_change': '2023-10-16T19:57:05.971386+0000', 'last_active': '2023-10-16T19:57:05.971386+0000', 'last_peered': '2023-10-16T19:57:05.971386+0000', 'last_clean': '2023-10-16T19:57:05.971386+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T19:57:05.971386+0000', 'last_undegraded': '2023-10-16T19:57:05.971386+0000', 'last_fullsized': '2023-10-16T19:57:05.971386+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T19:57:05.971386+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T19:57:05.971386+0000', 'last_clean_scrub_stamp': '2023-10-16T19:57:05.971386+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T19:57:11.885 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.16 is not active+clean 2023-10-16T19:57:11.885 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2023-10-16T19:57:04.976978+0000', 'last_change': '2023-10-16T19:57:04.976978+0000', 'last_active': '2023-10-16T19:57:04.967702+0000', 'last_peered': '2023-10-16T19:57:04.967702+0000', 'last_clean': '2023-10-16T19:57:04.967702+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T19:57:04.976978+0000', 'last_undegraded': '2023-10-16T19:57:04.976978+0000', 'last_fullsized': '2023-10-16T19:57:04.976978+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T19:57:04.967702+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T19:57:04.967702+0000', 'last_clean_scrub_stamp': '2023-10-16T19:57:04.967702+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-16T19:57:11.885 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.17 is not active+clean 2023-10-16T19:57:11.886 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T19:57:05.971386+0000', 'last_change': '2023-10-16T19:57:05.971386+0000', 'last_active': '2023-10-16T19:57:05.971386+0000', 'last_peered': '2023-10-16T19:57:05.971386+0000', 'last_clean': '2023-10-16T19:57:05.971386+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T19:57:05.971386+0000', 'last_undegraded': '2023-10-16T19:57:05.971386+0000', 'last_fullsized': '2023-10-16T19:57:05.971386+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T19:57:05.971386+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T19:57:05.971386+0000', 'last_clean_scrub_stamp': '2023-10-16T19:57:05.971386+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T19:57:11.886 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.15 is not active+clean 2023-10-16T19:57:11.886 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2023-10-16T19:57:04.975501+0000', 'last_change': '2023-10-16T19:57:04.975501+0000', 'last_active': '2023-10-16T19:57:04.967702+0000', 'last_peered': '2023-10-16T19:57:04.967702+0000', 'last_clean': '2023-10-16T19:57:04.967702+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T19:57:04.975501+0000', 'last_undegraded': '2023-10-16T19:57:04.975501+0000', 'last_fullsized': '2023-10-16T19:57:04.975501+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T19:57:04.967702+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T19:57:04.967702+0000', 'last_clean_scrub_stamp': '2023-10-16T19:57:04.967702+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-16T19:57:11.887 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.14 is not active+clean 2023-10-16T19:57:11.887 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T19:57:05.971386+0000', 'last_change': '2023-10-16T19:57:05.971386+0000', 'last_active': '2023-10-16T19:57:05.971386+0000', 'last_peered': '2023-10-16T19:57:05.971386+0000', 'last_clean': '2023-10-16T19:57:05.971386+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T19:57:05.971386+0000', 'last_undegraded': '2023-10-16T19:57:05.971386+0000', 'last_fullsized': '2023-10-16T19:57:05.971386+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T19:57:05.971386+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T19:57:05.971386+0000', 'last_clean_scrub_stamp': '2023-10-16T19:57:05.971386+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T19:57:11.887 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.14 is not active+clean 2023-10-16T19:57:11.888 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2023-10-16T19:57:04.973701+0000', 'last_change': '2023-10-16T19:57:04.973701+0000', 'last_active': '2023-10-16T19:57:04.967702+0000', 'last_peered': '2023-10-16T19:57:04.967702+0000', 'last_clean': '2023-10-16T19:57:04.967702+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T19:57:04.973701+0000', 'last_undegraded': '2023-10-16T19:57:04.973701+0000', 'last_fullsized': '2023-10-16T19:57:04.973701+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T19:57:04.967702+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T19:57:04.967702+0000', 'last_clean_scrub_stamp': '2023-10-16T19:57:04.967702+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-16T19:57:11.888 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.15 is not active+clean 2023-10-16T19:57:11.888 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T19:57:05.971386+0000', 'last_change': '2023-10-16T19:57:05.971386+0000', 'last_active': '2023-10-16T19:57:05.971386+0000', 'last_peered': '2023-10-16T19:57:05.971386+0000', 'last_clean': '2023-10-16T19:57:05.971386+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T19:57:05.971386+0000', 'last_undegraded': '2023-10-16T19:57:05.971386+0000', 'last_fullsized': '2023-10-16T19:57:05.971386+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T19:57:05.971386+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T19:57:05.971386+0000', 'last_clean_scrub_stamp': '2023-10-16T19:57:05.971386+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T19:57:11.889 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.13 is not active+clean 2023-10-16T19:57:11.889 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2023-10-16T19:57:04.973640+0000', 'last_change': '2023-10-16T19:57:04.973640+0000', 'last_active': '2023-10-16T19:57:04.967702+0000', 'last_peered': '2023-10-16T19:57:04.967702+0000', 'last_clean': '2023-10-16T19:57:04.967702+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T19:57:04.973640+0000', 'last_undegraded': '2023-10-16T19:57:04.973640+0000', 'last_fullsized': '2023-10-16T19:57:04.973640+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T19:57:04.967702+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T19:57:04.967702+0000', 'last_clean_scrub_stamp': '2023-10-16T19:57:04.967702+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-16T19:57:11.889 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.12 is not active+clean 2023-10-16T19:57:11.890 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T19:57:05.971386+0000', 'last_change': '2023-10-16T19:57:05.971386+0000', 'last_active': '2023-10-16T19:57:05.971386+0000', 'last_peered': '2023-10-16T19:57:05.971386+0000', 'last_clean': '2023-10-16T19:57:05.971386+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T19:57:05.971386+0000', 'last_undegraded': '2023-10-16T19:57:05.971386+0000', 'last_fullsized': '2023-10-16T19:57:05.971386+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T19:57:05.971386+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T19:57:05.971386+0000', 'last_clean_scrub_stamp': '2023-10-16T19:57:05.971386+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T19:57:11.890 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.12 is not active+clean 2023-10-16T19:57:11.890 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2023-10-16T19:57:04.976037+0000', 'last_change': '2023-10-16T19:57:04.976037+0000', 'last_active': '2023-10-16T19:57:04.967702+0000', 'last_peered': '2023-10-16T19:57:04.967702+0000', 'last_clean': '2023-10-16T19:57:04.967702+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T19:57:04.976037+0000', 'last_undegraded': '2023-10-16T19:57:04.976037+0000', 'last_fullsized': '2023-10-16T19:57:04.976037+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T19:57:04.967702+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T19:57:04.967702+0000', 'last_clean_scrub_stamp': '2023-10-16T19:57:04.967702+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-16T19:57:11.891 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.13 is not active+clean 2023-10-16T19:57:11.891 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T19:57:05.971386+0000', 'last_change': '2023-10-16T19:57:05.971386+0000', 'last_active': '2023-10-16T19:57:05.971386+0000', 'last_peered': '2023-10-16T19:57:05.971386+0000', 'last_clean': '2023-10-16T19:57:05.971386+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T19:57:05.971386+0000', 'last_undegraded': '2023-10-16T19:57:05.971386+0000', 'last_fullsized': '2023-10-16T19:57:05.971386+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T19:57:05.971386+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T19:57:05.971386+0000', 'last_clean_scrub_stamp': '2023-10-16T19:57:05.971386+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T19:57:11.891 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.11 is not active+clean 2023-10-16T19:57:11.892 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2023-10-16T19:57:04.973680+0000', 'last_change': '2023-10-16T19:57:04.973680+0000', 'last_active': '2023-10-16T19:57:04.967702+0000', 'last_peered': '2023-10-16T19:57:04.967702+0000', 'last_clean': '2023-10-16T19:57:04.967702+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T19:57:04.973680+0000', 'last_undegraded': '2023-10-16T19:57:04.973680+0000', 'last_fullsized': '2023-10-16T19:57:04.973680+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T19:57:04.967702+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T19:57:04.967702+0000', 'last_clean_scrub_stamp': '2023-10-16T19:57:04.967702+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-16T19:57:11.892 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.10 is not active+clean 2023-10-16T19:57:11.892 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T19:57:05.971386+0000', 'last_change': '2023-10-16T19:57:05.971386+0000', 'last_active': '2023-10-16T19:57:05.971386+0000', 'last_peered': '2023-10-16T19:57:05.971386+0000', 'last_clean': '2023-10-16T19:57:05.971386+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T19:57:05.971386+0000', 'last_undegraded': '2023-10-16T19:57:05.971386+0000', 'last_fullsized': '2023-10-16T19:57:05.971386+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T19:57:05.971386+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T19:57:05.971386+0000', 'last_clean_scrub_stamp': '2023-10-16T19:57:05.971386+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T19:57:11.893 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.10 is not active+clean 2023-10-16T19:57:11.893 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2023-10-16T19:57:04.977796+0000', 'last_change': '2023-10-16T19:57:04.977796+0000', 'last_active': '2023-10-16T19:57:04.967702+0000', 'last_peered': '2023-10-16T19:57:04.967702+0000', 'last_clean': '2023-10-16T19:57:04.967702+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T19:57:04.977796+0000', 'last_undegraded': '2023-10-16T19:57:04.977796+0000', 'last_fullsized': '2023-10-16T19:57:04.977796+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T19:57:04.967702+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T19:57:04.967702+0000', 'last_clean_scrub_stamp': '2023-10-16T19:57:04.967702+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-16T19:57:11.893 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.11 is not active+clean 2023-10-16T19:57:11.894 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T19:57:05.971386+0000', 'last_change': '2023-10-16T19:57:05.971386+0000', 'last_active': '2023-10-16T19:57:05.971386+0000', 'last_peered': '2023-10-16T19:57:05.971386+0000', 'last_clean': '2023-10-16T19:57:05.971386+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T19:57:05.971386+0000', 'last_undegraded': '2023-10-16T19:57:05.971386+0000', 'last_fullsized': '2023-10-16T19:57:05.971386+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T19:57:05.971386+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T19:57:05.971386+0000', 'last_clean_scrub_stamp': '2023-10-16T19:57:05.971386+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T19:57:11.894 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.f is not active+clean 2023-10-16T19:57:11.894 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2023-10-16T19:57:04.972878+0000', 'last_change': '2023-10-16T19:57:04.972878+0000', 'last_active': '2023-10-16T19:57:04.967702+0000', 'last_peered': '2023-10-16T19:57:04.967702+0000', 'last_clean': '2023-10-16T19:57:04.967702+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T19:57:04.972878+0000', 'last_undegraded': '2023-10-16T19:57:04.972878+0000', 'last_fullsized': '2023-10-16T19:57:04.972878+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T19:57:04.967702+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T19:57:04.967702+0000', 'last_clean_scrub_stamp': '2023-10-16T19:57:04.967702+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-16T19:57:11.895 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.e is not active+clean 2023-10-16T19:57:11.895 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T19:57:05.971386+0000', 'last_change': '2023-10-16T19:57:05.971386+0000', 'last_active': '2023-10-16T19:57:05.971386+0000', 'last_peered': '2023-10-16T19:57:05.971386+0000', 'last_clean': '2023-10-16T19:57:05.971386+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T19:57:05.971386+0000', 'last_undegraded': '2023-10-16T19:57:05.971386+0000', 'last_fullsized': '2023-10-16T19:57:05.971386+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T19:57:05.971386+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T19:57:05.971386+0000', 'last_clean_scrub_stamp': '2023-10-16T19:57:05.971386+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T19:57:11.895 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.4 is not active+clean 2023-10-16T19:57:11.896 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2023-10-16T19:57:04.975078+0000', 'last_change': '2023-10-16T19:57:04.975078+0000', 'last_active': '2023-10-16T19:57:04.967702+0000', 'last_peered': '2023-10-16T19:57:04.967702+0000', 'last_clean': '2023-10-16T19:57:04.967702+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T19:57:04.975078+0000', 'last_undegraded': '2023-10-16T19:57:04.975078+0000', 'last_fullsized': '2023-10-16T19:57:04.975078+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T19:57:04.967702+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T19:57:04.967702+0000', 'last_clean_scrub_stamp': '2023-10-16T19:57:04.967702+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-16T19:57:11.896 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.5 is not active+clean 2023-10-16T19:57:11.896 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T19:57:05.971386+0000', 'last_change': '2023-10-16T19:57:05.971386+0000', 'last_active': '2023-10-16T19:57:05.971386+0000', 'last_peered': '2023-10-16T19:57:05.971386+0000', 'last_clean': '2023-10-16T19:57:05.971386+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T19:57:05.971386+0000', 'last_undegraded': '2023-10-16T19:57:05.971386+0000', 'last_fullsized': '2023-10-16T19:57:05.971386+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T19:57:05.971386+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T19:57:05.971386+0000', 'last_clean_scrub_stamp': '2023-10-16T19:57:05.971386+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T19:57:11.897 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.2 is not active+clean 2023-10-16T19:57:11.897 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2023-10-16T19:57:04.975630+0000', 'last_change': '2023-10-16T19:57:04.975630+0000', 'last_active': '2023-10-16T19:57:04.967702+0000', 'last_peered': '2023-10-16T19:57:04.967702+0000', 'last_clean': '2023-10-16T19:57:04.967702+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T19:57:04.975630+0000', 'last_undegraded': '2023-10-16T19:57:04.975630+0000', 'last_fullsized': '2023-10-16T19:57:04.975630+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T19:57:04.967702+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T19:57:04.967702+0000', 'last_clean_scrub_stamp': '2023-10-16T19:57:04.967702+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-16T19:57:11.898 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3 is not active+clean 2023-10-16T19:57:11.898 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T19:57:05.971386+0000', 'last_change': '2023-10-16T19:57:05.971386+0000', 'last_active': '2023-10-16T19:57:05.971386+0000', 'last_peered': '2023-10-16T19:57:05.971386+0000', 'last_clean': '2023-10-16T19:57:05.971386+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T19:57:05.971386+0000', 'last_undegraded': '2023-10-16T19:57:05.971386+0000', 'last_fullsized': '2023-10-16T19:57:05.971386+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T19:57:05.971386+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T19:57:05.971386+0000', 'last_clean_scrub_stamp': '2023-10-16T19:57:05.971386+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T19:57:11.898 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.0 is not active+clean 2023-10-16T19:57:11.898 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T19:57:05.971386+0000', 'last_change': '2023-10-16T19:57:05.971386+0000', 'last_active': '2023-10-16T19:57:05.971386+0000', 'last_peered': '2023-10-16T19:57:05.971386+0000', 'last_clean': '2023-10-16T19:57:05.971386+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T19:57:05.971386+0000', 'last_undegraded': '2023-10-16T19:57:05.971386+0000', 'last_fullsized': '2023-10-16T19:57:05.971386+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T19:57:05.971386+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T19:57:05.971386+0000', 'last_clean_scrub_stamp': '2023-10-16T19:57:05.971386+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T19:57:11.899 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.1 is not active+clean 2023-10-16T19:57:11.899 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2023-10-16T19:57:04.977484+0000', 'last_change': '2023-10-16T19:57:04.977484+0000', 'last_active': '2023-10-16T19:57:04.967702+0000', 'last_peered': '2023-10-16T19:57:04.967702+0000', 'last_clean': '2023-10-16T19:57:04.967702+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T19:57:04.977484+0000', 'last_undegraded': '2023-10-16T19:57:04.977484+0000', 'last_fullsized': '2023-10-16T19:57:04.977484+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T19:57:04.967702+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T19:57:04.967702+0000', 'last_clean_scrub_stamp': '2023-10-16T19:57:04.967702+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-16T19:57:11.899 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2 is not active+clean 2023-10-16T19:57:11.900 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T19:57:05.971386+0000', 'last_change': '2023-10-16T19:57:05.971386+0000', 'last_active': '2023-10-16T19:57:05.971386+0000', 'last_peered': '2023-10-16T19:57:05.971386+0000', 'last_clean': '2023-10-16T19:57:05.971386+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T19:57:05.971386+0000', 'last_undegraded': '2023-10-16T19:57:05.971386+0000', 'last_fullsized': '2023-10-16T19:57:05.971386+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T19:57:05.971386+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T19:57:05.971386+0000', 'last_clean_scrub_stamp': '2023-10-16T19:57:05.971386+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T19:57:11.900 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.3 is not active+clean 2023-10-16T19:57:11.900 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2023-10-16T19:57:04.975685+0000', 'last_change': '2023-10-16T19:57:04.975685+0000', 'last_active': '2023-10-16T19:57:04.967702+0000', 'last_peered': '2023-10-16T19:57:04.967702+0000', 'last_clean': '2023-10-16T19:57:04.967702+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T19:57:04.975685+0000', 'last_undegraded': '2023-10-16T19:57:04.975685+0000', 'last_fullsized': '2023-10-16T19:57:04.975685+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T19:57:04.967702+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T19:57:04.967702+0000', 'last_clean_scrub_stamp': '2023-10-16T19:57:04.967702+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-16T19:57:11.901 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1 is not active+clean 2023-10-16T19:57:11.901 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T19:57:05.971386+0000', 'last_change': '2023-10-16T19:57:05.971386+0000', 'last_active': '2023-10-16T19:57:05.971386+0000', 'last_peered': '2023-10-16T19:57:05.971386+0000', 'last_clean': '2023-10-16T19:57:05.971386+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T19:57:05.971386+0000', 'last_undegraded': '2023-10-16T19:57:05.971386+0000', 'last_fullsized': '2023-10-16T19:57:05.971386+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T19:57:05.971386+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T19:57:05.971386+0000', 'last_clean_scrub_stamp': '2023-10-16T19:57:05.971386+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T19:57:11.901 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.0 is not active+clean 2023-10-16T19:57:11.902 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2023-10-16T19:57:04.974266+0000', 'last_change': '2023-10-16T19:57:04.974266+0000', 'last_active': '2023-10-16T19:57:04.967702+0000', 'last_peered': '2023-10-16T19:57:04.967702+0000', 'last_clean': '2023-10-16T19:57:04.967702+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T19:57:04.974266+0000', 'last_undegraded': '2023-10-16T19:57:04.974266+0000', 'last_fullsized': '2023-10-16T19:57:04.974266+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T19:57:04.967702+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T19:57:04.967702+0000', 'last_clean_scrub_stamp': '2023-10-16T19:57:04.967702+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-16T19:57:11.902 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.5 is not active+clean 2023-10-16T19:57:11.902 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2023-10-16T19:57:04.974682+0000', 'last_change': '2023-10-16T19:57:04.974682+0000', 'last_active': '2023-10-16T19:57:04.967702+0000', 'last_peered': '2023-10-16T19:57:04.967702+0000', 'last_clean': '2023-10-16T19:57:04.967702+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T19:57:04.974682+0000', 'last_undegraded': '2023-10-16T19:57:04.974682+0000', 'last_fullsized': '2023-10-16T19:57:04.974682+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T19:57:04.967702+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T19:57:04.967702+0000', 'last_clean_scrub_stamp': '2023-10-16T19:57:04.967702+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-16T19:57:11.903 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.4 is not active+clean 2023-10-16T19:57:11.903 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T19:57:05.971386+0000', 'last_change': '2023-10-16T19:57:05.971386+0000', 'last_active': '2023-10-16T19:57:05.971386+0000', 'last_peered': '2023-10-16T19:57:05.971386+0000', 'last_clean': '2023-10-16T19:57:05.971386+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T19:57:05.971386+0000', 'last_undegraded': '2023-10-16T19:57:05.971386+0000', 'last_fullsized': '2023-10-16T19:57:05.971386+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T19:57:05.971386+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T19:57:05.971386+0000', 'last_clean_scrub_stamp': '2023-10-16T19:57:05.971386+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T19:57:11.903 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.6 is not active+clean 2023-10-16T19:57:11.904 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2023-10-16T19:57:04.975232+0000', 'last_change': '2023-10-16T19:57:04.975232+0000', 'last_active': '2023-10-16T19:57:04.967702+0000', 'last_peered': '2023-10-16T19:57:04.967702+0000', 'last_clean': '2023-10-16T19:57:04.967702+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T19:57:04.975232+0000', 'last_undegraded': '2023-10-16T19:57:04.975232+0000', 'last_fullsized': '2023-10-16T19:57:04.975232+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T19:57:04.967702+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T19:57:04.967702+0000', 'last_clean_scrub_stamp': '2023-10-16T19:57:04.967702+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-16T19:57:11.904 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.7 is not active+clean 2023-10-16T19:57:11.904 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T19:57:05.971386+0000', 'last_change': '2023-10-16T19:57:05.971386+0000', 'last_active': '2023-10-16T19:57:05.971386+0000', 'last_peered': '2023-10-16T19:57:05.971386+0000', 'last_clean': '2023-10-16T19:57:05.971386+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T19:57:05.971386+0000', 'last_undegraded': '2023-10-16T19:57:05.971386+0000', 'last_fullsized': '2023-10-16T19:57:05.971386+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T19:57:05.971386+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T19:57:05.971386+0000', 'last_clean_scrub_stamp': '2023-10-16T19:57:05.971386+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T19:57:11.905 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.7 is not active+clean 2023-10-16T19:57:11.905 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2023-10-16T19:57:04.973273+0000', 'last_change': '2023-10-16T19:57:04.973273+0000', 'last_active': '2023-10-16T19:57:04.967702+0000', 'last_peered': '2023-10-16T19:57:04.967702+0000', 'last_clean': '2023-10-16T19:57:04.967702+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T19:57:04.973273+0000', 'last_undegraded': '2023-10-16T19:57:04.973273+0000', 'last_fullsized': '2023-10-16T19:57:04.973273+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T19:57:04.967702+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T19:57:04.967702+0000', 'last_clean_scrub_stamp': '2023-10-16T19:57:04.967702+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-16T19:57:11.905 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.6 is not active+clean 2023-10-16T19:57:11.906 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T19:57:05.971386+0000', 'last_change': '2023-10-16T19:57:05.971386+0000', 'last_active': '2023-10-16T19:57:05.971386+0000', 'last_peered': '2023-10-16T19:57:05.971386+0000', 'last_clean': '2023-10-16T19:57:05.971386+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T19:57:05.971386+0000', 'last_undegraded': '2023-10-16T19:57:05.971386+0000', 'last_fullsized': '2023-10-16T19:57:05.971386+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T19:57:05.971386+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T19:57:05.971386+0000', 'last_clean_scrub_stamp': '2023-10-16T19:57:05.971386+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T19:57:11.906 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.8 is not active+clean 2023-10-16T19:57:11.906 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2023-10-16T19:57:04.975030+0000', 'last_change': '2023-10-16T19:57:04.975030+0000', 'last_active': '2023-10-16T19:57:04.967702+0000', 'last_peered': '2023-10-16T19:57:04.967702+0000', 'last_clean': '2023-10-16T19:57:04.967702+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T19:57:04.975030+0000', 'last_undegraded': '2023-10-16T19:57:04.975030+0000', 'last_fullsized': '2023-10-16T19:57:04.975030+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T19:57:04.967702+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T19:57:04.967702+0000', 'last_clean_scrub_stamp': '2023-10-16T19:57:04.967702+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-16T19:57:11.907 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.9 is not active+clean 2023-10-16T19:57:11.907 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T19:57:05.971386+0000', 'last_change': '2023-10-16T19:57:05.971386+0000', 'last_active': '2023-10-16T19:57:05.971386+0000', 'last_peered': '2023-10-16T19:57:05.971386+0000', 'last_clean': '2023-10-16T19:57:05.971386+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T19:57:05.971386+0000', 'last_undegraded': '2023-10-16T19:57:05.971386+0000', 'last_fullsized': '2023-10-16T19:57:05.971386+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T19:57:05.971386+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T19:57:05.971386+0000', 'last_clean_scrub_stamp': '2023-10-16T19:57:05.971386+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T19:57:11.908 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.9 is not active+clean 2023-10-16T19:57:11.908 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2023-10-16T19:57:04.975439+0000', 'last_change': '2023-10-16T19:57:04.975439+0000', 'last_active': '2023-10-16T19:57:04.967702+0000', 'last_peered': '2023-10-16T19:57:04.967702+0000', 'last_clean': '2023-10-16T19:57:04.967702+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T19:57:04.975439+0000', 'last_undegraded': '2023-10-16T19:57:04.975439+0000', 'last_fullsized': '2023-10-16T19:57:04.975439+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T19:57:04.967702+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T19:57:04.967702+0000', 'last_clean_scrub_stamp': '2023-10-16T19:57:04.967702+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-16T19:57:11.908 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.8 is not active+clean 2023-10-16T19:57:11.908 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T19:57:05.971386+0000', 'last_change': '2023-10-16T19:57:05.971386+0000', 'last_active': '2023-10-16T19:57:05.971386+0000', 'last_peered': '2023-10-16T19:57:05.971386+0000', 'last_clean': '2023-10-16T19:57:05.971386+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T19:57:05.971386+0000', 'last_undegraded': '2023-10-16T19:57:05.971386+0000', 'last_fullsized': '2023-10-16T19:57:05.971386+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T19:57:05.971386+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T19:57:05.971386+0000', 'last_clean_scrub_stamp': '2023-10-16T19:57:05.971386+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T19:57:11.909 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.a is not active+clean 2023-10-16T19:57:11.909 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2023-10-16T19:57:04.975072+0000', 'last_change': '2023-10-16T19:57:04.975072+0000', 'last_active': '2023-10-16T19:57:04.967702+0000', 'last_peered': '2023-10-16T19:57:04.967702+0000', 'last_clean': '2023-10-16T19:57:04.967702+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T19:57:04.975072+0000', 'last_undegraded': '2023-10-16T19:57:04.975072+0000', 'last_fullsized': '2023-10-16T19:57:04.975072+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T19:57:04.967702+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T19:57:04.967702+0000', 'last_clean_scrub_stamp': '2023-10-16T19:57:04.967702+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-16T19:57:11.910 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.b is not active+clean 2023-10-16T19:57:11.910 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T19:57:05.971386+0000', 'last_change': '2023-10-16T19:57:05.971386+0000', 'last_active': '2023-10-16T19:57:05.971386+0000', 'last_peered': '2023-10-16T19:57:05.971386+0000', 'last_clean': '2023-10-16T19:57:05.971386+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T19:57:05.971386+0000', 'last_undegraded': '2023-10-16T19:57:05.971386+0000', 'last_fullsized': '2023-10-16T19:57:05.971386+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T19:57:05.971386+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T19:57:05.971386+0000', 'last_clean_scrub_stamp': '2023-10-16T19:57:05.971386+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T19:57:11.910 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.b is not active+clean 2023-10-16T19:57:11.911 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2023-10-16T19:57:04.974558+0000', 'last_change': '2023-10-16T19:57:04.974558+0000', 'last_active': '2023-10-16T19:57:04.967702+0000', 'last_peered': '2023-10-16T19:57:04.967702+0000', 'last_clean': '2023-10-16T19:57:04.967702+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T19:57:04.974558+0000', 'last_undegraded': '2023-10-16T19:57:04.974558+0000', 'last_fullsized': '2023-10-16T19:57:04.974558+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T19:57:04.967702+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T19:57:04.967702+0000', 'last_clean_scrub_stamp': '2023-10-16T19:57:04.967702+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-16T19:57:11.911 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.a is not active+clean 2023-10-16T19:57:11.911 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T19:57:05.971386+0000', 'last_change': '2023-10-16T19:57:05.971386+0000', 'last_active': '2023-10-16T19:57:05.971386+0000', 'last_peered': '2023-10-16T19:57:05.971386+0000', 'last_clean': '2023-10-16T19:57:05.971386+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T19:57:05.971386+0000', 'last_undegraded': '2023-10-16T19:57:05.971386+0000', 'last_fullsized': '2023-10-16T19:57:05.971386+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T19:57:05.971386+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T19:57:05.971386+0000', 'last_clean_scrub_stamp': '2023-10-16T19:57:05.971386+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T19:57:11.912 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.c is not active+clean 2023-10-16T19:57:11.912 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2023-10-16T19:57:04.977460+0000', 'last_change': '2023-10-16T19:57:04.977460+0000', 'last_active': '2023-10-16T19:57:04.967702+0000', 'last_peered': '2023-10-16T19:57:04.967702+0000', 'last_clean': '2023-10-16T19:57:04.967702+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T19:57:04.977460+0000', 'last_undegraded': '2023-10-16T19:57:04.977460+0000', 'last_fullsized': '2023-10-16T19:57:04.977460+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T19:57:04.967702+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T19:57:04.967702+0000', 'last_clean_scrub_stamp': '2023-10-16T19:57:04.967702+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-16T19:57:11.912 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.d is not active+clean 2023-10-16T19:57:11.913 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T19:57:05.971386+0000', 'last_change': '2023-10-16T19:57:05.971386+0000', 'last_active': '2023-10-16T19:57:05.971386+0000', 'last_peered': '2023-10-16T19:57:05.971386+0000', 'last_clean': '2023-10-16T19:57:05.971386+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T19:57:05.971386+0000', 'last_undegraded': '2023-10-16T19:57:05.971386+0000', 'last_fullsized': '2023-10-16T19:57:05.971386+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T19:57:05.971386+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T19:57:05.971386+0000', 'last_clean_scrub_stamp': '2023-10-16T19:57:05.971386+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T19:57:11.913 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.d is not active+clean 2023-10-16T19:57:11.913 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2023-10-16T19:57:04.975874+0000', 'last_change': '2023-10-16T19:57:04.975874+0000', 'last_active': '2023-10-16T19:57:04.967702+0000', 'last_peered': '2023-10-16T19:57:04.967702+0000', 'last_clean': '2023-10-16T19:57:04.967702+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T19:57:04.975874+0000', 'last_undegraded': '2023-10-16T19:57:04.975874+0000', 'last_fullsized': '2023-10-16T19:57:04.975874+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T19:57:04.967702+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T19:57:04.967702+0000', 'last_clean_scrub_stamp': '2023-10-16T19:57:04.967702+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-16T19:57:11.914 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.c is not active+clean 2023-10-16T19:57:11.914 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T19:57:05.971386+0000', 'last_change': '2023-10-16T19:57:05.971386+0000', 'last_active': '2023-10-16T19:57:05.971386+0000', 'last_peered': '2023-10-16T19:57:05.971386+0000', 'last_clean': '2023-10-16T19:57:05.971386+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T19:57:05.971386+0000', 'last_undegraded': '2023-10-16T19:57:05.971386+0000', 'last_fullsized': '2023-10-16T19:57:05.971386+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T19:57:05.971386+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T19:57:05.971386+0000', 'last_clean_scrub_stamp': '2023-10-16T19:57:05.971386+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T19:57:11.914 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.e is not active+clean 2023-10-16T19:57:11.915 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2023-10-16T19:57:04.977430+0000', 'last_change': '2023-10-16T19:57:04.977430+0000', 'last_active': '2023-10-16T19:57:04.967702+0000', 'last_peered': '2023-10-16T19:57:04.967702+0000', 'last_clean': '2023-10-16T19:57:04.967702+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T19:57:04.977430+0000', 'last_undegraded': '2023-10-16T19:57:04.977430+0000', 'last_fullsized': '2023-10-16T19:57:04.977430+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T19:57:04.967702+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T19:57:04.967702+0000', 'last_clean_scrub_stamp': '2023-10-16T19:57:04.967702+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-16T19:57:11.915 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.f is not active+clean 2023-10-16T19:57:11.915 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T19:57:05.971386+0000', 'last_change': '2023-10-16T19:57:05.971386+0000', 'last_active': '2023-10-16T19:57:05.971386+0000', 'last_peered': '2023-10-16T19:57:05.971386+0000', 'last_clean': '2023-10-16T19:57:05.971386+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T19:57:05.971386+0000', 'last_undegraded': '2023-10-16T19:57:05.971386+0000', 'last_fullsized': '2023-10-16T19:57:05.971386+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T19:57:05.971386+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T19:57:05.971386+0000', 'last_clean_scrub_stamp': '2023-10-16T19:57:05.971386+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T19:57:11.916 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.20 is not active+clean 2023-10-16T19:57:11.916 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T19:57:05.971386+0000', 'last_change': '2023-10-16T19:57:05.971386+0000', 'last_active': '2023-10-16T19:57:05.971386+0000', 'last_peered': '2023-10-16T19:57:05.971386+0000', 'last_clean': '2023-10-16T19:57:05.971386+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T19:57:05.971386+0000', 'last_undegraded': '2023-10-16T19:57:05.971386+0000', 'last_fullsized': '2023-10-16T19:57:05.971386+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T19:57:05.971386+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T19:57:05.971386+0000', 'last_clean_scrub_stamp': '2023-10-16T19:57:05.971386+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T19:57:11.916 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.21 is not active+clean 2023-10-16T19:57:11.917 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T19:57:05.971386+0000', 'last_change': '2023-10-16T19:57:05.971386+0000', 'last_active': '2023-10-16T19:57:05.971386+0000', 'last_peered': '2023-10-16T19:57:05.971386+0000', 'last_clean': '2023-10-16T19:57:05.971386+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T19:57:05.971386+0000', 'last_undegraded': '2023-10-16T19:57:05.971386+0000', 'last_fullsized': '2023-10-16T19:57:05.971386+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T19:57:05.971386+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T19:57:05.971386+0000', 'last_clean_scrub_stamp': '2023-10-16T19:57:05.971386+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T19:57:11.917 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.22 is not active+clean 2023-10-16T19:57:11.917 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T19:57:05.971386+0000', 'last_change': '2023-10-16T19:57:05.971386+0000', 'last_active': '2023-10-16T19:57:05.971386+0000', 'last_peered': '2023-10-16T19:57:05.971386+0000', 'last_clean': '2023-10-16T19:57:05.971386+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T19:57:05.971386+0000', 'last_undegraded': '2023-10-16T19:57:05.971386+0000', 'last_fullsized': '2023-10-16T19:57:05.971386+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T19:57:05.971386+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T19:57:05.971386+0000', 'last_clean_scrub_stamp': '2023-10-16T19:57:05.971386+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T19:57:11.918 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.23 is not active+clean 2023-10-16T19:57:11.918 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T19:57:05.971386+0000', 'last_change': '2023-10-16T19:57:05.971386+0000', 'last_active': '2023-10-16T19:57:05.971386+0000', 'last_peered': '2023-10-16T19:57:05.971386+0000', 'last_clean': '2023-10-16T19:57:05.971386+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T19:57:05.971386+0000', 'last_undegraded': '2023-10-16T19:57:05.971386+0000', 'last_fullsized': '2023-10-16T19:57:05.971386+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T19:57:05.971386+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T19:57:05.971386+0000', 'last_clean_scrub_stamp': '2023-10-16T19:57:05.971386+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T19:57:11.918 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.24 is not active+clean 2023-10-16T19:57:11.919 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T19:57:05.971386+0000', 'last_change': '2023-10-16T19:57:05.971386+0000', 'last_active': '2023-10-16T19:57:05.971386+0000', 'last_peered': '2023-10-16T19:57:05.971386+0000', 'last_clean': '2023-10-16T19:57:05.971386+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T19:57:05.971386+0000', 'last_undegraded': '2023-10-16T19:57:05.971386+0000', 'last_fullsized': '2023-10-16T19:57:05.971386+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T19:57:05.971386+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T19:57:05.971386+0000', 'last_clean_scrub_stamp': '2023-10-16T19:57:05.971386+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T19:57:11.919 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.25 is not active+clean 2023-10-16T19:57:11.919 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T19:57:05.971386+0000', 'last_change': '2023-10-16T19:57:05.971386+0000', 'last_active': '2023-10-16T19:57:05.971386+0000', 'last_peered': '2023-10-16T19:57:05.971386+0000', 'last_clean': '2023-10-16T19:57:05.971386+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T19:57:05.971386+0000', 'last_undegraded': '2023-10-16T19:57:05.971386+0000', 'last_fullsized': '2023-10-16T19:57:05.971386+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T19:57:05.971386+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T19:57:05.971386+0000', 'last_clean_scrub_stamp': '2023-10-16T19:57:05.971386+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T19:57:11.920 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.26 is not active+clean 2023-10-16T19:57:11.920 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T19:57:05.971386+0000', 'last_change': '2023-10-16T19:57:05.971386+0000', 'last_active': '2023-10-16T19:57:05.971386+0000', 'last_peered': '2023-10-16T19:57:05.971386+0000', 'last_clean': '2023-10-16T19:57:05.971386+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T19:57:05.971386+0000', 'last_undegraded': '2023-10-16T19:57:05.971386+0000', 'last_fullsized': '2023-10-16T19:57:05.971386+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T19:57:05.971386+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T19:57:05.971386+0000', 'last_clean_scrub_stamp': '2023-10-16T19:57:05.971386+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T19:57:11.920 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.27 is not active+clean 2023-10-16T19:57:11.921 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T19:57:05.971386+0000', 'last_change': '2023-10-16T19:57:05.971386+0000', 'last_active': '2023-10-16T19:57:05.971386+0000', 'last_peered': '2023-10-16T19:57:05.971386+0000', 'last_clean': '2023-10-16T19:57:05.971386+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T19:57:05.971386+0000', 'last_undegraded': '2023-10-16T19:57:05.971386+0000', 'last_fullsized': '2023-10-16T19:57:05.971386+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T19:57:05.971386+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T19:57:05.971386+0000', 'last_clean_scrub_stamp': '2023-10-16T19:57:05.971386+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T19:57:11.921 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.28 is not active+clean 2023-10-16T19:57:11.921 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T19:57:05.971386+0000', 'last_change': '2023-10-16T19:57:05.971386+0000', 'last_active': '2023-10-16T19:57:05.971386+0000', 'last_peered': '2023-10-16T19:57:05.971386+0000', 'last_clean': '2023-10-16T19:57:05.971386+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T19:57:05.971386+0000', 'last_undegraded': '2023-10-16T19:57:05.971386+0000', 'last_fullsized': '2023-10-16T19:57:05.971386+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T19:57:05.971386+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T19:57:05.971386+0000', 'last_clean_scrub_stamp': '2023-10-16T19:57:05.971386+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T19:57:11.922 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.29 is not active+clean 2023-10-16T19:57:11.922 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T19:57:05.971386+0000', 'last_change': '2023-10-16T19:57:05.971386+0000', 'last_active': '2023-10-16T19:57:05.971386+0000', 'last_peered': '2023-10-16T19:57:05.971386+0000', 'last_clean': '2023-10-16T19:57:05.971386+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T19:57:05.971386+0000', 'last_undegraded': '2023-10-16T19:57:05.971386+0000', 'last_fullsized': '2023-10-16T19:57:05.971386+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T19:57:05.971386+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T19:57:05.971386+0000', 'last_clean_scrub_stamp': '2023-10-16T19:57:05.971386+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T19:57:11.922 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2a is not active+clean 2023-10-16T19:57:11.923 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T19:57:05.971386+0000', 'last_change': '2023-10-16T19:57:05.971386+0000', 'last_active': '2023-10-16T19:57:05.971386+0000', 'last_peered': '2023-10-16T19:57:05.971386+0000', 'last_clean': '2023-10-16T19:57:05.971386+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T19:57:05.971386+0000', 'last_undegraded': '2023-10-16T19:57:05.971386+0000', 'last_fullsized': '2023-10-16T19:57:05.971386+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T19:57:05.971386+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T19:57:05.971386+0000', 'last_clean_scrub_stamp': '2023-10-16T19:57:05.971386+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T19:57:11.923 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2b is not active+clean 2023-10-16T19:57:11.923 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T19:57:05.971386+0000', 'last_change': '2023-10-16T19:57:05.971386+0000', 'last_active': '2023-10-16T19:57:05.971386+0000', 'last_peered': '2023-10-16T19:57:05.971386+0000', 'last_clean': '2023-10-16T19:57:05.971386+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T19:57:05.971386+0000', 'last_undegraded': '2023-10-16T19:57:05.971386+0000', 'last_fullsized': '2023-10-16T19:57:05.971386+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T19:57:05.971386+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T19:57:05.971386+0000', 'last_clean_scrub_stamp': '2023-10-16T19:57:05.971386+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T19:57:11.924 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2c is not active+clean 2023-10-16T19:57:11.924 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-16T19:57:05.971386+0000', 'last_change': '2023-10-16T19:57:05.971386+0000', 'last_active': '2023-10-16T19:57:05.971386+0000', 'last_peered': '2023-10-16T19:57:05.971386+0000', 'last_clean': '2023-10-16T19:57:05.971386+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T19:57:05.971386+0000', 'last_undegraded': '2023-10-16T19:57:05.971386+0000', 'last_fullsized': '2023-10-16T19:57:05.971386+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T19:57:05.971386+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T19:57:05.971386+0000', 'last_clean_scrub_stamp': '2023-10-16T19:57:05.971386+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-16T19:57:11.925 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-16T19:57:12.045 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:12.042+0000 7fc55e783700 1 Processor -- start 2023-10-16T19:57:12.045 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:12.042+0000 7fc55e783700 1 -- start start 2023-10-16T19:57:12.047 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:12.043+0000 7fc55e783700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc558143bd0 0x7fc5580cef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:12.048 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:12.043+0000 7fc55e783700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fc5580cf4c0 0x7fc5580b2710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:12.048 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:12.043+0000 7fc55e783700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc55806e180 con 0x7fc5580b2c50 2023-10-16T19:57:12.048 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:12.043+0000 7fc55e783700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5580b3100 con 0x7fc5580cf4c0 2023-10-16T19:57:12.048 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:12.043+0000 7fc55e783700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc558143fb0 con 0x7fc558143bd0 2023-10-16T19:57:12.049 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:12.043+0000 7fc55cd20700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7fc5580b2c50 0x7fc558071080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:55352/0 (socket says 172.21.15.157:55352) 2023-10-16T19:57:12.049 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:12.043+0000 7fc55cd20700 1 -- 172.21.15.157:0/1900642602 learned_addr learned my addr 172.21.15.157:0/1900642602 (peer_addr_for_me v1:172.21.15.157:0/0) 2023-10-16T19:57:12.049 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:12.044+0000 7fc557fff700 1 --2- 172.21.15.157:0/1900642602 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc558143bd0 0x7fc5580cef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:12.049 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:12.044+0000 7fc5577fe700 1 --2- 172.21.15.157:0/1900642602 >> v2:172.21.15.187:3300/0 conn(0x7fc5580cf4c0 0x7fc5580b2710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:12.049 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:12.044+0000 7fc556ffd700 1 -- 172.21.15.157:0/1900642602 <== mon.0 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1890018610 0 0) 0x7fc55806e180 con 0x7fc5580b2c50 2023-10-16T19:57:12.050 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:12.044+0000 7fc556ffd700 1 -- 172.21.15.157:0/1900642602 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc5400035b0 con 0x7fc5580b2c50 2023-10-16T19:57:12.050 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:12.044+0000 7fc556ffd700 1 -- 172.21.15.157:0/1900642602 <== mon.0 v1:172.21.15.157:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3088104326 0 0) 0x7fc5400035b0 con 0x7fc5580b2c50 2023-10-16T19:57:12.050 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:12.044+0000 7fc557fff700 1 -- 172.21.15.157:0/1900642602 >> v2:172.21.15.187:3300/0 conn(0x7fc5580cf4c0 msgr2=0x7fc5580b2710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:57:12.050 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:12.044+0000 7fc557fff700 1 --2- 172.21.15.157:0/1900642602 >> v2:172.21.15.187:3300/0 conn(0x7fc5580cf4c0 0x7fc5580b2710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:12.050 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:12.044+0000 7fc557fff700 1 -- 172.21.15.157:0/1900642602 >> v1:172.21.15.157:6789/0 conn(0x7fc5580b2c50 legacy=0x7fc558071080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:12.050 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:12.044+0000 7fc557fff700 1 -- 172.21.15.157:0/1900642602 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc558144480 con 0x7fc558143bd0 2023-10-16T19:57:12.051 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:12.044+0000 7fc557fff700 1 --2- 172.21.15.157:0/1900642602 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc558143bd0 0x7fc5580cef80 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fc54c009840 tx=0x7fc54c009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7db525b288a90649 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:12.051 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:12.044+0000 7fc556ffd700 1 -- 172.21.15.157:0/1900642602 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5500019f0 con 0x7fc558143bd0 2023-10-16T19:57:12.051 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:12.044+0000 7fc556ffd700 1 -- 172.21.15.157:0/1900642602 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc54c004030 con 0x7fc558143bd0 2023-10-16T19:57:12.051 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:12.044+0000 7fc556ffd700 1 -- 172.21.15.157:0/1900642602 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc54c0043a0 con 0x7fc558143bd0 2023-10-16T19:57:12.051 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:12.045+0000 7fc55e783700 1 -- 172.21.15.157:0/1900642602 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc558143bd0 msgr2=0x7fc5580cef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:12.052 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:12.045+0000 7fc55e783700 1 --2- 172.21.15.157:0/1900642602 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc558143bd0 0x7fc5580cef80 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fc54c009840 tx=0x7fc54c009b50 comp rx=0 tx=0).stop 2023-10-16T19:57:12.052 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:12.045+0000 7fc55e783700 1 -- 172.21.15.157:0/1900642602 shutdown_connections 2023-10-16T19:57:12.052 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:12.045+0000 7fc55e783700 1 --2- 172.21.15.157:0/1900642602 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc558143bd0 0x7fc5580cef80 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:12.052 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:12.045+0000 7fc55e783700 1 --2- 172.21.15.157:0/1900642602 >> v2:172.21.15.187:3300/0 conn(0x7fc5580cf4c0 0x7fc5580b2710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:12.052 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:12.045+0000 7fc55e783700 1 -- 172.21.15.157:0/1900642602 >> 172.21.15.157:0/1900642602 conn(0x7fc5580d0b30 msgr2=0x7fc5580d0f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:12.053 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:12.045+0000 7fc55e783700 1 -- 172.21.15.157:0/1900642602 shutdown_connections 2023-10-16T19:57:12.053 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:12.045+0000 7fc55e783700 1 -- 172.21.15.157:0/1900642602 wait complete. 2023-10-16T19:57:12.055 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:12.046+0000 7fc55e783700 1 Processor -- start 2023-10-16T19:57:12.055 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:12.046+0000 7fc55e783700 1 -- start start 2023-10-16T19:57:12.056 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:12.047+0000 7fc55e783700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc5580b2c50 0x7fc558071260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:12.056 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:12.047+0000 7fc55e783700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc5580cf4c0 0x7fc5581585f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:12.056 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:12.047+0000 7fc55e783700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc558143bd0 0x7fc558158b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:12.056 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:12.047+0000 7fc55e783700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc55815a950 con 0x7fc5580b2c50 2023-10-16T19:57:12.056 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:12.047+0000 7fc55e783700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5581376e0 con 0x7fc5580cf4c0 2023-10-16T19:57:12.057 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:12.047+0000 7fc55e783700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5581373b0 con 0x7fc558143bd0 2023-10-16T19:57:12.057 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:12.047+0000 7fc557fff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc5580b2c50 0x7fc558071260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:12.057 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:12.047+0000 7fc557fff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc5580b2c50 0x7fc558071260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:45682/0 (socket says 172.21.15.157:45682) 2023-10-16T19:57:12.057 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:12.047+0000 7fc557fff700 1 -- 172.21.15.157:0/3949108862 learned_addr learned my addr 172.21.15.157:0/3949108862 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:57:12.057 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:12.047+0000 7fc557fff700 1 -- 172.21.15.157:0/3949108862 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc558143bd0 msgr2=0x7fc558158b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:12.058 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:12.047+0000 7fc55cd20700 1 --2- 172.21.15.157:0/3949108862 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc558143bd0 0x7fc558158b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:12.058 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:12.047+0000 7fc5577fe700 1 --2- 172.21.15.157:0/3949108862 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc5580cf4c0 0x7fc5581585f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:12.058 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:12.047+0000 7fc557fff700 1 --2- 172.21.15.157:0/3949108862 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc558143bd0 0x7fc558158b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:12.058 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:12.047+0000 7fc557fff700 1 -- 172.21.15.157:0/3949108862 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc5580cf4c0 msgr2=0x7fc5581585f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:12.058 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:12.047+0000 7fc557fff700 1 --2- 172.21.15.157:0/3949108862 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc5580cf4c0 0x7fc5581585f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:12.059 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:12.047+0000 7fc557fff700 1 -- 172.21.15.157:0/3949108862 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc54c0094a0 con 0x7fc5580b2c50 2023-10-16T19:57:12.059 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:12.047+0000 7fc557fff700 1 --2- 172.21.15.157:0/3949108862 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc5580b2c50 0x7fc558071260 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc54c000c00 tx=0x7fc54c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:12.059 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:12.048+0000 7fc554ff9700 1 -- 172.21.15.157:0/3949108862 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc54c004590 con 0x7fc5580b2c50 2023-10-16T19:57:12.059 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:12.048+0000 7fc554ff9700 1 -- 172.21.15.157:0/3949108862 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc54c01f070 con 0x7fc5580b2c50 2023-10-16T19:57:12.059 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:12.048+0000 7fc55e783700 1 -- 172.21.15.157:0/3949108862 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc558159ed0 con 0x7fc5580b2c50 2023-10-16T19:57:12.060 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:12.048+0000 7fc554ff9700 1 -- 172.21.15.157:0/3949108862 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc54c011870 con 0x7fc5580b2c50 2023-10-16T19:57:12.060 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:12.048+0000 7fc55e783700 1 -- 172.21.15.157:0/3949108862 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc55815a490 con 0x7fc5580b2c50 2023-10-16T19:57:12.060 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:12.049+0000 7fc55e783700 1 -- 172.21.15.157:0/3949108862 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc558137210 con 0x7fc5580b2c50 2023-10-16T19:57:12.060 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:12.049+0000 7fc554ff9700 1 -- 172.21.15.157:0/3949108862 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fc54c0119d0 con 0x7fc5580b2c50 2023-10-16T19:57:12.060 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:12.049+0000 7fc554ff9700 1 --2- 172.21.15.157:0/3949108862 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fc54406af00 0x7fc54406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:12.060 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:12.049+0000 7fc554ff9700 1 -- 172.21.15.157:0/3949108862 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc54c021070 con 0x7fc5580b2c50 2023-10-16T19:57:12.061 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:12.050+0000 7fc5577fe700 1 --2- 172.21.15.157:0/3949108862 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fc54406af00 0x7fc54406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:12.061 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:12.050+0000 7fc5577fe700 1 --2- 172.21.15.157:0/3949108862 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fc54406af00 0x7fc54406d3c0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fc5580ca840 tx=0x7fc548008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:12.061 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:12.054+0000 7fc554ff9700 1 -- 172.21.15.157:0/3949108862 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc558137210 con 0x7fc5580b2c50 2023-10-16T19:57:12.323 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:12.321+0000 7fc55e783700 1 -- 172.21.15.157:0/3949108862 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fc558137210 con 0x7fc5580b2c50 2023-10-16T19:57:12.324 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:12.321+0000 7fc554ff9700 1 -- 172.21.15.157:0/3949108862 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1100 (secure 0 0 0) 0x7fc558137210 con 0x7fc5580b2c50 2023-10-16T19:57:12.324 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-10-16T19:57:12.325 INFO:teuthology.orchestra.run.smithi157.stdout:{"fsid":"28199dc9-64d5-479e-83c6-21f097c33d39","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":23,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":21,"num_osds":8,"num_up_osds":8,"osd_up_since":1697486214,"num_in_osds":8,"osd_in_since":1697486211,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":64},{"state_name":"creating+peering","count":32},{"state_name":"active+clean","count":1}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":1623391,"bytes_avail":1598376609,"bytes_total":1600000000,"unknown_pgs_ratio":0.65979379415512085,"inactive_pgs_ratio":0.32989689707756042},"fsmap":{"epoch":8,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"d","status":"up:active","gid":4282}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":1,"modified":"2023-10-16T19:56:49.203104+0000","services":{}},"progress_events":{}} 2023-10-16T19:57:12.326 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:12.324+0000 7fc55e783700 1 -- 172.21.15.157:0/3949108862 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fc54406af00 msgr2=0x7fc54406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:12.326 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:12.324+0000 7fc55e783700 1 --2- 172.21.15.157:0/3949108862 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fc54406af00 0x7fc54406d3c0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fc5580ca840 tx=0x7fc548008040 comp rx=0 tx=0).stop 2023-10-16T19:57:12.327 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:12.324+0000 7fc55e783700 1 -- 172.21.15.157:0/3949108862 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc5580b2c50 msgr2=0x7fc558071260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:12.327 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:12.324+0000 7fc55e783700 1 --2- 172.21.15.157:0/3949108862 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc5580b2c50 0x7fc558071260 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc54c000c00 tx=0x7fc54c004750 comp rx=0 tx=0).stop 2023-10-16T19:57:12.327 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:12.324+0000 7fc55e783700 1 -- 172.21.15.157:0/3949108862 shutdown_connections 2023-10-16T19:57:12.327 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:12.324+0000 7fc55e783700 1 --2- 172.21.15.157:0/3949108862 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc558143bd0 0x7fc558158b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:12.327 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:12.324+0000 7fc55e783700 1 --2- 172.21.15.157:0/3949108862 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc5580b2c50 0x7fc558071260 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:12.328 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:12.324+0000 7fc55e783700 1 --2- 172.21.15.157:0/3949108862 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fc54406af00 0x7fc54406d3c0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:12.328 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:12.324+0000 7fc55e783700 1 --2- 172.21.15.157:0/3949108862 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc5580cf4c0 0x7fc5581585f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:12.328 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:12.324+0000 7fc55e783700 1 -- 172.21.15.157:0/3949108862 >> 172.21.15.157:0/3949108862 conn(0x7fc5580d0b30 msgr2=0x7fc5580d01f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:12.328 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:12.324+0000 7fc55e783700 1 -- 172.21.15.157:0/3949108862 shutdown_connections 2023-10-16T19:57:12.328 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:12.324+0000 7fc55e783700 1 -- 172.21.15.157:0/3949108862 wait complete. 2023-10-16T19:57:12.338 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-10-16T19:57:12.339 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-16T19:57:12.460 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:12.457+0000 7f4111889700 1 Processor -- start 2023-10-16T19:57:12.460 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:12.457+0000 7f4111889700 1 -- start start 2023-10-16T19:57:12.462 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:12.458+0000 7f4111889700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f410c15de00 0x7f410c161a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:12.463 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:12.458+0000 7f4111889700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f410c0ce870 con 0x7f410c161f50 2023-10-16T19:57:12.463 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:12.458+0000 7f4111889700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f410c162990 con 0x7f410c0ced00 2023-10-16T19:57:12.463 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:12.458+0000 7f4111889700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f410c1623d0 con 0x7f410c15de00 2023-10-16T19:57:12.463 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:12.458+0000 7f410a7fc700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f410c161f50 0x7f410c0d2200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:55362/0 (socket says 172.21.15.157:55362) 2023-10-16T19:57:12.463 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:12.458+0000 7f410a7fc700 1 -- 172.21.15.157:0/4172140668 learned_addr learned my addr 172.21.15.157:0/4172140668 (peer_addr_for_me v1:172.21.15.157:0/0) 2023-10-16T19:57:12.464 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:12.458+0000 7f410affd700 1 --2- 172.21.15.157:0/4172140668 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f410c15de00 0x7f410c161a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:12.464 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:12.458+0000 7f4109ffb700 1 -- 172.21.15.157:0/4172140668 <== mon.0 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 177771613 0 0) 0x7f410c0ce870 con 0x7f410c161f50 2023-10-16T19:57:12.464 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:12.458+0000 7f4109ffb700 1 -- 172.21.15.157:0/4172140668 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f40f40035b0 con 0x7f410c161f50 2023-10-16T19:57:12.464 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:12.459+0000 7f4109ffb700 1 -- 172.21.15.157:0/4172140668 <== mon.0 v1:172.21.15.157:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3103467932 0 0) 0x7f40f40035b0 con 0x7f410c161f50 2023-10-16T19:57:12.464 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:12.459+0000 7f410affd700 1 -- 172.21.15.157:0/4172140668 >> v1:172.21.15.187:6789/0 conn(0x7f410c0ced00 legacy=0x7f410c0d05b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:12.465 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:12.459+0000 7f410affd700 1 -- 172.21.15.157:0/4172140668 >> v1:172.21.15.157:6789/0 conn(0x7f410c161f50 legacy=0x7f410c0d2200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:12.465 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:12.459+0000 7f410affd700 1 -- 172.21.15.157:0/4172140668 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f410c1626b0 con 0x7f410c15de00 2023-10-16T19:57:12.465 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:12.459+0000 7f410affd700 1 --2- 172.21.15.157:0/4172140668 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f410c15de00 0x7f410c161a10 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f4100009870 tx=0x7f4100009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f3cd6d79986a9dd6 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:12.465 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:12.459+0000 7f4109ffb700 1 -- 172.21.15.157:0/4172140668 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40fc001670 con 0x7f410c15de00 2023-10-16T19:57:12.465 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:12.459+0000 7f4109ffb700 1 -- 172.21.15.157:0/4172140668 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4100004030 con 0x7f410c15de00 2023-10-16T19:57:12.466 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:12.459+0000 7f4109ffb700 1 -- 172.21.15.157:0/4172140668 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41000043a0 con 0x7f410c15de00 2023-10-16T19:57:12.466 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:12.459+0000 7f4111889700 1 -- 172.21.15.157:0/4172140668 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f410c15de00 msgr2=0x7f410c161a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:12.466 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:12.459+0000 7f4111889700 1 --2- 172.21.15.157:0/4172140668 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f410c15de00 0x7f410c161a10 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f4100009870 tx=0x7f4100009b80 comp rx=0 tx=0).stop 2023-10-16T19:57:12.466 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:12.460+0000 7f4111889700 1 -- 172.21.15.157:0/4172140668 shutdown_connections 2023-10-16T19:57:12.466 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:12.460+0000 7f4111889700 1 --2- 172.21.15.157:0/4172140668 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f410c15de00 0x7f410c161a10 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:12.467 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:12.460+0000 7f4111889700 1 -- 172.21.15.157:0/4172140668 >> 172.21.15.157:0/4172140668 conn(0x7f410c0665a0 msgr2=0x7f410c066980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:12.467 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:12.460+0000 7f4111889700 1 -- 172.21.15.157:0/4172140668 shutdown_connections 2023-10-16T19:57:12.467 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:12.460+0000 7f4111889700 1 -- 172.21.15.157:0/4172140668 wait complete. 2023-10-16T19:57:12.469 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:12.461+0000 7f4111889700 1 Processor -- start 2023-10-16T19:57:12.470 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:12.461+0000 7f4111889700 1 -- start start 2023-10-16T19:57:12.471 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:12.462+0000 7f4111889700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f410c0ced00 0x7f410c1f3980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:12.471 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:12.462+0000 7f4111889700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f410c15de00 0x7f410c0c78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:12.471 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:12.462+0000 7f4111889700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f410c161f50 0x7f410c1f0d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:12.471 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:12.462+0000 7f4111889700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f410c1f4990 con 0x7f410c15de00 2023-10-16T19:57:12.471 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:12.462+0000 7f4111889700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f410c0cdd90 con 0x7f410c161f50 2023-10-16T19:57:12.472 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:12.462+0000 7f4111889700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f410c0c7f40 con 0x7f410c0ced00 2023-10-16T19:57:12.472 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:12.462+0000 7f410a7fc700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f410c15de00 0x7f410c0c78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:12.472 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:12.462+0000 7f410a7fc700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f410c15de00 0x7f410c0c78b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:45698/0 (socket says 172.21.15.157:45698) 2023-10-16T19:57:12.472 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:12.462+0000 7f410a7fc700 1 -- 172.21.15.157:0/3050125130 learned_addr learned my addr 172.21.15.157:0/3050125130 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:57:12.472 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:12.462+0000 7f410affd700 1 --2- 172.21.15.157:0/3050125130 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f410c0ced00 0x7f410c1f3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:12.473 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:12.462+0000 7f410b7fe700 1 --2- 172.21.15.157:0/3050125130 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f410c161f50 0x7f410c1f0d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:12.473 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:12.462+0000 7f410a7fc700 1 -- 172.21.15.157:0/3050125130 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f410c0ced00 msgr2=0x7f410c1f3980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:12.473 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:12.462+0000 7f410a7fc700 1 --2- 172.21.15.157:0/3050125130 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f410c0ced00 0x7f410c1f3980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:12.473 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:12.462+0000 7f410a7fc700 1 -- 172.21.15.157:0/3050125130 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f410c161f50 msgr2=0x7f410c1f0d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:12.473 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:12.462+0000 7f410a7fc700 1 --2- 172.21.15.157:0/3050125130 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f410c161f50 0x7f410c1f0d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:12.474 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:12.462+0000 7f410a7fc700 1 -- 172.21.15.157:0/3050125130 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41000094a0 con 0x7f410c15de00 2023-10-16T19:57:12.474 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:12.462+0000 7f410a7fc700 1 --2- 172.21.15.157:0/3050125130 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f410c15de00 0x7f410c0c78b0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f40fc00c770 tx=0x7f40fc00ca80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:12.474 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:12.462+0000 7f40f3fff700 1 -- 172.21.15.157:0/3050125130 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40fc004c80 con 0x7f410c15de00 2023-10-16T19:57:12.474 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:12.462+0000 7f40f3fff700 1 -- 172.21.15.157:0/3050125130 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40fc004de0 con 0x7f410c15de00 2023-10-16T19:57:12.474 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:12.462+0000 7f40f3fff700 1 -- 172.21.15.157:0/3050125130 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40fc0072d0 con 0x7f410c15de00 2023-10-16T19:57:12.475 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:12.462+0000 7f4111889700 1 -- 172.21.15.157:0/3050125130 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f410c0c8220 con 0x7f410c15de00 2023-10-16T19:57:12.475 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:12.462+0000 7f4111889700 1 -- 172.21.15.157:0/3050125130 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f410c0c87e0 con 0x7f410c15de00 2023-10-16T19:57:12.475 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:12.463+0000 7f4111889700 1 -- 172.21.15.157:0/3050125130 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f410c04f400 con 0x7f410c15de00 2023-10-16T19:57:12.475 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:12.464+0000 7f40f3fff700 1 -- 172.21.15.157:0/3050125130 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f40fc007430 con 0x7f410c15de00 2023-10-16T19:57:12.476 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:12.464+0000 7f40f3fff700 1 --2- 172.21.15.157:0/3050125130 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f40f806af00 0x7f40f806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:12.476 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:12.464+0000 7f40f3fff700 1 -- 172.21.15.157:0/3050125130 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f40fc089310 con 0x7f410c15de00 2023-10-16T19:57:12.476 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:12.464+0000 7f410affd700 1 --2- 172.21.15.157:0/3050125130 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f40f806af00 0x7f40f806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:12.476 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:12.465+0000 7f410affd700 1 --2- 172.21.15.157:0/3050125130 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f40f806af00 0x7f40f806d3c0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f4100000c00 tx=0x7f4100008000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:12.477 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:12.469+0000 7f40f3fff700 1 -- 172.21.15.157:0/3050125130 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f40fc054450 con 0x7f410c15de00 2023-10-16T19:57:12.655 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:12.653+0000 7f4111889700 1 -- 172.21.15.157:0/3050125130 --> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f410c15e1e0 con 0x7f40f806af00 2023-10-16T19:57:12.662 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:12.660+0000 7f40f3fff700 1 -- 172.21.15.157:0/3050125130 <== mgr.4100 v2:172.21.15.187:6832/2426285296 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+250117 (secure 0 0 0) 0x7f4100003720 con 0x7f40f806af00 2023-10-16T19:57:12.665 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-10-16T19:57:12.668 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:12.663+0000 7f4111889700 1 -- 172.21.15.157:0/3050125130 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f40f806af00 msgr2=0x7f40f806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:12.668 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:12.663+0000 7f4111889700 1 --2- 172.21.15.157:0/3050125130 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f40f806af00 0x7f40f806d3c0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f4100000c00 tx=0x7f4100008000 comp rx=0 tx=0).stop 2023-10-16T19:57:12.668 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:12.663+0000 7f4111889700 1 -- 172.21.15.157:0/3050125130 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f410c15de00 msgr2=0x7f410c0c78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:12.668 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:12.663+0000 7f4111889700 1 --2- 172.21.15.157:0/3050125130 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f410c15de00 0x7f410c0c78b0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f40fc00c770 tx=0x7f40fc00ca80 comp rx=0 tx=0).stop 2023-10-16T19:57:12.668 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:12.663+0000 7f4111889700 1 -- 172.21.15.157:0/3050125130 shutdown_connections 2023-10-16T19:57:12.669 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:12.663+0000 7f4111889700 1 --2- 172.21.15.157:0/3050125130 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f40f806af00 0x7f40f806d3c0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:12.669 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:12.663+0000 7f4111889700 1 --2- 172.21.15.157:0/3050125130 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f410c161f50 0x7f410c1f0d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:12.669 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:12.663+0000 7f4111889700 1 --2- 172.21.15.157:0/3050125130 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f410c0ced00 0x7f410c1f3980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:12.669 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:12.663+0000 7f4111889700 1 --2- 172.21.15.157:0/3050125130 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f410c15de00 0x7f410c0c78b0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:12.670 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:12.663+0000 7f4111889700 1 -- 172.21.15.157:0/3050125130 >> 172.21.15.157:0/3050125130 conn(0x7f410c0665a0 msgr2=0x7f410c15d4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:12.670 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:12.663+0000 7f4111889700 1 -- 172.21.15.157:0/3050125130 shutdown_connections 2023-10-16T19:57:12.670 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:12.663+0000 7f4111889700 1 -- 172.21.15.157:0/3050125130 wait complete. 2023-10-16T19:57:12.670 INFO:teuthology.orchestra.run.smithi157.stderr:dumped all 2023-10-16T19:57:12.678 INFO:teuthology.orchestra.run.smithi157.stdout:{"pg_ready":true,"pg_map":{"version":19,"stamp":"2023-10-16T19:57:10.891317+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":8,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":1585,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560914,"statfs":{"total":1600000000,"available":1598376609,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.919151"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-16T19:57:04.973649+0000","last_change":"2023-10-16T19:57:04.973649+0000","last_active":"2023-10-16T19:57:04.967702+0000","last_peered":"2023-10-16T19:57:04.967702+0000","last_clean":"2023-10-16T19:57:04.967702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:04.973649+0000","last_undegraded":"2023-10-16T19:57:04.973649+0000","last_fullsized":"2023-10-16T19:57:04.973649+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-16T19:57:04.974840+0000","last_change":"2023-10-16T19:57:04.974840+0000","last_active":"2023-10-16T19:57:04.967702+0000","last_peered":"2023-10-16T19:57:04.967702+0000","last_clean":"2023-10-16T19:57:04.967702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:04.974840+0000","last_undegraded":"2023-10-16T19:57:04.974840+0000","last_fullsized":"2023-10-16T19:57:04.974840+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-16T19:57:04.974328+0000","last_change":"2023-10-16T19:57:04.974328+0000","last_active":"2023-10-16T19:57:04.967702+0000","last_peered":"2023-10-16T19:57:04.967702+0000","last_clean":"2023-10-16T19:57:04.967702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:04.974328+0000","last_undegraded":"2023-10-16T19:57:04.974328+0000","last_fullsized":"2023-10-16T19:57:04.974328+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-16T19:57:04.975403+0000","last_change":"2023-10-16T19:57:04.975403+0000","last_active":"2023-10-16T19:57:04.967702+0000","last_peered":"2023-10-16T19:57:04.967702+0000","last_clean":"2023-10-16T19:57:04.967702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:04.975403+0000","last_undegraded":"2023-10-16T19:57:04.975403+0000","last_fullsized":"2023-10-16T19:57:04.975403+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-16T19:57:04.974498+0000","last_change":"2023-10-16T19:57:04.974498+0000","last_active":"2023-10-16T19:57:04.967702+0000","last_peered":"2023-10-16T19:57:04.967702+0000","last_clean":"2023-10-16T19:57:04.967702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:04.974498+0000","last_undegraded":"2023-10-16T19:57:04.974498+0000","last_fullsized":"2023-10-16T19:57:04.974498+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-16T19:57:04.974477+0000","last_change":"2023-10-16T19:57:04.974477+0000","last_active":"2023-10-16T19:57:04.967702+0000","last_peered":"2023-10-16T19:57:04.967702+0000","last_clean":"2023-10-16T19:57:04.967702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:04.974477+0000","last_undegraded":"2023-10-16T19:57:04.974477+0000","last_fullsized":"2023-10-16T19:57:04.974477+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-16T19:57:04.974484+0000","last_change":"2023-10-16T19:57:04.974484+0000","last_active":"2023-10-16T19:57:04.967702+0000","last_peered":"2023-10-16T19:57:04.967702+0000","last_clean":"2023-10-16T19:57:04.967702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:04.974484+0000","last_undegraded":"2023-10-16T19:57:04.974484+0000","last_fullsized":"2023-10-16T19:57:04.974484+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-16T19:57:04.977118+0000","last_change":"2023-10-16T19:57:04.977118+0000","last_active":"2023-10-16T19:57:04.967702+0000","last_peered":"2023-10-16T19:57:04.967702+0000","last_clean":"2023-10-16T19:57:04.967702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:04.977118+0000","last_undegraded":"2023-10-16T19:57:04.977118+0000","last_fullsized":"2023-10-16T19:57:04.977118+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-16T19:57:04.974103+0000","last_change":"2023-10-16T19:57:04.974103+0000","last_active":"2023-10-16T19:57:04.967702+0000","last_peered":"2023-10-16T19:57:04.967702+0000","last_clean":"2023-10-16T19:57:04.967702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:04.974103+0000","last_undegraded":"2023-10-16T19:57:04.974103+0000","last_fullsized":"2023-10-16T19:57:04.974103+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-16T19:57:04.976978+0000","last_change":"2023-10-16T19:57:04.976978+0000","last_active":"2023-10-16T19:57:04.967702+0000","last_peered":"2023-10-16T19:57:04.967702+0000","last_clean":"2023-10-16T19:57:04.967702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:04.976978+0000","last_undegraded":"2023-10-16T19:57:04.976978+0000","last_fullsized":"2023-10-16T19:57:04.976978+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-16T19:57:04.975501+0000","last_change":"2023-10-16T19:57:04.975501+0000","last_active":"2023-10-16T19:57:04.967702+0000","last_peered":"2023-10-16T19:57:04.967702+0000","last_clean":"2023-10-16T19:57:04.967702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:04.975501+0000","last_undegraded":"2023-10-16T19:57:04.975501+0000","last_fullsized":"2023-10-16T19:57:04.975501+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-16T19:57:04.973701+0000","last_change":"2023-10-16T19:57:04.973701+0000","last_active":"2023-10-16T19:57:04.967702+0000","last_peered":"2023-10-16T19:57:04.967702+0000","last_clean":"2023-10-16T19:57:04.967702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:04.973701+0000","last_undegraded":"2023-10-16T19:57:04.973701+0000","last_fullsized":"2023-10-16T19:57:04.973701+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-16T19:57:04.973640+0000","last_change":"2023-10-16T19:57:04.973640+0000","last_active":"2023-10-16T19:57:04.967702+0000","last_peered":"2023-10-16T19:57:04.967702+0000","last_clean":"2023-10-16T19:57:04.967702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:04.973640+0000","last_undegraded":"2023-10-16T19:57:04.973640+0000","last_fullsized":"2023-10-16T19:57:04.973640+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-16T19:57:04.976037+0000","last_change":"2023-10-16T19:57:04.976037+0000","last_active":"2023-10-16T19:57:04.967702+0000","last_peered":"2023-10-16T19:57:04.967702+0000","last_clean":"2023-10-16T19:57:04.967702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:04.976037+0000","last_undegraded":"2023-10-16T19:57:04.976037+0000","last_fullsized":"2023-10-16T19:57:04.976037+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-16T19:57:04.973680+0000","last_change":"2023-10-16T19:57:04.973680+0000","last_active":"2023-10-16T19:57:04.967702+0000","last_peered":"2023-10-16T19:57:04.967702+0000","last_clean":"2023-10-16T19:57:04.967702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:04.973680+0000","last_undegraded":"2023-10-16T19:57:04.973680+0000","last_fullsized":"2023-10-16T19:57:04.973680+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-16T19:57:04.977796+0000","last_change":"2023-10-16T19:57:04.977796+0000","last_active":"2023-10-16T19:57:04.967702+0000","last_peered":"2023-10-16T19:57:04.967702+0000","last_clean":"2023-10-16T19:57:04.967702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:04.977796+0000","last_undegraded":"2023-10-16T19:57:04.977796+0000","last_fullsized":"2023-10-16T19:57:04.977796+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-16T19:57:04.972878+0000","last_change":"2023-10-16T19:57:04.972878+0000","last_active":"2023-10-16T19:57:04.967702+0000","last_peered":"2023-10-16T19:57:04.967702+0000","last_clean":"2023-10-16T19:57:04.967702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:04.972878+0000","last_undegraded":"2023-10-16T19:57:04.972878+0000","last_fullsized":"2023-10-16T19:57:04.972878+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-16T19:57:04.975078+0000","last_change":"2023-10-16T19:57:04.975078+0000","last_active":"2023-10-16T19:57:04.967702+0000","last_peered":"2023-10-16T19:57:04.967702+0000","last_clean":"2023-10-16T19:57:04.967702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:04.975078+0000","last_undegraded":"2023-10-16T19:57:04.975078+0000","last_fullsized":"2023-10-16T19:57:04.975078+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-16T19:57:04.975630+0000","last_change":"2023-10-16T19:57:04.975630+0000","last_active":"2023-10-16T19:57:04.967702+0000","last_peered":"2023-10-16T19:57:04.967702+0000","last_clean":"2023-10-16T19:57:04.967702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:04.975630+0000","last_undegraded":"2023-10-16T19:57:04.975630+0000","last_fullsized":"2023-10-16T19:57:04.975630+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-16T19:57:04.977484+0000","last_change":"2023-10-16T19:57:04.977484+0000","last_active":"2023-10-16T19:57:04.967702+0000","last_peered":"2023-10-16T19:57:04.967702+0000","last_clean":"2023-10-16T19:57:04.967702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:04.977484+0000","last_undegraded":"2023-10-16T19:57:04.977484+0000","last_fullsized":"2023-10-16T19:57:04.977484+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-16T19:57:04.975685+0000","last_change":"2023-10-16T19:57:04.975685+0000","last_active":"2023-10-16T19:57:04.967702+0000","last_peered":"2023-10-16T19:57:04.967702+0000","last_clean":"2023-10-16T19:57:04.967702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:04.975685+0000","last_undegraded":"2023-10-16T19:57:04.975685+0000","last_fullsized":"2023-10-16T19:57:04.975685+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":162,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-16T19:57:00.898304+0000","last_change":"2023-10-16T19:56:58.775782+0000","last_active":"2023-10-16T19:57:00.898304+0000","last_peered":"2023-10-16T19:57:00.898304+0000","last_clean":"2023-10-16T19:57:00.898304+0000","last_became_active":"2023-10-16T19:56:58.775567+0000","last_became_peered":"2023-10-16T19:56:58.775567+0000","last_unstale":"2023-10-16T19:57:00.898304+0000","last_undegraded":"2023-10-16T19:57:00.898304+0000","last_fullsized":"2023-10-16T19:57:00.898304+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:56:57.693332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:56:57.693332+0000","last_clean_scrub_stamp":"2023-10-16T19:56:57.693332+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:10:23.849736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-16T19:57:04.974266+0000","last_change":"2023-10-16T19:57:04.974266+0000","last_active":"2023-10-16T19:57:04.967702+0000","last_peered":"2023-10-16T19:57:04.967702+0000","last_clean":"2023-10-16T19:57:04.967702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:04.974266+0000","last_undegraded":"2023-10-16T19:57:04.974266+0000","last_fullsized":"2023-10-16T19:57:04.974266+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-16T19:57:04.974682+0000","last_change":"2023-10-16T19:57:04.974682+0000","last_active":"2023-10-16T19:57:04.967702+0000","last_peered":"2023-10-16T19:57:04.967702+0000","last_clean":"2023-10-16T19:57:04.967702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:04.974682+0000","last_undegraded":"2023-10-16T19:57:04.974682+0000","last_fullsized":"2023-10-16T19:57:04.974682+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-16T19:57:04.975232+0000","last_change":"2023-10-16T19:57:04.975232+0000","last_active":"2023-10-16T19:57:04.967702+0000","last_peered":"2023-10-16T19:57:04.967702+0000","last_clean":"2023-10-16T19:57:04.967702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:04.975232+0000","last_undegraded":"2023-10-16T19:57:04.975232+0000","last_fullsized":"2023-10-16T19:57:04.975232+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-16T19:57:04.973273+0000","last_change":"2023-10-16T19:57:04.973273+0000","last_active":"2023-10-16T19:57:04.967702+0000","last_peered":"2023-10-16T19:57:04.967702+0000","last_clean":"2023-10-16T19:57:04.967702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:04.973273+0000","last_undegraded":"2023-10-16T19:57:04.973273+0000","last_fullsized":"2023-10-16T19:57:04.973273+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-16T19:57:04.975030+0000","last_change":"2023-10-16T19:57:04.975030+0000","last_active":"2023-10-16T19:57:04.967702+0000","last_peered":"2023-10-16T19:57:04.967702+0000","last_clean":"2023-10-16T19:57:04.967702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:04.975030+0000","last_undegraded":"2023-10-16T19:57:04.975030+0000","last_fullsized":"2023-10-16T19:57:04.975030+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-16T19:57:04.975439+0000","last_change":"2023-10-16T19:57:04.975439+0000","last_active":"2023-10-16T19:57:04.967702+0000","last_peered":"2023-10-16T19:57:04.967702+0000","last_clean":"2023-10-16T19:57:04.967702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:04.975439+0000","last_undegraded":"2023-10-16T19:57:04.975439+0000","last_fullsized":"2023-10-16T19:57:04.975439+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-16T19:57:04.975072+0000","last_change":"2023-10-16T19:57:04.975072+0000","last_active":"2023-10-16T19:57:04.967702+0000","last_peered":"2023-10-16T19:57:04.967702+0000","last_clean":"2023-10-16T19:57:04.967702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:04.975072+0000","last_undegraded":"2023-10-16T19:57:04.975072+0000","last_fullsized":"2023-10-16T19:57:04.975072+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-16T19:57:04.974558+0000","last_change":"2023-10-16T19:57:04.974558+0000","last_active":"2023-10-16T19:57:04.967702+0000","last_peered":"2023-10-16T19:57:04.967702+0000","last_clean":"2023-10-16T19:57:04.967702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:04.974558+0000","last_undegraded":"2023-10-16T19:57:04.974558+0000","last_fullsized":"2023-10-16T19:57:04.974558+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-16T19:57:04.977460+0000","last_change":"2023-10-16T19:57:04.977460+0000","last_active":"2023-10-16T19:57:04.967702+0000","last_peered":"2023-10-16T19:57:04.967702+0000","last_clean":"2023-10-16T19:57:04.967702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:04.977460+0000","last_undegraded":"2023-10-16T19:57:04.977460+0000","last_fullsized":"2023-10-16T19:57:04.977460+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-16T19:57:04.975874+0000","last_change":"2023-10-16T19:57:04.975874+0000","last_active":"2023-10-16T19:57:04.967702+0000","last_peered":"2023-10-16T19:57:04.967702+0000","last_clean":"2023-10-16T19:57:04.967702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:04.975874+0000","last_undegraded":"2023-10-16T19:57:04.975874+0000","last_fullsized":"2023-10-16T19:57:04.975874+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-10-16T19:57:04.977430+0000","last_change":"2023-10-16T19:57:04.977430+0000","last_active":"2023-10-16T19:57:04.967702+0000","last_peered":"2023-10-16T19:57:04.967702+0000","last_clean":"2023-10-16T19:57:04.967702+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:04.977430+0000","last_undegraded":"2023-10-16T19:57:04.977430+0000","last_fullsized":"2023-10-16T19:57:04.977430+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T19:57:05.971386+0000","last_change":"2023-10-16T19:57:05.971386+0000","last_active":"2023-10-16T19:57:05.971386+0000","last_peered":"2023-10-16T19:57:05.971386+0000","last_clean":"2023-10-16T19:57:05.971386+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T19:57:05.971386+0000","last_undegraded":"2023-10-16T19:57:05.971386+0000","last_fullsized":"2023-10-16T19:57:05.971386+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574851,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":631,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194681,"statfs":{"total":200000000,"available":199353573,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46300000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41199999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60799999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70099999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":49,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195263,"statfs":{"total":200000000,"available":199949758,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58099999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35699999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48499999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574851,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":54,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195257,"statfs":{"total":200000000,"available":199943941,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38700000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34399999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40100000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48899999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]}]},{"osd":0,"up_from":13,"seq":55834574851,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":631,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194681,"statfs":{"total":200000000,"available":199353573,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.249}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34300000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32900000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52800000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42899999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45500000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":54,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195257,"statfs":{"total":200000000,"available":199943941,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45200000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33700000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52300000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65100000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.502}]}]},{"osd":3,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":54,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195257,"statfs":{"total":200000000,"available":199943941,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36699999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38300000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33400000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67400000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":54,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195257,"statfs":{"total":200000000,"available":199943941,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.622}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66000000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.371}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45200000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47899999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":54,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195257,"statfs":{"total":200000000,"available":199943941,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41399999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45800000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38700000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44400000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]}]}],"pool_statfs":[]}} 2023-10-16T19:57:15.684 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-16T19:57:15.818 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:15.816+0000 7f9f1ed4c700 1 Processor -- start 2023-10-16T19:57:15.819 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:15.816+0000 7f9f1ed4c700 1 -- start start 2023-10-16T19:57:15.821 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:15.817+0000 7f9f1ed4c700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f9f1815e2f0 0x7f9f1806d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:15.821 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:15.817+0000 7f9f1ed4c700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f9f1806de00 0x7f9f180ce910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:15.821 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:15.817+0000 7f9f1ed4c700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f180d08b0 con 0x7f9f1806a850 2023-10-16T19:57:15.822 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:15.817+0000 7f9f1ed4c700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f181628f0 con 0x7f9f1815e2f0 2023-10-16T19:57:15.822 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:15.817+0000 7f9f1ed4c700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f18162bd0 con 0x7f9f1806de00 2023-10-16T19:57:15.822 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:15.817+0000 7f9f1cae8700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f9f1815e2f0 0x7f9f1806d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:15.822 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:15.817+0000 7f9f1d2e9700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f9f1806a850 0x7f9f18070f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:55380/0 (socket says 172.21.15.157:55380) 2023-10-16T19:57:15.822 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:15.817+0000 7f9f1d2e9700 1 -- 172.21.15.157:0/933744035 learned_addr learned my addr 172.21.15.157:0/933744035 (peer_addr_for_me v1:172.21.15.157:0/0) 2023-10-16T19:57:15.823 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:15.817+0000 7f9f177fe700 1 -- 172.21.15.157:0/933744035 <== mon.0 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3087235800 0 0) 0x7f9f180d08b0 con 0x7f9f1806a850 2023-10-16T19:57:15.823 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:15.817+0000 7f9f177fe700 1 -- 172.21.15.157:0/933744035 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9f080035b0 con 0x7f9f1806a850 2023-10-16T19:57:15.823 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:15.817+0000 7f9f1cae8700 1 -- 172.21.15.157:0/933744035 >> v2:172.21.15.187:3300/0 conn(0x7f9f1806de00 msgr2=0x7f9f180ce910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:57:15.823 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:15.817+0000 7f9f1cae8700 1 --2- 172.21.15.157:0/933744035 >> v2:172.21.15.187:3300/0 conn(0x7f9f1806de00 0x7f9f180ce910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:15.823 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:15.817+0000 7f9f1cae8700 1 -- 172.21.15.157:0/933744035 >> v1:172.21.15.157:6789/0 conn(0x7f9f1806a850 legacy=0x7f9f18070f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:15.824 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:15.817+0000 7f9f1cae8700 1 -- 172.21.15.157:0/933744035 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f180d05d0 con 0x7f9f1815e2f0 2023-10-16T19:57:15.824 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:15.817+0000 7f9f1cae8700 1 --2- 172.21.15.157:0/933744035 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9f1815e2f0 0x7f9f1806d0f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f9f180678b0 tx=0x7f9f0c009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cf41681c61366ee server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:15.824 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:15.817+0000 7f9f177fe700 1 -- 172.21.15.157:0/933744035 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f0c011830 con 0x7f9f1815e2f0 2023-10-16T19:57:15.824 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:15.818+0000 7f9f177fe700 1 -- 172.21.15.157:0/933744035 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f0c011990 con 0x7f9f1815e2f0 2023-10-16T19:57:15.824 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:15.818+0000 7f9f177fe700 1 -- 172.21.15.157:0/933744035 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f0c011d20 con 0x7f9f1815e2f0 2023-10-16T19:57:15.825 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:15.818+0000 7f9f1ed4c700 1 -- 172.21.15.157:0/933744035 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9f1815e2f0 msgr2=0x7f9f1806d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:15.825 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:15.818+0000 7f9f1ed4c700 1 --2- 172.21.15.157:0/933744035 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9f1815e2f0 0x7f9f1806d0f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f9f180678b0 tx=0x7f9f0c009b20 comp rx=0 tx=0).stop 2023-10-16T19:57:15.825 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:15.818+0000 7f9f1ed4c700 1 -- 172.21.15.157:0/933744035 shutdown_connections 2023-10-16T19:57:15.825 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:15.818+0000 7f9f1ed4c700 1 --2- 172.21.15.157:0/933744035 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9f1815e2f0 0x7f9f1806d0f0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:15.825 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:15.818+0000 7f9f1ed4c700 1 --2- 172.21.15.157:0/933744035 >> v2:172.21.15.187:3300/0 conn(0x7f9f1806de00 0x7f9f180ce910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:15.825 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:15.818+0000 7f9f1ed4c700 1 -- 172.21.15.157:0/933744035 >> 172.21.15.157:0/933744035 conn(0x7f9f180cd4e0 msgr2=0x7f9f180cd8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:15.826 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:15.818+0000 7f9f1ed4c700 1 -- 172.21.15.157:0/933744035 shutdown_connections 2023-10-16T19:57:15.826 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:15.818+0000 7f9f1ed4c700 1 -- 172.21.15.157:0/933744035 wait complete. 2023-10-16T19:57:15.828 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:15.819+0000 7f9f1ed4c700 1 Processor -- start 2023-10-16T19:57:15.829 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:15.819+0000 7f9f1ed4c700 1 -- start start 2023-10-16T19:57:15.829 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:15.820+0000 7f9f1ed4c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9f1806a850 0x7f9f181f4700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:15.829 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:15.820+0000 7f9f1ed4c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9f1806de00 0x7f9f181f3400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:15.829 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:15.820+0000 7f9f1ed4c700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9f1815e2f0 0x7f9f180c6720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:15.829 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:15.820+0000 7f9f1ed4c700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f180b49c0 con 0x7f9f1806a850 2023-10-16T19:57:15.830 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:15.820+0000 7f9f1ed4c700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f180b4440 con 0x7f9f1806de00 2023-10-16T19:57:15.830 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:15.820+0000 7f9f1ed4c700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f180c4430 con 0x7f9f1815e2f0 2023-10-16T19:57:15.830 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:15.820+0000 7f9f1cae8700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9f1806a850 0x7f9f181f4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:15.830 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:15.820+0000 7f9f1cae8700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9f1806a850 0x7f9f181f4700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:45710/0 (socket says 172.21.15.157:45710) 2023-10-16T19:57:15.831 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:15.820+0000 7f9f1cae8700 1 -- 172.21.15.157:0/1938436291 learned_addr learned my addr 172.21.15.157:0/1938436291 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:57:15.831 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:15.821+0000 7f9f1d2e9700 1 --2- 172.21.15.157:0/1938436291 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9f1815e2f0 0x7f9f180c6720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:15.831 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:15.821+0000 7f9f17fff700 1 --2- 172.21.15.157:0/1938436291 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9f1806de00 0x7f9f181f3400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:15.831 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:15.821+0000 7f9f1cae8700 1 -- 172.21.15.157:0/1938436291 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9f1815e2f0 msgr2=0x7f9f180c6720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:15.831 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:15.821+0000 7f9f1cae8700 1 --2- 172.21.15.157:0/1938436291 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9f1815e2f0 0x7f9f180c6720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:15.832 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:15.821+0000 7f9f1cae8700 1 -- 172.21.15.157:0/1938436291 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9f1806de00 msgr2=0x7f9f181f3400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:15.832 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:15.821+0000 7f9f1cae8700 1 --2- 172.21.15.157:0/1938436291 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9f1806de00 0x7f9f181f3400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:15.832 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:15.821+0000 7f9f1cae8700 1 -- 172.21.15.157:0/1938436291 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f0c0094a0 con 0x7f9f1806a850 2023-10-16T19:57:15.832 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:15.821+0000 7f9f17fff700 1 --2- 172.21.15.157:0/1938436291 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9f1806de00 0x7f9f181f3400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T19:57:15.832 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:15.821+0000 7f9f1cae8700 1 --2- 172.21.15.157:0/1938436291 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9f1806a850 0x7f9f181f4700 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f9f0c000c00 tx=0x7f9f0c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:15.832 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:15.821+0000 7f9f157fa700 1 -- 172.21.15.157:0/1938436291 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f0c0038a0 con 0x7f9f1806a850 2023-10-16T19:57:15.833 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:15.821+0000 7f9f157fa700 1 -- 172.21.15.157:0/1938436291 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f0c01f070 con 0x7f9f1806a850 2023-10-16T19:57:15.833 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:15.821+0000 7f9f1ed4c700 1 -- 172.21.15.157:0/1938436291 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f181f4c40 con 0x7f9f1806a850 2023-10-16T19:57:15.833 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:15.821+0000 7f9f157fa700 1 -- 172.21.15.157:0/1938436291 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f0c003c60 con 0x7f9f1806a850 2023-10-16T19:57:15.833 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:15.821+0000 7f9f1ed4c700 1 -- 172.21.15.157:0/1938436291 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f180c46d0 con 0x7f9f1806a850 2023-10-16T19:57:15.833 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:15.822+0000 7f9f1ed4c700 1 -- 172.21.15.157:0/1938436291 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f1804f400 con 0x7f9f1806a850 2023-10-16T19:57:15.834 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:15.822+0000 7f9f157fa700 1 -- 172.21.15.157:0/1938436291 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f9f0c01a430 con 0x7f9f1806a850 2023-10-16T19:57:15.834 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:15.823+0000 7f9f157fa700 1 --2- 172.21.15.157:0/1938436291 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f9efc06af00 0x7f9efc06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:15.834 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:15.823+0000 7f9f157fa700 1 -- 172.21.15.157:0/1938436291 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9f0c021070 con 0x7f9f1806a850 2023-10-16T19:57:15.834 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:15.823+0000 7f9f17fff700 1 --2- 172.21.15.157:0/1938436291 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f9efc06af00 0x7f9efc06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:15.834 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:15.823+0000 7f9f17fff700 1 --2- 172.21.15.157:0/1938436291 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f9efc06af00 0x7f9efc06d3c0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f9f0400a8f0 tx=0x7f9f04008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:15.835 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:15.827+0000 7f9f157fa700 1 -- 172.21.15.157:0/1938436291 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9f0c055fe0 con 0x7f9f1806a850 2023-10-16T19:57:16.016 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.014+0000 7f9f1ed4c700 1 -- 172.21.15.157:0/1938436291 --> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9f180b02a0 con 0x7f9efc06af00 2023-10-16T19:57:16.024 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.022+0000 7f9f157fa700 1 -- 172.21.15.157:0/1938436291 <== mgr.4100 v2:172.21.15.187:6832/2426285296 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+260225 (secure 0 0 0) 0x7f9f0400ad60 con 0x7f9efc06af00 2023-10-16T19:57:16.027 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-10-16T19:57:16.029 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.025+0000 7f9f1ed4c700 1 -- 172.21.15.157:0/1938436291 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f9efc06af00 msgr2=0x7f9efc06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:16.029 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.025+0000 7f9f1ed4c700 1 --2- 172.21.15.157:0/1938436291 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f9efc06af00 0x7f9efc06d3c0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f9f0400a8f0 tx=0x7f9f04008040 comp rx=0 tx=0).stop 2023-10-16T19:57:16.030 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.025+0000 7f9f1ed4c700 1 -- 172.21.15.157:0/1938436291 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9f1806a850 msgr2=0x7f9f181f4700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:16.030 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.025+0000 7f9f1ed4c700 1 --2- 172.21.15.157:0/1938436291 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9f1806a850 0x7f9f181f4700 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f9f0c000c00 tx=0x7f9f0c004750 comp rx=0 tx=0).stop 2023-10-16T19:57:16.030 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.025+0000 7f9f1ed4c700 1 -- 172.21.15.157:0/1938436291 shutdown_connections 2023-10-16T19:57:16.030 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.025+0000 7f9f1ed4c700 1 --2- 172.21.15.157:0/1938436291 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9f1815e2f0 0x7f9f180c6720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:16.031 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.025+0000 7f9f1ed4c700 1 --2- 172.21.15.157:0/1938436291 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9f1806a850 0x7f9f181f4700 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:16.031 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.025+0000 7f9f1ed4c700 1 --2- 172.21.15.157:0/1938436291 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f9efc06af00 0x7f9efc06d3c0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:16.031 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.025+0000 7f9f1ed4c700 1 --2- 172.21.15.157:0/1938436291 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9f1806de00 0x7f9f181f3400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:16.031 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.025+0000 7f9f1ed4c700 1 -- 172.21.15.157:0/1938436291 >> 172.21.15.157:0/1938436291 conn(0x7f9f180cd4e0 msgr2=0x7f9f1806f320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:16.031 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.025+0000 7f9f1ed4c700 1 -- 172.21.15.157:0/1938436291 shutdown_connections 2023-10-16T19:57:16.032 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.025+0000 7f9f1ed4c700 1 -- 172.21.15.157:0/1938436291 wait complete. 2023-10-16T19:57:16.032 INFO:teuthology.orchestra.run.smithi157.stderr:dumped all 2023-10-16T19:57:16.039 INFO:teuthology.orchestra.run.smithi157.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2023-10-16T19:57:14.892434+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":181,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":1746,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560753,"statfs":{"total":1600000000,"available":1598211172,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002049"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-16T19:57:07.995517+0000","last_change":"2023-10-16T19:57:07.006384+0000","last_active":"2023-10-16T19:57:07.995517+0000","last_peered":"2023-10-16T19:57:07.995517+0000","last_clean":"2023-10-16T19:57:07.995517+0000","last_became_active":"2023-10-16T19:57:07.005790+0000","last_became_peered":"2023-10-16T19:57:07.005790+0000","last_unstale":"2023-10-16T19:57:07.995517+0000","last_undegraded":"2023-10-16T19:57:07.995517+0000","last_fullsized":"2023-10-16T19:57:07.995517+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:09:12.928664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-16T19:57:07.991019+0000","last_change":"2023-10-16T19:57:06.999389+0000","last_active":"2023-10-16T19:57:07.991019+0000","last_peered":"2023-10-16T19:57:07.991019+0000","last_clean":"2023-10-16T19:57:07.991019+0000","last_became_active":"2023-10-16T19:57:06.999162+0000","last_became_peered":"2023-10-16T19:57:06.999162+0000","last_unstale":"2023-10-16T19:57:07.991019+0000","last_undegraded":"2023-10-16T19:57:07.991019+0000","last_fullsized":"2023-10-16T19:57:07.991019+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:45:06.036665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-16T19:57:08.122675+0000","last_change":"2023-10-16T19:57:06.998825+0000","last_active":"2023-10-16T19:57:08.122675+0000","last_peered":"2023-10-16T19:57:08.122675+0000","last_clean":"2023-10-16T19:57:08.122675+0000","last_became_active":"2023-10-16T19:57:06.998479+0000","last_became_peered":"2023-10-16T19:57:06.998479+0000","last_unstale":"2023-10-16T19:57:08.122675+0000","last_undegraded":"2023-10-16T19:57:08.122675+0000","last_fullsized":"2023-10-16T19:57:08.122675+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:03:58.859315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-16T19:57:08.122859+0000","last_change":"2023-10-16T19:57:06.999838+0000","last_active":"2023-10-16T19:57:08.122859+0000","last_peered":"2023-10-16T19:57:08.122859+0000","last_clean":"2023-10-16T19:57:08.122859+0000","last_became_active":"2023-10-16T19:57:06.999305+0000","last_became_peered":"2023-10-16T19:57:06.999305+0000","last_unstale":"2023-10-16T19:57:08.122859+0000","last_undegraded":"2023-10-16T19:57:08.122859+0000","last_fullsized":"2023-10-16T19:57:08.122859+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:45:06.036665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-16T19:57:07.995504+0000","last_change":"2023-10-16T19:57:07.000324+0000","last_active":"2023-10-16T19:57:07.995504+0000","last_peered":"2023-10-16T19:57:07.995504+0000","last_clean":"2023-10-16T19:57:07.995504+0000","last_became_active":"2023-10-16T19:57:07.000057+0000","last_became_peered":"2023-10-16T19:57:07.000057+0000","last_unstale":"2023-10-16T19:57:07.995504+0000","last_undegraded":"2023-10-16T19:57:07.995504+0000","last_fullsized":"2023-10-16T19:57:07.995504+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:56:13.067804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-16T19:57:08.123449+0000","last_change":"2023-10-16T19:57:07.004149+0000","last_active":"2023-10-16T19:57:08.123449+0000","last_peered":"2023-10-16T19:57:08.123449+0000","last_clean":"2023-10-16T19:57:08.123449+0000","last_became_active":"2023-10-16T19:57:07.003618+0000","last_became_peered":"2023-10-16T19:57:07.003618+0000","last_unstale":"2023-10-16T19:57:08.123449+0000","last_undegraded":"2023-10-16T19:57:08.123449+0000","last_fullsized":"2023-10-16T19:57:08.123449+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:25:58.328485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-16T19:57:07.995466+0000","last_change":"2023-10-16T19:57:07.005978+0000","last_active":"2023-10-16T19:57:07.995466+0000","last_peered":"2023-10-16T19:57:07.995466+0000","last_clean":"2023-10-16T19:57:07.995466+0000","last_became_active":"2023-10-16T19:57:07.005529+0000","last_became_peered":"2023-10-16T19:57:07.005529+0000","last_unstale":"2023-10-16T19:57:07.995466+0000","last_undegraded":"2023-10-16T19:57:07.995466+0000","last_fullsized":"2023-10-16T19:57:07.995466+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:55:10.600360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-16T19:57:08.219621+0000","last_change":"2023-10-16T19:57:06.998520+0000","last_active":"2023-10-16T19:57:08.219621+0000","last_peered":"2023-10-16T19:57:08.219621+0000","last_clean":"2023-10-16T19:57:08.219621+0000","last_became_active":"2023-10-16T19:57:06.998293+0000","last_became_peered":"2023-10-16T19:57:06.998293+0000","last_unstale":"2023-10-16T19:57:08.219621+0000","last_undegraded":"2023-10-16T19:57:08.219621+0000","last_fullsized":"2023-10-16T19:57:08.219621+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:25:48.980225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-16T19:57:07.994923+0000","last_change":"2023-10-16T19:57:07.008535+0000","last_active":"2023-10-16T19:57:07.994923+0000","last_peered":"2023-10-16T19:57:07.994923+0000","last_clean":"2023-10-16T19:57:07.994923+0000","last_became_active":"2023-10-16T19:57:07.008297+0000","last_became_peered":"2023-10-16T19:57:07.008297+0000","last_unstale":"2023-10-16T19:57:07.994923+0000","last_undegraded":"2023-10-16T19:57:07.994923+0000","last_fullsized":"2023-10-16T19:57:07.994923+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:53:43.704346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-16T19:57:07.995044+0000","last_change":"2023-10-16T19:57:06.998253+0000","last_active":"2023-10-16T19:57:07.995044+0000","last_peered":"2023-10-16T19:57:07.995044+0000","last_clean":"2023-10-16T19:57:07.995044+0000","last_became_active":"2023-10-16T19:57:06.998051+0000","last_became_peered":"2023-10-16T19:57:06.998051+0000","last_unstale":"2023-10-16T19:57:07.995044+0000","last_undegraded":"2023-10-16T19:57:07.995044+0000","last_fullsized":"2023-10-16T19:57:07.995044+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:45:06.036665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-16T19:57:07.994446+0000","last_change":"2023-10-16T19:57:06.999597+0000","last_active":"2023-10-16T19:57:07.994446+0000","last_peered":"2023-10-16T19:57:07.994446+0000","last_clean":"2023-10-16T19:57:07.994446+0000","last_became_active":"2023-10-16T19:57:06.999312+0000","last_became_peered":"2023-10-16T19:57:06.999312+0000","last_unstale":"2023-10-16T19:57:07.994446+0000","last_undegraded":"2023-10-16T19:57:07.994446+0000","last_fullsized":"2023-10-16T19:57:07.994446+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:41:51.205240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-16T19:57:08.123128+0000","last_change":"2023-10-16T19:57:07.002089+0000","last_active":"2023-10-16T19:57:08.123128+0000","last_peered":"2023-10-16T19:57:08.123128+0000","last_clean":"2023-10-16T19:57:08.123128+0000","last_became_active":"2023-10-16T19:57:07.001847+0000","last_became_peered":"2023-10-16T19:57:07.001847+0000","last_unstale":"2023-10-16T19:57:08.123128+0000","last_undegraded":"2023-10-16T19:57:08.123128+0000","last_fullsized":"2023-10-16T19:57:08.123128+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:19:58.543996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-16T19:57:08.219751+0000","last_change":"2023-10-16T19:57:06.993639+0000","last_active":"2023-10-16T19:57:08.219751+0000","last_peered":"2023-10-16T19:57:08.219751+0000","last_clean":"2023-10-16T19:57:08.219751+0000","last_became_active":"2023-10-16T19:57:06.993396+0000","last_became_peered":"2023-10-16T19:57:06.993396+0000","last_unstale":"2023-10-16T19:57:08.219751+0000","last_undegraded":"2023-10-16T19:57:08.219751+0000","last_fullsized":"2023-10-16T19:57:08.219751+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:31:11.770822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-16T19:57:08.122373+0000","last_change":"2023-10-16T19:57:07.001284+0000","last_active":"2023-10-16T19:57:08.122373+0000","last_peered":"2023-10-16T19:57:08.122373+0000","last_clean":"2023-10-16T19:57:08.122373+0000","last_became_active":"2023-10-16T19:57:07.001063+0000","last_became_peered":"2023-10-16T19:57:07.001063+0000","last_unstale":"2023-10-16T19:57:08.122373+0000","last_undegraded":"2023-10-16T19:57:08.122373+0000","last_fullsized":"2023-10-16T19:57:08.122373+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:41:51.205240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-16T19:57:07.990740+0000","last_change":"2023-10-16T19:57:06.997709+0000","last_active":"2023-10-16T19:57:07.990740+0000","last_peered":"2023-10-16T19:57:07.990740+0000","last_clean":"2023-10-16T19:57:07.990740+0000","last_became_active":"2023-10-16T19:57:06.997354+0000","last_became_peered":"2023-10-16T19:57:06.997354+0000","last_unstale":"2023-10-16T19:57:07.990740+0000","last_undegraded":"2023-10-16T19:57:07.990740+0000","last_fullsized":"2023-10-16T19:57:07.990740+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:41:51.205240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-16T19:57:08.123798+0000","last_change":"2023-10-16T19:57:07.003971+0000","last_active":"2023-10-16T19:57:08.123798+0000","last_peered":"2023-10-16T19:57:08.123798+0000","last_clean":"2023-10-16T19:57:08.123798+0000","last_became_active":"2023-10-16T19:57:07.003330+0000","last_became_peered":"2023-10-16T19:57:07.003330+0000","last_unstale":"2023-10-16T19:57:08.123798+0000","last_undegraded":"2023-10-16T19:57:08.123798+0000","last_fullsized":"2023-10-16T19:57:08.123798+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:31:11.770822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-16T19:57:08.124416+0000","last_change":"2023-10-16T19:57:07.006715+0000","last_active":"2023-10-16T19:57:08.124416+0000","last_peered":"2023-10-16T19:57:08.124416+0000","last_clean":"2023-10-16T19:57:08.124416+0000","last_became_active":"2023-10-16T19:57:07.006217+0000","last_became_peered":"2023-10-16T19:57:07.006217+0000","last_unstale":"2023-10-16T19:57:08.124416+0000","last_undegraded":"2023-10-16T19:57:08.124416+0000","last_fullsized":"2023-10-16T19:57:08.124416+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:46:01.293187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-16T19:57:08.219133+0000","last_change":"2023-10-16T19:57:06.993961+0000","last_active":"2023-10-16T19:57:08.219133+0000","last_peered":"2023-10-16T19:57:08.219133+0000","last_clean":"2023-10-16T19:57:08.219133+0000","last_became_active":"2023-10-16T19:57:06.993724+0000","last_became_peered":"2023-10-16T19:57:06.993724+0000","last_unstale":"2023-10-16T19:57:08.219133+0000","last_undegraded":"2023-10-16T19:57:08.219133+0000","last_fullsized":"2023-10-16T19:57:08.219133+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:19:58.543996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-16T19:57:07.994655+0000","last_change":"2023-10-16T19:57:07.005634+0000","last_active":"2023-10-16T19:57:07.994655+0000","last_peered":"2023-10-16T19:57:07.994655+0000","last_clean":"2023-10-16T19:57:07.994655+0000","last_became_active":"2023-10-16T19:57:07.005057+0000","last_became_peered":"2023-10-16T19:57:07.005057+0000","last_unstale":"2023-10-16T19:57:07.994655+0000","last_undegraded":"2023-10-16T19:57:07.994655+0000","last_fullsized":"2023-10-16T19:57:07.994655+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:58:54.518707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T19:57:07.018064+0000","last_change":"2023-10-16T19:57:05.987741+0000","last_active":"2023-10-16T19:57:07.018064+0000","last_peered":"2023-10-16T19:57:07.018064+0000","last_clean":"2023-10-16T19:57:07.018064+0000","last_became_active":"2023-10-16T19:57:05.987520+0000","last_became_peered":"2023-10-16T19:57:05.987520+0000","last_unstale":"2023-10-16T19:57:07.018064+0000","last_undegraded":"2023-10-16T19:57:07.018064+0000","last_fullsized":"2023-10-16T19:57:07.018064+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:15:56.693134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-16T19:57:08.219412+0000","last_change":"2023-10-16T19:57:06.993252+0000","last_active":"2023-10-16T19:57:08.219412+0000","last_peered":"2023-10-16T19:57:08.219412+0000","last_clean":"2023-10-16T19:57:08.219412+0000","last_became_active":"2023-10-16T19:57:06.993020+0000","last_became_peered":"2023-10-16T19:57:06.993020+0000","last_unstale":"2023-10-16T19:57:08.219412+0000","last_undegraded":"2023-10-16T19:57:08.219412+0000","last_fullsized":"2023-10-16T19:57:08.219412+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:45:06.036665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T19:57:07.017741+0000","last_change":"2023-10-16T19:57:05.983983+0000","last_active":"2023-10-16T19:57:07.017741+0000","last_peered":"2023-10-16T19:57:07.017741+0000","last_clean":"2023-10-16T19:57:07.017741+0000","last_became_active":"2023-10-16T19:57:05.983622+0000","last_became_peered":"2023-10-16T19:57:05.983622+0000","last_unstale":"2023-10-16T19:57:07.017741+0000","last_undegraded":"2023-10-16T19:57:07.017741+0000","last_fullsized":"2023-10-16T19:57:07.017741+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:06:23.036752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-16T19:57:08.122603+0000","last_change":"2023-10-16T19:57:06.997914+0000","last_active":"2023-10-16T19:57:08.122603+0000","last_peered":"2023-10-16T19:57:08.122603+0000","last_clean":"2023-10-16T19:57:08.122603+0000","last_became_active":"2023-10-16T19:57:06.997690+0000","last_became_peered":"2023-10-16T19:57:06.997690+0000","last_unstale":"2023-10-16T19:57:08.122603+0000","last_undegraded":"2023-10-16T19:57:08.122603+0000","last_fullsized":"2023-10-16T19:57:08.122603+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:24:55.061118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T19:57:07.015417+0000","last_change":"2023-10-16T19:57:05.987000+0000","last_active":"2023-10-16T19:57:07.015417+0000","last_peered":"2023-10-16T19:57:07.015417+0000","last_clean":"2023-10-16T19:57:07.015417+0000","last_became_active":"2023-10-16T19:57:05.986803+0000","last_became_peered":"2023-10-16T19:57:05.986803+0000","last_unstale":"2023-10-16T19:57:07.015417+0000","last_undegraded":"2023-10-16T19:57:07.015417+0000","last_fullsized":"2023-10-16T19:57:07.015417+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:20:23.642933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-16T19:57:08.123957+0000","last_change":"2023-10-16T19:57:06.997052+0000","last_active":"2023-10-16T19:57:08.123957+0000","last_peered":"2023-10-16T19:57:08.123957+0000","last_clean":"2023-10-16T19:57:08.123957+0000","last_became_active":"2023-10-16T19:57:06.996662+0000","last_became_peered":"2023-10-16T19:57:06.996662+0000","last_unstale":"2023-10-16T19:57:08.123957+0000","last_undegraded":"2023-10-16T19:57:08.123957+0000","last_fullsized":"2023-10-16T19:57:08.123957+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:58:54.518707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T19:57:07.015115+0000","last_change":"2023-10-16T19:57:05.989284+0000","last_active":"2023-10-16T19:57:07.015115+0000","last_peered":"2023-10-16T19:57:07.015115+0000","last_clean":"2023-10-16T19:57:07.015115+0000","last_became_active":"2023-10-16T19:57:05.989033+0000","last_became_peered":"2023-10-16T19:57:05.989033+0000","last_unstale":"2023-10-16T19:57:07.015115+0000","last_undegraded":"2023-10-16T19:57:07.015115+0000","last_fullsized":"2023-10-16T19:57:07.015115+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:15:01.090446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-16T19:57:08.123335+0000","last_change":"2023-10-16T19:57:06.997386+0000","last_active":"2023-10-16T19:57:08.123335+0000","last_peered":"2023-10-16T19:57:08.123335+0000","last_clean":"2023-10-16T19:57:08.123335+0000","last_became_active":"2023-10-16T19:57:06.997156+0000","last_became_peered":"2023-10-16T19:57:06.997156+0000","last_unstale":"2023-10-16T19:57:08.123335+0000","last_undegraded":"2023-10-16T19:57:08.123335+0000","last_fullsized":"2023-10-16T19:57:08.123335+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:25:48.980225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T19:57:07.016041+0000","last_change":"2023-10-16T19:57:05.985822+0000","last_active":"2023-10-16T19:57:07.016041+0000","last_peered":"2023-10-16T19:57:07.016041+0000","last_clean":"2023-10-16T19:57:07.016041+0000","last_became_active":"2023-10-16T19:57:05.985592+0000","last_became_peered":"2023-10-16T19:57:05.985592+0000","last_unstale":"2023-10-16T19:57:07.016041+0000","last_undegraded":"2023-10-16T19:57:07.016041+0000","last_fullsized":"2023-10-16T19:57:07.016041+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:57:35.959611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-16T19:57:08.123129+0000","last_change":"2023-10-16T19:57:06.993561+0000","last_active":"2023-10-16T19:57:08.123129+0000","last_peered":"2023-10-16T19:57:08.123129+0000","last_clean":"2023-10-16T19:57:08.123129+0000","last_became_active":"2023-10-16T19:57:06.993306+0000","last_became_peered":"2023-10-16T19:57:06.993306+0000","last_unstale":"2023-10-16T19:57:08.123129+0000","last_undegraded":"2023-10-16T19:57:08.123129+0000","last_fullsized":"2023-10-16T19:57:08.123129+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:06:24.040436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T19:57:07.014669+0000","last_change":"2023-10-16T19:57:05.979963+0000","last_active":"2023-10-16T19:57:07.014669+0000","last_peered":"2023-10-16T19:57:07.014669+0000","last_clean":"2023-10-16T19:57:07.014669+0000","last_became_active":"2023-10-16T19:57:05.979710+0000","last_became_peered":"2023-10-16T19:57:05.979710+0000","last_unstale":"2023-10-16T19:57:07.014669+0000","last_undegraded":"2023-10-16T19:57:07.014669+0000","last_fullsized":"2023-10-16T19:57:07.014669+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:19:58.141677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-16T19:57:08.122506+0000","last_change":"2023-10-16T19:57:06.999329+0000","last_active":"2023-10-16T19:57:08.122506+0000","last_peered":"2023-10-16T19:57:08.122506+0000","last_clean":"2023-10-16T19:57:08.122506+0000","last_became_active":"2023-10-16T19:57:06.999101+0000","last_became_peered":"2023-10-16T19:57:06.999101+0000","last_unstale":"2023-10-16T19:57:08.122506+0000","last_undegraded":"2023-10-16T19:57:08.122506+0000","last_fullsized":"2023-10-16T19:57:08.122506+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:45:06.036665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T19:57:06.989953+0000","last_change":"2023-10-16T19:57:05.983843+0000","last_active":"2023-10-16T19:57:06.989953+0000","last_peered":"2023-10-16T19:57:06.989953+0000","last_clean":"2023-10-16T19:57:06.989953+0000","last_became_active":"2023-10-16T19:57:05.983163+0000","last_became_peered":"2023-10-16T19:57:05.983163+0000","last_unstale":"2023-10-16T19:57:06.989953+0000","last_undegraded":"2023-10-16T19:57:06.989953+0000","last_fullsized":"2023-10-16T19:57:06.989953+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:15:01.090446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-16T19:57:08.219610+0000","last_change":"2023-10-16T19:57:06.999441+0000","last_active":"2023-10-16T19:57:08.219610+0000","last_peered":"2023-10-16T19:57:08.219610+0000","last_clean":"2023-10-16T19:57:08.219610+0000","last_became_active":"2023-10-16T19:57:06.999162+0000","last_became_peered":"2023-10-16T19:57:06.999162+0000","last_unstale":"2023-10-16T19:57:08.219610+0000","last_undegraded":"2023-10-16T19:57:08.219610+0000","last_fullsized":"2023-10-16T19:57:08.219610+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:21:23.357923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T19:57:06.994513+0000","last_change":"2023-10-16T19:57:05.989194+0000","last_active":"2023-10-16T19:57:06.994513+0000","last_peered":"2023-10-16T19:57:06.994513+0000","last_clean":"2023-10-16T19:57:06.994513+0000","last_became_active":"2023-10-16T19:57:05.988926+0000","last_became_peered":"2023-10-16T19:57:05.988926+0000","last_unstale":"2023-10-16T19:57:06.994513+0000","last_undegraded":"2023-10-16T19:57:06.994513+0000","last_fullsized":"2023-10-16T19:57:06.994513+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:34:39.732847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-16T19:57:07.990808+0000","last_change":"2023-10-16T19:57:06.996063+0000","last_active":"2023-10-16T19:57:07.990808+0000","last_peered":"2023-10-16T19:57:07.990808+0000","last_clean":"2023-10-16T19:57:07.990808+0000","last_became_active":"2023-10-16T19:57:06.995511+0000","last_became_peered":"2023-10-16T19:57:06.995511+0000","last_unstale":"2023-10-16T19:57:07.990808+0000","last_undegraded":"2023-10-16T19:57:07.990808+0000","last_fullsized":"2023-10-16T19:57:07.990808+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:20:24.646617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T19:57:06.992213+0000","last_change":"2023-10-16T19:57:05.984937+0000","last_active":"2023-10-16T19:57:06.992213+0000","last_peered":"2023-10-16T19:57:06.992213+0000","last_clean":"2023-10-16T19:57:06.992213+0000","last_became_active":"2023-10-16T19:57:05.984623+0000","last_became_peered":"2023-10-16T19:57:05.984623+0000","last_unstale":"2023-10-16T19:57:06.992213+0000","last_undegraded":"2023-10-16T19:57:06.992213+0000","last_fullsized":"2023-10-16T19:57:06.992213+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:15:01.090446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-16T19:57:08.124150+0000","last_change":"2023-10-16T19:57:07.006439+0000","last_active":"2023-10-16T19:57:08.124150+0000","last_peered":"2023-10-16T19:57:08.124150+0000","last_clean":"2023-10-16T19:57:08.124150+0000","last_became_active":"2023-10-16T19:57:07.005621+0000","last_became_peered":"2023-10-16T19:57:07.005621+0000","last_unstale":"2023-10-16T19:57:08.124150+0000","last_undegraded":"2023-10-16T19:57:08.124150+0000","last_fullsized":"2023-10-16T19:57:08.124150+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:53:43.704346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T19:57:06.998505+0000","last_change":"2023-10-16T19:57:05.988154+0000","last_active":"2023-10-16T19:57:06.998505+0000","last_peered":"2023-10-16T19:57:06.998505+0000","last_clean":"2023-10-16T19:57:06.998505+0000","last_became_active":"2023-10-16T19:57:05.986384+0000","last_became_peered":"2023-10-16T19:57:05.986384+0000","last_unstale":"2023-10-16T19:57:06.998505+0000","last_undegraded":"2023-10-16T19:57:06.998505+0000","last_fullsized":"2023-10-16T19:57:06.998505+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:01:18.011775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-16T19:57:08.122337+0000","last_change":"2023-10-16T19:57:07.002146+0000","last_active":"2023-10-16T19:57:08.122337+0000","last_peered":"2023-10-16T19:57:08.122337+0000","last_clean":"2023-10-16T19:57:08.122337+0000","last_became_active":"2023-10-16T19:57:07.001914+0000","last_became_peered":"2023-10-16T19:57:07.001914+0000","last_unstale":"2023-10-16T19:57:08.122337+0000","last_undegraded":"2023-10-16T19:57:08.122337+0000","last_fullsized":"2023-10-16T19:57:08.122337+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:17:52.307869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T19:57:07.014816+0000","last_change":"2023-10-16T19:57:05.983913+0000","last_active":"2023-10-16T19:57:07.014816+0000","last_peered":"2023-10-16T19:57:07.014816+0000","last_clean":"2023-10-16T19:57:07.014816+0000","last_became_active":"2023-10-16T19:57:05.983697+0000","last_became_peered":"2023-10-16T19:57:05.983697+0000","last_unstale":"2023-10-16T19:57:07.014816+0000","last_undegraded":"2023-10-16T19:57:07.014816+0000","last_fullsized":"2023-10-16T19:57:07.014816+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:22:25.206288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-16T19:57:08.123063+0000","last_change":"2023-10-16T19:57:07.005291+0000","last_active":"2023-10-16T19:57:08.123063+0000","last_peered":"2023-10-16T19:57:08.123063+0000","last_clean":"2023-10-16T19:57:08.123063+0000","last_became_active":"2023-10-16T19:57:07.005076+0000","last_became_peered":"2023-10-16T19:57:07.005076+0000","last_unstale":"2023-10-16T19:57:08.123063+0000","last_undegraded":"2023-10-16T19:57:08.123063+0000","last_fullsized":"2023-10-16T19:57:08.123063+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:57:36.963296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T19:57:07.018757+0000","last_change":"2023-10-16T19:57:05.986612+0000","last_active":"2023-10-16T19:57:07.018757+0000","last_peered":"2023-10-16T19:57:07.018757+0000","last_clean":"2023-10-16T19:57:07.018757+0000","last_became_active":"2023-10-16T19:57:05.986376+0000","last_became_peered":"2023-10-16T19:57:05.986376+0000","last_unstale":"2023-10-16T19:57:07.018757+0000","last_undegraded":"2023-10-16T19:57:07.018757+0000","last_fullsized":"2023-10-16T19:57:07.018757+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:52:39.590803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-16T19:57:07.994878+0000","last_change":"2023-10-16T19:57:07.003484+0000","last_active":"2023-10-16T19:57:07.994878+0000","last_peered":"2023-10-16T19:57:07.994878+0000","last_clean":"2023-10-16T19:57:07.994878+0000","last_became_active":"2023-10-16T19:57:07.003250+0000","last_became_peered":"2023-10-16T19:57:07.003250+0000","last_unstale":"2023-10-16T19:57:07.994878+0000","last_undegraded":"2023-10-16T19:57:07.994878+0000","last_fullsized":"2023-10-16T19:57:07.994878+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:39:24.484888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T19:57:07.016866+0000","last_change":"2023-10-16T19:57:05.986994+0000","last_active":"2023-10-16T19:57:07.016866+0000","last_peered":"2023-10-16T19:57:07.016866+0000","last_clean":"2023-10-16T19:57:07.016866+0000","last_became_active":"2023-10-16T19:57:05.986599+0000","last_became_peered":"2023-10-16T19:57:05.986599+0000","last_unstale":"2023-10-16T19:57:07.016866+0000","last_undegraded":"2023-10-16T19:57:07.016866+0000","last_fullsized":"2023-10-16T19:57:07.016866+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:34:39.732847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-16T19:57:08.122472+0000","last_change":"2023-10-16T19:57:07.007947+0000","last_active":"2023-10-16T19:57:08.122472+0000","last_peered":"2023-10-16T19:57:08.122472+0000","last_clean":"2023-10-16T19:57:08.122472+0000","last_became_active":"2023-10-16T19:57:07.007510+0000","last_became_peered":"2023-10-16T19:57:07.007510+0000","last_unstale":"2023-10-16T19:57:08.122472+0000","last_undegraded":"2023-10-16T19:57:08.122472+0000","last_fullsized":"2023-10-16T19:57:08.122472+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:01:19.015459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T19:57:06.995603+0000","last_change":"2023-10-16T19:57:05.987167+0000","last_active":"2023-10-16T19:57:06.995603+0000","last_peered":"2023-10-16T19:57:06.995603+0000","last_clean":"2023-10-16T19:57:06.995603+0000","last_became_active":"2023-10-16T19:57:05.986764+0000","last_became_peered":"2023-10-16T19:57:05.986764+0000","last_unstale":"2023-10-16T19:57:06.995603+0000","last_undegraded":"2023-10-16T19:57:06.995603+0000","last_fullsized":"2023-10-16T19:57:06.995603+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:20:23.642933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-16T19:57:07.995599+0000","last_change":"2023-10-16T19:57:07.001344+0000","last_active":"2023-10-16T19:57:07.995599+0000","last_peered":"2023-10-16T19:57:07.995599+0000","last_clean":"2023-10-16T19:57:07.995599+0000","last_became_active":"2023-10-16T19:57:07.000758+0000","last_became_peered":"2023-10-16T19:57:07.000758+0000","last_unstale":"2023-10-16T19:57:07.995599+0000","last_undegraded":"2023-10-16T19:57:07.995599+0000","last_fullsized":"2023-10-16T19:57:07.995599+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:18:03.774335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T19:57:06.991741+0000","last_change":"2023-10-16T19:57:05.981794+0000","last_active":"2023-10-16T19:57:06.991741+0000","last_peered":"2023-10-16T19:57:06.991741+0000","last_clean":"2023-10-16T19:57:06.991741+0000","last_became_active":"2023-10-16T19:57:05.981583+0000","last_became_peered":"2023-10-16T19:57:05.981583+0000","last_unstale":"2023-10-16T19:57:06.991741+0000","last_undegraded":"2023-10-16T19:57:06.991741+0000","last_fullsized":"2023-10-16T19:57:06.991741+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:06:23.036752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-16T19:57:07.994645+0000","last_change":"2023-10-16T19:57:07.000451+0000","last_active":"2023-10-16T19:57:07.994645+0000","last_peered":"2023-10-16T19:57:07.994645+0000","last_clean":"2023-10-16T19:57:07.994645+0000","last_became_active":"2023-10-16T19:57:07.000132+0000","last_became_peered":"2023-10-16T19:57:07.000132+0000","last_unstale":"2023-10-16T19:57:07.994645+0000","last_undegraded":"2023-10-16T19:57:07.994645+0000","last_fullsized":"2023-10-16T19:57:07.994645+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:20:24.646617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T19:57:07.017505+0000","last_change":"2023-10-16T19:57:05.983364+0000","last_active":"2023-10-16T19:57:07.017505+0000","last_peered":"2023-10-16T19:57:07.017505+0000","last_clean":"2023-10-16T19:57:07.017505+0000","last_became_active":"2023-10-16T19:57:05.982833+0000","last_became_peered":"2023-10-16T19:57:05.982833+0000","last_unstale":"2023-10-16T19:57:07.017505+0000","last_undegraded":"2023-10-16T19:57:07.017505+0000","last_fullsized":"2023-10-16T19:57:07.017505+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:57:35.959611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-16T19:57:07.995235+0000","last_change":"2023-10-16T19:57:07.005825+0000","last_active":"2023-10-16T19:57:07.995235+0000","last_peered":"2023-10-16T19:57:07.995235+0000","last_clean":"2023-10-16T19:57:07.995235+0000","last_became_active":"2023-10-16T19:57:07.004948+0000","last_became_peered":"2023-10-16T19:57:07.004948+0000","last_unstale":"2023-10-16T19:57:07.995235+0000","last_undegraded":"2023-10-16T19:57:07.995235+0000","last_fullsized":"2023-10-16T19:57:07.995235+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:32:45.323575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T19:57:07.015859+0000","last_change":"2023-10-16T19:57:05.982827+0000","last_active":"2023-10-16T19:57:07.015859+0000","last_peered":"2023-10-16T19:57:07.015859+0000","last_clean":"2023-10-16T19:57:07.015859+0000","last_became_active":"2023-10-16T19:57:05.982621+0000","last_became_peered":"2023-10-16T19:57:05.982621+0000","last_unstale":"2023-10-16T19:57:07.015859+0000","last_undegraded":"2023-10-16T19:57:07.015859+0000","last_fullsized":"2023-10-16T19:57:07.015859+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:20:16.603179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-16T19:57:07.995680+0000","last_change":"2023-10-16T19:57:07.001478+0000","last_active":"2023-10-16T19:57:07.995680+0000","last_peered":"2023-10-16T19:57:07.995680+0000","last_clean":"2023-10-16T19:57:07.995680+0000","last_became_active":"2023-10-16T19:57:07.001102+0000","last_became_peered":"2023-10-16T19:57:07.001102+0000","last_unstale":"2023-10-16T19:57:07.995680+0000","last_undegraded":"2023-10-16T19:57:07.995680+0000","last_fullsized":"2023-10-16T19:57:07.995680+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:02:43.240567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T19:57:06.992538+0000","last_change":"2023-10-16T19:57:05.984208+0000","last_active":"2023-10-16T19:57:06.992538+0000","last_peered":"2023-10-16T19:57:06.992538+0000","last_clean":"2023-10-16T19:57:06.992538+0000","last_became_active":"2023-10-16T19:57:05.983817+0000","last_became_peered":"2023-10-16T19:57:05.983817+0000","last_unstale":"2023-10-16T19:57:06.992538+0000","last_undegraded":"2023-10-16T19:57:06.992538+0000","last_fullsized":"2023-10-16T19:57:06.992538+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:34:39.732847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-16T19:57:08.123002+0000","last_change":"2023-10-16T19:57:06.999700+0000","last_active":"2023-10-16T19:57:08.123002+0000","last_peered":"2023-10-16T19:57:08.123002+0000","last_clean":"2023-10-16T19:57:08.123002+0000","last_became_active":"2023-10-16T19:57:06.999001+0000","last_became_peered":"2023-10-16T19:57:06.999001+0000","last_unstale":"2023-10-16T19:57:08.123002+0000","last_undegraded":"2023-10-16T19:57:08.123002+0000","last_fullsized":"2023-10-16T19:57:08.123002+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:24:55.061118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T19:57:06.998668+0000","last_change":"2023-10-16T19:57:05.988394+0000","last_active":"2023-10-16T19:57:06.998668+0000","last_peered":"2023-10-16T19:57:06.998668+0000","last_clean":"2023-10-16T19:57:06.998668+0000","last_became_active":"2023-10-16T19:57:05.987547+0000","last_became_peered":"2023-10-16T19:57:05.987547+0000","last_unstale":"2023-10-16T19:57:06.998668+0000","last_undegraded":"2023-10-16T19:57:06.998668+0000","last_fullsized":"2023-10-16T19:57:06.998668+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:51:43.832499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-16T19:57:08.123381+0000","last_change":"2023-10-16T19:57:07.002567+0000","last_active":"2023-10-16T19:57:08.123381+0000","last_peered":"2023-10-16T19:57:08.123381+0000","last_clean":"2023-10-16T19:57:08.123381+0000","last_became_active":"2023-10-16T19:57:07.002314+0000","last_became_peered":"2023-10-16T19:57:07.002314+0000","last_unstale":"2023-10-16T19:57:08.123381+0000","last_undegraded":"2023-10-16T19:57:08.123381+0000","last_fullsized":"2023-10-16T19:57:08.123381+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:52:40.594488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-16T19:57:07.991098+0000","last_change":"2023-10-16T19:57:06.996216+0000","last_active":"2023-10-16T19:57:07.991098+0000","last_peered":"2023-10-16T19:57:07.991098+0000","last_clean":"2023-10-16T19:57:07.991098+0000","last_became_active":"2023-10-16T19:57:06.995818+0000","last_became_peered":"2023-10-16T19:57:06.995818+0000","last_unstale":"2023-10-16T19:57:07.991098+0000","last_undegraded":"2023-10-16T19:57:07.991098+0000","last_fullsized":"2023-10-16T19:57:07.991098+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:24:55.061118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T19:57:06.992752+0000","last_change":"2023-10-16T19:57:05.983515+0000","last_active":"2023-10-16T19:57:06.992752+0000","last_peered":"2023-10-16T19:57:06.992752+0000","last_clean":"2023-10-16T19:57:06.992752+0000","last_became_active":"2023-10-16T19:57:05.983096+0000","last_became_peered":"2023-10-16T19:57:05.983096+0000","last_unstale":"2023-10-16T19:57:06.992752+0000","last_undegraded":"2023-10-16T19:57:06.992752+0000","last_fullsized":"2023-10-16T19:57:06.992752+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:03:35.140465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-16T19:57:08.219540+0000","last_change":"2023-10-16T19:57:07.002274+0000","last_active":"2023-10-16T19:57:08.219540+0000","last_peered":"2023-10-16T19:57:08.219540+0000","last_clean":"2023-10-16T19:57:08.219540+0000","last_became_active":"2023-10-16T19:57:07.001797+0000","last_became_peered":"2023-10-16T19:57:07.001797+0000","last_unstale":"2023-10-16T19:57:08.219540+0000","last_undegraded":"2023-10-16T19:57:08.219540+0000","last_fullsized":"2023-10-16T19:57:08.219540+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:03:58.859315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T19:57:06.995366+0000","last_change":"2023-10-16T19:57:05.983807+0000","last_active":"2023-10-16T19:57:06.995366+0000","last_peered":"2023-10-16T19:57:06.995366+0000","last_clean":"2023-10-16T19:57:06.995366+0000","last_became_active":"2023-10-16T19:57:05.983538+0000","last_became_peered":"2023-10-16T19:57:05.983538+0000","last_unstale":"2023-10-16T19:57:06.995366+0000","last_undegraded":"2023-10-16T19:57:06.995366+0000","last_fullsized":"2023-10-16T19:57:06.995366+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:41:50.201556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":165,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T19:57:07.004328+0000","last_change":"2023-10-16T19:56:58.775782+0000","last_active":"2023-10-16T19:57:07.004328+0000","last_peered":"2023-10-16T19:57:07.004328+0000","last_clean":"2023-10-16T19:57:07.004328+0000","last_became_active":"2023-10-16T19:56:58.775567+0000","last_became_peered":"2023-10-16T19:56:58.775567+0000","last_unstale":"2023-10-16T19:57:07.004328+0000","last_undegraded":"2023-10-16T19:57:07.004328+0000","last_fullsized":"2023-10-16T19:57:07.004328+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:56:57.693332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:56:57.693332+0000","last_clean_scrub_stamp":"2023-10-16T19:56:57.693332+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:10:23.849736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-16T19:57:08.122492+0000","last_change":"2023-10-16T19:57:07.000186+0000","last_active":"2023-10-16T19:57:08.122492+0000","last_peered":"2023-10-16T19:57:08.122492+0000","last_clean":"2023-10-16T19:57:08.122492+0000","last_became_active":"2023-10-16T19:57:06.999922+0000","last_became_peered":"2023-10-16T19:57:06.999922+0000","last_unstale":"2023-10-16T19:57:08.122492+0000","last_undegraded":"2023-10-16T19:57:08.122492+0000","last_fullsized":"2023-10-16T19:57:08.122492+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:51:44.836184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T19:57:07.002178+0000","last_change":"2023-10-16T19:57:05.986507+0000","last_active":"2023-10-16T19:57:07.002178+0000","last_peered":"2023-10-16T19:57:07.002178+0000","last_clean":"2023-10-16T19:57:07.002178+0000","last_became_active":"2023-10-16T19:57:05.986234+0000","last_became_peered":"2023-10-16T19:57:05.986234+0000","last_unstale":"2023-10-16T19:57:07.002178+0000","last_undegraded":"2023-10-16T19:57:07.002178+0000","last_fullsized":"2023-10-16T19:57:07.002178+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:45:05.032981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T19:57:07.002307+0000","last_change":"2023-10-16T19:57:05.988441+0000","last_active":"2023-10-16T19:57:07.002307+0000","last_peered":"2023-10-16T19:57:07.002307+0000","last_clean":"2023-10-16T19:57:07.002307+0000","last_became_active":"2023-10-16T19:57:05.987113+0000","last_became_peered":"2023-10-16T19:57:05.987113+0000","last_unstale":"2023-10-16T19:57:07.002307+0000","last_undegraded":"2023-10-16T19:57:07.002307+0000","last_fullsized":"2023-10-16T19:57:07.002307+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:24:54.057434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-16T19:57:07.990900+0000","last_change":"2023-10-16T19:57:06.997577+0000","last_active":"2023-10-16T19:57:07.990900+0000","last_peered":"2023-10-16T19:57:07.990900+0000","last_clean":"2023-10-16T19:57:07.990900+0000","last_became_active":"2023-10-16T19:57:06.997051+0000","last_became_peered":"2023-10-16T19:57:06.997051+0000","last_unstale":"2023-10-16T19:57:07.990900+0000","last_undegraded":"2023-10-16T19:57:07.990900+0000","last_fullsized":"2023-10-16T19:57:07.990900+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:51:44.836184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-16T19:57:07.990858+0000","last_change":"2023-10-16T19:57:05.981020+0000","last_active":"2023-10-16T19:57:07.990858+0000","last_peered":"2023-10-16T19:57:07.990858+0000","last_clean":"2023-10-16T19:57:07.990858+0000","last_became_active":"2023-10-16T19:57:05.980784+0000","last_became_peered":"2023-10-16T19:57:05.980784+0000","last_unstale":"2023-10-16T19:57:07.990858+0000","last_undegraded":"2023-10-16T19:57:07.990858+0000","last_fullsized":"2023-10-16T19:57:07.990858+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:15:01.090446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-16T19:57:08.219259+0000","last_change":"2023-10-16T19:57:07.002362+0000","last_active":"2023-10-16T19:57:08.219259+0000","last_peered":"2023-10-16T19:57:08.219259+0000","last_clean":"2023-10-16T19:57:08.219259+0000","last_became_active":"2023-10-16T19:57:07.002080+0000","last_became_peered":"2023-10-16T19:57:07.002080+0000","last_unstale":"2023-10-16T19:57:08.219259+0000","last_undegraded":"2023-10-16T19:57:08.219259+0000","last_fullsized":"2023-10-16T19:57:08.219259+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:41:51.205240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T19:57:07.015539+0000","last_change":"2023-10-16T19:57:05.985909+0000","last_active":"2023-10-16T19:57:07.015539+0000","last_peered":"2023-10-16T19:57:07.015539+0000","last_clean":"2023-10-16T19:57:07.015539+0000","last_became_active":"2023-10-16T19:57:05.985720+0000","last_became_peered":"2023-10-16T19:57:05.985720+0000","last_unstale":"2023-10-16T19:57:07.015539+0000","last_undegraded":"2023-10-16T19:57:07.015539+0000","last_fullsized":"2023-10-16T19:57:07.015539+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:57:35.959611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-16T19:57:08.122386+0000","last_change":"2023-10-16T19:57:06.999291+0000","last_active":"2023-10-16T19:57:08.122386+0000","last_peered":"2023-10-16T19:57:08.122386+0000","last_clean":"2023-10-16T19:57:08.122386+0000","last_became_active":"2023-10-16T19:57:06.999034+0000","last_became_peered":"2023-10-16T19:57:06.999034+0000","last_unstale":"2023-10-16T19:57:08.122386+0000","last_undegraded":"2023-10-16T19:57:08.122386+0000","last_fullsized":"2023-10-16T19:57:08.122386+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:20:24.646617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T19:57:06.996025+0000","last_change":"2023-10-16T19:57:05.987808+0000","last_active":"2023-10-16T19:57:06.996025+0000","last_peered":"2023-10-16T19:57:06.996025+0000","last_clean":"2023-10-16T19:57:06.996025+0000","last_became_active":"2023-10-16T19:57:05.987595+0000","last_became_peered":"2023-10-16T19:57:05.987595+0000","last_unstale":"2023-10-16T19:57:06.996025+0000","last_undegraded":"2023-10-16T19:57:06.996025+0000","last_fullsized":"2023-10-16T19:57:06.996025+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:15:56.693134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-16T19:57:08.123801+0000","last_change":"2023-10-16T19:57:06.996295+0000","last_active":"2023-10-16T19:57:08.123801+0000","last_peered":"2023-10-16T19:57:08.123801+0000","last_clean":"2023-10-16T19:57:08.123801+0000","last_became_active":"2023-10-16T19:57:06.995604+0000","last_became_peered":"2023-10-16T19:57:06.995604+0000","last_unstale":"2023-10-16T19:57:08.123801+0000","last_undegraded":"2023-10-16T19:57:08.123801+0000","last_fullsized":"2023-10-16T19:57:08.123801+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:15:02.094131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T19:57:06.992662+0000","last_change":"2023-10-16T19:57:05.985744+0000","last_active":"2023-10-16T19:57:06.992662+0000","last_peered":"2023-10-16T19:57:06.992662+0000","last_clean":"2023-10-16T19:57:06.992662+0000","last_became_active":"2023-10-16T19:57:05.985591+0000","last_became_peered":"2023-10-16T19:57:05.985591+0000","last_unstale":"2023-10-16T19:57:06.992662+0000","last_undegraded":"2023-10-16T19:57:06.992662+0000","last_fullsized":"2023-10-16T19:57:06.992662+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:31:52.657457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-16T19:57:08.219291+0000","last_change":"2023-10-16T19:57:06.993916+0000","last_active":"2023-10-16T19:57:08.219291+0000","last_peered":"2023-10-16T19:57:08.219291+0000","last_clean":"2023-10-16T19:57:08.219291+0000","last_became_active":"2023-10-16T19:57:06.993732+0000","last_became_peered":"2023-10-16T19:57:06.993732+0000","last_unstale":"2023-10-16T19:57:08.219291+0000","last_undegraded":"2023-10-16T19:57:08.219291+0000","last_fullsized":"2023-10-16T19:57:08.219291+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:20:24.646617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T19:57:06.992674+0000","last_change":"2023-10-16T19:57:05.981641+0000","last_active":"2023-10-16T19:57:06.992674+0000","last_peered":"2023-10-16T19:57:06.992674+0000","last_clean":"2023-10-16T19:57:06.992674+0000","last_became_active":"2023-10-16T19:57:05.981424+0000","last_became_peered":"2023-10-16T19:57:05.981424+0000","last_unstale":"2023-10-16T19:57:06.992674+0000","last_undegraded":"2023-10-16T19:57:06.992674+0000","last_fullsized":"2023-10-16T19:57:06.992674+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:17:51.304185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-16T19:57:08.219535+0000","last_change":"2023-10-16T19:57:06.999753+0000","last_active":"2023-10-16T19:57:08.219535+0000","last_peered":"2023-10-16T19:57:08.219535+0000","last_clean":"2023-10-16T19:57:08.219535+0000","last_became_active":"2023-10-16T19:57:06.999499+0000","last_became_peered":"2023-10-16T19:57:06.999499+0000","last_unstale":"2023-10-16T19:57:08.219535+0000","last_undegraded":"2023-10-16T19:57:08.219535+0000","last_fullsized":"2023-10-16T19:57:08.219535+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:24:55.061118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T19:57:07.015534+0000","last_change":"2023-10-16T19:57:05.987589+0000","last_active":"2023-10-16T19:57:07.015534+0000","last_peered":"2023-10-16T19:57:07.015534+0000","last_clean":"2023-10-16T19:57:07.015534+0000","last_became_active":"2023-10-16T19:57:05.987345+0000","last_became_peered":"2023-10-16T19:57:05.987345+0000","last_unstale":"2023-10-16T19:57:07.015534+0000","last_undegraded":"2023-10-16T19:57:07.015534+0000","last_fullsized":"2023-10-16T19:57:07.015534+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:19:57.540312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-16T19:57:07.994730+0000","last_change":"2023-10-16T19:57:07.002297+0000","last_active":"2023-10-16T19:57:07.994730+0000","last_peered":"2023-10-16T19:57:07.994730+0000","last_clean":"2023-10-16T19:57:07.994730+0000","last_became_active":"2023-10-16T19:57:07.002036+0000","last_became_peered":"2023-10-16T19:57:07.002036+0000","last_unstale":"2023-10-16T19:57:07.994730+0000","last_undegraded":"2023-10-16T19:57:07.994730+0000","last_fullsized":"2023-10-16T19:57:07.994730+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:17:52.307869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T19:57:06.991993+0000","last_change":"2023-10-16T19:57:05.989449+0000","last_active":"2023-10-16T19:57:06.991993+0000","last_peered":"2023-10-16T19:57:06.991993+0000","last_clean":"2023-10-16T19:57:06.991993+0000","last_became_active":"2023-10-16T19:57:05.989136+0000","last_became_peered":"2023-10-16T19:57:05.989136+0000","last_unstale":"2023-10-16T19:57:06.991993+0000","last_undegraded":"2023-10-16T19:57:06.991993+0000","last_fullsized":"2023-10-16T19:57:06.991993+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:20:16.603179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-16T19:57:07.995372+0000","last_change":"2023-10-16T19:57:07.006520+0000","last_active":"2023-10-16T19:57:07.995372+0000","last_peered":"2023-10-16T19:57:07.995372+0000","last_clean":"2023-10-16T19:57:07.995372+0000","last_became_active":"2023-10-16T19:57:07.006154+0000","last_became_peered":"2023-10-16T19:57:07.006154+0000","last_unstale":"2023-10-16T19:57:07.995372+0000","last_undegraded":"2023-10-16T19:57:07.995372+0000","last_fullsized":"2023-10-16T19:57:07.995372+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:46:01.293187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T19:57:07.015059+0000","last_change":"2023-10-16T19:57:05.976185+0000","last_active":"2023-10-16T19:57:07.015059+0000","last_peered":"2023-10-16T19:57:07.015059+0000","last_clean":"2023-10-16T19:57:07.015059+0000","last_became_active":"2023-10-16T19:57:05.975953+0000","last_became_peered":"2023-10-16T19:57:05.975953+0000","last_unstale":"2023-10-16T19:57:07.015059+0000","last_undegraded":"2023-10-16T19:57:07.015059+0000","last_fullsized":"2023-10-16T19:57:07.015059+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:15:56.693134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-16T19:57:08.124279+0000","last_change":"2023-10-16T19:57:06.999678+0000","last_active":"2023-10-16T19:57:08.124279+0000","last_peered":"2023-10-16T19:57:08.124279+0000","last_clean":"2023-10-16T19:57:08.124279+0000","last_became_active":"2023-10-16T19:57:06.999426+0000","last_became_peered":"2023-10-16T19:57:06.999426+0000","last_unstale":"2023-10-16T19:57:08.124279+0000","last_undegraded":"2023-10-16T19:57:08.124279+0000","last_fullsized":"2023-10-16T19:57:08.124279+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:32:45.323575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T19:57:07.017013+0000","last_change":"2023-10-16T19:57:05.978522+0000","last_active":"2023-10-16T19:57:07.017013+0000","last_peered":"2023-10-16T19:57:07.017013+0000","last_clean":"2023-10-16T19:57:07.017013+0000","last_became_active":"2023-10-16T19:57:05.978289+0000","last_became_peered":"2023-10-16T19:57:05.978289+0000","last_unstale":"2023-10-16T19:57:07.017013+0000","last_undegraded":"2023-10-16T19:57:07.017013+0000","last_fullsized":"2023-10-16T19:57:07.017013+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:06:23.036752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-16T19:57:07.994495+0000","last_change":"2023-10-16T19:57:07.005818+0000","last_active":"2023-10-16T19:57:07.994495+0000","last_peered":"2023-10-16T19:57:07.994495+0000","last_clean":"2023-10-16T19:57:07.994495+0000","last_became_active":"2023-10-16T19:57:07.005393+0000","last_became_peered":"2023-10-16T19:57:07.005393+0000","last_unstale":"2023-10-16T19:57:07.994495+0000","last_undegraded":"2023-10-16T19:57:07.994495+0000","last_fullsized":"2023-10-16T19:57:07.994495+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:31:11.770822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-16T19:57:07.995096+0000","last_change":"2023-10-16T19:57:07.000189+0000","last_active":"2023-10-16T19:57:07.995096+0000","last_peered":"2023-10-16T19:57:07.995096+0000","last_clean":"2023-10-16T19:57:07.995096+0000","last_became_active":"2023-10-16T19:57:06.999930+0000","last_became_peered":"2023-10-16T19:57:06.999930+0000","last_unstale":"2023-10-16T19:57:07.995096+0000","last_undegraded":"2023-10-16T19:57:07.995096+0000","last_fullsized":"2023-10-16T19:57:07.995096+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:24:55.061118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-16T19:57:08.219189+0000","last_change":"2023-10-16T19:57:06.997514+0000","last_active":"2023-10-16T19:57:08.219189+0000","last_peered":"2023-10-16T19:57:08.219189+0000","last_clean":"2023-10-16T19:57:08.219189+0000","last_became_active":"2023-10-16T19:57:06.997292+0000","last_became_peered":"2023-10-16T19:57:06.997292+0000","last_unstale":"2023-10-16T19:57:08.219189+0000","last_undegraded":"2023-10-16T19:57:08.219189+0000","last_fullsized":"2023-10-16T19:57:08.219189+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:52:40.594488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-16T19:57:08.123089+0000","last_change":"2023-10-16T19:57:06.999829+0000","last_active":"2023-10-16T19:57:08.123089+0000","last_peered":"2023-10-16T19:57:08.123089+0000","last_clean":"2023-10-16T19:57:08.123089+0000","last_became_active":"2023-10-16T19:57:06.999557+0000","last_became_peered":"2023-10-16T19:57:06.999557+0000","last_unstale":"2023-10-16T19:57:08.123089+0000","last_undegraded":"2023-10-16T19:57:08.123089+0000","last_fullsized":"2023-10-16T19:57:08.123089+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:03:58.859315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-16T19:57:08.122165+0000","last_change":"2023-10-16T19:57:06.998834+0000","last_active":"2023-10-16T19:57:08.122165+0000","last_peered":"2023-10-16T19:57:08.122165+0000","last_clean":"2023-10-16T19:57:08.122165+0000","last_became_active":"2023-10-16T19:57:06.998620+0000","last_became_peered":"2023-10-16T19:57:06.998620+0000","last_unstale":"2023-10-16T19:57:08.122165+0000","last_undegraded":"2023-10-16T19:57:08.122165+0000","last_fullsized":"2023-10-16T19:57:08.122165+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:31:53.661141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-16T19:57:08.219407+0000","last_change":"2023-10-16T19:57:07.002242+0000","last_active":"2023-10-16T19:57:08.219407+0000","last_peered":"2023-10-16T19:57:08.219407+0000","last_clean":"2023-10-16T19:57:08.219407+0000","last_became_active":"2023-10-16T19:57:07.001663+0000","last_became_peered":"2023-10-16T19:57:07.001663+0000","last_unstale":"2023-10-16T19:57:08.219407+0000","last_undegraded":"2023-10-16T19:57:08.219407+0000","last_fullsized":"2023-10-16T19:57:08.219407+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:51:44.836184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-16T19:57:07.990887+0000","last_change":"2023-10-16T19:57:06.995596+0000","last_active":"2023-10-16T19:57:07.990887+0000","last_peered":"2023-10-16T19:57:07.990887+0000","last_clean":"2023-10-16T19:57:07.990887+0000","last_became_active":"2023-10-16T19:57:06.995350+0000","last_became_peered":"2023-10-16T19:57:06.995350+0000","last_unstale":"2023-10-16T19:57:07.990887+0000","last_undegraded":"2023-10-16T19:57:07.990887+0000","last_fullsized":"2023-10-16T19:57:07.990887+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:01:19.015459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-16T19:57:07.994691+0000","last_change":"2023-10-16T19:57:07.006772+0000","last_active":"2023-10-16T19:57:07.994691+0000","last_peered":"2023-10-16T19:57:07.994691+0000","last_clean":"2023-10-16T19:57:07.994691+0000","last_became_active":"2023-10-16T19:57:07.006400+0000","last_became_peered":"2023-10-16T19:57:07.006400+0000","last_unstale":"2023-10-16T19:57:07.994691+0000","last_undegraded":"2023-10-16T19:57:07.994691+0000","last_fullsized":"2023-10-16T19:57:07.994691+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:01:19.015459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-16T19:57:08.219340+0000","last_change":"2023-10-16T19:57:07.000947+0000","last_active":"2023-10-16T19:57:08.219340+0000","last_peered":"2023-10-16T19:57:08.219340+0000","last_clean":"2023-10-16T19:57:08.219340+0000","last_became_active":"2023-10-16T19:57:07.000759+0000","last_became_peered":"2023-10-16T19:57:07.000759+0000","last_unstale":"2023-10-16T19:57:08.219340+0000","last_undegraded":"2023-10-16T19:57:08.219340+0000","last_fullsized":"2023-10-16T19:57:08.219340+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:01:19.015459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-16T19:57:08.123164+0000","last_change":"2023-10-16T19:57:06.999553+0000","last_active":"2023-10-16T19:57:08.123164+0000","last_peered":"2023-10-16T19:57:08.123164+0000","last_clean":"2023-10-16T19:57:08.123164+0000","last_became_active":"2023-10-16T19:57:06.998666+0000","last_became_peered":"2023-10-16T19:57:06.998666+0000","last_unstale":"2023-10-16T19:57:08.123164+0000","last_undegraded":"2023-10-16T19:57:08.123164+0000","last_fullsized":"2023-10-16T19:57:08.123164+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:21:23.357923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-16T19:57:08.219688+0000","last_change":"2023-10-16T19:57:07.002395+0000","last_active":"2023-10-16T19:57:08.219688+0000","last_peered":"2023-10-16T19:57:08.219688+0000","last_clean":"2023-10-16T19:57:08.219688+0000","last_became_active":"2023-10-16T19:57:07.002046+0000","last_became_peered":"2023-10-16T19:57:07.002046+0000","last_unstale":"2023-10-16T19:57:08.219688+0000","last_undegraded":"2023-10-16T19:57:08.219688+0000","last_fullsized":"2023-10-16T19:57:08.219688+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:25:58.328485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-16T19:57:08.123979+0000","last_change":"2023-10-16T19:57:07.006579+0000","last_active":"2023-10-16T19:57:08.123979+0000","last_peered":"2023-10-16T19:57:08.123979+0000","last_clean":"2023-10-16T19:57:08.123979+0000","last_became_active":"2023-10-16T19:57:07.005912+0000","last_became_peered":"2023-10-16T19:57:07.005912+0000","last_unstale":"2023-10-16T19:57:08.123979+0000","last_undegraded":"2023-10-16T19:57:08.123979+0000","last_fullsized":"2023-10-16T19:57:08.123979+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:39:24.484888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-16T19:57:08.122786+0000","last_change":"2023-10-16T19:57:07.007756+0000","last_active":"2023-10-16T19:57:08.122786+0000","last_peered":"2023-10-16T19:57:08.122786+0000","last_clean":"2023-10-16T19:57:08.122786+0000","last_became_active":"2023-10-16T19:57:07.007189+0000","last_became_peered":"2023-10-16T19:57:07.007189+0000","last_unstale":"2023-10-16T19:57:08.122786+0000","last_undegraded":"2023-10-16T19:57:08.122786+0000","last_fullsized":"2023-10-16T19:57:08.122786+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:21:23.357923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-16T19:57:07.994884+0000","last_change":"2023-10-16T19:57:07.003763+0000","last_active":"2023-10-16T19:57:07.994884+0000","last_peered":"2023-10-16T19:57:07.994884+0000","last_clean":"2023-10-16T19:57:07.994884+0000","last_became_active":"2023-10-16T19:57:07.003612+0000","last_became_peered":"2023-10-16T19:57:07.003612+0000","last_unstale":"2023-10-16T19:57:07.994884+0000","last_undegraded":"2023-10-16T19:57:07.994884+0000","last_fullsized":"2023-10-16T19:57:07.994884+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:51:44.836184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":30,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":650,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194661,"statfs":{"total":200000000,"available":199333641,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67600000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54500000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58099999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66000000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69899999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":75,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195237,"statfs":{"total":200000000,"available":199922979,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34499999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.433}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":73,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195238,"statfs":{"total":200000000,"available":199924431,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38700000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34399999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40100000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48899999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]}]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":650,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194661,"statfs":{"total":200000000,"available":199333585,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41799999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.24299999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28699999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.314}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42699999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38800000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.438}]}]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":13,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":73,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195238,"statfs":{"total":200000000,"available":199924591,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45000000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40000000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42699999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60999999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63600000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67000000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.748}]}]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":75,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195237,"statfs":{"total":200000000,"available":199922979,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26600000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30099999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.22}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78600000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76700000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53100000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70099999999999996}]}]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":73,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195238,"statfs":{"total":200000000,"available":199924465,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57799999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61199999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36399999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66400000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45300000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":30,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":73,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195238,"statfs":{"total":200000000,"available":199924501,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69899999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.624}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65500000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71599999999999997}]}]}],"pool_statfs":[]}} 2023-10-16T19:57:16.045 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-16T19:57:16.046 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-10-16T19:57:16.046 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-10-16T19:57:16.046 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-10-16T19:57:16.047 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-10-16T19:57:16.199 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.197+0000 7ff9cfa94700 1 Processor -- start 2023-10-16T19:57:16.200 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.197+0000 7ff9cfa94700 1 -- start start 2023-10-16T19:57:16.202 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.198+0000 7ff9cfa94700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7ff9c815f130 0x7ff9c806bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:16.202 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.198+0000 7ff9cfa94700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9c806e240 con 0x7ff9c806b960 2023-10-16T19:57:16.202 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.198+0000 7ff9cfa94700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9c806d950 con 0x7ff9c81446b0 2023-10-16T19:57:16.202 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.198+0000 7ff9cfa94700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9c806ede0 con 0x7ff9c815f130 2023-10-16T19:57:16.203 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.198+0000 7ff9ce031700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7ff9c815f130 0x7ff9c806bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:16.203 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.198+0000 7ff9cd02f700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7ff9c806b960 0x7ff9c815ea20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:55392/0 (socket says 172.21.15.157:55392) 2023-10-16T19:57:16.203 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.198+0000 7ff9cd02f700 1 -- 172.21.15.157:0/1887996193 learned_addr learned my addr 172.21.15.157:0/1887996193 (peer_addr_for_me v1:172.21.15.157:0/0) 2023-10-16T19:57:16.203 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.198+0000 7ff9ce031700 1 -- 172.21.15.157:0/1887996193 >> v1:172.21.15.187:6789/0 conn(0x7ff9c81446b0 legacy=0x7ff9c806e6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:16.203 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.198+0000 7ff9ce031700 1 -- 172.21.15.157:0/1887996193 >> v1:172.21.15.157:6789/0 conn(0x7ff9c806b960 legacy=0x7ff9c815ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:16.204 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.198+0000 7ff9ce031700 1 -- 172.21.15.157:0/1887996193 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9c8144a90 con 0x7ff9c815f130 2023-10-16T19:57:16.204 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.198+0000 7ff9cc82e700 1 -- 172.21.15.157:0/1887996193 <== mon.0 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4032145887 0 0) 0x7ff9c806e240 con 0x7ff9c806b960 2023-10-16T19:57:16.204 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.198+0000 7ff9ce031700 1 --2- 172.21.15.157:0/1887996193 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff9c815f130 0x7ff9c806bde0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ff9c0009d90 tx=0x7ff9c000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adf2d7058c3cb7b5 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:16.204 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.199+0000 7ff9cc82e700 1 -- 172.21.15.157:0/1887996193 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9c000e070 con 0x7ff9c815f130 2023-10-16T19:57:16.204 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.199+0000 7ff9cc82e700 1 -- 172.21.15.157:0/1887996193 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9c000bbd0 con 0x7ff9c815f130 2023-10-16T19:57:16.205 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.199+0000 7ff9cc82e700 1 -- 172.21.15.157:0/1887996193 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9c0012430 con 0x7ff9c815f130 2023-10-16T19:57:16.205 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.199+0000 7ff9cfa94700 1 -- 172.21.15.157:0/1887996193 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff9c815f130 msgr2=0x7ff9c806bde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:16.205 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.199+0000 7ff9cfa94700 1 --2- 172.21.15.157:0/1887996193 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff9c815f130 0x7ff9c806bde0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ff9c0009d90 tx=0x7ff9c000b330 comp rx=0 tx=0).stop 2023-10-16T19:57:16.205 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.199+0000 7ff9cfa94700 1 -- 172.21.15.157:0/1887996193 shutdown_connections 2023-10-16T19:57:16.205 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.199+0000 7ff9cfa94700 1 --2- 172.21.15.157:0/1887996193 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff9c815f130 0x7ff9c806bde0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:16.206 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.199+0000 7ff9cfa94700 1 -- 172.21.15.157:0/1887996193 >> 172.21.15.157:0/1887996193 conn(0x7ff9c80d0b50 msgr2=0x7ff9c80d0f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:16.206 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.199+0000 7ff9cfa94700 1 -- 172.21.15.157:0/1887996193 shutdown_connections 2023-10-16T19:57:16.206 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.199+0000 7ff9cfa94700 1 -- 172.21.15.157:0/1887996193 wait complete. 2023-10-16T19:57:16.209 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.200+0000 7ff9cfa94700 1 Processor -- start 2023-10-16T19:57:16.209 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.200+0000 7ff9cfa94700 1 -- start start 2023-10-16T19:57:16.209 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.201+0000 7ff9cfa94700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff9c806b960 0x7ff9c815a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:16.209 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.201+0000 7ff9cfa94700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff9c81446b0 0x7ff9c815b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:16.209 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.201+0000 7ff9cfa94700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff9c815f130 0x7ff9c815b730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:16.210 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.201+0000 7ff9cfa94700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9c815c9c0 con 0x7ff9c806b960 2023-10-16T19:57:16.210 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.201+0000 7ff9cfa94700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9c80b67b0 con 0x7ff9c815f130 2023-10-16T19:57:16.210 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.201+0000 7ff9cfa94700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9c815bdb0 con 0x7ff9c81446b0 2023-10-16T19:57:16.210 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.201+0000 7ff9cd830700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff9c806b960 0x7ff9c815a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:16.211 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.201+0000 7ff9cd830700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff9c806b960 0x7ff9c815a7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:45724/0 (socket says 172.21.15.157:45724) 2023-10-16T19:57:16.211 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.201+0000 7ff9cd830700 1 -- 172.21.15.157:0/276731299 learned_addr learned my addr 172.21.15.157:0/276731299 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:57:16.211 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.201+0000 7ff9ce031700 1 --2- 172.21.15.157:0/276731299 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff9c815f130 0x7ff9c815b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:16.211 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.201+0000 7ff9cd02f700 1 --2- 172.21.15.157:0/276731299 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff9c81446b0 0x7ff9c815b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:16.211 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.202+0000 7ff9cd830700 1 -- 172.21.15.157:0/276731299 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff9c81446b0 msgr2=0x7ff9c815b1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:16.212 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.202+0000 7ff9cd830700 1 --2- 172.21.15.157:0/276731299 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff9c81446b0 0x7ff9c815b1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:16.212 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.202+0000 7ff9cd830700 1 -- 172.21.15.157:0/276731299 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff9c815f130 msgr2=0x7ff9c815b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:16.212 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.202+0000 7ff9cd830700 1 --2- 172.21.15.157:0/276731299 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff9c815f130 0x7ff9c815b730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:16.212 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.202+0000 7ff9cd830700 1 -- 172.21.15.157:0/276731299 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9c0009a70 con 0x7ff9c806b960 2023-10-16T19:57:16.212 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.202+0000 7ff9cd830700 1 --2- 172.21.15.157:0/276731299 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff9c806b960 0x7ff9c815a7d0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ff9c400c700 tx=0x7ff9c400ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:16.213 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.202+0000 7ff9be7fc700 1 -- 172.21.15.157:0/276731299 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9c40052d0 con 0x7ff9c806b960 2023-10-16T19:57:16.213 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.202+0000 7ff9be7fc700 1 -- 172.21.15.157:0/276731299 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9c4005430 con 0x7ff9c806b960 2023-10-16T19:57:16.213 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.202+0000 7ff9cfa94700 1 -- 172.21.15.157:0/276731299 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9c815c090 con 0x7ff9c806b960 2023-10-16T19:57:16.213 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.202+0000 7ff9be7fc700 1 -- 172.21.15.157:0/276731299 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9c4003880 con 0x7ff9c806b960 2023-10-16T19:57:16.213 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.202+0000 7ff9cfa94700 1 -- 172.21.15.157:0/276731299 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9c815c650 con 0x7ff9c806b960 2023-10-16T19:57:16.214 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.203+0000 7ff9cfa94700 1 -- 172.21.15.157:0/276731299 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9c804f400 con 0x7ff9c806b960 2023-10-16T19:57:16.214 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.203+0000 7ff9be7fc700 1 -- 172.21.15.157:0/276731299 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7ff9c40039e0 con 0x7ff9c806b960 2023-10-16T19:57:16.214 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.204+0000 7ff9be7fc700 1 --2- 172.21.15.157:0/276731299 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7ff9ac06af00 0x7ff9ac06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:16.214 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.204+0000 7ff9be7fc700 1 -- 172.21.15.157:0/276731299 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff9c40887a0 con 0x7ff9c806b960 2023-10-16T19:57:16.214 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.204+0000 7ff9cd02f700 1 --2- 172.21.15.157:0/276731299 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7ff9ac06af00 0x7ff9ac06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:16.215 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.204+0000 7ff9cd02f700 1 --2- 172.21.15.157:0/276731299 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7ff9ac06af00 0x7ff9ac06d3c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7ff9b8007b10 tx=0x7ff9b8007a60 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:16.215 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.208+0000 7ff9be7fc700 1 -- 172.21.15.157:0/276731299 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff9c4053990 con 0x7ff9c806b960 2023-10-16T19:57:16.458 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.456+0000 7ff9cfa94700 1 -- 172.21.15.157:0/276731299 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7ff9c806d240 con 0x7ff9c806b960 2023-10-16T19:57:16.461 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.459+0000 7ff9be7fc700 1 -- 172.21.15.157:0/276731299 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+171037 (secure 0 0 0) 0x7ff9c4056fb0 con 0x7ff9c806b960 2023-10-16T19:57:16.463 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-10-16T19:57:16.464 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.461+0000 7ff9cfa94700 1 -- 172.21.15.157:0/276731299 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7ff9ac06af00 msgr2=0x7ff9ac06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:16.465 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.461+0000 7ff9cfa94700 1 --2- 172.21.15.157:0/276731299 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7ff9ac06af00 0x7ff9ac06d3c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7ff9b8007b10 tx=0x7ff9b8007a60 comp rx=0 tx=0).stop 2023-10-16T19:57:16.465 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.461+0000 7ff9cfa94700 1 -- 172.21.15.157:0/276731299 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff9c806b960 msgr2=0x7ff9c815a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:16.465 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.461+0000 7ff9cfa94700 1 --2- 172.21.15.157:0/276731299 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff9c806b960 0x7ff9c815a7d0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ff9c400c700 tx=0x7ff9c400ca10 comp rx=0 tx=0).stop 2023-10-16T19:57:16.465 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.462+0000 7ff9cfa94700 1 -- 172.21.15.157:0/276731299 shutdown_connections 2023-10-16T19:57:16.465 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.462+0000 7ff9cfa94700 1 --2- 172.21.15.157:0/276731299 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7ff9ac06af00 0x7ff9ac06d3c0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:16.466 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.462+0000 7ff9cfa94700 1 --2- 172.21.15.157:0/276731299 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff9c815f130 0x7ff9c815b730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:16.466 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.462+0000 7ff9cfa94700 1 --2- 172.21.15.157:0/276731299 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff9c806b960 0x7ff9c815a7d0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:16.466 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.462+0000 7ff9cfa94700 1 --2- 172.21.15.157:0/276731299 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff9c81446b0 0x7ff9c815b1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:16.467 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.462+0000 7ff9cfa94700 1 -- 172.21.15.157:0/276731299 >> 172.21.15.157:0/276731299 conn(0x7ff9c80d0b50 msgr2=0x7ff9c8073ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:16.467 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.462+0000 7ff9cfa94700 1 -- 172.21.15.157:0/276731299 shutdown_connections 2023-10-16T19:57:16.467 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.462+0000 7ff9cfa94700 1 -- 172.21.15.157:0/276731299 wait complete. 2023-10-16T19:57:16.476 INFO:teuthology.orchestra.run.smithi157.stdout:{"epoch":5,"active_gid":4100,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":2426285296},{"type":"v1","addr":"172.21.15.187:6833","nonce":2426285296}]},"active_addr":"172.21.15.187:6833/2426285296","active_change":"2023-10-16T19:56:54.879670+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4103,"name":"y","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.3","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.3","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.187:0","nonce":4230955193}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.187:0","nonce":2462178561}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.187:0","nonce":4167099600}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.187:0","nonce":2377765194}]}]} 2023-10-16T19:57:16.480 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-10-16T19:57:16.480 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-10-16T19:57:16.481 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T19:57:16.602 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.599+0000 7f5b27ec8700 1 Processor -- start 2023-10-16T19:57:16.602 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.599+0000 7f5b27ec8700 1 -- start start 2023-10-16T19:57:16.604 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.600+0000 7f5b27ec8700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5b2015b130 0x7f5b20071f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:16.604 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.600+0000 7f5b27ec8700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f5b2006eb20 0x7f5b2006efb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:16.605 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.600+0000 7f5b27ec8700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b200cefc0 con 0x7f5b2006d0f0 2023-10-16T19:57:16.605 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.600+0000 7f5b27ec8700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b200b0050 con 0x7f5b2006eb20 2023-10-16T19:57:16.605 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.600+0000 7f5b27ec8700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b2006f4f0 con 0x7f5b2015b130 2023-10-16T19:57:16.605 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.600+0000 7f5b26465700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f5b2006eb20 0x7f5b2006efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:16.605 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.600+0000 7f5b26465700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f5b2006eb20 0x7f5b2006efb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:45734/0 (socket says 172.21.15.157:45734) 2023-10-16T19:57:16.606 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.600+0000 7f5b26465700 1 -- 172.21.15.157:0/3014473277 learned_addr learned my addr 172.21.15.157:0/3014473277 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:57:16.606 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.601+0000 7f5b25c64700 1 --2- 172.21.15.157:0/3014473277 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5b2015b130 0x7f5b20071f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:16.606 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.601+0000 7f5b26465700 1 -- 172.21.15.157:0/3014473277 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5b2015b130 msgr2=0x7f5b20071f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:57:16.606 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.601+0000 7f5b26465700 1 --2- 172.21.15.157:0/3014473277 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5b2015b130 0x7f5b20071f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:16.606 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.601+0000 7f5b26465700 1 -- 172.21.15.157:0/3014473277 >> v1:172.21.15.187:6789/0 conn(0x7f5b2006d0f0 legacy=0x7f5b200cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:57:16.607 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.601+0000 7f5b26465700 1 -- 172.21.15.157:0/3014473277 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b2006e090 con 0x7f5b2006eb20 2023-10-16T19:57:16.607 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.601+0000 7f5b26465700 1 --2- 172.21.15.157:0/3014473277 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5b2006eb20 0x7f5b2006efb0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f5b1800d150 tx=0x7f5b1800d460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0552ff1702ae050 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:16.608 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.601+0000 7f5b24c62700 1 -- 172.21.15.157:0/3014473277 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b18010070 con 0x7f5b2006eb20 2023-10-16T19:57:16.608 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.601+0000 7f5b24c62700 1 -- 172.21.15.157:0/3014473277 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b1800dd80 con 0x7f5b2006eb20 2023-10-16T19:57:16.609 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.601+0000 7f5b24c62700 1 -- 172.21.15.157:0/3014473277 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b1800b310 con 0x7f5b2006eb20 2023-10-16T19:57:16.609 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.601+0000 7f5b27ec8700 1 -- 172.21.15.157:0/3014473277 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5b2006eb20 msgr2=0x7f5b2006efb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:16.609 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.601+0000 7f5b27ec8700 1 --2- 172.21.15.157:0/3014473277 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5b2006eb20 0x7f5b2006efb0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f5b1800d150 tx=0x7f5b1800d460 comp rx=0 tx=0).stop 2023-10-16T19:57:16.609 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.602+0000 7f5b27ec8700 1 -- 172.21.15.157:0/3014473277 shutdown_connections 2023-10-16T19:57:16.609 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.602+0000 7f5b27ec8700 1 --2- 172.21.15.157:0/3014473277 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5b2015b130 0x7f5b20071f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:16.610 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.602+0000 7f5b27ec8700 1 --2- 172.21.15.157:0/3014473277 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5b2006eb20 0x7f5b2006efb0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:16.610 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.602+0000 7f5b27ec8700 1 -- 172.21.15.157:0/3014473277 >> 172.21.15.157:0/3014473277 conn(0x7f5b200cd4e0 msgr2=0x7f5b200cd8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:16.610 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.602+0000 7f5b27ec8700 1 -- 172.21.15.157:0/3014473277 shutdown_connections 2023-10-16T19:57:16.610 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.602+0000 7f5b27ec8700 1 -- 172.21.15.157:0/3014473277 wait complete. 2023-10-16T19:57:16.613 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.603+0000 7f5b27ec8700 1 Processor -- start 2023-10-16T19:57:16.614 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.603+0000 7f5b27ec8700 1 -- start start 2023-10-16T19:57:16.614 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.603+0000 7f5b27ec8700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5b2006d0f0 0x7f5b200c7160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:16.614 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.603+0000 7f5b27ec8700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5b2006eb20 0x7f5b20154960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:16.614 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.603+0000 7f5b27ec8700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5b2015b130 0x7f5b20157760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:16.615 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.603+0000 7f5b27ec8700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b20156300 con 0x7f5b2006d0f0 2023-10-16T19:57:16.615 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.603+0000 7f5b27ec8700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b20155260 con 0x7f5b2015b130 2023-10-16T19:57:16.615 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.603+0000 7f5b27ec8700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b20155540 con 0x7f5b2006eb20 2023-10-16T19:57:16.615 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.604+0000 7f5b25c64700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5b2006d0f0 0x7f5b200c7160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:16.615 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.604+0000 7f5b25c64700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5b2006d0f0 0x7f5b200c7160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:45736/0 (socket says 172.21.15.157:45736) 2023-10-16T19:57:16.616 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.604+0000 7f5b25c64700 1 -- 172.21.15.157:0/1529924002 learned_addr learned my addr 172.21.15.157:0/1529924002 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:57:16.616 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.604+0000 7f5b26465700 1 --2- 172.21.15.157:0/1529924002 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5b2015b130 0x7f5b20157760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:16.616 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.604+0000 7f5b25463700 1 --2- 172.21.15.157:0/1529924002 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5b2006eb20 0x7f5b20154960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:16.616 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.604+0000 7f5b25c64700 1 -- 172.21.15.157:0/1529924002 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5b2006eb20 msgr2=0x7f5b20154960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:16.616 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.604+0000 7f5b25c64700 1 --2- 172.21.15.157:0/1529924002 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5b2006eb20 0x7f5b20154960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:16.617 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.604+0000 7f5b25c64700 1 -- 172.21.15.157:0/1529924002 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5b2015b130 msgr2=0x7f5b20157760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:16.617 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.604+0000 7f5b25c64700 1 --2- 172.21.15.157:0/1529924002 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5b2015b130 0x7f5b20157760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:16.617 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.604+0000 7f5b25c64700 1 -- 172.21.15.157:0/1529924002 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b1800bd40 con 0x7f5b2006d0f0 2023-10-16T19:57:16.618 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.604+0000 7f5b26465700 1 --2- 172.21.15.157:0/1529924002 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5b2015b130 0x7f5b20157760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T19:57:16.618 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.604+0000 7f5b25c64700 1 --2- 172.21.15.157:0/1529924002 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5b2006d0f0 0x7f5b200c7160 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f5b1000e810 tx=0x7f5b1000eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:16.618 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.604+0000 7f5b167fc700 1 -- 172.21.15.157:0/1529924002 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b10013610 con 0x7f5b2006d0f0 2023-10-16T19:57:16.618 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.604+0000 7f5b167fc700 1 -- 172.21.15.157:0/1529924002 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b10013770 con 0x7f5b2006d0f0 2023-10-16T19:57:16.619 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.604+0000 7f5b27ec8700 1 -- 172.21.15.157:0/1529924002 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b20155820 con 0x7f5b2006d0f0 2023-10-16T19:57:16.619 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.604+0000 7f5b167fc700 1 -- 172.21.15.157:0/1529924002 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b10013b20 con 0x7f5b2006d0f0 2023-10-16T19:57:16.619 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.604+0000 7f5b27ec8700 1 -- 172.21.15.157:0/1529924002 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b20155de0 con 0x7f5b2006d0f0 2023-10-16T19:57:16.619 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.605+0000 7f5b27ec8700 1 -- 172.21.15.157:0/1529924002 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b2006d550 con 0x7f5b2006d0f0 2023-10-16T19:57:16.619 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.606+0000 7f5b167fc700 1 -- 172.21.15.157:0/1529924002 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f5b10013c80 con 0x7f5b2006d0f0 2023-10-16T19:57:16.620 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.606+0000 7f5b167fc700 1 --2- 172.21.15.157:0/1529924002 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f5b0406af00 0x7f5b0406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:16.620 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.606+0000 7f5b167fc700 1 -- 172.21.15.157:0/1529924002 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5b10089210 con 0x7f5b2006d0f0 2023-10-16T19:57:16.620 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.606+0000 7f5b25463700 1 --2- 172.21.15.157:0/1529924002 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f5b0406af00 0x7f5b0406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:16.620 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.607+0000 7f5b25463700 1 --2- 172.21.15.157:0/1529924002 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f5b0406af00 0x7f5b0406d3c0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f5b201f7250 tx=0x7f5b1c0090e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:16.621 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.611+0000 7f5b167fc700 1 -- 172.21.15.157:0/1529924002 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5b2006d550 con 0x7f5b2006d0f0 2023-10-16T19:57:16.802 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.799+0000 7f5b27ec8700 1 -- 172.21.15.157:0/1529924002 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5b2006d550 con 0x7f5b2006d0f0 2023-10-16T19:57:16.803 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.801+0000 7f5b167fc700 1 -- 172.21.15.157:0/1529924002 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16517 (secure 0 0 0) 0x7f5b2006d550 con 0x7f5b2006d0f0 2023-10-16T19:57:16.803 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-10-16T19:57:16.803 INFO:teuthology.orchestra.run.smithi157.stdout:{"epoch":21,"fsid":"28199dc9-64d5-479e-83c6-21f097c33d39","created":"2023-10-16T19:56:49.201889+0000","modified":"2023-10-16T19:57:07.988567+0000","last_up_change":"2023-10-16T19:56:54.675673+0000","last_in_change":"2023-10-16T19:56:51.666728+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T19:56:56.932895+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-16T19:57:04.936105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-16T19:57:05.335279+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":335785898},{"type":"v1","addr":"172.21.15.157:6809","nonce":335785898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":335785898},{"type":"v1","addr":"172.21.15.157:6811","nonce":335785898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6815","nonce":335785898},{"type":"v1","addr":"172.21.15.157:6817","nonce":335785898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":335785898},{"type":"v1","addr":"172.21.15.157:6813","nonce":335785898}]},"public_addr":"172.21.15.157:6809/335785898","cluster_addr":"172.21.15.157:6811/335785898","heartbeat_back_addr":"172.21.15.157:6817/335785898","heartbeat_front_addr":"172.21.15.157:6813/335785898","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":3482825047},{"type":"v1","addr":"172.21.15.157:6801","nonce":3482825047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":3482825047},{"type":"v1","addr":"172.21.15.157:6803","nonce":3482825047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":3482825047},{"type":"v1","addr":"172.21.15.157:6807","nonce":3482825047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":3482825047},{"type":"v1","addr":"172.21.15.157:6805","nonce":3482825047}]},"public_addr":"172.21.15.157:6801/3482825047","cluster_addr":"172.21.15.157:6803/3482825047","heartbeat_back_addr":"172.21.15.157:6807/3482825047","heartbeat_front_addr":"172.21.15.157:6805/3482825047","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":1118292389},{"type":"v1","addr":"172.21.15.157:6825","nonce":1118292389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":1118292389},{"type":"v1","addr":"172.21.15.157:6827","nonce":1118292389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":1118292389},{"type":"v1","addr":"172.21.15.157:6831","nonce":1118292389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":1118292389},{"type":"v1","addr":"172.21.15.157:6829","nonce":1118292389}]},"public_addr":"172.21.15.157:6825/1118292389","cluster_addr":"172.21.15.157:6827/1118292389","heartbeat_back_addr":"172.21.15.157:6831/1118292389","heartbeat_front_addr":"172.21.15.157:6829/1118292389","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":989329821},{"type":"v1","addr":"172.21.15.157:6816","nonce":989329821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":989329821},{"type":"v1","addr":"172.21.15.157:6819","nonce":989329821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":989329821},{"type":"v1","addr":"172.21.15.157:6823","nonce":989329821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":989329821},{"type":"v1","addr":"172.21.15.157:6821","nonce":989329821}]},"public_addr":"172.21.15.157:6816/989329821","cluster_addr":"172.21.15.157:6819/989329821","heartbeat_back_addr":"172.21.15.157:6823/989329821","heartbeat_front_addr":"172.21.15.157:6821/989329821","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":3841016811},{"type":"v1","addr":"172.21.15.187:6801","nonce":3841016811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6803","nonce":3841016811},{"type":"v1","addr":"172.21.15.187:6804","nonce":3841016811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6809","nonce":3841016811},{"type":"v1","addr":"172.21.15.187:6811","nonce":3841016811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":3841016811},{"type":"v1","addr":"172.21.15.187:6808","nonce":3841016811}]},"public_addr":"172.21.15.187:6801/3841016811","cluster_addr":"172.21.15.187:6804/3841016811","heartbeat_back_addr":"172.21.15.187:6811/3841016811","heartbeat_front_addr":"172.21.15.187:6808/3841016811","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":915130263},{"type":"v1","addr":"172.21.15.187:6805","nonce":915130263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6807","nonce":915130263},{"type":"v1","addr":"172.21.15.187:6810","nonce":915130263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":915130263},{"type":"v1","addr":"172.21.15.187:6815","nonce":915130263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":915130263},{"type":"v1","addr":"172.21.15.187:6813","nonce":915130263}]},"public_addr":"172.21.15.187:6805/915130263","cluster_addr":"172.21.15.187:6810/915130263","heartbeat_back_addr":"172.21.15.187:6815/915130263","heartbeat_front_addr":"172.21.15.187:6813/915130263","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":654976824},{"type":"v1","addr":"172.21.15.187:6817","nonce":654976824}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":654976824},{"type":"v1","addr":"172.21.15.187:6819","nonce":654976824}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":654976824},{"type":"v1","addr":"172.21.15.187:6823","nonce":654976824}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":654976824},{"type":"v1","addr":"172.21.15.187:6821","nonce":654976824}]},"public_addr":"172.21.15.187:6817/654976824","cluster_addr":"172.21.15.187:6819/654976824","heartbeat_back_addr":"172.21.15.187:6823/654976824","heartbeat_front_addr":"172.21.15.187:6821/654976824","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":4284059445},{"type":"v1","addr":"172.21.15.187:6825","nonce":4284059445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":4284059445},{"type":"v1","addr":"172.21.15.187:6827","nonce":4284059445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":4284059445},{"type":"v1","addr":"172.21.15.187:6831","nonce":4284059445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":4284059445},{"type":"v1","addr":"172.21.15.187:6829","nonce":4284059445}]},"public_addr":"172.21.15.187:6825/4284059445","cluster_addr":"172.21.15.187:6827/4284059445","heartbeat_back_addr":"172.21.15.187:6831/4284059445","heartbeat_front_addr":"172.21.15.187:6829/4284059445","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.819780+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.824193+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.849575+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.824806+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.809540+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.805093+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.866109+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.807372+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T19:57:16.805 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.803+0000 7f5b27ec8700 1 -- 172.21.15.157:0/1529924002 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f5b0406af00 msgr2=0x7f5b0406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:16.805 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.803+0000 7f5b27ec8700 1 --2- 172.21.15.157:0/1529924002 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f5b0406af00 0x7f5b0406d3c0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f5b201f7250 tx=0x7f5b1c0090e0 comp rx=0 tx=0).stop 2023-10-16T19:57:16.806 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.803+0000 7f5b27ec8700 1 -- 172.21.15.157:0/1529924002 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5b2006d0f0 msgr2=0x7f5b200c7160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:16.806 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.803+0000 7f5b27ec8700 1 --2- 172.21.15.157:0/1529924002 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5b2006d0f0 0x7f5b200c7160 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f5b1000e810 tx=0x7f5b1000eb20 comp rx=0 tx=0).stop 2023-10-16T19:57:16.806 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.803+0000 7f5b27ec8700 1 -- 172.21.15.157:0/1529924002 shutdown_connections 2023-10-16T19:57:16.806 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.803+0000 7f5b27ec8700 1 --2- 172.21.15.157:0/1529924002 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f5b0406af00 0x7f5b0406d3c0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:16.807 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.803+0000 7f5b27ec8700 1 --2- 172.21.15.157:0/1529924002 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5b2015b130 0x7f5b20157760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:16.807 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.803+0000 7f5b27ec8700 1 --2- 172.21.15.157:0/1529924002 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5b2006d0f0 0x7f5b200c7160 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:16.807 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.803+0000 7f5b27ec8700 1 --2- 172.21.15.157:0/1529924002 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5b2006eb20 0x7f5b20154960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:16.807 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.803+0000 7f5b27ec8700 1 -- 172.21.15.157:0/1529924002 >> 172.21.15.157:0/1529924002 conn(0x7f5b200cd4e0 msgr2=0x7f5b200cf2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:16.807 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.803+0000 7f5b27ec8700 1 -- 172.21.15.157:0/1529924002 shutdown_connections 2023-10-16T19:57:16.807 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.803+0000 7f5b27ec8700 1 -- 172.21.15.157:0/1529924002 wait complete. 2023-10-16T19:57:16.817 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-10-16T19:57:16.817 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T19:57:16.938 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.936+0000 7fa8a445e700 1 Processor -- start 2023-10-16T19:57:16.938 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.936+0000 7fa8a445e700 1 -- start start 2023-10-16T19:57:16.940 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.936+0000 7fa8a445e700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa89c15de80 0x7fa89c0cf2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:16.941 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.936+0000 7fa8a445e700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fa89c15e260 0x7fa89c0b5810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:16.941 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.936+0000 7fa8a445e700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa89c0cee50 con 0x7fa89c0b5d50 2023-10-16T19:57:16.941 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.936+0000 7fa8a445e700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa89c0b6200 con 0x7fa89c15e260 2023-10-16T19:57:16.941 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.936+0000 7fa8a445e700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa89c0ce5f0 con 0x7fa89c15de80 2023-10-16T19:57:16.942 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.937+0000 7fa8a29fb700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7fa89c0b5d50 0x7fa89c161cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:55416/0 (socket says 172.21.15.157:55416) 2023-10-16T19:57:16.942 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.937+0000 7fa8a29fb700 1 -- 172.21.15.157:0/455141996 learned_addr learned my addr 172.21.15.157:0/455141996 (peer_addr_for_me v1:172.21.15.157:0/0) 2023-10-16T19:57:16.942 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.937+0000 7fa8a21fa700 1 --2- 172.21.15.157:0/455141996 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa89c15de80 0x7fa89c0cf2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:16.942 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.937+0000 7fa8a19f9700 1 --2- 172.21.15.157:0/455141996 >> v2:172.21.15.187:3300/0 conn(0x7fa89c15e260 0x7fa89c0b5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:16.942 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.937+0000 7fa8a11f8700 1 -- 172.21.15.157:0/455141996 <== mon.0 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3662619579 0 0) 0x7fa89c0cee50 con 0x7fa89c0b5d50 2023-10-16T19:57:16.943 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.937+0000 7fa8a11f8700 1 -- 172.21.15.157:0/455141996 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa8880035b0 con 0x7fa89c0b5d50 2023-10-16T19:57:16.943 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.937+0000 7fa8a21fa700 1 -- 172.21.15.157:0/455141996 >> v2:172.21.15.187:3300/0 conn(0x7fa89c15e260 msgr2=0x7fa89c0b5810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:57:16.943 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.937+0000 7fa8a21fa700 1 --2- 172.21.15.157:0/455141996 >> v2:172.21.15.187:3300/0 conn(0x7fa89c15e260 0x7fa89c0b5810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:16.943 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.937+0000 7fa8a21fa700 1 -- 172.21.15.157:0/455141996 >> v1:172.21.15.157:6789/0 conn(0x7fa89c0b5d50 legacy=0x7fa89c161cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:16.943 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.937+0000 7fa8a21fa700 1 -- 172.21.15.157:0/455141996 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa89c0cf820 con 0x7fa89c15de80 2023-10-16T19:57:16.944 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.937+0000 7fa8a21fa700 1 --2- 172.21.15.157:0/455141996 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa89c15de80 0x7fa89c0cf2e0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fa88c009840 tx=0x7fa88c009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ef0d5d98f0f823 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:16.944 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.937+0000 7fa8a11f8700 1 -- 172.21.15.157:0/455141996 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa88c011830 con 0x7fa89c15de80 2023-10-16T19:57:16.944 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.938+0000 7fa8a11f8700 1 -- 172.21.15.157:0/455141996 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa88c011990 con 0x7fa89c15de80 2023-10-16T19:57:16.944 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.938+0000 7fa8a11f8700 1 -- 172.21.15.157:0/455141996 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa88c011d00 con 0x7fa89c15de80 2023-10-16T19:57:16.944 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.938+0000 7fa8a445e700 1 -- 172.21.15.157:0/455141996 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa89c15de80 msgr2=0x7fa89c0cf2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:16.944 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.938+0000 7fa8a445e700 1 --2- 172.21.15.157:0/455141996 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa89c15de80 0x7fa89c0cf2e0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fa88c009840 tx=0x7fa88c009b50 comp rx=0 tx=0).stop 2023-10-16T19:57:16.945 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.938+0000 7fa8a445e700 1 -- 172.21.15.157:0/455141996 shutdown_connections 2023-10-16T19:57:16.945 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.938+0000 7fa8a445e700 1 --2- 172.21.15.157:0/455141996 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa89c15de80 0x7fa89c0cf2e0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:16.945 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.938+0000 7fa8a445e700 1 --2- 172.21.15.157:0/455141996 >> v2:172.21.15.187:3300/0 conn(0x7fa89c15e260 0x7fa89c0b5810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:16.945 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.938+0000 7fa8a445e700 1 -- 172.21.15.157:0/455141996 >> 172.21.15.157:0/455141996 conn(0x7fa89c0d0810 msgr2=0x7fa89c0d0bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:16.945 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.938+0000 7fa8a445e700 1 -- 172.21.15.157:0/455141996 shutdown_connections 2023-10-16T19:57:16.946 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.938+0000 7fa8a445e700 1 -- 172.21.15.157:0/455141996 wait complete. 2023-10-16T19:57:16.948 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.939+0000 7fa8a445e700 1 Processor -- start 2023-10-16T19:57:16.948 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.939+0000 7fa8a445e700 1 -- start start 2023-10-16T19:57:16.949 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.940+0000 7fa8a445e700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa89c0b5d50 0x7fa89c0c8930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:16.949 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.940+0000 7fa8a445e700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa89c15de80 0x7fa89c0b44e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:16.949 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.940+0000 7fa8a445e700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa89c15e260 0x7fa89c1f6f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:16.949 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.940+0000 7fa8a445e700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa89c0ca820 con 0x7fa89c15e260 2023-10-16T19:57:16.950 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.940+0000 7fa8a445e700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa89c1f7b00 con 0x7fa89c15de80 2023-10-16T19:57:16.950 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.940+0000 7fa8a445e700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa89c1f7de0 con 0x7fa89c0b5d50 2023-10-16T19:57:16.950 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.940+0000 7fa8a29fb700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa89c15e260 0x7fa89c1f6f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:16.950 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.940+0000 7fa8a29fb700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa89c15e260 0x7fa89c1f6f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:45754/0 (socket says 172.21.15.157:45754) 2023-10-16T19:57:16.950 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.940+0000 7fa8a29fb700 1 -- 172.21.15.157:0/3766780635 learned_addr learned my addr 172.21.15.157:0/3766780635 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:57:16.951 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.940+0000 7fa8a21fa700 1 --2- 172.21.15.157:0/3766780635 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa89c0b5d50 0x7fa89c0c8930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:16.951 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.940+0000 7fa8a19f9700 1 --2- 172.21.15.157:0/3766780635 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa89c15de80 0x7fa89c0b44e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:16.951 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.941+0000 7fa8a29fb700 1 -- 172.21.15.157:0/3766780635 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa89c0b5d50 msgr2=0x7fa89c0c8930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:16.951 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.941+0000 7fa8a29fb700 1 --2- 172.21.15.157:0/3766780635 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa89c0b5d50 0x7fa89c0c8930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:16.951 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.941+0000 7fa8a29fb700 1 -- 172.21.15.157:0/3766780635 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa89c15de80 msgr2=0x7fa89c0b44e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:16.952 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.941+0000 7fa8a29fb700 1 --2- 172.21.15.157:0/3766780635 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa89c15de80 0x7fa89c0b44e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:16.952 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.941+0000 7fa8a29fb700 1 -- 172.21.15.157:0/3766780635 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa88c0094a0 con 0x7fa89c15e260 2023-10-16T19:57:16.952 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.941+0000 7fa8a29fb700 1 --2- 172.21.15.157:0/3766780635 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa89c15e260 0x7fa89c1f6f90 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fa89400cb40 tx=0x7fa89400ce50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:16.952 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.941+0000 7fa892ffd700 1 -- 172.21.15.157:0/3766780635 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa89400a9e0 con 0x7fa89c15e260 2023-10-16T19:57:16.953 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.941+0000 7fa892ffd700 1 -- 172.21.15.157:0/3766780635 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa89400ab40 con 0x7fa89c15e260 2023-10-16T19:57:16.953 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.941+0000 7fa892ffd700 1 -- 172.21.15.157:0/3766780635 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa894012400 con 0x7fa89c15e260 2023-10-16T19:57:16.953 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.941+0000 7fa8a445e700 1 -- 172.21.15.157:0/3766780635 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa89c0c7e50 con 0x7fa89c15e260 2023-10-16T19:57:16.953 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.941+0000 7fa8a445e700 1 -- 172.21.15.157:0/3766780635 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa89c0c8410 con 0x7fa89c15e260 2023-10-16T19:57:16.953 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.942+0000 7fa8a445e700 1 -- 172.21.15.157:0/3766780635 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa89c04f400 con 0x7fa89c15e260 2023-10-16T19:57:16.954 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.942+0000 7fa892ffd700 1 -- 172.21.15.157:0/3766780635 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fa89401b3b0 con 0x7fa89c15e260 2023-10-16T19:57:16.954 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.942+0000 7fa892ffd700 1 --2- 172.21.15.157:0/3766780635 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fa88006af00 0x7fa88006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:16.954 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.943+0000 7fa892ffd700 1 -- 172.21.15.157:0/3766780635 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa894089100 con 0x7fa89c15e260 2023-10-16T19:57:16.954 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.943+0000 7fa8a21fa700 1 --2- 172.21.15.157:0/3766780635 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fa88006af00 0x7fa88006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:16.954 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.943+0000 7fa8a21fa700 1 --2- 172.21.15.157:0/3766780635 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fa88006af00 0x7fa88006d3c0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fa88c009fd0 tx=0x7fa88c008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:16.955 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:16.947+0000 7fa892ffd700 1 -- 172.21.15.157:0/3766780635 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa894054260 con 0x7fa89c15e260 2023-10-16T19:57:17.140 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.138+0000 7fa8a445e700 1 -- 172.21.15.157:0/3766780635 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa89c0d05f0 con 0x7fa89c15e260 2023-10-16T19:57:17.141 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.139+0000 7fa892ffd700 1 -- 172.21.15.157:0/3766780635 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16517 (secure 0 0 0) 0x7fa894057880 con 0x7fa89c15e260 2023-10-16T19:57:17.141 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-10-16T19:57:17.142 INFO:teuthology.orchestra.run.smithi157.stdout:{"epoch":21,"fsid":"28199dc9-64d5-479e-83c6-21f097c33d39","created":"2023-10-16T19:56:49.201889+0000","modified":"2023-10-16T19:57:07.988567+0000","last_up_change":"2023-10-16T19:56:54.675673+0000","last_in_change":"2023-10-16T19:56:51.666728+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T19:56:56.932895+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-16T19:57:04.936105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-16T19:57:05.335279+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":335785898},{"type":"v1","addr":"172.21.15.157:6809","nonce":335785898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":335785898},{"type":"v1","addr":"172.21.15.157:6811","nonce":335785898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6815","nonce":335785898},{"type":"v1","addr":"172.21.15.157:6817","nonce":335785898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":335785898},{"type":"v1","addr":"172.21.15.157:6813","nonce":335785898}]},"public_addr":"172.21.15.157:6809/335785898","cluster_addr":"172.21.15.157:6811/335785898","heartbeat_back_addr":"172.21.15.157:6817/335785898","heartbeat_front_addr":"172.21.15.157:6813/335785898","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":3482825047},{"type":"v1","addr":"172.21.15.157:6801","nonce":3482825047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":3482825047},{"type":"v1","addr":"172.21.15.157:6803","nonce":3482825047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":3482825047},{"type":"v1","addr":"172.21.15.157:6807","nonce":3482825047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":3482825047},{"type":"v1","addr":"172.21.15.157:6805","nonce":3482825047}]},"public_addr":"172.21.15.157:6801/3482825047","cluster_addr":"172.21.15.157:6803/3482825047","heartbeat_back_addr":"172.21.15.157:6807/3482825047","heartbeat_front_addr":"172.21.15.157:6805/3482825047","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":1118292389},{"type":"v1","addr":"172.21.15.157:6825","nonce":1118292389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":1118292389},{"type":"v1","addr":"172.21.15.157:6827","nonce":1118292389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":1118292389},{"type":"v1","addr":"172.21.15.157:6831","nonce":1118292389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":1118292389},{"type":"v1","addr":"172.21.15.157:6829","nonce":1118292389}]},"public_addr":"172.21.15.157:6825/1118292389","cluster_addr":"172.21.15.157:6827/1118292389","heartbeat_back_addr":"172.21.15.157:6831/1118292389","heartbeat_front_addr":"172.21.15.157:6829/1118292389","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":989329821},{"type":"v1","addr":"172.21.15.157:6816","nonce":989329821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":989329821},{"type":"v1","addr":"172.21.15.157:6819","nonce":989329821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":989329821},{"type":"v1","addr":"172.21.15.157:6823","nonce":989329821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":989329821},{"type":"v1","addr":"172.21.15.157:6821","nonce":989329821}]},"public_addr":"172.21.15.157:6816/989329821","cluster_addr":"172.21.15.157:6819/989329821","heartbeat_back_addr":"172.21.15.157:6823/989329821","heartbeat_front_addr":"172.21.15.157:6821/989329821","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":3841016811},{"type":"v1","addr":"172.21.15.187:6801","nonce":3841016811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6803","nonce":3841016811},{"type":"v1","addr":"172.21.15.187:6804","nonce":3841016811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6809","nonce":3841016811},{"type":"v1","addr":"172.21.15.187:6811","nonce":3841016811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":3841016811},{"type":"v1","addr":"172.21.15.187:6808","nonce":3841016811}]},"public_addr":"172.21.15.187:6801/3841016811","cluster_addr":"172.21.15.187:6804/3841016811","heartbeat_back_addr":"172.21.15.187:6811/3841016811","heartbeat_front_addr":"172.21.15.187:6808/3841016811","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":915130263},{"type":"v1","addr":"172.21.15.187:6805","nonce":915130263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6807","nonce":915130263},{"type":"v1","addr":"172.21.15.187:6810","nonce":915130263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":915130263},{"type":"v1","addr":"172.21.15.187:6815","nonce":915130263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":915130263},{"type":"v1","addr":"172.21.15.187:6813","nonce":915130263}]},"public_addr":"172.21.15.187:6805/915130263","cluster_addr":"172.21.15.187:6810/915130263","heartbeat_back_addr":"172.21.15.187:6815/915130263","heartbeat_front_addr":"172.21.15.187:6813/915130263","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":654976824},{"type":"v1","addr":"172.21.15.187:6817","nonce":654976824}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":654976824},{"type":"v1","addr":"172.21.15.187:6819","nonce":654976824}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":654976824},{"type":"v1","addr":"172.21.15.187:6823","nonce":654976824}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":654976824},{"type":"v1","addr":"172.21.15.187:6821","nonce":654976824}]},"public_addr":"172.21.15.187:6817/654976824","cluster_addr":"172.21.15.187:6819/654976824","heartbeat_back_addr":"172.21.15.187:6823/654976824","heartbeat_front_addr":"172.21.15.187:6821/654976824","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":4284059445},{"type":"v1","addr":"172.21.15.187:6825","nonce":4284059445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":4284059445},{"type":"v1","addr":"172.21.15.187:6827","nonce":4284059445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":4284059445},{"type":"v1","addr":"172.21.15.187:6831","nonce":4284059445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":4284059445},{"type":"v1","addr":"172.21.15.187:6829","nonce":4284059445}]},"public_addr":"172.21.15.187:6825/4284059445","cluster_addr":"172.21.15.187:6827/4284059445","heartbeat_back_addr":"172.21.15.187:6831/4284059445","heartbeat_front_addr":"172.21.15.187:6829/4284059445","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.819780+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.824193+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.849575+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.824806+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.809540+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.805093+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.866109+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.807372+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T19:57:17.144 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.141+0000 7fa8a445e700 1 -- 172.21.15.157:0/3766780635 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fa88006af00 msgr2=0x7fa88006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:17.144 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.141+0000 7fa8a445e700 1 --2- 172.21.15.157:0/3766780635 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fa88006af00 0x7fa88006d3c0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fa88c009fd0 tx=0x7fa88c008030 comp rx=0 tx=0).stop 2023-10-16T19:57:17.144 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.141+0000 7fa8a445e700 1 -- 172.21.15.157:0/3766780635 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa89c15e260 msgr2=0x7fa89c1f6f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:17.144 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.141+0000 7fa8a445e700 1 --2- 172.21.15.157:0/3766780635 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa89c15e260 0x7fa89c1f6f90 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fa89400cb40 tx=0x7fa89400ce50 comp rx=0 tx=0).stop 2023-10-16T19:57:17.145 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.141+0000 7fa8a445e700 1 -- 172.21.15.157:0/3766780635 shutdown_connections 2023-10-16T19:57:17.145 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.141+0000 7fa8a445e700 1 --2- 172.21.15.157:0/3766780635 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa89c15e260 0x7fa89c1f6f90 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:17.145 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.141+0000 7fa8a445e700 1 --2- 172.21.15.157:0/3766780635 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa89c0b5d50 0x7fa89c0c8930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:17.145 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.141+0000 7fa8a445e700 1 --2- 172.21.15.157:0/3766780635 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fa88006af00 0x7fa88006d3c0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:17.145 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.141+0000 7fa8a445e700 1 --2- 172.21.15.157:0/3766780635 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa89c15de80 0x7fa89c0b44e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:17.145 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.141+0000 7fa8a445e700 1 -- 172.21.15.157:0/3766780635 >> 172.21.15.157:0/3766780635 conn(0x7fa89c0d0810 msgr2=0x7fa89c161aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:17.146 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.141+0000 7fa8a445e700 1 -- 172.21.15.157:0/3766780635 shutdown_connections 2023-10-16T19:57:17.146 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.141+0000 7fa8a445e700 1 -- 172.21.15.157:0/3766780635 wait complete. 2023-10-16T19:57:17.156 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-10-16T19:57:17.157 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-10-16T19:57:17.157 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-10-16T19:57:17.158 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-10-16T19:57:17.158 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-10-16T19:57:17.159 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-10-16T19:57:17.160 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-10-16T19:57:17.160 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-10-16T19:57:17.369 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.366+0000 7f29f3a36700 1 Processor -- start 2023-10-16T19:57:17.369 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.366+0000 7f29f3a36700 1 -- start start 2023-10-16T19:57:17.369 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.367+0000 7f060dbd7700 1 Processor -- start 2023-10-16T19:57:17.370 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.367+0000 7f29f3a36700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f29ec162730 0x7f29ec166c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:17.370 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.367+0000 7f29f3a36700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f29ec162b10 0x7f29ec06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:17.371 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.368+0000 7f29f3a36700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29ec1667c0 con 0x7f29ec0c3890 2023-10-16T19:57:17.371 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.368+0000 7f29f3a36700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29ec166490 con 0x7f29ec162730 2023-10-16T19:57:17.371 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.368+0000 7f29f3a36700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29ec0ce720 con 0x7f29ec162b10 2023-10-16T19:57:17.371 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.367+0000 7f060dbd7700 1 -- start start 2023-10-16T19:57:17.372 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.368+0000 7f060dbd7700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f06080708d0 0x7f06080cb780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:17.372 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.368+0000 7f060dbd7700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f060815a2e0 con 0x7f0608159f00 2023-10-16T19:57:17.372 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.368+0000 7f060dbd7700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f060815e2c0 con 0x7f06080cbcc0 2023-10-16T19:57:17.372 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.368+0000 7f060dbd7700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06080cc130 con 0x7f06080708d0 2023-10-16T19:57:17.373 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.368+0000 7f29f1fd3700 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7f29ec0c3890 0x7f29ec070f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.157:39126/0 (socket says 172.21.15.157:39126) 2023-10-16T19:57:17.373 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.368+0000 7f29f1fd3700 1 -- 172.21.15.157:0/1333814437 learned_addr learned my addr 172.21.15.157:0/1333814437 (peer_addr_for_me v1:172.21.15.157:0/0) 2023-10-16T19:57:17.373 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.368+0000 7f06077fe700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f0608159f00 0x7f060815da70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:55434/0 (socket says 172.21.15.157:55434) 2023-10-16T19:57:17.373 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.368+0000 7f06077fe700 1 -- 172.21.15.157:0/2515725245 learned_addr learned my addr 172.21.15.157:0/2515725245 (peer_addr_for_me v1:172.21.15.157:0/0) 2023-10-16T19:57:17.374 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.368+0000 7f29f0fd1700 1 --2- 172.21.15.157:0/1333814437 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f29ec162b10 0x7f29ec06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:17.374 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.368+0000 7f0606ffd700 1 --2- 172.21.15.157:0/2515725245 >> v2:172.21.15.187:3300/0 conn(0x7f06080708d0 0x7f06080cb780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:17.375 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.369+0000 7f29e3fff700 1 -- 172.21.15.157:0/1333814437 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2711854591 0 0) 0x7f29ec1667c0 con 0x7f29ec0c3890 2023-10-16T19:57:17.375 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.369+0000 7f29f0fd1700 1 -- 172.21.15.157:0/1333814437 >> v2:172.21.15.157:3300/0 conn(0x7f29ec162730 msgr2=0x7f29ec166c50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-16T19:57:17.375 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.369+0000 7f29f0fd1700 1 --2- 172.21.15.157:0/1333814437 >> v2:172.21.15.157:3300/0 conn(0x7f29ec162730 0x7f29ec166c50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:17.376 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.369+0000 7f29f0fd1700 1 -- 172.21.15.157:0/1333814437 >> v1:172.21.15.187:6789/0 conn(0x7f29ec0c3890 legacy=0x7f29ec070f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:17.376 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.369+0000 7f29f0fd1700 1 -- 172.21.15.157:0/1333814437 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29ec0cea00 con 0x7f29ec162b10 2023-10-16T19:57:17.376 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.369+0000 7f0606ffd700 1 -- 172.21.15.157:0/2515725245 >> v1:172.21.15.187:6789/0 conn(0x7f06080cbcc0 legacy=0x7f06080cdd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:17.377 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.369+0000 7f0606ffd700 1 -- 172.21.15.157:0/2515725245 >> v1:172.21.15.157:6789/0 conn(0x7f0608159f00 legacy=0x7f060815da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:17.377 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.369+0000 7f0606ffd700 1 -- 172.21.15.157:0/2515725245 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f060815e5a0 con 0x7f06080708d0 2023-10-16T19:57:17.377 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.369+0000 7f29f0fd1700 1 --2- 172.21.15.157:0/1333814437 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f29ec162b10 0x7f29ec06d0f0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f29e8009840 tx=0x7f29e8009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8b6c63b3c45c06f1 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:17.378 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.369+0000 7f0606ffd700 1 --2- 172.21.15.157:0/2515725245 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f06080708d0 0x7f06080cb780 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f05f800a9e0 tx=0x7f05f800acf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8a7a580ca26e32c server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:17.378 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.369+0000 7f29e3fff700 1 -- 172.21.15.157:0/1333814437 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29e8011830 con 0x7f29ec162b10 2023-10-16T19:57:17.379 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.369+0000 7f29e3fff700 1 -- 172.21.15.157:0/1333814437 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29e8011990 con 0x7f29ec162b10 2023-10-16T19:57:17.379 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.369+0000 7f29e3fff700 1 -- 172.21.15.157:0/1333814437 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29e8011d20 con 0x7f29ec162b10 2023-10-16T19:57:17.379 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.370+0000 7f29f3a36700 1 -- 172.21.15.157:0/1333814437 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f29ec162b10 msgr2=0x7f29ec06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:17.379 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.370+0000 7f29f3a36700 1 --2- 172.21.15.157:0/1333814437 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f29ec162b10 0x7f29ec06d0f0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f29e8009840 tx=0x7f29e8009b50 comp rx=0 tx=0).stop 2023-10-16T19:57:17.379 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.371+0000 7f29f3a36700 1 -- 172.21.15.157:0/1333814437 shutdown_connections 2023-10-16T19:57:17.380 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.371+0000 7f29f3a36700 1 --2- 172.21.15.157:0/1333814437 >> v2:172.21.15.157:3300/0 conn(0x7f29ec162730 0x7f29ec166c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:17.380 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.371+0000 7f29f3a36700 1 --2- 172.21.15.157:0/1333814437 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f29ec162b10 0x7f29ec06d0f0 secure :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f29e8009840 tx=0x7f29e8009b50 comp rx=0 tx=0).stop 2023-10-16T19:57:17.380 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.371+0000 7f29f3a36700 1 -- 172.21.15.157:0/1333814437 >> 172.21.15.157:0/1333814437 conn(0x7f29ec0cd4e0 msgr2=0x7f29ec0cd8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:17.381 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.371+0000 7f99b98b5700 1 Processor -- start 2023-10-16T19:57:17.381 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.371+0000 7f06067fc700 1 -- 172.21.15.157:0/2515725245 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05f8004230 con 0x7f06080708d0 2023-10-16T19:57:17.381 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.371+0000 7f06067fc700 1 -- 172.21.15.157:0/2515725245 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05f8004390 con 0x7f06080708d0 2023-10-16T19:57:17.382 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.371+0000 7f06067fc700 1 -- 172.21.15.157:0/2515725245 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05f800c870 con 0x7f06080708d0 2023-10-16T19:57:17.382 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.371+0000 7f99b98b5700 1 -- start start 2023-10-16T19:57:17.382 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.371+0000 7f29f3a36700 1 -- 172.21.15.157:0/1333814437 shutdown_connections 2023-10-16T19:57:17.383 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.369+0000 7f2bc6967700 1 Processor -- start 2023-10-16T19:57:17.383 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.369+0000 7f2bc6967700 1 -- start start 2023-10-16T19:57:17.383 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.370+0000 7f2bc6967700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2bc01446b0 0x7f2bc006e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:17.384 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.370+0000 7f2bc6967700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f2bc006b960 0x7f2bc006bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:17.384 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.370+0000 7f2bc6967700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2bc006e240 con 0x7f2bc015ea20 2023-10-16T19:57:17.384 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.370+0000 7f2bc6967700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bc006c320 con 0x7f2bc006b960 2023-10-16T19:57:17.384 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.370+0000 7f2bc6967700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bc015f780 con 0x7f2bc01446b0 2023-10-16T19:57:17.384 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.371+0000 7f2bbf7fe700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f2bc006b960 0x7f2bc006bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:17.385 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.371+0000 7f2bbf7fe700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f2bc006b960 0x7f2bc006bde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.157:40876/0 (socket says 172.21.15.157:40876) 2023-10-16T19:57:17.385 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.371+0000 7f2bbf7fe700 1 -- 172.21.15.157:0/4156037565 learned_addr learned my addr 172.21.15.157:0/4156037565 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:57:17.385 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.371+0000 7f2bbeffd700 1 -- 172.21.15.157:0/4156037565 <== mon.0 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2672127134 0 0) 0x7f2bc006e240 con 0x7f2bc015ea20 2023-10-16T19:57:17.385 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.371+0000 7f2bbeffd700 1 -- 172.21.15.157:0/4156037565 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2ba80035b0 con 0x7f2bc015ea20 2023-10-16T19:57:17.385 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.371+0000 7f2bbf7fe700 1 -- 172.21.15.157:0/4156037565 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2bc01446b0 msgr2=0x7f2bc006e6d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-16T19:57:17.386 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.371+0000 7f2bbf7fe700 1 --2- 172.21.15.157:0/4156037565 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2bc01446b0 0x7f2bc006e6d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:17.386 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.371+0000 7f2bbf7fe700 1 -- 172.21.15.157:0/4156037565 >> v1:172.21.15.157:6789/0 conn(0x7f2bc015ea20 legacy=0x7f2bc015eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:17.386 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.371+0000 7f2bbf7fe700 1 -- 172.21.15.157:0/4156037565 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bc006d950 con 0x7f2bc006b960 2023-10-16T19:57:17.386 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.372+0000 7f2bbf7fe700 1 --2- 172.21.15.157:0/4156037565 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2bc006b960 0x7f2bc006bde0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f2bb40098f0 tx=0x7f2bb4009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1b7a40bc0077482e server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:17.387 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.372+0000 7f99b98b5700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f99b415a120 0x7f99b406c410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:17.387 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.372+0000 7f99b98b5700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f99b415a500 0x7f99b40cefa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:17.387 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.372+0000 7f99b98b5700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99b40c9fa0 con 0x7f99b40af070 2023-10-16T19:57:17.387 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.372+0000 7f99b98b5700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99b40ca1f0 con 0x7f99b415a500 2023-10-16T19:57:17.388 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.372+0000 7f99b98b5700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99b40ca4d0 con 0x7f99b415a120 2023-10-16T19:57:17.388 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.372+0000 7f99b37fe700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f99b40af070 0x7f99b40cddb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:55444/0 (socket says 172.21.15.157:55444) 2023-10-16T19:57:17.388 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.372+0000 7f99b37fe700 1 -- 172.21.15.157:0/1465294171 learned_addr learned my addr 172.21.15.157:0/1465294171 (peer_addr_for_me v1:172.21.15.157:0/0) 2023-10-16T19:57:17.389 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.372+0000 7f2bbeffd700 1 -- 172.21.15.157:0/4156037565 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bb4011830 con 0x7f2bc006b960 2023-10-16T19:57:17.389 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.372+0000 7f2bbeffd700 1 -- 172.21.15.157:0/4156037565 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bb4011990 con 0x7f2bc006b960 2023-10-16T19:57:17.389 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.372+0000 7f2bbeffd700 1 -- 172.21.15.157:0/4156037565 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bb4011d20 con 0x7f2bc006b960 2023-10-16T19:57:17.389 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.373+0000 7f99b1ffb700 1 -- 172.21.15.157:0/1465294171 <== mon.0 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4288743211 0 0) 0x7f99b40c9fa0 con 0x7f99b40af070 2023-10-16T19:57:17.390 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.373+0000 7f99b1ffb700 1 -- 172.21.15.157:0/1465294171 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f999c0035b0 con 0x7f99b40af070 2023-10-16T19:57:17.390 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.372+0000 7f29f3a36700 1 -- 172.21.15.157:0/1333814437 wait complete. 2023-10-16T19:57:17.391 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.372+0000 7f060dbd7700 1 -- 172.21.15.157:0/2515725245 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f06080708d0 msgr2=0x7f06080cb780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:17.391 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.372+0000 7f060dbd7700 1 --2- 172.21.15.157:0/2515725245 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f06080708d0 0x7f06080cb780 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f05f800a9e0 tx=0x7f05f800acf0 comp rx=0 tx=0).stop 2023-10-16T19:57:17.391 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.372+0000 7f060dbd7700 1 -- 172.21.15.157:0/2515725245 shutdown_connections 2023-10-16T19:57:17.391 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.372+0000 7f060dbd7700 1 --2- 172.21.15.157:0/2515725245 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f06080708d0 0x7f06080cb780 secure :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f05f800a9e0 tx=0x7f05f800acf0 comp rx=0 tx=0).stop 2023-10-16T19:57:17.391 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.372+0000 7f060dbd7700 1 -- 172.21.15.157:0/2515725245 >> 172.21.15.157:0/2515725245 conn(0x7f06080cf950 msgr2=0x7f06080cfd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:17.392 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.373+0000 7f2bc6967700 1 -- 172.21.15.157:0/4156037565 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2bc006b960 msgr2=0x7f2bc006bde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:17.392 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.373+0000 7f2bc6967700 1 --2- 172.21.15.157:0/4156037565 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2bc006b960 0x7f2bc006bde0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f2bb40098f0 tx=0x7f2bb4009c00 comp rx=0 tx=0).stop 2023-10-16T19:57:17.392 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.373+0000 7f99b1ffb700 1 -- 172.21.15.157:0/1465294171 <== mon.0 v1:172.21.15.157:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2680095148 0 0) 0x7f999c0035b0 con 0x7f99b40af070 2023-10-16T19:57:17.393 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.373+0000 7f99b1ffb700 1 -- 172.21.15.157:0/1465294171 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f99b415a120 msgr2=0x7f99b406c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:57:17.393 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.373+0000 7f99b1ffb700 1 --2- 172.21.15.157:0/1465294171 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f99b415a120 0x7f99b406c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:17.393 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.373+0000 7f99b1ffb700 1 -- 172.21.15.157:0/1465294171 >> v2:172.21.15.187:3300/0 conn(0x7f99b415a500 msgr2=0x7f99b40cefa0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-16T19:57:17.393 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.373+0000 7f99b1ffb700 1 --2- 172.21.15.157:0/1465294171 >> v2:172.21.15.187:3300/0 conn(0x7f99b415a500 0x7f99b40cefa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:17.394 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.373+0000 7f99b1ffb700 1 -- 172.21.15.157:0/1465294171 --> v1:172.21.15.157:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99b40ca7b0 con 0x7f99b40af070 2023-10-16T19:57:17.394 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.373+0000 7f99b1ffb700 1 -- 172.21.15.157:0/1465294171 <== mon.0 v1:172.21.15.157:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4021145519 0 0) 0x7f99ac0019f0 con 0x7f99b40af070 2023-10-16T19:57:17.394 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.373+0000 7f99b1ffb700 1 -- 172.21.15.157:0/1465294171 >> v1:172.21.15.157:6789/0 conn(0x7f99b40af070 legacy=0x7f99b40cddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:17.394 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.373+0000 7f99b1ffb700 1 --2- 172.21.15.157:0/1465294171 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f999c003a00 0x7f999c003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:17.394 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.373+0000 7f99b1ffb700 1 --2- 172.21.15.157:0/1465294171 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f999c004850 0x7f999c004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:17.395 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.373+0000 7f99b1ffb700 1 --2- 172.21.15.157:0/1465294171 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f999c005330 0x7f999c00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:17.395 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.373+0000 7f99b1ffb700 1 -- 172.21.15.157:0/1465294171 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99b40ca1f0 con 0x7f999c003a00 2023-10-16T19:57:17.395 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.373+0000 7f99b1ffb700 1 -- 172.21.15.157:0/1465294171 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99b40ca4d0 con 0x7f999c004850 2023-10-16T19:57:17.395 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.373+0000 7f99b1ffb700 1 -- 172.21.15.157:0/1465294171 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f999c00c210 con 0x7f999c005330 2023-10-16T19:57:17.396 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.373+0000 7f29f3a36700 1 Processor -- start 2023-10-16T19:57:17.396 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.373+0000 7f060dbd7700 1 -- 172.21.15.157:0/2515725245 shutdown_connections 2023-10-16T19:57:17.396 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.374+0000 7f060dbd7700 1 -- 172.21.15.157:0/2515725245 wait complete. 2023-10-16T19:57:17.397 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.374+0000 7f2bc6967700 1 -- 172.21.15.157:0/4156037565 shutdown_connections 2023-10-16T19:57:17.397 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.374+0000 7f2bc6967700 1 --2- 172.21.15.157:0/4156037565 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2bc01446b0 0x7f2bc006e6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:17.397 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.374+0000 7f2bc6967700 1 --2- 172.21.15.157:0/4156037565 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2bc006b960 0x7f2bc006bde0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:17.397 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.374+0000 7f2bc6967700 1 -- 172.21.15.157:0/4156037565 >> 172.21.15.157:0/4156037565 conn(0x7f2bc00d0b50 msgr2=0x7f2bc00d0f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:17.398 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.374+0000 7f99b2ffd700 1 --2- 172.21.15.157:0/1465294171 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f999c003a00 0x7f999c003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:17.398 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.374+0000 7f99b37fe700 1 --2- 172.21.15.157:0/1465294171 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f999c005330 0x7f999c00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:17.399 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.374+0000 7f99b2ffd700 1 -- 172.21.15.157:0/1465294171 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f999c005330 msgr2=0x7f999c00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:57:17.399 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.374+0000 7f99b2ffd700 1 --2- 172.21.15.157:0/1465294171 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f999c005330 0x7f999c00ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:17.399 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.374+0000 7f99b2ffd700 1 -- 172.21.15.157:0/1465294171 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f999c004850 msgr2=0x7f999c004cd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-16T19:57:17.399 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.374+0000 7f99b2ffd700 1 --2- 172.21.15.157:0/1465294171 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f999c004850 0x7f999c004cd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:17.399 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.374+0000 7f99b2ffd700 1 -- 172.21.15.157:0/1465294171 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f999c0035b0 con 0x7f999c003a00 2023-10-16T19:57:17.400 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.374+0000 7f99b37fe700 1 --2- 172.21.15.157:0/1465294171 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f999c005330 0x7f999c00ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T19:57:17.400 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.374+0000 7f29f3a36700 1 -- start start 2023-10-16T19:57:17.400 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.374+0000 7f99b2ffd700 1 --2- 172.21.15.157:0/1465294171 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f999c003a00 0x7f999c003e20 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f99b40b25e0 tx=0x7f999c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3dc6ebf6a6405d2 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:17.401 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.374+0000 7f2bc6967700 1 -- 172.21.15.157:0/4156037565 shutdown_connections 2023-10-16T19:57:17.401 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.374+0000 7f2bc6967700 1 -- 172.21.15.157:0/4156037565 wait complete. 2023-10-16T19:57:17.402 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.374+0000 7f99b1ffb700 1 -- 172.21.15.157:0/1465294171 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99a4011620 con 0x7f999c003a00 2023-10-16T19:57:17.402 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.375+0000 7f99b1ffb700 1 -- 172.21.15.157:0/1465294171 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99a4011780 con 0x7f999c003a00 2023-10-16T19:57:17.402 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.375+0000 7f99b1ffb700 1 -- 172.21.15.157:0/1465294171 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99a4011b30 con 0x7f999c003a00 2023-10-16T19:57:17.403 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.375+0000 7f29f3a36700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f29ec0c3890 0x7f29ec0b50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:17.403 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.375+0000 7f29f3a36700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f29ec162730 0x7f29ec1647e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:17.403 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.375+0000 7f29f3a36700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f29ec164d20 0x7f29ec15fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:17.403 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.375+0000 7f29f3a36700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29ec0c7aa0 con 0x7f29ec162730 2023-10-16T19:57:17.404 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.375+0000 7f29f3a36700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29ec0b44d0 con 0x7f29ec164d20 2023-10-16T19:57:17.404 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.375+0000 7f29f3a36700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29ec1651b0 con 0x7f29ec0c3890 2023-10-16T19:57:17.404 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.375+0000 7f060dbd7700 1 Processor -- start 2023-10-16T19:57:17.405 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.375+0000 7f29f1fd3700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f29ec164d20 0x7f29ec15fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:17.405 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.375+0000 7f29f1fd3700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f29ec164d20 0x7f29ec15fcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.157:40890/0 (socket says 172.21.15.157:40890) 2023-10-16T19:57:17.405 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.375+0000 7f29f1fd3700 1 -- 172.21.15.157:0/1850526673 learned_addr learned my addr 172.21.15.157:0/1850526673 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:57:17.406 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.375+0000 7f29f17d2700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f29ec0c3890 0x7f29ec0b50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:17.406 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.375+0000 7f29f0fd1700 1 --2- 172.21.15.157:0/1850526673 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f29ec162730 0x7f29ec1647e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:17.406 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.376+0000 7f29f1fd3700 1 -- 172.21.15.157:0/1850526673 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f29ec0c3890 msgr2=0x7f29ec0b50e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:17.406 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.376+0000 7f29f1fd3700 1 --2- 172.21.15.157:0/1850526673 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f29ec0c3890 0x7f29ec0b50e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:17.407 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.376+0000 7f29f1fd3700 1 -- 172.21.15.157:0/1850526673 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f29ec162730 msgr2=0x7f29ec1647e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:17.407 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.376+0000 7f29f1fd3700 1 --2- 172.21.15.157:0/1850526673 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f29ec162730 0x7f29ec1647e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:17.407 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.376+0000 7f29f1fd3700 1 -- 172.21.15.157:0/1850526673 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29e80094a0 con 0x7f29ec164d20 2023-10-16T19:57:17.407 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.376+0000 7f29f1fd3700 1 --2- 172.21.15.157:0/1850526673 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f29ec164d20 0x7f29ec15fcf0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f29e400cba0 tx=0x7f29e400ceb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:17.408 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.375+0000 7f99b98b5700 1 -- 172.21.15.157:0/1465294171 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f999c003a00 msgr2=0x7f999c003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:17.408 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.375+0000 7f99b98b5700 1 --2- 172.21.15.157:0/1465294171 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f999c003a00 0x7f999c003e20 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f99b40b25e0 tx=0x7f999c005880 comp rx=0 tx=0).stop 2023-10-16T19:57:17.408 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.375+0000 7f99b37fe700 1 -- 172.21.15.157:0/1465294171 reap_dead start 2023-10-16T19:57:17.409 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.376+0000 7f29e1ffb700 1 -- 172.21.15.157:0/1850526673 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29e400aad0 con 0x7f29ec164d20 2023-10-16T19:57:17.409 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.376+0000 7f29e1ffb700 1 -- 172.21.15.157:0/1850526673 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29e400ac50 con 0x7f29ec164d20 2023-10-16T19:57:17.409 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.376+0000 7f29e1ffb700 1 -- 172.21.15.157:0/1850526673 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29e40070d0 con 0x7f29ec164d20 2023-10-16T19:57:17.409 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.376+0000 7f29f3a36700 1 -- 172.21.15.157:0/1850526673 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29ec0b38c0 con 0x7f29ec164d20 2023-10-16T19:57:17.410 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.376+0000 7f2bc6967700 1 Processor -- start 2023-10-16T19:57:17.410 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.376+0000 7f29f3a36700 1 -- 172.21.15.157:0/1850526673 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29ec0b3e80 con 0x7f29ec164d20 2023-10-16T19:57:17.411 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.375+0000 7f060dbd7700 1 -- start start 2023-10-16T19:57:17.411 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.377+0000 7f060dbd7700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f06080cbcc0 0x7f06081e7940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:17.411 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.377+0000 7f060dbd7700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0608159f00 0x7f0608158800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:17.413 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.377+0000 7f060dbd7700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f06080c6a20 0x7f06080ce1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:17.413 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.377+0000 7f060dbd7700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06080c8070 con 0x7f06080cbcc0 2023-10-16T19:57:17.413 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.377+0000 7f060dbd7700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06080c7a80 con 0x7f0608159f00 2023-10-16T19:57:17.414 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.377+0000 7f060dbd7700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0608158d40 con 0x7f06080c6a20 2023-10-16T19:57:17.414 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.376+0000 7f7e9a0ed700 1 Processor -- start 2023-10-16T19:57:17.414 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.376+0000 7f7e9a0ed700 1 -- start start 2023-10-16T19:57:17.415 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.377+0000 7f0607fff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f06080c6a20 0x7f06080ce1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:17.415 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.377+0000 7f0607fff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f06080c6a20 0x7f06080ce1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.157:55096/0 (socket says 172.21.15.157:55096) 2023-10-16T19:57:17.415 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.377+0000 7f0607fff700 1 -- 172.21.15.157:0/3846558239 learned_addr learned my addr 172.21.15.157:0/3846558239 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:57:17.416 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.377+0000 7f2bc6967700 1 -- start start 2023-10-16T19:57:17.416 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.377+0000 7feba115f700 1 Processor -- start 2023-10-16T19:57:17.416 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.377+0000 7feba115f700 1 -- start start 2023-10-16T19:57:17.417 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.377+0000 7fc47b8ac700 1 Processor -- start 2023-10-16T19:57:17.417 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.378+0000 7f2bc6967700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2bc006b960 0x7f2bc013e970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:17.417 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.378+0000 7f2bc6967700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2bc01446b0 0x7f2bc015c360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:17.418 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.378+0000 7f2bc6967700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2bc015ea20 0x7f2bc015dce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:17.418 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.378+0000 7f2bc6967700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bc015cc40 con 0x7f2bc01446b0 2023-10-16T19:57:17.418 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.378+0000 7f2bc6967700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bc015cf20 con 0x7f2bc015ea20 2023-10-16T19:57:17.418 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.378+0000 7f2bc6967700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bc015d200 con 0x7f2bc006b960 2023-10-16T19:57:17.419 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.377+0000 7f99b98b5700 1 -- 172.21.15.157:0/1465294171 shutdown_connections 2023-10-16T19:57:17.419 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.377+0000 7f99b98b5700 1 -- 172.21.15.157:0/1465294171 >> 172.21.15.157:0/1465294171 conn(0x7f99b40cf950 msgr2=0x7f99b40cfd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:17.420 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.378+0000 7f2bbffff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2bc006b960 0x7f2bc013e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:17.420 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.378+0000 7f2bbffff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2bc006b960 0x7f2bc013e970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.157:55102/0 (socket says 172.21.15.157:55102) 2023-10-16T19:57:17.420 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.378+0000 7f2bbffff700 1 -- 172.21.15.157:0/2243750634 learned_addr learned my addr 172.21.15.157:0/2243750634 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:57:17.420 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.378+0000 7f2bc4f04700 1 --2- 172.21.15.157:0/2243750634 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2bc015ea20 0x7f2bc015dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:17.421 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.378+0000 7f2bbf7fe700 1 --2- 172.21.15.157:0/2243750634 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2bc01446b0 0x7f2bc015c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:17.421 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.378+0000 7f2bbffff700 1 -- 172.21.15.157:0/2243750634 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2bc015ea20 msgr2=0x7f2bc015dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:17.421 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.378+0000 7f2bbffff700 1 --2- 172.21.15.157:0/2243750634 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2bc015ea20 0x7f2bc015dce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:17.421 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.379+0000 7f2bbffff700 1 -- 172.21.15.157:0/2243750634 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2bc01446b0 msgr2=0x7f2bc015c360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:17.421 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.379+0000 7f2bbffff700 1 --2- 172.21.15.157:0/2243750634 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2bc01446b0 0x7f2bc015c360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:17.421 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.379+0000 7f2bbffff700 1 -- 172.21.15.157:0/2243750634 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bb4009550 con 0x7f2bc006b960 2023-10-16T19:57:17.422 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.379+0000 7f2bbffff700 1 --2- 172.21.15.157:0/2243750634 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2bc006b960 0x7f2bc013e970 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f2bb000b550 tx=0x7f2bb000b860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:17.422 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.379+0000 7f99b98b5700 1 -- 172.21.15.157:0/1465294171 shutdown_connections 2023-10-16T19:57:17.423 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.379+0000 7feba115f700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7feb9c15de60 0x7feb9c070ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:17.423 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.379+0000 7feba115f700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7feb9c1626d0 0x7feb9c161b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:17.423 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.379+0000 7feba115f700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb9c0adf70 con 0x7feb9c15e240 2023-10-16T19:57:17.423 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.379+0000 7feba115f700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb9c071900 con 0x7feb9c15de60 2023-10-16T19:57:17.424 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.379+0000 7feba115f700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb9c0cab20 con 0x7feb9c1626d0 2023-10-16T19:57:17.424 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.379+0000 7feb9ad9d700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7feb9c15de60 0x7feb9c070ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:17.424 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.379+0000 7feb9ad9d700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7feb9c15de60 0x7feb9c070ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:45806/0 (socket says 172.21.15.157:45806) 2023-10-16T19:57:17.424 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.379+0000 7feb9ad9d700 1 -- 172.21.15.157:0/1560935771 learned_addr learned my addr 172.21.15.157:0/1560935771 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:57:17.425 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.378+0000 7f0606ffd700 1 --2- 172.21.15.157:0/3846558239 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0608159f00 0x7f0608158800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:17.426 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.378+0000 7f06077fe700 1 --2- 172.21.15.157:0/3846558239 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f06080cbcc0 0x7f06081e7940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:17.426 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.378+0000 7f0607fff700 1 -- 172.21.15.157:0/3846558239 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0608159f00 msgr2=0x7f0608158800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:17.426 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.378+0000 7f0607fff700 1 --2- 172.21.15.157:0/3846558239 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0608159f00 0x7f0608158800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:17.426 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.378+0000 7f0607fff700 1 -- 172.21.15.157:0/3846558239 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f06080cbcc0 msgr2=0x7f06081e7940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:17.426 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.378+0000 7f0607fff700 1 --2- 172.21.15.157:0/3846558239 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f06080cbcc0 0x7f06081e7940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:17.427 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.378+0000 7f0607fff700 1 -- 172.21.15.157:0/3846558239 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05f800a640 con 0x7f06080c6a20 2023-10-16T19:57:17.427 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.378+0000 7f0607fff700 1 --2- 172.21.15.157:0/3846558239 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f06080c6a20 0x7f06080ce1b0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f060000c8c0 tx=0x7f060000cc80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:17.427 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.378+0000 7f05effff700 1 -- 172.21.15.157:0/3846558239 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0600003e30 con 0x7f06080c6a20 2023-10-16T19:57:17.427 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.379+0000 7f05effff700 1 -- 172.21.15.157:0/3846558239 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0600005070 con 0x7f06080c6a20 2023-10-16T19:57:17.427 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.379+0000 7f05effff700 1 -- 172.21.15.157:0/3846558239 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0600005420 con 0x7f06080c6a20 2023-10-16T19:57:17.428 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.379+0000 7f060dbd7700 1 -- 172.21.15.157:0/3846558239 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06081f8120 con 0x7f06080c6a20 2023-10-16T19:57:17.428 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.379+0000 7f060dbd7700 1 -- 172.21.15.157:0/3846558239 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06080c74c0 con 0x7f06080c6a20 2023-10-16T19:57:17.428 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.379+0000 7f2bbcff9700 1 -- 172.21.15.157:0/2243750634 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bb0011830 con 0x7f2bc006b960 2023-10-16T19:57:17.428 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.379+0000 7f2bbcff9700 1 -- 172.21.15.157:0/2243750634 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bb0011990 con 0x7f2bc006b960 2023-10-16T19:57:17.429 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.379+0000 7f2bbcff9700 1 -- 172.21.15.157:0/2243750634 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bb0011d20 con 0x7f2bc006b960 2023-10-16T19:57:17.429 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.379+0000 7f2bc6967700 1 -- 172.21.15.157:0/2243750634 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bc015d4e0 con 0x7f2bc006b960 2023-10-16T19:57:17.429 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.379+0000 7f2bc6967700 1 -- 172.21.15.157:0/2243750634 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bc015c8a0 con 0x7f2bc006b960 2023-10-16T19:57:17.429 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.379+0000 7feb9b59e700 1 --2- 172.21.15.157:0/1560935771 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7feb9c1626d0 0x7feb9c161b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:17.430 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.378+0000 7f7e9a0ed700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f7e940aee90 0x7f7e940cdf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:17.430 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.378+0000 7f7e9a0ed700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e940cef70 con 0x7f7e9416a7f0 2023-10-16T19:57:17.430 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.378+0000 7f7e9a0ed700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e940ce470 con 0x7f7e94070660 2023-10-16T19:57:17.430 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.378+0000 7f7e9a0ed700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e940ce9b0 con 0x7f7e940aee90 2023-10-16T19:57:17.431 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.378+0000 7f7e92ffd700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f7e9416a7f0 0x7f7e9406ff50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:55466/0 (socket says 172.21.15.157:55466) 2023-10-16T19:57:17.431 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.378+0000 7f7e92ffd700 1 -- 172.21.15.157:0/66244252 learned_addr learned my addr 172.21.15.157:0/66244252 (peer_addr_for_me v1:172.21.15.157:0/0) 2023-10-16T19:57:17.431 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.378+0000 7f7e927fc700 1 -- 172.21.15.157:0/66244252 <== mon.0 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 620614665 0 0) 0x7f7e7c001110 con 0x7f7e9416a7f0 2023-10-16T19:57:17.431 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.380+0000 7f2bc6967700 1 -- 172.21.15.157:0/2243750634 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2ba0000fc0 con 0x7f2bc006b960 2023-10-16T19:57:17.432 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.378+0000 7fc47b8ac700 1 -- start start 2023-10-16T19:57:17.432 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.379+0000 7fc47b8ac700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fc474159f00 0x7fc47415da70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:17.432 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.379+0000 7fc47b8ac700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc4740708d0 0x7fc4740cb780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:17.432 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.379+0000 7fc47b8ac700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fc4740cbcc0 0x7fc4740ca290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:17.433 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.379+0000 7fc47b8ac700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4740cc150 con 0x7fc4740cbcc0 2023-10-16T19:57:17.433 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.379+0000 7fc47b8ac700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc47415a2e0 con 0x7fc474159f00 2023-10-16T19:57:17.433 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.379+0000 7fc47b8ac700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc47415e2c0 con 0x7fc4740708d0 2023-10-16T19:57:17.433 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.380+0000 7fc479648700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fc474159f00 0x7fc47415da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:17.433 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.380+0000 7fc479648700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fc474159f00 0x7fc47415da70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.157:40924/0 (socket says 172.21.15.157:40924) 2023-10-16T19:57:17.434 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.380+0000 7fc479648700 1 -- 172.21.15.157:0/2760409854 learned_addr learned my addr 172.21.15.157:0/2760409854 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:57:17.434 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.380+0000 7f99b98b5700 1 -- 172.21.15.157:0/1465294171 wait complete. 2023-10-16T19:57:17.434 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.380+0000 7feb9b59e700 1 -- 172.21.15.157:0/1560935771 >> v2:172.21.15.157:3300/0 conn(0x7feb9c15de60 msgr2=0x7feb9c070ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:57:17.435 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.380+0000 7feb9b59e700 1 --2- 172.21.15.157:0/1560935771 >> v2:172.21.15.157:3300/0 conn(0x7feb9c15de60 0x7feb9c070ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:17.435 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.380+0000 7feb9b59e700 1 -- 172.21.15.157:0/1560935771 >> v1:172.21.15.157:6789/0 conn(0x7feb9c15e240 legacy=0x7feb9c0ad860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:17.435 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.380+0000 7feb9b59e700 1 -- 172.21.15.157:0/1560935771 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb9c0cae00 con 0x7feb9c1626d0 2023-10-16T19:57:17.435 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.380+0000 7feb9b59e700 1 --2- 172.21.15.157:0/1560935771 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7feb9c1626d0 0x7feb9c161b30 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7feb9c0ae160 tx=0x7feb9400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ef20e174f2e3d23e server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:17.436 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.380+0000 7f060dbd7700 1 -- 172.21.15.157:0/3846558239 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f05e8000fc0 con 0x7f06080c6a20 2023-10-16T19:57:17.436 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.378+0000 7f7e927fc700 1 -- 172.21.15.157:0/66244252 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7e8000bdc0 con 0x7f7e9416a7f0 2023-10-16T19:57:17.436 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.379+0000 7f7e937fe700 1 --2- 172.21.15.157:0/66244252 >> v2:172.21.15.157:3300/0 conn(0x7f7e940aee90 0x7f7e940cdf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:17.437 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.379+0000 7f7e927fc700 1 -- 172.21.15.157:0/66244252 <== mon.0 v1:172.21.15.157:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 917833241 0 0) 0x7f7e8000bdc0 con 0x7f7e9416a7f0 2023-10-16T19:57:17.437 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.379+0000 7f7e927fc700 1 -- 172.21.15.157:0/66244252 >> v2:172.21.15.157:3300/0 conn(0x7f7e940aee90 msgr2=0x7f7e940cdf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:57:17.437 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.379+0000 7f7e927fc700 1 --2- 172.21.15.157:0/66244252 >> v2:172.21.15.157:3300/0 conn(0x7f7e940aee90 0x7f7e940cdf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:17.437 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.379+0000 7f7e927fc700 1 -- 172.21.15.157:0/66244252 >> v1:172.21.15.187:6789/0 conn(0x7f7e94070660 legacy=0x7f7e9408b060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:57:17.437 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.379+0000 7f7e927fc700 1 -- 172.21.15.157:0/66244252 --> v1:172.21.15.157:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e940cec90 con 0x7f7e9416a7f0 2023-10-16T19:57:17.438 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.379+0000 7f7e927fc700 1 -- 172.21.15.157:0/66244252 <== mon.0 v1:172.21.15.157:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4021145519 0 0) 0x7f7e7c001800 con 0x7f7e9416a7f0 2023-10-16T19:57:17.438 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.379+0000 7f7e927fc700 1 -- 172.21.15.157:0/66244252 >> v1:172.21.15.157:6789/0 conn(0x7f7e9416a7f0 legacy=0x7f7e9406ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:17.438 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.379+0000 7f7e927fc700 1 --2- 172.21.15.157:0/66244252 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7e8000c210 0x7f7e8000c610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:17.438 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.379+0000 7f7e927fc700 1 --2- 172.21.15.157:0/66244252 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7e8000d060 0x7f7e8000d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:17.438 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.379+0000 7f7e927fc700 1 --2- 172.21.15.157:0/66244252 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7e8000da20 0x7f7e800094e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:17.439 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.379+0000 7f7e927fc700 1 -- 172.21.15.157:0/66244252 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e940ce9b0 con 0x7f7e8000c210 2023-10-16T19:57:17.439 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.379+0000 7f7e927fc700 1 -- 172.21.15.157:0/66244252 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e80009c30 con 0x7f7e8000d060 2023-10-16T19:57:17.439 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.379+0000 7f7e927fc700 1 -- 172.21.15.157:0/66244252 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e80009df0 con 0x7f7e8000da20 2023-10-16T19:57:17.439 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.379+0000 7f7e92ffd700 1 --2- 172.21.15.157:0/66244252 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7e8000d060 0x7f7e8000d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:17.439 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.381+0000 7f7e93fff700 1 --2- 172.21.15.157:0/66244252 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7e8000da20 0x7f7e800094e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:17.440 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.381+0000 7fc479e49700 1 --2- 172.21.15.157:0/2760409854 >> v2:172.21.15.157:3300/0 conn(0x7fc4740cbcc0 0x7fc4740ca290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:17.440 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.381+0000 7f7e92ffd700 1 -- 172.21.15.157:0/66244252 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7e8000da20 msgr2=0x7f7e800094e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:57:17.441 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.381+0000 7f7e92ffd700 1 --2- 172.21.15.157:0/66244252 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7e8000da20 0x7f7e800094e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:17.441 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.381+0000 7f7e92ffd700 1 -- 172.21.15.157:0/66244252 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7e8000c210 msgr2=0x7f7e8000c610 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-16T19:57:17.441 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.381+0000 7f7e92ffd700 1 --2- 172.21.15.157:0/66244252 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7e8000c210 0x7f7e8000c610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:17.441 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.381+0000 7f7e92ffd700 1 -- 172.21.15.157:0/66244252 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e940cec90 con 0x7f7e8000d060 2023-10-16T19:57:17.441 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.381+0000 7f7e93fff700 1 -- 172.21.15.157:0/66244252 reap_dead start 2023-10-16T19:57:17.442 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.381+0000 7f29e1ffb700 1 -- 172.21.15.157:0/1850526673 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f29e4007230 con 0x7f29ec164d20 2023-10-16T19:57:17.442 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.381+0000 7f29e1ffb700 1 --2- 172.21.15.157:0/1850526673 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f29d006afd0 0x7f29d006d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:17.442 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.381+0000 7f29e1ffb700 1 -- 172.21.15.157:0/1850526673 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f29e4089550 con 0x7f29ec164d20 2023-10-16T19:57:17.443 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.381+0000 7f7e92ffd700 1 --2- 172.21.15.157:0/66244252 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7e8000d060 0x7f7e8000d4e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f7e7c001eb0 tx=0x7f7e8000e090 comp rx=0 tx=0).ready entity=mon.1 client_cookie=39807d805f5dc6ed server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:17.443 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.382+0000 7f7e927fc700 1 -- 172.21.15.157:0/66244252 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e7c02ecc0 con 0x7f7e8000d060 2023-10-16T19:57:17.443 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.382+0000 7f7e927fc700 1 -- 172.21.15.157:0/66244252 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e7c02ee20 con 0x7f7e8000d060 2023-10-16T19:57:17.444 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.382+0000 7f7e927fc700 1 -- 172.21.15.157:0/66244252 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e7c005ba0 con 0x7f7e8000d060 2023-10-16T19:57:17.444 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.382+0000 7fc479648700 1 -- 172.21.15.157:0/2760409854 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc4740708d0 msgr2=0x7fc4740cb780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:57:17.444 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.382+0000 7fc479648700 1 --2- 172.21.15.157:0/2760409854 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc4740708d0 0x7fc4740cb780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:17.444 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.382+0000 7fc479648700 1 -- 172.21.15.157:0/2760409854 >> v2:172.21.15.157:3300/0 conn(0x7fc4740cbcc0 msgr2=0x7fc4740ca290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:57:17.445 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.382+0000 7fc479648700 1 --2- 172.21.15.157:0/2760409854 >> v2:172.21.15.157:3300/0 conn(0x7fc4740cbcc0 0x7fc4740ca290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:17.445 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.382+0000 7fc479648700 1 -- 172.21.15.157:0/2760409854 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc47415e5a0 con 0x7fc474159f00 2023-10-16T19:57:17.445 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.382+0000 7f29f17d2700 1 --2- 172.21.15.157:0/1850526673 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f29d006afd0 0x7f29d006d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:17.446 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.383+0000 7f7e9a0ed700 1 -- 172.21.15.157:0/66244252 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7e8000d060 msgr2=0x7f7e8000d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:17.446 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.383+0000 7f7e9a0ed700 1 --2- 172.21.15.157:0/66244252 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7e8000d060 0x7f7e8000d4e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f7e7c001eb0 tx=0x7f7e8000e090 comp rx=0 tx=0).stop 2023-10-16T19:57:17.446 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.381+0000 7f2bbcff9700 1 -- 172.21.15.157:0/2243750634 <== mon.2 v2:172.21.15.187:3301/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f2bb0004020 con 0x7f2bc006b960 2023-10-16T19:57:17.447 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.382+0000 7f2bbcff9700 1 --2- 172.21.15.157:0/2243750634 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f2bac06af80 0x7f2bac06d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:17.447 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.382+0000 7f2bbcff9700 1 -- 172.21.15.157:0/2243750634 <== mon.2 v2:172.21.15.187:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2bb0089230 con 0x7f2bc006b960 2023-10-16T19:57:17.447 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.382+0000 7f2bbf7fe700 1 --2- 172.21.15.157:0/2243750634 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f2bac06af80 0x7f2bac06d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:17.447 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.382+0000 7f2bbcff9700 1 --2- 172.21.15.157:0/2243750634 >> [v2:172.21.15.157:6824/1118292389,v1:172.21.15.157:6825/1118292389] conn(0x7f2bac0731a0 0x7f2bac0755c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:17.447 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.382+0000 7f2bbcff9700 1 -- 172.21.15.157:0/2243750634 --> [v2:172.21.15.157:6824/1118292389,v1:172.21.15.157:6825/1118292389] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2bac075c70 con 0x7f2bac0731a0 2023-10-16T19:57:17.448 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.382+0000 7f2bbcff9700 1 -- 172.21.15.157:0/2243750634 <== mon.2 v2:172.21.15.187:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2bb00895a0 con 0x7f2bc006b960 2023-10-16T19:57:17.448 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.382+0000 7f2bc4f04700 1 --2- 172.21.15.157:0/2243750634 >> [v2:172.21.15.157:6824/1118292389,v1:172.21.15.157:6825/1118292389] conn(0x7f2bac0731a0 0x7f2bac0755c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:17.448 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.382+0000 7fc479648700 1 --2- 172.21.15.157:0/2760409854 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc474159f00 0x7fc47415da70 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc4740b25e0 tx=0x7fc46c00d650 comp rx=0 tx=0).ready entity=mon.1 client_cookie=279d56a976d4756e server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:17.448 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.382+0000 7fc46bfff700 1 -- 172.21.15.157:0/2760409854 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc46c007d30 con 0x7fc474159f00 2023-10-16T19:57:17.449 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.382+0000 7fc46bfff700 1 -- 172.21.15.157:0/2760409854 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc46c007e90 con 0x7fc474159f00 2023-10-16T19:57:17.449 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.382+0000 7fc46bfff700 1 -- 172.21.15.157:0/2760409854 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc46c003c40 con 0x7fc474159f00 2023-10-16T19:57:17.449 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.382+0000 7f99b98b5700 1 Processor -- start 2023-10-16T19:57:17.449 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.383+0000 7f99b98b5700 1 -- start start 2023-10-16T19:57:17.450 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.382+0000 7f29f3a36700 1 --2- 172.21.15.157:0/1850526673 >> [v2:172.21.15.187:6802/915130263,v1:172.21.15.187:6805/915130263] conn(0x7f29ec06eb20 0x7f29ec203f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:17.450 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.382+0000 7f29f3a36700 1 -- 172.21.15.157:0/1850526673 --> [v2:172.21.15.187:6802/915130263,v1:172.21.15.187:6805/915130263] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f29ec160740 con 0x7f29ec06eb20 2023-10-16T19:57:17.450 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.383+0000 7f29f0fd1700 1 --2- 172.21.15.157:0/1850526673 >> [v2:172.21.15.187:6802/915130263,v1:172.21.15.187:6805/915130263] conn(0x7f29ec06eb20 0x7f29ec203f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:17.451 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.383+0000 7feb99d9b700 1 -- 172.21.15.157:0/1560935771 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb94016070 con 0x7feb9c1626d0 2023-10-16T19:57:17.451 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.383+0000 7feb99d9b700 1 -- 172.21.15.157:0/1560935771 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb9400bbd0 con 0x7feb9c1626d0 2023-10-16T19:57:17.451 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.383+0000 7feb99d9b700 1 -- 172.21.15.157:0/1560935771 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb9400e070 con 0x7feb9c1626d0 2023-10-16T19:57:17.452 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.381+0000 7f05effff700 1 -- 172.21.15.157:0/3846558239 <== mon.2 v2:172.21.15.187:3301/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f0600005580 con 0x7f06080c6a20 2023-10-16T19:57:17.452 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.382+0000 7f05effff700 1 --2- 172.21.15.157:0/3846558239 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f05f406afd0 0x7f05f406d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:17.452 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.382+0000 7f05effff700 1 -- 172.21.15.157:0/3846558239 <== mon.2 v2:172.21.15.187:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0600088dd0 con 0x7f06080c6a20 2023-10-16T19:57:17.452 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.382+0000 7f05effff700 1 --2- 172.21.15.157:0/3846558239 >> [v2:172.21.15.187:6824/4284059445,v1:172.21.15.187:6825/4284059445] conn(0x7f05f4073170 0x7f05f4075590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:17.453 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.382+0000 7f05effff700 1 -- 172.21.15.157:0/3846558239 --> [v2:172.21.15.187:6824/4284059445,v1:172.21.15.187:6825/4284059445] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f05f4075c40 con 0x7f05f4073170 2023-10-16T19:57:17.453 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.382+0000 7f0606ffd700 1 --2- 172.21.15.157:0/3846558239 >> [v2:172.21.15.187:6824/4284059445,v1:172.21.15.187:6825/4284059445] conn(0x7f05f4073170 0x7f05f4075590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:17.453 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.382+0000 7f06077fe700 1 --2- 172.21.15.157:0/3846558239 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f05f406afd0 0x7f05f406d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:17.453 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.383+0000 7f05effff700 1 -- 172.21.15.157:0/3846558239 <== mon.2 v2:172.21.15.187:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0600053e60 con 0x7f06080c6a20 2023-10-16T19:57:17.453 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.383+0000 7f0606ffd700 1 --2- 172.21.15.157:0/3846558239 >> [v2:172.21.15.187:6824/4284059445,v1:172.21.15.187:6825/4284059445] conn(0x7f05f4073170 0x7f05f4075590 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:17.454 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.383+0000 7f06077fe700 1 --2- 172.21.15.157:0/3846558239 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f05f406afd0 0x7f05f406d490 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f05fc0048d0 tx=0x7f05fc007eb0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:17.454 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.383+0000 7f7e9a0ed700 1 -- 172.21.15.157:0/66244252 shutdown_connections 2023-10-16T19:57:17.454 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.383+0000 7f7e9a0ed700 1 --2- 172.21.15.157:0/66244252 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7e8000d060 0x7f7e8000d4e0 secure :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f7e7c001eb0 tx=0x7f7e8000e090 comp rx=0 tx=0).stop 2023-10-16T19:57:17.454 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.383+0000 7f7e9a0ed700 1 -- 172.21.15.157:0/66244252 >> 172.21.15.157:0/66244252 conn(0x7f7e940cf950 msgr2=0x7f7e940cfd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:17.455 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.383+0000 7f29f0fd1700 1 --2- 172.21.15.157:0/1850526673 >> [v2:172.21.15.187:6802/915130263,v1:172.21.15.187:6805/915130263] conn(0x7f29ec06eb20 0x7f29ec203f70 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:17.455 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.383+0000 7f2bc4f04700 1 --2- 172.21.15.157:0/2243750634 >> [v2:172.21.15.157:6824/1118292389,v1:172.21.15.157:6825/1118292389] conn(0x7f2bac0731a0 0x7f2bac0755c0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:17.456 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.384+0000 7f7e9a0ed700 1 -- 172.21.15.157:0/66244252 shutdown_connections 2023-10-16T19:57:17.456 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.384+0000 7feba115f700 1 -- 172.21.15.157:0/1560935771 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7feb9c1626d0 msgr2=0x7feb9c161b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:17.456 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.384+0000 7feba115f700 1 --2- 172.21.15.157:0/1560935771 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7feb9c1626d0 0x7feb9c161b30 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7feb9c0ae160 tx=0x7feb9400b330 comp rx=0 tx=0).stop 2023-10-16T19:57:17.457 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.384+0000 7f05effff700 1 -- 172.21.15.157:0/3846558239 <== osd.7 v2:172.21.15.187:6824/4284059445 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23595 (crc 0 0 0) 0x7f05f4075c40 con 0x7f05f4073170 2023-10-16T19:57:17.457 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.384+0000 7f7e9a0ed700 1 -- 172.21.15.157:0/66244252 wait complete. 2023-10-16T19:57:17.458 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.384+0000 7f2bbcff9700 1 -- 172.21.15.157:0/2243750634 <== osd.2 v2:172.21.15.157:6824/1118292389 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23595 (crc 0 0 0) 0x7f2bac075c70 con 0x7f2bac0731a0 2023-10-16T19:57:17.458 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.384+0000 7f2bbf7fe700 1 --2- 172.21.15.157:0/2243750634 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f2bac06af80 0x7f2bac06d440 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f2bb4000c00 tx=0x7f2bb401d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:17.458 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.384+0000 7feba115f700 1 -- 172.21.15.157:0/1560935771 shutdown_connections 2023-10-16T19:57:17.459 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.384+0000 7feba115f700 1 --2- 172.21.15.157:0/1560935771 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7feb9c1626d0 0x7feb9c161b30 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:17.459 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.384+0000 7feba115f700 1 --2- 172.21.15.157:0/1560935771 >> v2:172.21.15.157:3300/0 conn(0x7feb9c15de60 0x7feb9c070ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:17.459 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.384+0000 7feba115f700 1 -- 172.21.15.157:0/1560935771 >> 172.21.15.157:0/1560935771 conn(0x7feb9c0cf950 msgr2=0x7feb9c0cfd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:17.460 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.384+0000 7f99b98b5700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f999c003a00 0x7f99b40c53a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:17.460 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.384+0000 7f99b98b5700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f99b4146910 0x7f99b4158a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:17.460 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.384+0000 7f99b98b5700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f99b406df80 0x7f99b406e400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:17.460 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.384+0000 7f99b98b5700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99b406e940 con 0x7f999c003a00 2023-10-16T19:57:17.460 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.384+0000 7f99b98b5700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99b4150130 con 0x7f99b4146910 2023-10-16T19:57:17.461 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.384+0000 7f99b98b5700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99b40c5a60 con 0x7f99b406df80 2023-10-16T19:57:17.461 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.384+0000 7f29f17d2700 1 --2- 172.21.15.157:0/1850526673 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f29d006afd0 0x7f29d006d490 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f29dc006fd0 tx=0x7f29dc009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:17.461 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.384+0000 7f99b2ffd700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f999c003a00 0x7f99b40c53a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:17.462 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.384+0000 7f99b2ffd700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f999c003a00 0x7f99b40c53a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:45834/0 (socket says 172.21.15.157:45834) 2023-10-16T19:57:17.462 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.384+0000 7f99b2ffd700 1 -- 172.21.15.157:0/3602937403 learned_addr learned my addr 172.21.15.157:0/3602937403 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:57:17.462 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.384+0000 7f29e1ffb700 1 -- 172.21.15.157:0/1850526673 <== osd.5 v2:172.21.15.187:6802/915130263 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23595 (crc 0 0 0) 0x7f29ec160740 con 0x7f29ec06eb20 2023-10-16T19:57:17.463 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.384+0000 7feba115f700 1 -- 172.21.15.157:0/1560935771 shutdown_connections 2023-10-16T19:57:17.463 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.384+0000 7feba115f700 1 -- 172.21.15.157:0/1560935771 wait complete. 2023-10-16T19:57:17.463 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.384+0000 7f99b27fc700 1 --2- 172.21.15.157:0/3602937403 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f99b4146910 0x7f99b4158a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:17.464 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.384+0000 7f99b37fe700 1 --2- 172.21.15.157:0/3602937403 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f99b406df80 0x7f99b406e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:17.464 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.385+0000 7fc47b8ac700 1 -- 172.21.15.157:0/2760409854 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc474159f00 msgr2=0x7fc47415da70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:17.464 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.385+0000 7fc47b8ac700 1 --2- 172.21.15.157:0/2760409854 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc474159f00 0x7fc47415da70 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc4740b25e0 tx=0x7fc46c00d650 comp rx=0 tx=0).stop 2023-10-16T19:57:17.465 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.384+0000 7f99b27fc700 1 -- 172.21.15.157:0/3602937403 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f99b406df80 msgr2=0x7f99b406e400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:17.465 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.384+0000 7f99b27fc700 1 --2- 172.21.15.157:0/3602937403 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f99b406df80 0x7f99b406e400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:17.465 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.384+0000 7f99b27fc700 1 -- 172.21.15.157:0/3602937403 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f999c003a00 msgr2=0x7f99b40c53a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:17.466 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.384+0000 7f99b27fc700 1 --2- 172.21.15.157:0/3602937403 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f999c003a00 0x7f99b40c53a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:17.466 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.384+0000 7f99b27fc700 1 -- 172.21.15.157:0/3602937403 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99b40c5d40 con 0x7f99b4146910 2023-10-16T19:57:17.466 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.385+0000 7fc47b8ac700 1 -- 172.21.15.157:0/2760409854 shutdown_connections 2023-10-16T19:57:17.466 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.385+0000 7fc47b8ac700 1 --2- 172.21.15.157:0/2760409854 >> v2:172.21.15.157:3300/0 conn(0x7fc4740cbcc0 0x7fc4740ca290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:17.467 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.385+0000 7fc47b8ac700 1 --2- 172.21.15.157:0/2760409854 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc474159f00 0x7fc47415da70 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:17.467 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.385+0000 7fc47b8ac700 1 --2- 172.21.15.157:0/2760409854 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc4740708d0 0x7fc4740cb780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:17.467 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.385+0000 7fc47b8ac700 1 -- 172.21.15.157:0/2760409854 >> 172.21.15.157:0/2760409854 conn(0x7fc4740cf950 msgr2=0x7fc4740cfd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:17.467 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.385+0000 7f7e9a0ed700 1 Processor -- start 2023-10-16T19:57:17.468 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.385+0000 7f99b27fc700 1 --2- 172.21.15.157:0/3602937403 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f99b4146910 0x7f99b4158a00 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f99a800b3c0 tx=0x7f99a800b6d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:17.468 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.386+0000 7f99a3fff700 1 -- 172.21.15.157:0/3602937403 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99a8011830 con 0x7f99b4146910 2023-10-16T19:57:17.468 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.386+0000 7f99a3fff700 1 -- 172.21.15.157:0/3602937403 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99a80119b0 con 0x7f99b4146910 2023-10-16T19:57:17.469 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.386+0000 7f99a3fff700 1 -- 172.21.15.157:0/3602937403 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99a8011d60 con 0x7f99b4146910 2023-10-16T19:57:17.469 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.386+0000 7feba115f700 1 Processor -- start 2023-10-16T19:57:17.470 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.386+0000 7f7e9a0ed700 1 -- start start 2023-10-16T19:57:17.470 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.387+0000 7f7e9a0ed700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7e94169cf0 0x7f7e9416ba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:17.470 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.387+0000 7f7e9a0ed700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7e940ae0b0 0x7f7e9416d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:17.470 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.387+0000 7f7e9a0ed700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7e9416d690 0x7f7e942037a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:17.470 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.387+0000 7f7e9a0ed700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e9416cb40 con 0x7f7e94169cf0 2023-10-16T19:57:17.471 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.387+0000 7f7e9a0ed700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e9416db10 con 0x7f7e940ae0b0 2023-10-16T19:57:17.471 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.387+0000 7f7e9a0ed700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e940c36b0 con 0x7f7e9416d690 2023-10-16T19:57:17.471 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.386+0000 7feba115f700 1 -- start start 2023-10-16T19:57:17.471 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.387+0000 7feba115f700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feb9c15de60 0x7feb9c146a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:17.472 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.387+0000 7feba115f700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7feb9c1626d0 0x7feb9c06d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:17.472 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.387+0000 7feba115f700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7feb9c06e1e0 0x7feb9c06d980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:17.472 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.387+0000 7feba115f700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb9c1f74a0 con 0x7feb9c15de60 2023-10-16T19:57:17.472 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.387+0000 7feba115f700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb9c1f7780 con 0x7feb9c06e1e0 2023-10-16T19:57:17.472 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.387+0000 7feba115f700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb9c144550 con 0x7feb9c1626d0 2023-10-16T19:57:17.473 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.387+0000 7f7e937fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7e94169cf0 0x7f7e9416ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:17.473 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.387+0000 7f7e937fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7e94169cf0 0x7f7e9416ba10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:45842/0 (socket says 172.21.15.157:45842) 2023-10-16T19:57:17.473 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.387+0000 7f7e937fe700 1 -- 172.21.15.157:0/1187901600 learned_addr learned my addr 172.21.15.157:0/1187901600 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:57:17.474 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.387+0000 7f7e93fff700 1 --2- 172.21.15.157:0/1187901600 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7e9416d690 0x7f7e942037a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:17.474 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.388+0000 7feb9ad9d700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feb9c15de60 0x7feb9c146a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:17.474 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.388+0000 7feb9ad9d700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feb9c15de60 0x7feb9c146a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:45844/0 (socket says 172.21.15.157:45844) 2023-10-16T19:57:17.474 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.388+0000 7feb9ad9d700 1 -- 172.21.15.157:0/1848015034 learned_addr learned my addr 172.21.15.157:0/1848015034 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:57:17.475 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.388+0000 7f7e937fe700 1 -- 172.21.15.157:0/1187901600 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7e9416d690 msgr2=0x7f7e942037a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:17.475 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.388+0000 7f7e937fe700 1 --2- 172.21.15.157:0/1187901600 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7e9416d690 0x7f7e942037a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:17.475 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.388+0000 7f7e937fe700 1 -- 172.21.15.157:0/1187901600 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7e940ae0b0 msgr2=0x7f7e9416d150 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-16T19:57:17.475 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.388+0000 7f7e937fe700 1 --2- 172.21.15.157:0/1187901600 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7e940ae0b0 0x7f7e9416d150 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:17.476 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.388+0000 7f7e937fe700 1 -- 172.21.15.157:0/1187901600 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e9416c2a0 con 0x7f7e94169cf0 2023-10-16T19:57:17.476 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.388+0000 7feb9a59c700 1 --2- 172.21.15.157:0/1848015034 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7feb9c1626d0 0x7feb9c06d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:17.476 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.388+0000 7feb9b59e700 1 --2- 172.21.15.157:0/1848015034 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7feb9c06e1e0 0x7feb9c06d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:17.477 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.388+0000 7f7e937fe700 1 --2- 172.21.15.157:0/1187901600 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7e94169cf0 0x7f7e9416ba10 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f7e8400e800 tx=0x7f7e8400eb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:17.477 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.388+0000 7feb9a59c700 1 -- 172.21.15.157:0/1848015034 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7feb9c06e1e0 msgr2=0x7feb9c06d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:17.478 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.388+0000 7feb9a59c700 1 --2- 172.21.15.157:0/1848015034 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7feb9c06e1e0 0x7feb9c06d980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:17.478 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.388+0000 7feb9a59c700 1 -- 172.21.15.157:0/1848015034 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feb9c15de60 msgr2=0x7feb9c146a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:17.478 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.388+0000 7feb9a59c700 1 --2- 172.21.15.157:0/1848015034 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feb9c15de60 0x7feb9c146a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:17.478 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.388+0000 7feb9a59c700 1 -- 172.21.15.157:0/1848015034 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb94009a70 con 0x7feb9c1626d0 2023-10-16T19:57:17.479 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.388+0000 7f7e8bfff700 1 -- 172.21.15.157:0/1187901600 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e84013680 con 0x7f7e94169cf0 2023-10-16T19:57:17.479 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.388+0000 7f7e8bfff700 1 -- 172.21.15.157:0/1187901600 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e840137e0 con 0x7f7e94169cf0 2023-10-16T19:57:17.479 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.388+0000 7f7e8bfff700 1 -- 172.21.15.157:0/1187901600 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e84013b90 con 0x7f7e94169cf0 2023-10-16T19:57:17.480 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.388+0000 7f7e9a0ed700 1 -- 172.21.15.157:0/1187901600 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e9416c580 con 0x7f7e94169cf0 2023-10-16T19:57:17.480 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.389+0000 7f7e9a0ed700 1 -- 172.21.15.157:0/1187901600 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e9416bf50 con 0x7f7e94169cf0 2023-10-16T19:57:17.480 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.389+0000 7f99b98b5700 1 -- 172.21.15.157:0/3602937403 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99b40c6020 con 0x7f99b4146910 2023-10-16T19:57:17.480 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.389+0000 7f99b98b5700 1 -- 172.21.15.157:0/3602937403 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99b4146d90 con 0x7f99b4146910 2023-10-16T19:57:17.481 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.389+0000 7fc47b8ac700 1 -- 172.21.15.157:0/2760409854 shutdown_connections 2023-10-16T19:57:17.482 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.389+0000 7feb9a59c700 1 --2- 172.21.15.157:0/1848015034 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7feb9c1626d0 0x7feb9c06d440 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7feb8c000f60 tx=0x7feb8c00c730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:17.482 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.390+0000 7feb837fe700 1 -- 172.21.15.157:0/1848015034 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb8c0052d0 con 0x7feb9c1626d0 2023-10-16T19:57:17.482 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.390+0000 7feb837fe700 1 -- 172.21.15.157:0/1848015034 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb8c005430 con 0x7feb9c1626d0 2023-10-16T19:57:17.482 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.390+0000 7feb837fe700 1 -- 172.21.15.157:0/1848015034 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb8c0038c0 con 0x7feb9c1626d0 2023-10-16T19:57:17.482 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.390+0000 7feba115f700 1 -- 172.21.15.157:0/1848015034 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb9c144830 con 0x7feb9c1626d0 2023-10-16T19:57:17.483 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.390+0000 7feba115f700 1 -- 172.21.15.157:0/1848015034 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb9c153290 con 0x7feb9c1626d0 2023-10-16T19:57:17.483 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.390+0000 7feba115f700 1 -- 172.21.15.157:0/1848015034 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7feb9c153570 con 0x7feb9c1626d0 2023-10-16T19:57:17.483 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.391+0000 7f7e8bfff700 1 -- 172.21.15.157:0/1187901600 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f7e84013cf0 con 0x7f7e94169cf0 2023-10-16T19:57:17.483 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.391+0000 7f7e8bfff700 1 --2- 172.21.15.157:0/1187901600 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f7e7406af00 0x7f7e7406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:17.484 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.391+0000 7f7e8bfff700 1 -- 172.21.15.157:0/1187901600 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7e84089300 con 0x7f7e94169cf0 2023-10-16T19:57:17.484 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.392+0000 7f7e92ffd700 1 --2- 172.21.15.157:0/1187901600 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f7e7406af00 0x7f7e7406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:17.484 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.392+0000 7feb837fe700 1 -- 172.21.15.157:0/1848015034 <== mon.2 v2:172.21.15.187:3301/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7feb8c003a20 con 0x7feb9c1626d0 2023-10-16T19:57:17.485 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.390+0000 7fc47b8ac700 1 -- 172.21.15.157:0/2760409854 wait complete. 2023-10-16T19:57:17.485 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.392+0000 7f7e9a0ed700 1 --2- 172.21.15.157:0/1187901600 >> [v2:172.21.15.157:6808/335785898,v1:172.21.15.157:6809/335785898] conn(0x7f7e94203ce0 0x7f7e942040c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:17.485 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.392+0000 7f7e9a0ed700 1 -- 172.21.15.157:0/1187901600 --> [v2:172.21.15.157:6808/335785898,v1:172.21.15.157:6809/335785898] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7e940ca140 con 0x7f7e94203ce0 2023-10-16T19:57:17.486 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.392+0000 7fc47b8ac700 1 Processor -- start 2023-10-16T19:57:17.486 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.392+0000 7f7e92ffd700 1 --2- 172.21.15.157:0/1187901600 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f7e7406af00 0x7f7e7406d3c0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f7e9402d590 tx=0x7f7e7c032000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:17.487 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.392+0000 7feb837fe700 1 --2- 172.21.15.157:0/1848015034 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7feb8806af00 0x7feb8806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:17.487 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.392+0000 7feb837fe700 1 -- 172.21.15.157:0/1848015034 <== mon.2 v2:172.21.15.187:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7feb8c088f50 con 0x7feb9c1626d0 2023-10-16T19:57:17.487 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.392+0000 7feb837fe700 1 --2- 172.21.15.157:0/1848015034 >> [v2:172.21.15.187:6816/654976824,v1:172.21.15.187:6817/654976824] conn(0x7feb880730a0 0x7feb880754c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:17.488 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.392+0000 7feb837fe700 1 -- 172.21.15.157:0/1848015034 --> [v2:172.21.15.187:6816/654976824,v1:172.21.15.187:6817/654976824] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7feb88075b70 con 0x7feb880730a0 2023-10-16T19:57:17.488 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.392+0000 7feb837fe700 1 -- 172.21.15.157:0/1848015034 <== mon.2 v2:172.21.15.187:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7feb8c0893a0 con 0x7feb9c1626d0 2023-10-16T19:57:17.488 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.392+0000 7feb9ad9d700 1 --2- 172.21.15.157:0/1848015034 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7feb8806af00 0x7feb8806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:17.488 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.393+0000 7feb9ad9d700 1 --2- 172.21.15.157:0/1848015034 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7feb8806af00 0x7feb8806d3c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7feb90006b20 tx=0x7feb90008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:17.489 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.392+0000 7fc47b8ac700 1 -- start start 2023-10-16T19:57:17.489 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.393+0000 7fc47b8ac700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc4740708d0 0x7fc47415cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:17.489 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.393+0000 7fc47b8ac700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc4740cbcc0 0x7fc47414cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:17.490 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.393+0000 7fc47b8ac700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc474159f00 0x7fc47406d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:17.490 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.393+0000 7fc47b8ac700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4741fc4e0 con 0x7fc4740cbcc0 2023-10-16T19:57:17.490 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.393+0000 7fc47b8ac700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4741504d0 con 0x7fc4740708d0 2023-10-16T19:57:17.490 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.393+0000 7fc47b8ac700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4741fb860 con 0x7fc474159f00 2023-10-16T19:57:17.491 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.393+0000 7fc479648700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc4740708d0 0x7fc47415cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:17.491 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.393+0000 7fc478e47700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc4740cbcc0 0x7fc47414cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:17.491 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.393+0000 7fc478e47700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc4740cbcc0 0x7fc47414cfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:45858/0 (socket says 172.21.15.157:45858) 2023-10-16T19:57:17.491 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.393+0000 7fc478e47700 1 -- 172.21.15.157:0/1692077095 learned_addr learned my addr 172.21.15.157:0/1692077095 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:57:17.491 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.393+0000 7fc479e49700 1 --2- 172.21.15.157:0/1692077095 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc474159f00 0x7fc47406d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:17.492 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.393+0000 7feb9b59e700 1 --2- 172.21.15.157:0/1848015034 >> [v2:172.21.15.187:6816/654976824,v1:172.21.15.187:6817/654976824] conn(0x7feb880730a0 0x7feb880754c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:17.492 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.393+0000 7f7e93fff700 1 --2- 172.21.15.157:0/1187901600 >> [v2:172.21.15.157:6808/335785898,v1:172.21.15.157:6809/335785898] conn(0x7f7e94203ce0 0x7f7e942040c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:17.493 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.393+0000 7fc479648700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc4740708d0 0x7fc47415cc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.157:40964/0 (socket says 172.21.15.157:40964) 2023-10-16T19:57:17.493 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.394+0000 7fc478e47700 1 -- 172.21.15.157:0/1692077095 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc474159f00 msgr2=0x7fc47406d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:17.493 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.394+0000 7fc478e47700 1 --2- 172.21.15.157:0/1692077095 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc474159f00 0x7fc47406d870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:17.493 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.394+0000 7fc478e47700 1 -- 172.21.15.157:0/1692077095 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc4740708d0 msgr2=0x7fc47415cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:17.494 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.394+0000 7fc478e47700 1 --2- 172.21.15.157:0/1692077095 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc4740708d0 0x7fc47415cc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:17.494 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.394+0000 7fc478e47700 1 -- 172.21.15.157:0/1692077095 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc46c00d050 con 0x7fc4740cbcc0 2023-10-16T19:57:17.494 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.394+0000 7f7e93fff700 1 --2- 172.21.15.157:0/1187901600 >> [v2:172.21.15.157:6808/335785898,v1:172.21.15.157:6809/335785898] conn(0x7f7e94203ce0 0x7f7e942040c0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:17.495 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.394+0000 7fc478e47700 1 --2- 172.21.15.157:0/1692077095 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc4740cbcc0 0x7fc47414cfe0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fc47000b530 tx=0x7fc47000b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:17.495 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.394+0000 7feb9b59e700 1 --2- 172.21.15.157:0/1848015034 >> [v2:172.21.15.187:6816/654976824,v1:172.21.15.187:6817/654976824] conn(0x7feb880730a0 0x7feb880754c0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:17.495 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.395+0000 7fc469ffb700 1 -- 172.21.15.157:0/1692077095 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc470011830 con 0x7fc4740cbcc0 2023-10-16T19:57:17.496 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.395+0000 7f7e8bfff700 1 -- 172.21.15.157:0/1187901600 <== osd.0 v2:172.21.15.157:6808/335785898 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23595 (crc 0 0 0) 0x7f7e8c005690 con 0x7f7e94203ce0 2023-10-16T19:57:17.496 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.395+0000 7fc469ffb700 1 -- 172.21.15.157:0/1692077095 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc470011990 con 0x7fc4740cbcc0 2023-10-16T19:57:17.497 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.395+0000 7fc47b8ac700 1 -- 172.21.15.157:0/1692077095 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4741fbb40 con 0x7fc4740cbcc0 2023-10-16T19:57:17.497 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.395+0000 7feb837fe700 1 -- 172.21.15.157:0/1848015034 <== osd.6 v2:172.21.15.187:6816/654976824 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23595 (crc 0 0 0) 0x7feb88075b70 con 0x7feb880730a0 2023-10-16T19:57:17.497 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.395+0000 7fc47b8ac700 1 -- 172.21.15.157:0/1692077095 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4741fc100 con 0x7fc4740cbcc0 2023-10-16T19:57:17.498 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.396+0000 7fc469ffb700 1 -- 172.21.15.157:0/1692077095 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc470011d40 con 0x7fc4740cbcc0 2023-10-16T19:57:17.498 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.397+0000 7f99a3fff700 1 -- 172.21.15.157:0/3602937403 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f99a801a400 con 0x7f99b4146910 2023-10-16T19:57:17.498 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.397+0000 7f99a3fff700 1 --2- 172.21.15.157:0/3602937403 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f999806afa0 0x7f999806d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:17.499 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.397+0000 7f99a3fff700 1 -- 172.21.15.157:0/3602937403 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f99a80894f0 con 0x7f99b4146910 2023-10-16T19:57:17.499 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.397+0000 7fc469ffb700 1 -- 172.21.15.157:0/1692077095 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fc47001a400 con 0x7fc4740cbcc0 2023-10-16T19:57:17.499 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.397+0000 7fc469ffb700 1 --2- 172.21.15.157:0/1692077095 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fc45806af00 0x7fc45806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:17.500 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.397+0000 7fc469ffb700 1 -- 172.21.15.157:0/1692077095 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc470089570 con 0x7fc4740cbcc0 2023-10-16T19:57:17.500 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.398+0000 7fc479648700 1 --2- 172.21.15.157:0/1692077095 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fc45806af00 0x7fc45806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:17.500 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.398+0000 7fc479648700 1 --2- 172.21.15.157:0/1692077095 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fc45806af00 0x7fc45806d3c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fc46c00d690 tx=0x7fc46c015000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:17.501 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.398+0000 7f99b2ffd700 1 --2- 172.21.15.157:0/3602937403 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f999806afa0 0x7f999806d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:17.501 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.398+0000 7f99b2ffd700 1 --2- 172.21.15.157:0/3602937403 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f999806afa0 0x7f999806d460 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f99a4014040 tx=0x7f99a401c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:17.501 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.400+0000 7f99b98b5700 1 --2- 172.21.15.157:0/3602937403 >> [v2:172.21.15.187:6800/3841016811,v1:172.21.15.187:6801/3841016811] conn(0x7f99b4157710 0x7f99b4157af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:17.501 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.400+0000 7f99b98b5700 1 -- 172.21.15.157:0/3602937403 --> [v2:172.21.15.187:6800/3841016811,v1:172.21.15.187:6801/3841016811] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f99b404f400 con 0x7f99b4157710 2023-10-16T19:57:17.502 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.400+0000 7fc47b8ac700 1 --2- 172.21.15.157:0/1692077095 >> [v2:172.21.15.157:6814/989329821,v1:172.21.15.157:6816/989329821] conn(0x7fc4540015e0 0x7fc454003aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:17.502 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.400+0000 7fc47b8ac700 1 -- 172.21.15.157:0/1692077095 --> [v2:172.21.15.157:6814/989329821,v1:172.21.15.157:6816/989329821] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc454006bd0 con 0x7fc4540015e0 2023-10-16T19:57:17.502 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.400+0000 7f99b37fe700 1 --2- 172.21.15.157:0/3602937403 >> [v2:172.21.15.187:6800/3841016811,v1:172.21.15.187:6801/3841016811] conn(0x7f99b4157710 0x7f99b4157af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:17.503 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.400+0000 7fc479e49700 1 --2- 172.21.15.157:0/1692077095 >> [v2:172.21.15.157:6814/989329821,v1:172.21.15.157:6816/989329821] conn(0x7fc4540015e0 0x7fc454003aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:17.503 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.401+0000 7fc479e49700 1 --2- 172.21.15.157:0/1692077095 >> [v2:172.21.15.157:6814/989329821,v1:172.21.15.157:6816/989329821] conn(0x7fc4540015e0 0x7fc454003aa0 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:17.503 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.402+0000 7fc469ffb700 1 -- 172.21.15.157:0/1692077095 <== osd.3 v2:172.21.15.157:6814/989329821 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23595 (crc 0 0 0) 0x7fc454006bd0 con 0x7fc4540015e0 2023-10-16T19:57:17.504 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.402+0000 7fb021ac0700 1 Processor -- start 2023-10-16T19:57:17.504 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.402+0000 7f99b37fe700 1 --2- 172.21.15.157:0/3602937403 >> [v2:172.21.15.187:6800/3841016811,v1:172.21.15.187:6801/3841016811] conn(0x7f99b4157710 0x7f99b4157af0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:17.504 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.403+0000 7f99a3fff700 1 -- 172.21.15.157:0/3602937403 <== osd.4 v2:172.21.15.187:6800/3841016811 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23595 (crc 0 0 0) 0x7f99b404f400 con 0x7f99b4157710 2023-10-16T19:57:17.505 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.407+0000 7fb021ac0700 1 -- start start 2023-10-16T19:57:17.506 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.408+0000 7fb021ac0700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fb01c159f00 0x7fb01c15da70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:17.506 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.408+0000 7fb021ac0700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fb01c0708d0 0x7fb01c0cb780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:17.506 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.408+0000 7fb021ac0700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb01c0cbcc0 0x7fb01c0ca290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:17.506 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.408+0000 7fb021ac0700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb01c0cc150 con 0x7fb01c159f00 2023-10-16T19:57:17.506 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.408+0000 7fb021ac0700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb01c15a2e0 con 0x7fb01c0708d0 2023-10-16T19:57:17.507 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.408+0000 7fb021ac0700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb01c15e2c0 con 0x7fb01c0cbcc0 2023-10-16T19:57:17.507 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.408+0000 7fb01bfff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb01c0cbcc0 0x7fb01c0ca290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:17.507 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.408+0000 7fb01affd700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fb01c0708d0 0x7fb01c0cb780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:17.507 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.408+0000 7fb01affd700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fb01c0708d0 0x7fb01c0cb780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.157:40984/0 (socket says 172.21.15.157:40984) 2023-10-16T19:57:17.507 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.408+0000 7fb01affd700 1 -- 172.21.15.157:0/1674660830 learned_addr learned my addr 172.21.15.157:0/1674660830 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:57:17.508 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.409+0000 7fb01b7fe700 1 --2- 172.21.15.157:0/1674660830 >> v2:172.21.15.157:3300/0 conn(0x7fb01c159f00 0x7fb01c15da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:17.508 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.409+0000 7fb01b7fe700 1 -- 172.21.15.157:0/1674660830 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb01c0cbcc0 msgr2=0x7fb01c0ca290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:57:17.508 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.409+0000 7fb01b7fe700 1 --2- 172.21.15.157:0/1674660830 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb01c0cbcc0 0x7fb01c0ca290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:17.508 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.409+0000 7fb01b7fe700 1 -- 172.21.15.157:0/1674660830 >> v2:172.21.15.187:3300/0 conn(0x7fb01c0708d0 msgr2=0x7fb01c0cb780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:57:17.508 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.409+0000 7fb01b7fe700 1 --2- 172.21.15.157:0/1674660830 >> v2:172.21.15.187:3300/0 conn(0x7fb01c0708d0 0x7fb01c0cb780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:17.509 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.409+0000 7fb01b7fe700 1 -- 172.21.15.157:0/1674660830 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb01c15e5a0 con 0x7fb01c159f00 2023-10-16T19:57:17.509 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.409+0000 7fb01b7fe700 1 --2- 172.21.15.157:0/1674660830 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb01c159f00 0x7fb01c15da70 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fb01c0734e0 tx=0x7fb01400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fb3d012ad754742 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:17.509 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.410+0000 7fb01a7fc700 1 -- 172.21.15.157:0/1674660830 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb01400bd20 con 0x7fb01c159f00 2023-10-16T19:57:17.509 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.410+0000 7fb01a7fc700 1 -- 172.21.15.157:0/1674660830 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb01400be80 con 0x7fb01c159f00 2023-10-16T19:57:17.509 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.410+0000 7fb01a7fc700 1 -- 172.21.15.157:0/1674660830 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb014010710 con 0x7fb01c159f00 2023-10-16T19:57:17.509 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.411+0000 7fb021ac0700 1 -- 172.21.15.157:0/1674660830 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb01c159f00 msgr2=0x7fb01c15da70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:17.510 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.411+0000 7fb021ac0700 1 --2- 172.21.15.157:0/1674660830 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb01c159f00 0x7fb01c15da70 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fb01c0734e0 tx=0x7fb01400b330 comp rx=0 tx=0).stop 2023-10-16T19:57:17.510 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.411+0000 7fb021ac0700 1 -- 172.21.15.157:0/1674660830 shutdown_connections 2023-10-16T19:57:17.510 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.411+0000 7fb021ac0700 1 --2- 172.21.15.157:0/1674660830 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb01c0cbcc0 0x7fb01c0ca290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:17.510 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.411+0000 7fb021ac0700 1 --2- 172.21.15.157:0/1674660830 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb01c159f00 0x7fb01c15da70 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:17.510 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.411+0000 7fb021ac0700 1 --2- 172.21.15.157:0/1674660830 >> v2:172.21.15.187:3300/0 conn(0x7fb01c0708d0 0x7fb01c0cb780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:17.511 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.411+0000 7fb021ac0700 1 -- 172.21.15.157:0/1674660830 >> 172.21.15.157:0/1674660830 conn(0x7fb01c0cf950 msgr2=0x7fb01c0cfd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:17.511 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.413+0000 7f29f3a36700 1 -- 172.21.15.157:0/1850526673 --> [v2:172.21.15.187:6802/915130263,v1:172.21.15.187:6805/915130263] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f29ec04f400 con 0x7f29ec06eb20 2023-10-16T19:57:17.511 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.413+0000 7f060dbd7700 1 -- 172.21.15.157:0/3846558239 --> [v2:172.21.15.187:6824/4284059445,v1:172.21.15.187:6825/4284059445] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f05e8002d40 con 0x7f05f4073170 2023-10-16T19:57:17.512 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.414+0000 7fb021ac0700 1 -- 172.21.15.157:0/1674660830 shutdown_connections 2023-10-16T19:57:17.512 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.414+0000 7fb021ac0700 1 -- 172.21.15.157:0/1674660830 wait complete. 2023-10-16T19:57:17.513 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.414+0000 7f05effff700 1 -- 172.21.15.157:0/3846558239 <== osd.7 v2:172.21.15.187:6824/4284059445 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f05e8002d40 con 0x7f05f4073170 2023-10-16T19:57:17.513 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.414+0000 7f29e1ffb700 1 -- 172.21.15.157:0/1850526673 <== osd.5 v2:172.21.15.187:6802/915130263 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f29ec04f400 con 0x7f29ec06eb20 2023-10-16T19:57:17.514 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.415+0000 7f2bc6967700 1 -- 172.21.15.157:0/2243750634 --> [v2:172.21.15.157:6824/1118292389,v1:172.21.15.157:6825/1118292389] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f2ba0002d40 con 0x7f2bac0731a0 2023-10-16T19:57:17.514 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.415+0000 7f29f3a36700 1 -- 172.21.15.157:0/1850526673 >> [v2:172.21.15.187:6802/915130263,v1:172.21.15.187:6805/915130263] conn(0x7f29ec06eb20 msgr2=0x7f29ec203f70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:17.514 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.415+0000 7f29f3a36700 1 --2- 172.21.15.157:0/1850526673 >> [v2:172.21.15.187:6802/915130263,v1:172.21.15.187:6805/915130263] conn(0x7f29ec06eb20 0x7f29ec203f70 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:17.515 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.415+0000 7f060dbd7700 1 -- 172.21.15.157:0/3846558239 >> [v2:172.21.15.187:6824/4284059445,v1:172.21.15.187:6825/4284059445] conn(0x7f05f4073170 msgr2=0x7f05f4075590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:17.515 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.415+0000 7f060dbd7700 1 --2- 172.21.15.157:0/3846558239 >> [v2:172.21.15.187:6824/4284059445,v1:172.21.15.187:6825/4284059445] conn(0x7f05f4073170 0x7f05f4075590 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:17.516 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.415+0000 7f29f3a36700 1 -- 172.21.15.157:0/1850526673 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f29d006afd0 msgr2=0x7f29d006d490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:17.516 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.415+0000 7f29f3a36700 1 --2- 172.21.15.157:0/1850526673 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f29d006afd0 0x7f29d006d490 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f29dc006fd0 tx=0x7f29dc009190 comp rx=0 tx=0).stop 2023-10-16T19:57:17.516 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.415+0000 7f29f3a36700 1 -- 172.21.15.157:0/1850526673 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f29ec164d20 msgr2=0x7f29ec15fcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:17.516 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.415+0000 7f29f3a36700 1 --2- 172.21.15.157:0/1850526673 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f29ec164d20 0x7f29ec15fcf0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f29e400cba0 tx=0x7f29e400ceb0 comp rx=0 tx=0).stop 2023-10-16T19:57:17.516 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.415+0000 7f29f1fd3700 1 -- 172.21.15.157:0/1850526673 reap_dead start 2023-10-16T19:57:17.517 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.415+0000 7f2bbcff9700 1 -- 172.21.15.157:0/2243750634 <== osd.2 v2:172.21.15.157:6824/1118292389 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f2ba0002d40 con 0x7f2bac0731a0 2023-10-16T19:57:17.517 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.415+0000 7f29f3a36700 1 -- 172.21.15.157:0/1850526673 shutdown_connections 2023-10-16T19:57:17.517 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.415+0000 7f29f3a36700 1 -- 172.21.15.157:0/1850526673 >> 172.21.15.157:0/1850526673 conn(0x7f29ec0cd4e0 msgr2=0x7f29ec0b06b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:17.518 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.415+0000 7f060dbd7700 1 -- 172.21.15.157:0/3846558239 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f05f406afd0 msgr2=0x7f05f406d490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:17.518 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.415+0000 7f060dbd7700 1 --2- 172.21.15.157:0/3846558239 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f05f406afd0 0x7f05f406d490 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f05fc0048d0 tx=0x7f05fc007eb0 comp rx=0 tx=0).stop 2023-10-16T19:57:17.518 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.415+0000 7f060dbd7700 1 -- 172.21.15.157:0/3846558239 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f06080c6a20 msgr2=0x7f06080ce1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:17.519 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.415+0000 7f060dbd7700 1 --2- 172.21.15.157:0/3846558239 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f06080c6a20 0x7f06080ce1b0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f060000c8c0 tx=0x7f060000cc80 comp rx=0 tx=0).stop 2023-10-16T19:57:17.519 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.415+0000 7f29f3a36700 1 -- 172.21.15.157:0/1850526673 shutdown_connections 2023-10-16T19:57:17.519 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.415+0000 7f0607fff700 1 -- 172.21.15.157:0/3846558239 reap_dead start 2023-10-16T19:57:17.520 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.416+0000 7fb021ac0700 1 Processor -- start 2023-10-16T19:57:17.520 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.416+0000 7f2bc6967700 1 -- 172.21.15.157:0/2243750634 >> [v2:172.21.15.157:6824/1118292389,v1:172.21.15.157:6825/1118292389] conn(0x7f2bac0731a0 msgr2=0x7f2bac0755c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:17.520 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.416+0000 7f2bc6967700 1 --2- 172.21.15.157:0/2243750634 >> [v2:172.21.15.157:6824/1118292389,v1:172.21.15.157:6825/1118292389] conn(0x7f2bac0731a0 0x7f2bac0755c0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:17.521 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.416+0000 7fb021ac0700 1 -- start start 2023-10-16T19:57:17.521 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.416+0000 7f29f3a36700 1 -- 172.21.15.157:0/1850526673 wait complete. 2023-10-16T19:57:17.522 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.416+0000 7f2bc6967700 1 -- 172.21.15.157:0/2243750634 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f2bac06af80 msgr2=0x7f2bac06d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:17.522 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.416+0000 7f2bc6967700 1 --2- 172.21.15.157:0/2243750634 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f2bac06af80 0x7f2bac06d440 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f2bb4000c00 tx=0x7f2bb401d040 comp rx=0 tx=0).stop 2023-10-16T19:57:17.523 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.416+0000 7f2bc6967700 1 -- 172.21.15.157:0/2243750634 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2bc006b960 msgr2=0x7f2bc013e970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:17.523 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.416+0000 7f2bc6967700 1 --2- 172.21.15.157:0/2243750634 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2bc006b960 0x7f2bc013e970 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f2bb000b550 tx=0x7f2bb000b860 comp rx=0 tx=0).stop 2023-10-16T19:57:17.523 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.416+0000 7f2bc4f04700 1 -- 172.21.15.157:0/2243750634 reap_dead start 2023-10-16T19:57:17.523 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.416+0000 7f2bc6967700 1 -- 172.21.15.157:0/2243750634 shutdown_connections 2023-10-16T19:57:17.523 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.416+0000 7f2bc6967700 1 -- 172.21.15.157:0/2243750634 >> 172.21.15.157:0/2243750634 conn(0x7f2bc00d0b50 msgr2=0x7f2bc00b1df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:17.523 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.417+0000 7f2bc6967700 1 -- 172.21.15.157:0/2243750634 shutdown_connections 2023-10-16T19:57:17.524 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.417+0000 7f2bc6967700 1 -- 172.21.15.157:0/2243750634 wait complete. 2023-10-16T19:57:17.524 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.417+0000 7f060dbd7700 1 -- 172.21.15.157:0/3846558239 shutdown_connections 2023-10-16T19:57:17.524 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.417+0000 7f060dbd7700 1 -- 172.21.15.157:0/3846558239 >> 172.21.15.157:0/3846558239 conn(0x7f06080cf950 msgr2=0x7f0608073ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:17.525 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.417+0000 7fb021ac0700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb01c0cbcc0 0x7fb01c1542d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:17.525 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.417+0000 7fb021ac0700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb01c159f00 0x7fb01c150400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:17.525 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.417+0000 7fb021ac0700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb01c15c840 0x7fb01c15ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:17.525 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.417+0000 7fb021ac0700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb01c0c3ca0 con 0x7fb01c15c840 2023-10-16T19:57:17.526 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.417+0000 7fb021ac0700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb01c1581a0 con 0x7fb01c159f00 2023-10-16T19:57:17.526 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.417+0000 7fb021ac0700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb01c157900 con 0x7fb01c0cbcc0 2023-10-16T19:57:17.526 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.417+0000 7fb01b7fe700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb01c0cbcc0 0x7fb01c1542d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:17.526 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.417+0000 7fb01affd700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb01c159f00 0x7fb01c150400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:17.526 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.417+0000 7fb01b7fe700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb01c0cbcc0 0x7fb01c1542d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.157:55186/0 (socket says 172.21.15.157:55186) 2023-10-16T19:57:17.527 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.418+0000 7f060dbd7700 1 -- 172.21.15.157:0/3846558239 shutdown_connections 2023-10-16T19:57:17.527 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.417+0000 7fb01b7fe700 1 -- 172.21.15.157:0/3142839193 learned_addr learned my addr 172.21.15.157:0/3142839193 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:57:17.527 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.417+0000 7fb01bfff700 1 --2- 172.21.15.157:0/3142839193 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb01c15c840 0x7fb01c15ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:17.528 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.418+0000 7f060dbd7700 1 -- 172.21.15.157:0/3846558239 wait complete. 2023-10-16T19:57:17.529 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.418+0000 7fb01affd700 1 -- 172.21.15.157:0/3142839193 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb01c0cbcc0 msgr2=0x7fb01c1542d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:17.529 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.418+0000 7fb01affd700 1 --2- 172.21.15.157:0/3142839193 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb01c0cbcc0 0x7fb01c1542d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:17.529 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.418+0000 7fb01affd700 1 -- 172.21.15.157:0/3142839193 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb01c15c840 msgr2=0x7fb01c15ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:17.529 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.418+0000 7fb01affd700 1 --2- 172.21.15.157:0/3142839193 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb01c15c840 0x7fb01c15ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:17.529 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.418+0000 7fb01affd700 1 -- 172.21.15.157:0/3142839193 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb014009a70 con 0x7fb01c159f00 2023-10-16T19:57:17.530 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.418+0000 7fb01affd700 1 --2- 172.21.15.157:0/3142839193 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb01c159f00 0x7fb01c150400 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb00c00ab40 tx=0x7fb00c00ae50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:17.530 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.418+0000 7fb003fff700 1 -- 172.21.15.157:0/3142839193 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb00c00c6f0 con 0x7fb01c159f00 2023-10-16T19:57:17.530 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.418+0000 7fb003fff700 1 -- 172.21.15.157:0/3142839193 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb00c00c850 con 0x7fb01c159f00 2023-10-16T19:57:17.530 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.418+0000 7fb003fff700 1 -- 172.21.15.157:0/3142839193 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb00c00cbc0 con 0x7fb01c159f00 2023-10-16T19:57:17.531 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.418+0000 7fb021ac0700 1 -- 172.21.15.157:0/3142839193 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb01c157be0 con 0x7fb01c159f00 2023-10-16T19:57:17.531 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.419+0000 7fb021ac0700 1 -- 172.21.15.157:0/3142839193 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb01c0c3930 con 0x7fb01c159f00 2023-10-16T19:57:17.531 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.419+0000 7f7e9a0ed700 1 -- 172.21.15.157:0/1187901600 --> [v2:172.21.15.157:6808/335785898,v1:172.21.15.157:6809/335785898] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f7e9416ac70 con 0x7f7e94203ce0 2023-10-16T19:57:17.531 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.420+0000 7f7e8bfff700 1 -- 172.21.15.157:0/1187901600 <== osd.0 v2:172.21.15.157:6808/335785898 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f7e8c015410 con 0x7f7e94203ce0 2023-10-16T19:57:17.532 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.420+0000 7fb003fff700 1 -- 172.21.15.157:0/3142839193 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fb00c00cd20 con 0x7fb01c159f00 2023-10-16T19:57:17.532 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.421+0000 7fb003fff700 1 --2- 172.21.15.157:0/3142839193 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fb00806af00 0x7fb00806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:17.533 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.421+0000 7fb003fff700 1 -- 172.21.15.157:0/3142839193 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb00c089080 con 0x7fb01c159f00 2023-10-16T19:57:17.533 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.421+0000 7fb01b7fe700 1 --2- 172.21.15.157:0/3142839193 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fb00806af00 0x7fb00806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:17.533 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.421+0000 7f7e9a0ed700 1 -- 172.21.15.157:0/1187901600 >> [v2:172.21.15.157:6808/335785898,v1:172.21.15.157:6809/335785898] conn(0x7f7e94203ce0 msgr2=0x7f7e942040c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:17.534 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.421+0000 7f7e9a0ed700 1 --2- 172.21.15.157:0/1187901600 >> [v2:172.21.15.157:6808/335785898,v1:172.21.15.157:6809/335785898] conn(0x7f7e94203ce0 0x7f7e942040c0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:17.534 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.421+0000 7f7e9a0ed700 1 -- 172.21.15.157:0/1187901600 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f7e7406af00 msgr2=0x7f7e7406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:17.534 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.421+0000 7f7e9a0ed700 1 --2- 172.21.15.157:0/1187901600 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f7e7406af00 0x7f7e7406d3c0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f7e9402d590 tx=0x7f7e7c032000 comp rx=0 tx=0).stop 2023-10-16T19:57:17.534 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.421+0000 7f7e9a0ed700 1 -- 172.21.15.157:0/1187901600 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7e94169cf0 msgr2=0x7f7e9416ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:17.535 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.421+0000 7f7e9a0ed700 1 --2- 172.21.15.157:0/1187901600 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7e94169cf0 0x7f7e9416ba10 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f7e8400e800 tx=0x7f7e8400eb10 comp rx=0 tx=0).stop 2023-10-16T19:57:17.535 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.421+0000 7f7e93fff700 1 -- 172.21.15.157:0/1187901600 reap_dead start 2023-10-16T19:57:17.535 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.422+0000 7f7e9a0ed700 1 -- 172.21.15.157:0/1187901600 shutdown_connections 2023-10-16T19:57:17.535 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.422+0000 7f7e9a0ed700 1 -- 172.21.15.157:0/1187901600 >> 172.21.15.157:0/1187901600 conn(0x7f7e940cf950 msgr2=0x7f7e940af3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:17.536 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.422+0000 7feba115f700 1 -- 172.21.15.157:0/1848015034 --> [v2:172.21.15.187:6816/654976824,v1:172.21.15.187:6817/654976824] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7feb9c0cb0e0 con 0x7feb880730a0 2023-10-16T19:57:17.536 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.422+0000 7feb837fe700 1 -- 172.21.15.157:0/1848015034 <== osd.6 v2:172.21.15.187:6816/654976824 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7feb94017040 con 0x7feb880730a0 2023-10-16T19:57:17.537 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.423+0000 7fb021ac0700 1 --2- 172.21.15.157:0/3142839193 >> [v2:172.21.15.157:6800/3482825047,v1:172.21.15.157:6801/3482825047] conn(0x7fb01c1526c0 0x7fb01c152aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:17.537 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.423+0000 7fb021ac0700 1 -- 172.21.15.157:0/3142839193 --> [v2:172.21.15.157:6800/3482825047,v1:172.21.15.157:6801/3482825047] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb01c15e880 con 0x7fb01c1526c0 2023-10-16T19:57:17.537 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.423+0000 7fb01bfff700 1 --2- 172.21.15.157:0/3142839193 >> [v2:172.21.15.157:6800/3482825047,v1:172.21.15.157:6801/3482825047] conn(0x7fb01c1526c0 0x7fb01c152aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:17.537 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.423+0000 7fb01bfff700 1 --2- 172.21.15.157:0/3142839193 >> [v2:172.21.15.157:6800/3482825047,v1:172.21.15.157:6801/3482825047] conn(0x7fb01c1526c0 0x7fb01c152aa0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:17.538 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.424+0000 7fb01b7fe700 1 --2- 172.21.15.157:0/3142839193 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fb00806af00 0x7fb00806d3c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb014000f80 tx=0x7fb014014000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:17.538 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.424+0000 7fb003fff700 1 -- 172.21.15.157:0/3142839193 <== osd.1 v2:172.21.15.157:6800/3482825047 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23595 (crc 0 0 0) 0x7fb010009910 con 0x7fb01c1526c0 2023-10-16T19:57:17.538 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.430+0000 7f99b98b5700 1 -- 172.21.15.157:0/3602937403 --> [v2:172.21.15.187:6800/3841016811,v1:172.21.15.187:6801/3841016811] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f99b40ced40 con 0x7f99b4157710 2023-10-16T19:57:17.539 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.430+0000 7feba115f700 1 -- 172.21.15.157:0/1848015034 >> [v2:172.21.15.187:6816/654976824,v1:172.21.15.187:6817/654976824] conn(0x7feb880730a0 msgr2=0x7feb880754c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:17.539 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.430+0000 7feba115f700 1 --2- 172.21.15.157:0/1848015034 >> [v2:172.21.15.187:6816/654976824,v1:172.21.15.187:6817/654976824] conn(0x7feb880730a0 0x7feb880754c0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:17.539 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.430+0000 7feba115f700 1 -- 172.21.15.157:0/1848015034 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7feb8806af00 msgr2=0x7feb8806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:17.539 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.430+0000 7feba115f700 1 --2- 172.21.15.157:0/1848015034 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7feb8806af00 0x7feb8806d3c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7feb90006b20 tx=0x7feb90008040 comp rx=0 tx=0).stop 2023-10-16T19:57:17.540 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.430+0000 7feba115f700 1 -- 172.21.15.157:0/1848015034 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7feb9c1626d0 msgr2=0x7feb9c06d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:17.540 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.430+0000 7feba115f700 1 --2- 172.21.15.157:0/1848015034 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7feb9c1626d0 0x7feb9c06d440 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7feb8c000f60 tx=0x7feb8c00c730 comp rx=0 tx=0).stop 2023-10-16T19:57:17.540 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.430+0000 7fc47b8ac700 1 -- 172.21.15.157:0/1692077095 --> [v2:172.21.15.157:6814/989329821,v1:172.21.15.157:6816/989329821] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fc454005cb0 con 0x7fc4540015e0 2023-10-16T19:57:17.541 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.430+0000 7feb9b59e700 1 -- 172.21.15.157:0/1848015034 reap_dead start 2023-10-16T19:57:17.541 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.430+0000 7feba115f700 1 -- 172.21.15.157:0/1848015034 shutdown_connections 2023-10-16T19:57:17.541 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.430+0000 7feba115f700 1 -- 172.21.15.157:0/1848015034 >> 172.21.15.157:0/1848015034 conn(0x7feb9c0cf950 msgr2=0x7feb9c0cb500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:17.542 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.428+0000 7f7e9a0ed700 1 -- 172.21.15.157:0/1187901600 shutdown_connections 2023-10-16T19:57:17.542 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.431+0000 7f7e9a0ed700 1 -- 172.21.15.157:0/1187901600 wait complete. 2023-10-16T19:57:17.542 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.431+0000 7f99a3fff700 1 -- 172.21.15.157:0/3602937403 <== osd.4 v2:172.21.15.187:6800/3841016811 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f99b40ced40 con 0x7f99b4157710 2023-10-16T19:57:17.543 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.431+0000 7f99b98b5700 1 -- 172.21.15.157:0/3602937403 >> [v2:172.21.15.187:6800/3841016811,v1:172.21.15.187:6801/3841016811] conn(0x7f99b4157710 msgr2=0x7f99b4157af0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:17.543 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.431+0000 7f99b98b5700 1 --2- 172.21.15.157:0/3602937403 >> [v2:172.21.15.187:6800/3841016811,v1:172.21.15.187:6801/3841016811] conn(0x7f99b4157710 0x7f99b4157af0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:17.543 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.431+0000 7fc469ffb700 1 -- 172.21.15.157:0/1692077095 <== osd.3 v2:172.21.15.157:6814/989329821 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fc454005cb0 con 0x7fc4540015e0 2023-10-16T19:57:17.544 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.431+0000 7feba115f700 1 -- 172.21.15.157:0/1848015034 shutdown_connections 2023-10-16T19:57:17.544 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.431+0000 7feba115f700 1 -- 172.21.15.157:0/1848015034 wait complete. 2023-10-16T19:57:17.545 INFO:teuthology.orchestra.run.smithi157.stdout:55834574854 2023-10-16T19:57:17.546 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-16T19:57:17.546 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.439+0000 7fc47b8ac700 1 -- 172.21.15.157:0/1692077095 >> [v2:172.21.15.157:6814/989329821,v1:172.21.15.157:6816/989329821] conn(0x7fc4540015e0 msgr2=0x7fc454003aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:17.547 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.439+0000 7fc47b8ac700 1 --2- 172.21.15.157:0/1692077095 >> [v2:172.21.15.157:6814/989329821,v1:172.21.15.157:6816/989329821] conn(0x7fc4540015e0 0x7fc454003aa0 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:17.547 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.439+0000 7f99b98b5700 1 -- 172.21.15.157:0/3602937403 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f999806afa0 msgr2=0x7f999806d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:17.547 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.439+0000 7f99b98b5700 1 --2- 172.21.15.157:0/3602937403 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f999806afa0 0x7f999806d460 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f99a4014040 tx=0x7f99a401c040 comp rx=0 tx=0).stop 2023-10-16T19:57:17.548 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.439+0000 7f99b98b5700 1 -- 172.21.15.157:0/3602937403 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f99b4146910 msgr2=0x7f99b4158a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:17.548 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.439+0000 7f99b98b5700 1 --2- 172.21.15.157:0/3602937403 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f99b4146910 0x7f99b4158a00 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f99a800b3c0 tx=0x7f99a800b6d0 comp rx=0 tx=0).stop 2023-10-16T19:57:17.548 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.439+0000 7f99b37fe700 1 -- 172.21.15.157:0/3602937403 reap_dead start 2023-10-16T19:57:17.548 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.439+0000 7f99b98b5700 1 -- 172.21.15.157:0/3602937403 shutdown_connections 2023-10-16T19:57:17.548 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.439+0000 7f99b98b5700 1 -- 172.21.15.157:0/3602937403 >> 172.21.15.157:0/3602937403 conn(0x7f99b40cf950 msgr2=0x7f99b40cc1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:17.549 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.440+0000 7f99b98b5700 1 -- 172.21.15.157:0/3602937403 shutdown_connections 2023-10-16T19:57:17.549 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.440+0000 7fc47b8ac700 1 -- 172.21.15.157:0/1692077095 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fc45806af00 msgr2=0x7fc45806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:17.549 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.440+0000 7fc47b8ac700 1 --2- 172.21.15.157:0/1692077095 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fc45806af00 0x7fc45806d3c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fc46c00d690 tx=0x7fc46c015000 comp rx=0 tx=0).stop 2023-10-16T19:57:17.549 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.440+0000 7fc47b8ac700 1 -- 172.21.15.157:0/1692077095 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc4740cbcc0 msgr2=0x7fc47414cfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:17.550 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.440+0000 7fc47b8ac700 1 --2- 172.21.15.157:0/1692077095 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc4740cbcc0 0x7fc47414cfe0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fc47000b530 tx=0x7fc47000b840 comp rx=0 tx=0).stop 2023-10-16T19:57:17.550 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.440+0000 7fc479e49700 1 -- 172.21.15.157:0/1692077095 reap_dead start 2023-10-16T19:57:17.550 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.441+0000 7f99b98b5700 1 -- 172.21.15.157:0/3602937403 wait complete. 2023-10-16T19:57:17.551 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.442+0000 7fc47b8ac700 1 -- 172.21.15.157:0/1692077095 shutdown_connections 2023-10-16T19:57:17.551 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.442+0000 7fc47b8ac700 1 -- 172.21.15.157:0/1692077095 >> 172.21.15.157:0/1692077095 conn(0x7fc4740cf950 msgr2=0x7fc474157fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:17.551 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.442+0000 7fc47b8ac700 1 -- 172.21.15.157:0/1692077095 shutdown_connections 2023-10-16T19:57:17.552 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.442+0000 7fc47b8ac700 1 -- 172.21.15.157:0/1692077095 wait complete. 2023-10-16T19:57:17.552 INFO:teuthology.orchestra.run.smithi157.stdout:55834574854 2023-10-16T19:57:17.553 INFO:teuthology.orchestra.run.smithi157.stdout:55834574854 2023-10-16T19:57:17.553 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-10-16T19:57:17.554 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-10-16T19:57:17.555 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.448+0000 7fb021ac0700 1 -- 172.21.15.157:0/3142839193 --> [v2:172.21.15.157:6800/3482825047,v1:172.21.15.157:6801/3482825047] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb01c0cd800 con 0x7fb01c1526c0 2023-10-16T19:57:17.555 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.448+0000 7fb003fff700 1 -- 172.21.15.157:0/3142839193 <== osd.1 v2:172.21.15.157:6800/3482825047 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fb010009d00 con 0x7fb01c1526c0 2023-10-16T19:57:17.556 INFO:teuthology.orchestra.run.smithi157.stdout:55834574854 2023-10-16T19:57:17.556 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-16T19:57:17.557 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.449+0000 7fb021ac0700 1 -- 172.21.15.157:0/3142839193 >> [v2:172.21.15.157:6800/3482825047,v1:172.21.15.157:6801/3482825047] conn(0x7fb01c1526c0 msgr2=0x7fb01c152aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:17.557 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.449+0000 7fb021ac0700 1 --2- 172.21.15.157:0/3142839193 >> [v2:172.21.15.157:6800/3482825047,v1:172.21.15.157:6801/3482825047] conn(0x7fb01c1526c0 0x7fb01c152aa0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:17.558 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.449+0000 7fb021ac0700 1 -- 172.21.15.157:0/3142839193 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fb00806af00 msgr2=0x7fb00806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:17.558 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.449+0000 7fb021ac0700 1 --2- 172.21.15.157:0/3142839193 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fb00806af00 0x7fb00806d3c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb014000f80 tx=0x7fb014014000 comp rx=0 tx=0).stop 2023-10-16T19:57:17.558 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.449+0000 7fb021ac0700 1 -- 172.21.15.157:0/3142839193 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb01c159f00 msgr2=0x7fb01c150400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:17.558 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.449+0000 7fb021ac0700 1 --2- 172.21.15.157:0/3142839193 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb01c159f00 0x7fb01c150400 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb00c00ab40 tx=0x7fb00c00ae50 comp rx=0 tx=0).stop 2023-10-16T19:57:17.558 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.449+0000 7fb01bfff700 1 -- 172.21.15.157:0/3142839193 reap_dead start 2023-10-16T19:57:17.559 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.449+0000 7fb021ac0700 1 -- 172.21.15.157:0/3142839193 shutdown_connections 2023-10-16T19:57:17.559 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.449+0000 7fb021ac0700 1 -- 172.21.15.157:0/3142839193 >> 172.21.15.157:0/3142839193 conn(0x7fb01c0cf950 msgr2=0x7fb01c1591c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:17.559 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.449+0000 7fb021ac0700 1 -- 172.21.15.157:0/3142839193 shutdown_connections 2023-10-16T19:57:17.559 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.449+0000 7fb021ac0700 1 -- 172.21.15.157:0/3142839193 wait complete. 2023-10-16T19:57:17.560 INFO:teuthology.orchestra.run.smithi157.stdout:55834574854 2023-10-16T19:57:17.560 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-10-16T19:57:17.561 INFO:teuthology.orchestra.run.smithi157.stdout:55834574854 2023-10-16T19:57:17.562 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-10-16T19:57:17.562 INFO:teuthology.orchestra.run.smithi157.stdout:55834574854 2023-10-16T19:57:17.563 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-16T19:57:17.564 INFO:teuthology.orchestra.run.smithi157.stdout:55834574854 2023-10-16T19:57:17.564 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-16T19:57:17.805 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.802+0000 7f0738b81700 1 Processor -- start 2023-10-16T19:57:17.805 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.802+0000 7f0738b81700 1 -- start start 2023-10-16T19:57:17.806 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.803+0000 7fdaef3f8700 1 Processor -- start 2023-10-16T19:57:17.806 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.803+0000 7fdaef3f8700 1 -- start start 2023-10-16T19:57:17.807 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.804+0000 7f0738b81700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f073415b130 0x7f0734071f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:17.807 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.804+0000 7f0738b81700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f073406eb20 0x7f073406efb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:17.807 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.804+0000 7f0738b81700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07340cefc0 con 0x7f073406d0f0 2023-10-16T19:57:17.807 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.804+0000 7f0738b81700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07340b0050 con 0x7f073415b130 2023-10-16T19:57:17.808 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.804+0000 7f0738b81700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f073406f4f0 con 0x7f073406eb20 2023-10-16T19:57:17.808 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.804+0000 7f0731d9b700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f073406d0f0 0x7f07340cb970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:55566/0 (socket says 172.21.15.157:55566) 2023-10-16T19:57:17.808 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.804+0000 7f0731d9b700 1 -- 172.21.15.157:0/2055487972 learned_addr learned my addr 172.21.15.157:0/2055487972 (peer_addr_for_me v1:172.21.15.157:0/0) 2023-10-16T19:57:17.808 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.804+0000 7f073259c700 1 --2- 172.21.15.157:0/2055487972 >> v2:172.21.15.187:3300/0 conn(0x7f073415b130 0x7f0734071f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:17.808 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.804+0000 7f073259c700 1 -- 172.21.15.157:0/2055487972 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f073406eb20 msgr2=0x7f073406efb0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-16T19:57:17.809 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.804+0000 7f073259c700 1 --2- 172.21.15.157:0/2055487972 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f073406eb20 0x7f073406efb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:17.809 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.804+0000 7f073259c700 1 -- 172.21.15.157:0/2055487972 >> v1:172.21.15.157:6789/0 conn(0x7f073406d0f0 legacy=0x7f07340cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:17.809 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.804+0000 7f073259c700 1 -- 172.21.15.157:0/2055487972 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f073406e090 con 0x7f073415b130 2023-10-16T19:57:17.809 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.805+0000 7f073259c700 1 --2- 172.21.15.157:0/2055487972 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f073415b130 0x7f0734071f60 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f0724009840 tx=0x7f0724009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=df72d79b5b8a5b24 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:17.810 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.805+0000 7fdaef3f8700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fdae806dfb0 0x7fdae80cdd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:17.810 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.805+0000 7fdaef3f8700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fdae806d3d0 0x7fdae8071110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:17.811 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.806+0000 7f073159a700 1 -- 172.21.15.157:0/2055487972 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0724011830 con 0x7f073415b130 2023-10-16T19:57:17.811 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.806+0000 7f073159a700 1 -- 172.21.15.157:0/2055487972 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0724011990 con 0x7f073415b130 2023-10-16T19:57:17.811 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.806+0000 7f073159a700 1 -- 172.21.15.157:0/2055487972 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0724011d20 con 0x7f073415b130 2023-10-16T19:57:17.811 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.806+0000 7f824f5bf700 1 Processor -- start 2023-10-16T19:57:17.812 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.806+0000 7f824f5bf700 1 -- start start 2023-10-16T19:57:17.812 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.806+0000 7f230ab7a700 1 Processor -- start 2023-10-16T19:57:17.813 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.805+0000 7fdaef3f8700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdae806d8b0 con 0x7fdae806a850 2023-10-16T19:57:17.813 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.806+0000 7fdaef3f8700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdae8161b80 con 0x7fdae806dfb0 2023-10-16T19:57:17.813 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.806+0000 7fdaef3f8700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdae80cd8b0 con 0x7fdae806d3d0 2023-10-16T19:57:17.813 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.806+0000 7fdaec993700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fdae806dfb0 0x7fdae80cdd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:17.813 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.806+0000 7fdaec993700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fdae806dfb0 0x7fdae80cdd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:45898/0 (socket says 172.21.15.157:45898) 2023-10-16T19:57:17.814 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.806+0000 7fdaec993700 1 -- 172.21.15.157:0/66813361 learned_addr learned my addr 172.21.15.157:0/66813361 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:57:17.814 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.806+0000 7fdaed995700 1 --2- 172.21.15.157:0/66813361 >> v2:172.21.15.187:3300/0 conn(0x7fdae806d3d0 0x7fdae8071110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:17.814 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.806+0000 7fdaed995700 1 -- 172.21.15.157:0/66813361 >> v2:172.21.15.157:3300/0 conn(0x7fdae806dfb0 msgr2=0x7fdae80cdd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:57:17.814 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.806+0000 7fdaed995700 1 --2- 172.21.15.157:0/66813361 >> v2:172.21.15.157:3300/0 conn(0x7fdae806dfb0 0x7fdae80cdd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:17.814 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.806+0000 7fdaed995700 1 -- 172.21.15.157:0/66813361 >> v1:172.21.15.187:6789/0 conn(0x7fdae806a850 legacy=0x7fdae806ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:17.815 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.806+0000 7fdaed995700 1 -- 172.21.15.157:0/66813361 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdae806f0e0 con 0x7fdae806d3d0 2023-10-16T19:57:17.815 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.806+0000 7fdadffff700 1 -- 172.21.15.157:0/66813361 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 877168547 0 0) 0x7fdae806d8b0 con 0x7fdae806a850 2023-10-16T19:57:17.815 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.806+0000 7fdaed995700 1 --2- 172.21.15.157:0/66813361 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdae806d3d0 0x7fdae8071110 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fdae80c7b80 tx=0x7fdae000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d1264bb88dd4b3db server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:17.815 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.807+0000 7fdadffff700 1 -- 172.21.15.157:0/66813361 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdae000e070 con 0x7fdae806d3d0 2023-10-16T19:57:17.815 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.807+0000 7fdadffff700 1 -- 172.21.15.157:0/66813361 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdae000bb20 con 0x7fdae806d3d0 2023-10-16T19:57:17.816 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.807+0000 7fdadffff700 1 -- 172.21.15.157:0/66813361 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdae0012430 con 0x7fdae806d3d0 2023-10-16T19:57:17.816 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.807+0000 7f0738b81700 1 -- 172.21.15.157:0/2055487972 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f073415b130 msgr2=0x7f0734071f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:17.816 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.807+0000 7f0738b81700 1 --2- 172.21.15.157:0/2055487972 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f073415b130 0x7f0734071f60 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f0724009840 tx=0x7f0724009b50 comp rx=0 tx=0).stop 2023-10-16T19:57:17.817 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.808+0000 7f0738b81700 1 -- 172.21.15.157:0/2055487972 shutdown_connections 2023-10-16T19:57:17.817 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.808+0000 7f0738b81700 1 --2- 172.21.15.157:0/2055487972 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f073406eb20 0x7f073406efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:17.817 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.808+0000 7f0738b81700 1 --2- 172.21.15.157:0/2055487972 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f073415b130 0x7f0734071f60 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:17.817 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.808+0000 7f0738b81700 1 -- 172.21.15.157:0/2055487972 >> 172.21.15.157:0/2055487972 conn(0x7f07340cd4e0 msgr2=0x7f07340cd8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:17.818 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.808+0000 7f824f5bf700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f82480c2d50 0x7f82480aea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:17.818 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.808+0000 7f824f5bf700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f82480cdc30 0x7f82480cb900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:17.818 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.808+0000 7f824f5bf700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8248166b40 con 0x7f82480c9fa0 2023-10-16T19:57:17.818 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.808+0000 7f824f5bf700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82481629f0 con 0x7f82480cdc30 2023-10-16T19:57:17.819 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.808+0000 7f824f5bf700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82480ca4a0 con 0x7f82480c2d50 2023-10-16T19:57:17.819 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.807+0000 7f230ab7a700 1 -- start start 2023-10-16T19:57:17.819 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.808+0000 7f230ab7a700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f23040cf110 0x7f23040cf900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:17.819 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.808+0000 7f230ab7a700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f230406cd80 0x7f230415a960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:17.820 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.808+0000 7f230ab7a700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23040cf4f0 con 0x7f23040cdd90 2023-10-16T19:57:17.820 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.808+0000 7f230ab7a700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23040d0110 con 0x7f23040cf110 2023-10-16T19:57:17.820 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.808+0000 7f230ab7a700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23040cfe40 con 0x7f230406cd80 2023-10-16T19:57:17.821 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.808+0000 7fdaef3f8700 1 -- 172.21.15.157:0/66813361 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdae806d3d0 msgr2=0x7fdae8071110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:17.821 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.808+0000 7fdaef3f8700 1 --2- 172.21.15.157:0/66813361 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdae806d3d0 0x7fdae8071110 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fdae80c7b80 tx=0x7fdae000b330 comp rx=0 tx=0).stop 2023-10-16T19:57:17.821 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.808+0000 7fdaef3f8700 1 -- 172.21.15.157:0/66813361 shutdown_connections 2023-10-16T19:57:17.821 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.808+0000 7fdaef3f8700 1 --2- 172.21.15.157:0/66813361 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdae806d3d0 0x7fdae8071110 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:17.821 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.808+0000 7fdaef3f8700 1 --2- 172.21.15.157:0/66813361 >> v2:172.21.15.157:3300/0 conn(0x7fdae806dfb0 0x7fdae80cdd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:17.822 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.808+0000 7fdaef3f8700 1 -- 172.21.15.157:0/66813361 >> 172.21.15.157:0/66813361 conn(0x7fdae806c0f0 msgr2=0x7fdae80b2630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:17.822 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.808+0000 7f824d35b700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f82480c2d50 0x7f82480aea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:17.822 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.808+0000 7f824cb5a700 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7f82480c9fa0 0x7f82480cd520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.157:39272/0 (socket says 172.21.15.157:39272) 2023-10-16T19:57:17.823 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.808+0000 7f824cb5a700 1 -- 172.21.15.157:0/287940682 learned_addr learned my addr 172.21.15.157:0/287940682 (peer_addr_for_me v1:172.21.15.157:0/0) 2023-10-16T19:57:17.823 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.808+0000 7f8441ad8700 1 Processor -- start 2023-10-16T19:57:17.823 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.808+0000 7f8441ad8700 1 -- start start 2023-10-16T19:57:17.825 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.808+0000 7f2303fff700 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7f23040cdd90 0x7f230406c670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.157:39274/0 (socket says 172.21.15.157:39274) 2023-10-16T19:57:17.826 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.808+0000 7f2303fff700 1 -- 172.21.15.157:0/3234882359 learned_addr learned my addr 172.21.15.157:0/3234882359 (peer_addr_for_me v1:172.21.15.157:0/0) 2023-10-16T19:57:17.826 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.808+0000 7f2308916700 1 --2- 172.21.15.157:0/3234882359 >> v2:172.21.15.187:3300/0 conn(0x7f23040cf110 0x7f23040cf900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:17.826 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.808+0000 7f2309117700 1 --2- 172.21.15.157:0/3234882359 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f230406cd80 0x7f230415a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:17.826 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.808+0000 7f823ffff700 1 -- 172.21.15.157:0/287940682 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3066288425 0 0) 0x7f8248166b40 con 0x7f82480c9fa0 2023-10-16T19:57:17.827 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.808+0000 7f824db5c700 1 --2- 172.21.15.157:0/287940682 >> v2:172.21.15.187:3300/0 conn(0x7f82480cdc30 0x7f82480cb900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:17.827 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.808+0000 7f823ffff700 1 -- 172.21.15.157:0/287940682 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f82340035b0 con 0x7f82480c9fa0 2023-10-16T19:57:17.827 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.808+0000 7f23037fe700 1 -- 172.21.15.157:0/3234882359 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3689328202 0 0) 0x7f23040cf4f0 con 0x7f23040cdd90 2023-10-16T19:57:17.828 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.808+0000 7f23037fe700 1 -- 172.21.15.157:0/3234882359 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f22f40035b0 con 0x7f23040cdd90 2023-10-16T19:57:17.828 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.809+0000 7f2308916700 1 -- 172.21.15.157:0/3234882359 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f230406cd80 msgr2=0x7f230415a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:57:17.828 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.809+0000 7f2308916700 1 --2- 172.21.15.157:0/3234882359 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f230406cd80 0x7f230415a960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:17.828 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.809+0000 7f2308916700 1 -- 172.21.15.157:0/3234882359 >> v1:172.21.15.187:6789/0 conn(0x7f23040cdd90 legacy=0x7f230406c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:17.829 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.808+0000 7f824d35b700 1 -- 172.21.15.157:0/287940682 >> v2:172.21.15.187:3300/0 conn(0x7f82480cdc30 msgr2=0x7f82480cb900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:57:17.829 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.808+0000 7f824d35b700 1 --2- 172.21.15.157:0/287940682 >> v2:172.21.15.187:3300/0 conn(0x7f82480cdc30 0x7f82480cb900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:17.829 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.808+0000 7f824d35b700 1 -- 172.21.15.157:0/287940682 >> v1:172.21.15.187:6789/0 conn(0x7f82480c9fa0 legacy=0x7f82480cd520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:17.829 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.808+0000 7f824d35b700 1 -- 172.21.15.157:0/287940682 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8248166210 con 0x7f82480c2d50 2023-10-16T19:57:17.830 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.809+0000 7f2308916700 1 -- 172.21.15.157:0/3234882359 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f230415e0f0 con 0x7f23040cf110 2023-10-16T19:57:17.830 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.809+0000 7f824d35b700 1 --2- 172.21.15.157:0/287940682 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f82480c2d50 0x7f82480aea80 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f8238009840 tx=0x7f8238009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cdc75f10814b982 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:17.831 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.809+0000 7f0738b81700 1 -- 172.21.15.157:0/2055487972 shutdown_connections 2023-10-16T19:57:17.831 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.809+0000 7f2308916700 1 --2- 172.21.15.157:0/3234882359 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f23040cf110 0x7f23040cf900 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f22f800dc50 tx=0x7f22f800df60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=392b12a99100df6f server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:17.831 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.809+0000 7f0738b81700 1 -- 172.21.15.157:0/2055487972 wait complete. 2023-10-16T19:57:17.832 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.809+0000 7fbe13f82700 1 Processor -- start 2023-10-16T19:57:17.832 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.809+0000 7f454e405700 1 Processor -- start 2023-10-16T19:57:17.833 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.809+0000 7f454e405700 1 -- start start 2023-10-16T19:57:17.833 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.809+0000 7f8441ad8700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f843c15de60 0x7f843c070ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:17.833 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.809+0000 7f8441ad8700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f843c15e240 0x7f843c0ad860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:17.834 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.809+0000 7f8441ad8700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f843c0adda0 0x7f843c161b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:17.834 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.809+0000 7f8441ad8700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f843c071900 con 0x7f843c15de60 2023-10-16T19:57:17.834 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.809+0000 7f8441ad8700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f843c0cab20 con 0x7f843c15e240 2023-10-16T19:57:17.834 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.809+0000 7f8441ad8700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f843c0cae00 con 0x7f843c0adda0 2023-10-16T19:57:17.835 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.809+0000 7fbe13f82700 1 -- start start 2023-10-16T19:57:17.835 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.809+0000 7f823ffff700 1 -- 172.21.15.157:0/287940682 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8238011830 con 0x7f82480c2d50 2023-10-16T19:57:17.835 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.809+0000 7f823ffff700 1 -- 172.21.15.157:0/287940682 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8238011990 con 0x7f82480c2d50 2023-10-16T19:57:17.836 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.809+0000 7f823ffff700 1 -- 172.21.15.157:0/287940682 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8238011d20 con 0x7f82480c2d50 2023-10-16T19:57:17.836 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.810+0000 7f843affd700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f843c15e240 0x7f843c0ad860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:17.836 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.810+0000 7f843affd700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f843c15e240 0x7f843c0ad860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.157:41024/0 (socket says 172.21.15.157:41024) 2023-10-16T19:57:17.836 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.810+0000 7f843affd700 1 -- 172.21.15.157:0/3169792346 learned_addr learned my addr 172.21.15.157:0/3169792346 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:57:17.837 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.810+0000 7f843bfff700 1 --2- 172.21.15.157:0/3169792346 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f843c0adda0 0x7f843c161b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:17.837 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.810+0000 7f23037fe700 1 -- 172.21.15.157:0/3234882359 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22f8012070 con 0x7f23040cf110 2023-10-16T19:57:17.837 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.810+0000 7f843affd700 1 -- 172.21.15.157:0/3169792346 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f843c0adda0 msgr2=0x7f843c161b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:57:17.838 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.810+0000 7f843affd700 1 --2- 172.21.15.157:0/3169792346 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f843c0adda0 0x7f843c161b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:17.838 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.810+0000 7f843affd700 1 -- 172.21.15.157:0/3169792346 >> v2:172.21.15.157:3300/0 conn(0x7f843c15de60 msgr2=0x7f843c070ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:57:17.838 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.810+0000 7f843affd700 1 --2- 172.21.15.157:0/3169792346 >> v2:172.21.15.157:3300/0 conn(0x7f843c15de60 0x7f843c070ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:17.838 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.810+0000 7f843affd700 1 -- 172.21.15.157:0/3169792346 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f843c0cb0e0 con 0x7f843c15e240 2023-10-16T19:57:17.839 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.810+0000 7f23037fe700 1 -- 172.21.15.157:0/3234882359 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22f8006b10 con 0x7f23040cf110 2023-10-16T19:57:17.839 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.810+0000 7f23037fe700 1 -- 172.21.15.157:0/3234882359 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22f800f6b0 con 0x7f23040cf110 2023-10-16T19:57:17.839 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.810+0000 7f824f5bf700 1 -- 172.21.15.157:0/287940682 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f82480c2d50 msgr2=0x7f82480aea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:17.840 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.810+0000 7f824f5bf700 1 --2- 172.21.15.157:0/287940682 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f82480c2d50 0x7f82480aea80 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f8238009840 tx=0x7f8238009b50 comp rx=0 tx=0).stop 2023-10-16T19:57:17.840 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.810+0000 7f843affd700 1 --2- 172.21.15.157:0/3169792346 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f843c15e240 0x7f843c0ad860 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f843c0ca410 tx=0x7f842c009bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c470de1a8a4b1d26 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:17.840 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.810+0000 7f454e405700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f454815ad70 0x7f45480716e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:17.841 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.810+0000 7f454e405700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f45480ca1b0 0x7f45480cc360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:17.841 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.811+0000 7f454e405700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45480706f0 con 0x7f45480cb350 2023-10-16T19:57:17.841 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.811+0000 7f454e405700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45480712c0 con 0x7f454815ad70 2023-10-16T19:57:17.841 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.811+0000 7f454e405700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f454815b150 con 0x7f45480ca1b0 2023-10-16T19:57:17.841 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.811+0000 7f454c9a2700 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7f45480cb350 0x7f45480cd520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.157:39292/0 (socket says 172.21.15.157:39292) 2023-10-16T19:57:17.842 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.811+0000 7f454c9a2700 1 -- 172.21.15.157:0/2874626659 learned_addr learned my addr 172.21.15.157:0/2874626659 (peer_addr_for_me v1:172.21.15.157:0/0) 2023-10-16T19:57:17.842 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.811+0000 7f824f5bf700 1 -- 172.21.15.157:0/287940682 shutdown_connections 2023-10-16T19:57:17.842 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.811+0000 7f824f5bf700 1 --2- 172.21.15.157:0/287940682 >> v2:172.21.15.187:3300/0 conn(0x7f82480cdc30 0x7f82480cb900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:17.842 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.811+0000 7f824f5bf700 1 --2- 172.21.15.157:0/287940682 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f82480c2d50 0x7f82480aea80 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:17.843 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.811+0000 7f824f5bf700 1 -- 172.21.15.157:0/287940682 >> 172.21.15.157:0/287940682 conn(0x7f82480b1540 msgr2=0x7f82480b1920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:17.843 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.811+0000 7f45477fe700 1 --2- 172.21.15.157:0/2874626659 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f45480ca1b0 0x7f45480cc360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:17.844 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.811+0000 7f230ab7a700 1 -- 172.21.15.157:0/3234882359 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f23040cf110 msgr2=0x7f23040cf900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:17.844 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.811+0000 7f230ab7a700 1 --2- 172.21.15.157:0/3234882359 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f23040cf110 0x7f23040cf900 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f22f800dc50 tx=0x7f22f800df60 comp rx=0 tx=0).stop 2023-10-16T19:57:17.844 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.811+0000 7f0738b81700 1 Processor -- start 2023-10-16T19:57:17.845 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.811+0000 7f843a7fc700 1 -- 172.21.15.157:0/3169792346 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f842c011830 con 0x7f843c15e240 2023-10-16T19:57:17.845 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.811+0000 7f843a7fc700 1 -- 172.21.15.157:0/3169792346 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f842c011990 con 0x7f843c15e240 2023-10-16T19:57:17.845 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.811+0000 7f843a7fc700 1 -- 172.21.15.157:0/3169792346 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f842c011d20 con 0x7f843c15e240 2023-10-16T19:57:17.845 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.810+0000 7fbe13f82700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbe0c0cf080 0x7fbe0c0665a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:17.846 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.810+0000 7fbe13f82700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fbe0c06c670 0x7fbe0c06caa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:17.846 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.810+0000 7fbe13f82700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe0c06cfe0 con 0x7fbe0c0cdd90 2023-10-16T19:57:17.846 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.810+0000 7fbe13f82700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe0c0d0110 con 0x7fbe0c06c670 2023-10-16T19:57:17.846 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.810+0000 7fbe13f82700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe0c15b970 con 0x7fbe0c0cf080 2023-10-16T19:57:17.847 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.811+0000 7f4547fff700 1 --2- 172.21.15.157:0/2874626659 >> v2:172.21.15.187:3300/0 conn(0x7f454815ad70 0x7f45480716e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:17.847 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.811+0000 7f824f5bf700 1 -- 172.21.15.157:0/287940682 shutdown_connections 2023-10-16T19:57:17.848 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.811+0000 7fbe11d1e700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7fbe0c0cdd90 0x7fbe0c0cf900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:55598/0 (socket says 172.21.15.157:55598) 2023-10-16T19:57:17.848 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.811+0000 7fbe11d1e700 1 -- 172.21.15.157:0/2186225474 learned_addr learned my addr 172.21.15.157:0/2186225474 (peer_addr_for_me v1:172.21.15.157:0/0) 2023-10-16T19:57:17.848 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.811+0000 7fbe1251f700 1 --2- 172.21.15.157:0/2186225474 >> v2:172.21.15.157:3300/0 conn(0x7fbe0c06c670 0x7fbe0c06caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:17.849 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.811+0000 7f45477fe700 1 -- 172.21.15.157:0/2874626659 >> v2:172.21.15.187:3300/0 conn(0x7f454815ad70 msgr2=0x7f45480716e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:57:17.849 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.811+0000 7f45477fe700 1 --2- 172.21.15.157:0/2874626659 >> v2:172.21.15.187:3300/0 conn(0x7f454815ad70 0x7f45480716e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:17.849 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.811+0000 7f45477fe700 1 -- 172.21.15.157:0/2874626659 >> v1:172.21.15.187:6789/0 conn(0x7f45480cb350 legacy=0x7f45480cd520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:17.850 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.811+0000 7f45477fe700 1 -- 172.21.15.157:0/2874626659 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45480ca690 con 0x7f45480ca1b0 2023-10-16T19:57:17.850 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.811+0000 7f45477fe700 1 --2- 172.21.15.157:0/2874626659 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f45480ca1b0 0x7f45480cc360 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f453c009840 tx=0x7f453c009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=92f66795123d925c server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:17.850 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.812+0000 7f4546ffd700 1 -- 172.21.15.157:0/2874626659 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f453c011830 con 0x7f45480ca1b0 2023-10-16T19:57:17.850 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.812+0000 7f4546ffd700 1 -- 172.21.15.157:0/2874626659 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f453c011990 con 0x7f45480ca1b0 2023-10-16T19:57:17.850 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.812+0000 7f4546ffd700 1 -- 172.21.15.157:0/2874626659 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f453c011d00 con 0x7f45480ca1b0 2023-10-16T19:57:17.851 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.812+0000 7fbe1251f700 1 -- 172.21.15.157:0/2186225474 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbe0c0cf080 msgr2=0x7fbe0c0665a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-16T19:57:17.851 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.812+0000 7fbe1251f700 1 --2- 172.21.15.157:0/2186225474 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbe0c0cf080 0x7fbe0c0665a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:17.851 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.812+0000 7fbe1251f700 1 -- 172.21.15.157:0/2186225474 >> v1:172.21.15.157:6789/0 conn(0x7fbe0c0cdd90 legacy=0x7fbe0c0cf900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:17.851 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.812+0000 7fbe1251f700 1 -- 172.21.15.157:0/2186225474 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe0c0cf500 con 0x7fbe0c06c670 2023-10-16T19:57:17.852 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.812+0000 7f8441ad8700 1 -- 172.21.15.157:0/3169792346 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f843c15e240 msgr2=0x7f843c0ad860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:17.852 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.812+0000 7f8441ad8700 1 --2- 172.21.15.157:0/3169792346 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f843c15e240 0x7f843c0ad860 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f843c0ca410 tx=0x7f842c009bd0 comp rx=0 tx=0).stop 2023-10-16T19:57:17.852 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.812+0000 7f8441ad8700 1 -- 172.21.15.157:0/3169792346 shutdown_connections 2023-10-16T19:57:17.852 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.812+0000 7f8441ad8700 1 --2- 172.21.15.157:0/3169792346 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f843c0adda0 0x7f843c161b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:17.853 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.812+0000 7f8441ad8700 1 --2- 172.21.15.157:0/3169792346 >> v2:172.21.15.157:3300/0 conn(0x7f843c15de60 0x7f843c070ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:17.853 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.812+0000 7f8441ad8700 1 --2- 172.21.15.157:0/3169792346 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f843c15e240 0x7f843c0ad860 secure :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f843c0ca410 tx=0x7f842c009bd0 comp rx=0 tx=0).stop 2023-10-16T19:57:17.853 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.812+0000 7f8441ad8700 1 -- 172.21.15.157:0/3169792346 >> 172.21.15.157:0/3169792346 conn(0x7f843c0cf950 msgr2=0x7f843c0cfd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:17.853 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.812+0000 7fbe1251f700 1 --2- 172.21.15.157:0/2186225474 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbe0c06c670 0x7fbe0c06caa0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fbe08009840 tx=0x7fbe08009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=828e34a0020b67b6 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:17.855 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.812+0000 7f8441ad8700 1 -- 172.21.15.157:0/3169792346 shutdown_connections 2023-10-16T19:57:17.855 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.812+0000 7fbe10d1c700 1 -- 172.21.15.157:0/2186225474 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe08011830 con 0x7fbe0c06c670 2023-10-16T19:57:17.855 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.812+0000 7fbe10d1c700 1 -- 172.21.15.157:0/2186225474 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe08011990 con 0x7fbe0c06c670 2023-10-16T19:57:17.856 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.812+0000 7fbe10d1c700 1 -- 172.21.15.157:0/2186225474 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe08011d20 con 0x7fbe0c06c670 2023-10-16T19:57:17.856 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.811+0000 7f0738b81700 1 -- start start 2023-10-16T19:57:17.856 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.812+0000 7f0738b81700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f073406d0f0 0x7f07340c9490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:17.857 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.812+0000 7f0738b81700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f073406eb20 0x7f07340b5e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:17.857 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.812+0000 7f0738b81700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f073415b130 0x7f0734152010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:17.857 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.812+0000 7f0738b81700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f073415a280 con 0x7f073406eb20 2023-10-16T19:57:17.857 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.812+0000 7f0738b81700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07340b51e0 con 0x7f073406d0f0 2023-10-16T19:57:17.857 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.812+0000 7f0738b81700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0734152550 con 0x7f073415b130 2023-10-16T19:57:17.858 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.813+0000 7f0732d9d700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f073415b130 0x7f0734152010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:17.858 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.813+0000 7f073259c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f073406d0f0 0x7f07340c9490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:17.858 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.813+0000 7f0732d9d700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f073415b130 0x7f0734152010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.157:55240/0 (socket says 172.21.15.157:55240) 2023-10-16T19:57:17.858 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.813+0000 7f0732d9d700 1 -- 172.21.15.157:0/3806631517 learned_addr learned my addr 172.21.15.157:0/3806631517 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:57:17.858 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.813+0000 7f0731d9b700 1 --2- 172.21.15.157:0/3806631517 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f073406eb20 0x7f07340b5e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:17.859 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.811+0000 7f824f5bf700 1 -- 172.21.15.157:0/287940682 wait complete. 2023-10-16T19:57:17.859 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.813+0000 7f824f5bf700 1 Processor -- start 2023-10-16T19:57:17.859 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.813+0000 7f454e405700 1 -- 172.21.15.157:0/2874626659 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f45480ca1b0 msgr2=0x7f45480cc360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:17.860 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.813+0000 7f454e405700 1 --2- 172.21.15.157:0/2874626659 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f45480ca1b0 0x7f45480cc360 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f453c009840 tx=0x7f453c009b50 comp rx=0 tx=0).stop 2023-10-16T19:57:17.860 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.813+0000 7fdaef3f8700 1 -- 172.21.15.157:0/66813361 shutdown_connections 2023-10-16T19:57:17.860 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.813+0000 7fdaef3f8700 1 -- 172.21.15.157:0/66813361 wait complete. 2023-10-16T19:57:17.861 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.813+0000 7f073259c700 1 -- 172.21.15.157:0/3806631517 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f073415b130 msgr2=0x7f0734152010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:17.861 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.813+0000 7f073259c700 1 --2- 172.21.15.157:0/3806631517 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f073415b130 0x7f0734152010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:17.861 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.813+0000 7f073259c700 1 -- 172.21.15.157:0/3806631517 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f073406eb20 msgr2=0x7f07340b5e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:17.861 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.813+0000 7f073259c700 1 --2- 172.21.15.157:0/3806631517 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f073406eb20 0x7f07340b5e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:17.861 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.813+0000 7f073259c700 1 -- 172.21.15.157:0/3806631517 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07240094a0 con 0x7f073406d0f0 2023-10-16T19:57:17.862 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.813+0000 7fbe13f82700 1 -- 172.21.15.157:0/2186225474 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbe0c06c670 msgr2=0x7fbe0c06caa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:17.862 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.813+0000 7fbe13f82700 1 --2- 172.21.15.157:0/2186225474 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbe0c06c670 0x7fbe0c06caa0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fbe08009840 tx=0x7fbe08009b50 comp rx=0 tx=0).stop 2023-10-16T19:57:17.862 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.813+0000 7fbe13f82700 1 -- 172.21.15.157:0/2186225474 shutdown_connections 2023-10-16T19:57:17.862 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.813+0000 7fbe13f82700 1 --2- 172.21.15.157:0/2186225474 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbe0c06c670 0x7fbe0c06caa0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:17.863 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.813+0000 7fbe13f82700 1 --2- 172.21.15.157:0/2186225474 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbe0c0cf080 0x7fbe0c0665a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:17.863 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.813+0000 7fbe13f82700 1 -- 172.21.15.157:0/2186225474 >> 172.21.15.157:0/2186225474 conn(0x7fbe0c0cceb0 msgr2=0x7fbe0c0cd290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:17.863 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.813+0000 7f073259c700 1 --2- 172.21.15.157:0/3806631517 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f073406d0f0 0x7f07340c9490 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f0724016000 tx=0x7f0724004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:17.864 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.813+0000 7f230ab7a700 1 -- 172.21.15.157:0/3234882359 shutdown_connections 2023-10-16T19:57:17.864 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.814+0000 7f230ab7a700 1 --2- 172.21.15.157:0/3234882359 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f230406cd80 0x7f230415a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:17.864 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.814+0000 7f230ab7a700 1 --2- 172.21.15.157:0/3234882359 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f23040cf110 0x7f23040cf900 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:17.864 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.814+0000 7f230ab7a700 1 -- 172.21.15.157:0/3234882359 >> 172.21.15.157:0/3234882359 conn(0x7f23040cceb0 msgr2=0x7f23040cd290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:17.865 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.814+0000 7fbe13f82700 1 -- 172.21.15.157:0/2186225474 shutdown_connections 2023-10-16T19:57:17.865 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.814+0000 7fbe13f82700 1 -- 172.21.15.157:0/2186225474 wait complete. 2023-10-16T19:57:17.866 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.813+0000 7f824f5bf700 1 -- start start 2023-10-16T19:57:17.866 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.814+0000 7f824f5bf700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f82480c2d50 0x7f824815ff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:17.866 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.814+0000 7f824f5bf700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f82480c9fa0 0x7f82481f7150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:17.866 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.814+0000 7f824f5bf700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f82480cdc30 0x7f82481f7690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:17.867 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.814+0000 7f824f5bf700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82481fbf00 con 0x7f82480cdc30 2023-10-16T19:57:17.867 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.814+0000 7f824f5bf700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82481f7bd0 con 0x7f82480c2d50 2023-10-16T19:57:17.867 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.814+0000 7f824f5bf700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82481fb2c0 con 0x7f82480c9fa0 2023-10-16T19:57:17.867 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.814+0000 7f824d35b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f82480c2d50 0x7f824815ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:17.868 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.814+0000 7f230ab7a700 1 -- 172.21.15.157:0/3234882359 shutdown_connections 2023-10-16T19:57:17.868 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.814+0000 7f824d35b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f82480c2d50 0x7f824815ff00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.157:41046/0 (socket says 172.21.15.157:41046) 2023-10-16T19:57:17.868 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.814+0000 7f824d35b700 1 -- 172.21.15.157:0/4284701692 learned_addr learned my addr 172.21.15.157:0/4284701692 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:57:17.868 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.814+0000 7f824db5c700 1 --2- 172.21.15.157:0/4284701692 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f82480cdc30 0x7f82481f7690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:17.869 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.812+0000 7f8441ad8700 1 -- 172.21.15.157:0/3169792346 wait complete. 2023-10-16T19:57:17.869 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.814+0000 7f8441ad8700 1 Processor -- start 2023-10-16T19:57:17.869 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.814+0000 7f824cb5a700 1 --2- 172.21.15.157:0/4284701692 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f82480c9fa0 0x7f82481f7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:17.870 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.814+0000 7f230ab7a700 1 -- 172.21.15.157:0/3234882359 wait complete. 2023-10-16T19:57:17.870 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.815+0000 7f824db5c700 1 -- 172.21.15.157:0/4284701692 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f82480c9fa0 msgr2=0x7f82481f7150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:17.871 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.815+0000 7f824db5c700 1 --2- 172.21.15.157:0/4284701692 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f82480c9fa0 0x7f82481f7150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:17.871 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.815+0000 7f824db5c700 1 -- 172.21.15.157:0/4284701692 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f82480c2d50 msgr2=0x7f824815ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:17.871 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.815+0000 7f824db5c700 1 --2- 172.21.15.157:0/4284701692 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f82480c2d50 0x7f824815ff00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:17.871 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.815+0000 7f824db5c700 1 -- 172.21.15.157:0/4284701692 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82380094a0 con 0x7f82480cdc30 2023-10-16T19:57:17.872 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.815+0000 7f8441ad8700 1 -- start start 2023-10-16T19:57:17.872 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.815+0000 7fdaef3f8700 1 Processor -- start 2023-10-16T19:57:17.873 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.815+0000 7f824db5c700 1 --2- 172.21.15.157:0/4284701692 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f82480cdc30 0x7f82481f7690 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f824806d440 tx=0x7f824000e0e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:17.873 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.815+0000 7fdaef3f8700 1 -- start start 2023-10-16T19:57:17.874 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.815+0000 7f823dffb700 1 -- 172.21.15.157:0/4284701692 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8240018070 con 0x7f82480cdc30 2023-10-16T19:57:17.874 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.815+0000 7f823dffb700 1 -- 172.21.15.157:0/4284701692 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8240003a20 con 0x7f82480cdc30 2023-10-16T19:57:17.874 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.815+0000 7f823dffb700 1 -- 172.21.15.157:0/4284701692 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8240003db0 con 0x7f82480cdc30 2023-10-16T19:57:17.875 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.816+0000 7fbe13f82700 1 Processor -- start 2023-10-16T19:57:17.875 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.816+0000 7fbe13f82700 1 -- start start 2023-10-16T19:57:17.875 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.816+0000 7f230ab7a700 1 Processor -- start 2023-10-16T19:57:17.876 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.816+0000 7f8441ad8700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f843c15de60 0x7f843c159130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:17.876 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.816+0000 7f8441ad8700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f843c15c390 0x7f843c0c7430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:17.876 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.816+0000 7f8441ad8700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f843c1f4400 0x7f843c1f48b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:17.877 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.816+0000 7f8441ad8700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f843c0c89b0 con 0x7f843c15de60 2023-10-16T19:57:17.877 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.816+0000 7f8441ad8700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f843c0c7da0 con 0x7f843c1f4400 2023-10-16T19:57:17.877 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.816+0000 7f8441ad8700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f843c0c8080 con 0x7f843c15c390 2023-10-16T19:57:17.877 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.816+0000 7f843b7fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f843c15de60 0x7f843c159130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:17.877 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.816+0000 7f843bfff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f843c1f4400 0x7f843c1f48b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:17.878 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.816+0000 7f843affd700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f843c15c390 0x7f843c0c7430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:17.878 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.816+0000 7f843b7fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f843c15de60 0x7f843c159130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:45944/0 (socket says 172.21.15.157:45944) 2023-10-16T19:57:17.878 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.816+0000 7f843b7fe700 1 -- 172.21.15.157:0/3342773935 learned_addr learned my addr 172.21.15.157:0/3342773935 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:57:17.878 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.816+0000 7f843bfff700 1 --2- 172.21.15.157:0/3342773935 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f843c1f4400 0x7f843c1f48b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.157:41054/0 (socket says 172.21.15.157:41054) 2023-10-16T19:57:17.878 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.816+0000 7f843bfff700 1 -- 172.21.15.157:0/3342773935 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f843c15c390 msgr2=0x7f843c0c7430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:17.879 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.816+0000 7f843bfff700 1 --2- 172.21.15.157:0/3342773935 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f843c15c390 0x7f843c0c7430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:17.879 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.816+0000 7f843bfff700 1 -- 172.21.15.157:0/3342773935 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f843c15de60 msgr2=0x7f843c159130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:17.879 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.816+0000 7f843bfff700 1 --2- 172.21.15.157:0/3342773935 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f843c15de60 0x7f843c159130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:17.879 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.816+0000 7f843bfff700 1 -- 172.21.15.157:0/3342773935 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f842c009550 con 0x7f843c1f4400 2023-10-16T19:57:17.879 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.816+0000 7f843b7fe700 1 --2- 172.21.15.157:0/3342773935 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f843c15de60 0x7f843c159130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T19:57:17.880 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.816+0000 7f843affd700 1 --2- 172.21.15.157:0/3342773935 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f843c15c390 0x7f843c0c7430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T19:57:17.880 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.816+0000 7fdaef3f8700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdae806a850 0x7fdae81571c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:17.880 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.816+0000 7fdaef3f8700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdae806d3d0 0x7fdae80b1d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:17.880 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.816+0000 7fdaef3f8700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdae806dfb0 0x7fdae80cb1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:17.881 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.816+0000 7fdaef3f8700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdae80b4530 con 0x7fdae806d3d0 2023-10-16T19:57:17.881 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.816+0000 7fdaef3f8700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdae80b4810 con 0x7fdae806a850 2023-10-16T19:57:17.881 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.816+0000 7fdaef3f8700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdae80b4af0 con 0x7fdae806dfb0 2023-10-16T19:57:17.881 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.817+0000 7fdaec993700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdae806d3d0 0x7fdae80b1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:17.881 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.817+0000 7fdaec993700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdae806d3d0 0x7fdae80b1d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:45950/0 (socket says 172.21.15.157:45950) 2023-10-16T19:57:17.882 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.817+0000 7fdaec993700 1 -- 172.21.15.157:0/831745026 learned_addr learned my addr 172.21.15.157:0/831745026 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:57:17.882 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.817+0000 7fdaec993700 1 -- 172.21.15.157:0/831745026 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdae806dfb0 msgr2=0x7fdae80cb1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:17.882 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.817+0000 7fdaec993700 1 --2- 172.21.15.157:0/831745026 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdae806dfb0 0x7fdae80cb1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:17.882 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.817+0000 7fdaec993700 1 -- 172.21.15.157:0/831745026 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdae806a850 msgr2=0x7fdae81571c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-16T19:57:17.882 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.817+0000 7fdaec993700 1 --2- 172.21.15.157:0/831745026 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdae806a850 0x7fdae81571c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:17.883 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.817+0000 7fdaec993700 1 -- 172.21.15.157:0/831745026 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdae0009a70 con 0x7fdae806d3d0 2023-10-16T19:57:17.883 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.818+0000 7fdaec993700 1 --2- 172.21.15.157:0/831745026 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdae806d3d0 0x7fdae80b1d80 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fdae400e800 tx=0x7fdae400ebc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:17.883 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.817+0000 7f824f5bf700 1 -- 172.21.15.157:0/4284701692 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82481fb560 con 0x7f82480cdc30 2023-10-16T19:57:17.883 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.817+0000 7f824f5bf700 1 -- 172.21.15.157:0/4284701692 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8248160440 con 0x7f82480cdc30 2023-10-16T19:57:17.884 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.817+0000 7f843bfff700 1 --2- 172.21.15.157:0/3342773935 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f843c1f4400 0x7f843c1f48b0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f843c071e30 tx=0x7f843000eb30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:17.884 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.817+0000 7fbe13f82700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbe0c06c670 0x7fbe0c0c5d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:17.884 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.817+0000 7fbe13f82700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbe0c0cdd90 0x7fbe0c15a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:17.885 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.817+0000 7fbe13f82700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbe0c0c3770 0x7fbe0c15ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:17.885 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.817+0000 7fbe13f82700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe0c0c4d40 con 0x7fbe0c0c3770 2023-10-16T19:57:17.885 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.817+0000 7fbe13f82700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe0c0c4f90 con 0x7fbe0c06c670 2023-10-16T19:57:17.885 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.817+0000 7fbe13f82700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe0c0c5270 con 0x7fbe0c0cdd90 2023-10-16T19:57:17.885 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.817+0000 7fbe11d1e700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbe0c06c670 0x7fbe0c0c5d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:17.886 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.817+0000 7fbe11d1e700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbe0c06c670 0x7fbe0c0c5d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.157:41062/0 (socket says 172.21.15.157:41062) 2023-10-16T19:57:17.886 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.817+0000 7fbe1151d700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbe0c0cdd90 0x7fbe0c15a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:17.886 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.817+0000 7fbe11d1e700 1 -- 172.21.15.157:0/2874792138 learned_addr learned my addr 172.21.15.157:0/2874792138 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:57:17.886 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.817+0000 7fbe1251f700 1 --2- 172.21.15.157:0/2874792138 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbe0c0c3770 0x7fbe0c15ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:17.886 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.817+0000 7fbe11d1e700 1 -- 172.21.15.157:0/2874792138 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbe0c0cdd90 msgr2=0x7fbe0c15a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:17.887 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.817+0000 7fbe11d1e700 1 --2- 172.21.15.157:0/2874792138 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbe0c0cdd90 0x7fbe0c15a7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:17.887 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.817+0000 7fbe11d1e700 1 -- 172.21.15.157:0/2874792138 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbe0c0c3770 msgr2=0x7fbe0c15ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:17.887 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.817+0000 7fbe11d1e700 1 --2- 172.21.15.157:0/2874792138 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbe0c0c3770 0x7fbe0c15ad10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:17.887 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.817+0000 7fbe11d1e700 1 -- 172.21.15.157:0/2874792138 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe080094a0 con 0x7fbe0c06c670 2023-10-16T19:57:17.887 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.817+0000 7fbe11d1e700 1 --2- 172.21.15.157:0/2874792138 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbe0c06c670 0x7fbe0c0c5d50 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fbdfc00c480 tx=0x7fbdfc00c790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:17.888 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.816+0000 7f230ab7a700 1 -- start start 2023-10-16T19:57:17.888 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.818+0000 7f230ab7a700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f230406cd80 0x7f23040b18f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:17.889 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.818+0000 7f230ab7a700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f23040cdd90 0x7f2304154570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:17.889 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.818+0000 7f230ab7a700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f23040cf110 0x7f23040c5860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:17.889 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.818+0000 7f230ab7a700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23040b14d0 con 0x7f23040cf110 2023-10-16T19:57:17.889 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.818+0000 7f230ab7a700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23040b0850 con 0x7f23040cdd90 2023-10-16T19:57:17.889 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.818+0000 7f230ab7a700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23040b0b30 con 0x7f230406cd80 2023-10-16T19:57:17.890 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.818+0000 7f2303fff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f23040cdd90 0x7f2304154570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:17.890 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.818+0000 7f2303fff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f23040cdd90 0x7f2304154570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.157:41068/0 (socket says 172.21.15.157:41068) 2023-10-16T19:57:17.890 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.818+0000 7f2303fff700 1 -- 172.21.15.157:0/1927047486 learned_addr learned my addr 172.21.15.157:0/1927047486 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:57:17.890 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.818+0000 7f2308916700 1 --2- 172.21.15.157:0/1927047486 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f230406cd80 0x7f23040b18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:17.891 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.818+0000 7f8423fff700 1 -- 172.21.15.157:0/3342773935 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8430013680 con 0x7f843c1f4400 2023-10-16T19:57:17.891 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.818+0000 7f8423fff700 1 -- 172.21.15.157:0/3342773935 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84300137e0 con 0x7f843c1f4400 2023-10-16T19:57:17.891 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.818+0000 7f8423fff700 1 -- 172.21.15.157:0/3342773935 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8430013b90 con 0x7f843c1f4400 2023-10-16T19:57:17.891 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.818+0000 7f8441ad8700 1 -- 172.21.15.157:0/3342773935 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f843c0c8360 con 0x7f843c1f4400 2023-10-16T19:57:17.892 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.818+0000 7f8441ad8700 1 -- 172.21.15.157:0/3342773935 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f843c0c7970 con 0x7f843c1f4400 2023-10-16T19:57:17.892 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.819+0000 7f823dffb700 1 -- 172.21.15.157:0/4284701692 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f824000e9c0 con 0x7f82480cdc30 2023-10-16T19:57:17.892 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.818+0000 7f2303fff700 1 -- 172.21.15.157:0/1927047486 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f230406cd80 msgr2=0x7f23040b18f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:17.893 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.818+0000 7f2303fff700 1 --2- 172.21.15.157:0/1927047486 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f230406cd80 0x7f23040b18f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:17.893 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.818+0000 7f2303fff700 1 -- 172.21.15.157:0/1927047486 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f23040cf110 msgr2=0x7f23040c5860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:17.893 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.818+0000 7f2303fff700 1 --2- 172.21.15.157:0/1927047486 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f23040cf110 0x7f23040c5860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:17.893 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.818+0000 7f2303fff700 1 -- 172.21.15.157:0/1927047486 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22f800d930 con 0x7f23040cdd90 2023-10-16T19:57:17.893 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.819+0000 7f2303fff700 1 --2- 172.21.15.157:0/1927047486 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f23040cdd90 0x7f2304154570 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f22f000c4d0 tx=0x7f22f000c7e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:17.894 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.819+0000 7f454e405700 1 -- 172.21.15.157:0/2874626659 shutdown_connections 2023-10-16T19:57:17.894 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.819+0000 7f454e405700 1 --2- 172.21.15.157:0/2874626659 >> v2:172.21.15.187:3300/0 conn(0x7f454815ad70 0x7f45480716e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:17.894 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.819+0000 7f454e405700 1 --2- 172.21.15.157:0/2874626659 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f45480ca1b0 0x7f45480cc360 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:17.895 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.819+0000 7f454e405700 1 -- 172.21.15.157:0/2874626659 >> 172.21.15.157:0/2874626659 conn(0x7f45480b1540 msgr2=0x7f45480b1920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:17.895 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.819+0000 7f824f5bf700 1 -- 172.21.15.157:0/4284701692 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82280052f0 con 0x7f82480cdc30 2023-10-16T19:57:17.895 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.819+0000 7f8441ad8700 1 -- 172.21.15.157:0/3342773935 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f843c162670 con 0x7f843c1f4400 2023-10-16T19:57:17.896 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.819+0000 7fdaddffb700 1 -- 172.21.15.157:0/831745026 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdae4013680 con 0x7fdae806d3d0 2023-10-16T19:57:17.896 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.819+0000 7f454e405700 1 -- 172.21.15.157:0/2874626659 shutdown_connections 2023-10-16T19:57:17.897 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.820+0000 7f823dffb700 1 --2- 172.21.15.157:0/4284701692 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f822c06af00 0x7f822c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:17.897 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.820+0000 7f823dffb700 1 -- 172.21.15.157:0/4284701692 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f82400894d0 con 0x7f82480cdc30 2023-10-16T19:57:17.897 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.820+0000 7f824d35b700 1 --2- 172.21.15.157:0/4284701692 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f822c06af00 0x7f822c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:17.897 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.819+0000 7fdaddffb700 1 -- 172.21.15.157:0/831745026 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdae40137e0 con 0x7fdae806d3d0 2023-10-16T19:57:17.898 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.819+0000 7fdaddffb700 1 -- 172.21.15.157:0/831745026 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdae4013b70 con 0x7fdae806d3d0 2023-10-16T19:57:17.898 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.820+0000 7fdaef3f8700 1 -- 172.21.15.157:0/831745026 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdae80b4dd0 con 0x7fdae806d3d0 2023-10-16T19:57:17.898 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.820+0000 7fdaef3f8700 1 -- 172.21.15.157:0/831745026 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdae8157700 con 0x7fdae806d3d0 2023-10-16T19:57:17.899 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.818+0000 7fbe027fc700 1 -- 172.21.15.157:0/2874792138 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdfc005d70 con 0x7fbe0c06c670 2023-10-16T19:57:17.899 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.818+0000 7fbe027fc700 1 -- 172.21.15.157:0/2874792138 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdfc00ce90 con 0x7fbe0c06c670 2023-10-16T19:57:17.899 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.818+0000 7fbe027fc700 1 -- 172.21.15.157:0/2874792138 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdfc0072d0 con 0x7fbe0c06c670 2023-10-16T19:57:17.899 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.818+0000 7fbe13f82700 1 -- 172.21.15.157:0/2874792138 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe0c0c5550 con 0x7fbe0c06c670 2023-10-16T19:57:17.900 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.818+0000 7fbe13f82700 1 -- 172.21.15.157:0/2874792138 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe0c0c6290 con 0x7fbe0c06c670 2023-10-16T19:57:17.900 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.820+0000 7fbe13f82700 1 -- 172.21.15.157:0/2874792138 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbdf00052f0 con 0x7fbe0c06c670 2023-10-16T19:57:17.900 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.821+0000 7f23017fa700 1 -- 172.21.15.157:0/1927047486 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22f0005d70 con 0x7f23040cdd90 2023-10-16T19:57:17.901 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.821+0000 7fdaef3f8700 1 -- 172.21.15.157:0/831745026 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdae804f400 con 0x7fdae806d3d0 2023-10-16T19:57:17.901 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.821+0000 7f230ab7a700 1 -- 172.21.15.157:0/1927047486 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23040b0e10 con 0x7f23040cdd90 2023-10-16T19:57:17.901 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.821+0000 7f23017fa700 1 -- 172.21.15.157:0/1927047486 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22f00070d0 con 0x7f23040cdd90 2023-10-16T19:57:17.901 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.821+0000 7f23017fa700 1 -- 172.21.15.157:0/1927047486 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22f0007460 con 0x7f23040cdd90 2023-10-16T19:57:17.902 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.821+0000 7f230ab7a700 1 -- 172.21.15.157:0/1927047486 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2304154ab0 con 0x7f23040cdd90 2023-10-16T19:57:17.902 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.821+0000 7f454e405700 1 -- 172.21.15.157:0/2874626659 wait complete. 2023-10-16T19:57:17.902 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.821+0000 7f8423fff700 1 -- 172.21.15.157:0/3342773935 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f8430013cf0 con 0x7f843c1f4400 2023-10-16T19:57:17.903 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.821+0000 7f8423fff700 1 --2- 172.21.15.157:0/3342773935 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f842806af50 0x7f842806d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:17.903 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.821+0000 7f8423fff700 1 -- 172.21.15.157:0/3342773935 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8430089b70 con 0x7f843c1f4400 2023-10-16T19:57:17.903 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.822+0000 7f843b7fe700 1 --2- 172.21.15.157:0/3342773935 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f842806af50 0x7f842806d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:17.904 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.820+0000 7f0722ffd700 1 -- 172.21.15.157:0/3806631517 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0724004510 con 0x7f073406d0f0 2023-10-16T19:57:17.904 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.820+0000 7f0722ffd700 1 -- 172.21.15.157:0/3806631517 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07240036a0 con 0x7f073406d0f0 2023-10-16T19:57:17.904 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.820+0000 7f0722ffd700 1 -- 172.21.15.157:0/3806631517 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0724003a50 con 0x7f073406d0f0 2023-10-16T19:57:17.904 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.821+0000 7f0738b81700 1 -- 172.21.15.157:0/3806631517 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07340b48f0 con 0x7f073406d0f0 2023-10-16T19:57:17.904 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.821+0000 7f0738b81700 1 -- 172.21.15.157:0/3806631517 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07340b4e70 con 0x7f073406d0f0 2023-10-16T19:57:17.905 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.822+0000 7f230ab7a700 1 -- 172.21.15.157:0/1927047486 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f230404f400 con 0x7f23040cdd90 2023-10-16T19:57:17.905 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.822+0000 7f824d35b700 1 --2- 172.21.15.157:0/4284701692 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f822c06af00 0x7f822c06d3c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8238009b90 tx=0x7f8238008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:17.906 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.822+0000 7f843b7fe700 1 --2- 172.21.15.157:0/3342773935 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f842806af50 0x7f842806d410 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f843400c530 tx=0x7f843400b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:17.906 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.822+0000 7f454e405700 1 Processor -- start 2023-10-16T19:57:17.906 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.823+0000 7f0738b81700 1 -- 172.21.15.157:0/3806631517 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f073404f400 con 0x7f073406d0f0 2023-10-16T19:57:17.907 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.823+0000 7f454e405700 1 -- start start 2023-10-16T19:57:17.907 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.823+0000 7f662557e700 1 Processor -- start 2023-10-16T19:57:17.907 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.823+0000 7f662557e700 1 -- start start 2023-10-16T19:57:17.909 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.824+0000 7f454e405700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f45480ca1b0 0x7f45480b0910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:17.909 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.824+0000 7f454e405700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f45480cb350 0x7f454815d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:17.909 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.824+0000 7f454e405700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f454815ad70 0x7f454815d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:17.909 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.824+0000 7f454e405700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45480b5590 con 0x7f45480ca1b0 2023-10-16T19:57:17.910 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.824+0000 7f454e405700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45480b4980 con 0x7f454815ad70 2023-10-16T19:57:17.910 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.824+0000 7f454e405700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45480b4c60 con 0x7f45480cb350 2023-10-16T19:57:17.910 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.824+0000 7f4547fff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f45480ca1b0 0x7f45480b0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:17.910 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.824+0000 7f4547fff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f45480ca1b0 0x7f45480b0910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:45970/0 (socket says 172.21.15.157:45970) 2023-10-16T19:57:17.910 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.824+0000 7f4547fff700 1 -- 172.21.15.157:0/3858734019 learned_addr learned my addr 172.21.15.157:0/3858734019 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:57:17.911 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.824+0000 7f45477fe700 1 --2- 172.21.15.157:0/3858734019 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f45480cb350 0x7f454815d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:17.911 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.824+0000 7f454c9a2700 1 --2- 172.21.15.157:0/3858734019 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f454815ad70 0x7f454815d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:17.911 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.824+0000 7f4547fff700 1 -- 172.21.15.157:0/3858734019 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f45480cb350 msgr2=0x7f454815d330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:17.911 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.824+0000 7f4547fff700 1 --2- 172.21.15.157:0/3858734019 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f45480cb350 0x7f454815d330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:17.911 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.824+0000 7f4547fff700 1 -- 172.21.15.157:0/3858734019 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f454815ad70 msgr2=0x7f454815d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:17.912 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.824+0000 7f4547fff700 1 --2- 172.21.15.157:0/3858734019 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f454815ad70 0x7f454815d870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:17.912 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.824+0000 7f662557e700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f662015e2f0 0x7f662006d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:17.912 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.824+0000 7f662557e700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f662006af60 0x7f66200ce910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:17.913 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.824+0000 7f662557e700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66200d08b0 con 0x7f662006de00 2023-10-16T19:57:17.913 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.824+0000 7f4547fff700 1 -- 172.21.15.157:0/3858734019 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f453c0094a0 con 0x7f45480ca1b0 2023-10-16T19:57:17.913 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.825+0000 7f662557e700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66201628f0 con 0x7f662006af60 2023-10-16T19:57:17.914 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.825+0000 7f662557e700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6620162bd0 con 0x7f662015e2f0 2023-10-16T19:57:17.914 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.825+0000 7f45477fe700 1 --2- 172.21.15.157:0/3858734019 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f45480cb350 0x7f454815d330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T19:57:17.915 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.825+0000 7f661f7fe700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f662006af60 0x7f66200ce910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:17.915 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.825+0000 7f661e7fc700 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7f662006de00 0x7f662006a850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.157:39346/0 (socket says 172.21.15.157:39346) 2023-10-16T19:57:17.915 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.825+0000 7f661e7fc700 1 -- 172.21.15.157:0/2394602464 learned_addr learned my addr 172.21.15.157:0/2394602464 (peer_addr_for_me v1:172.21.15.157:0/0) 2023-10-16T19:57:17.915 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.825+0000 7f661effd700 1 --2- 172.21.15.157:0/2394602464 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f662015e2f0 0x7f662006d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:17.916 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.825+0000 7f4547fff700 1 --2- 172.21.15.157:0/3858734019 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f45480ca1b0 0x7f45480b0910 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f453800d800 tx=0x7f453800db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:17.916 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.825+0000 7f661f7fe700 1 -- 172.21.15.157:0/2394602464 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f662015e2f0 msgr2=0x7f662006d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:57:17.917 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.825+0000 7f661f7fe700 1 --2- 172.21.15.157:0/2394602464 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f662015e2f0 0x7f662006d0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:17.917 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.825+0000 7f661f7fe700 1 -- 172.21.15.157:0/2394602464 >> v1:172.21.15.187:6789/0 conn(0x7f662006de00 legacy=0x7f662006a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:17.917 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.825+0000 7f661f7fe700 1 -- 172.21.15.157:0/2394602464 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66200d05d0 con 0x7f662006af60 2023-10-16T19:57:17.917 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.825+0000 7f661f7fe700 1 --2- 172.21.15.157:0/2394602464 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f662006af60 0x7f66200ce910 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f6618009d90 tx=0x7f661800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49fde2f8ce8a17d3 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:17.918 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.825+0000 7f8423fff700 1 -- 172.21.15.157:0/3342773935 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8430054d00 con 0x7f843c1f4400 2023-10-16T19:57:17.918 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.826+0000 7f823dffb700 1 -- 172.21.15.157:0/4284701692 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f82400544e0 con 0x7f82480cdc30 2023-10-16T19:57:17.919 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.826+0000 7f4544ff9700 1 -- 172.21.15.157:0/3858734019 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45380125f0 con 0x7f45480ca1b0 2023-10-16T19:57:17.919 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.826+0000 7f454e405700 1 -- 172.21.15.157:0/3858734019 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45480b4f40 con 0x7f45480ca1b0 2023-10-16T19:57:17.919 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.826+0000 7f454e405700 1 -- 172.21.15.157:0/3858734019 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45480b0e50 con 0x7f45480ca1b0 2023-10-16T19:57:17.919 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.827+0000 7f23017fa700 1 -- 172.21.15.157:0/1927047486 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f22f00075c0 con 0x7f23040cdd90 2023-10-16T19:57:17.920 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.827+0000 7fbe027fc700 1 -- 172.21.15.157:0/2874792138 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fbdfc007430 con 0x7fbe0c06c670 2023-10-16T19:57:17.920 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.827+0000 7fbe027fc700 1 --2- 172.21.15.157:0/2874792138 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fbdf806b060 0x7fbdf806d520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:17.920 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.827+0000 7fbe027fc700 1 -- 172.21.15.157:0/2874792138 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbdfc088ca0 con 0x7fbe0c06c670 2023-10-16T19:57:17.921 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.827+0000 7fbe1151d700 1 --2- 172.21.15.157:0/2874792138 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fbdf806b060 0x7fbdf806d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:17.921 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.827+0000 7f23017fa700 1 --2- 172.21.15.157:0/1927047486 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f22e806af50 0x7f22e806d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:17.921 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.828+0000 7f23017fa700 1 -- 172.21.15.157:0/1927047486 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f22f0088eb0 con 0x7f23040cdd90 2023-10-16T19:57:17.922 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.828+0000 7f2308916700 1 --2- 172.21.15.157:0/1927047486 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f22e806af50 0x7f22e806d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:17.922 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.828+0000 7f4544ff9700 1 -- 172.21.15.157:0/3858734019 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4538012750 con 0x7f45480ca1b0 2023-10-16T19:57:17.922 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.828+0000 7f4544ff9700 1 -- 172.21.15.157:0/3858734019 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4538012ae0 con 0x7f45480ca1b0 2023-10-16T19:57:17.923 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.828+0000 7f0722ffd700 1 -- 172.21.15.157:0/3806631517 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f0724003bb0 con 0x7f073406d0f0 2023-10-16T19:57:17.923 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.828+0000 7f2308916700 1 --2- 172.21.15.157:0/1927047486 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f22e806af50 0x7f22e806d410 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f22f801b040 tx=0x7f22f8014000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:17.924 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.828+0000 7f0722ffd700 1 --2- 172.21.15.157:0/3806631517 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f071406afd0 0x7f071406d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:17.924 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.828+0000 7f0722ffd700 1 -- 172.21.15.157:0/3806631517 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f072408ab20 con 0x7f073406d0f0 2023-10-16T19:57:17.924 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.828+0000 7f0731d9b700 1 --2- 172.21.15.157:0/3806631517 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f071406afd0 0x7f071406d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:17.925 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.829+0000 7f661dffb700 1 -- 172.21.15.157:0/2394602464 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f661800e070 con 0x7f662006af60 2023-10-16T19:57:17.925 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.829+0000 7f661dffb700 1 -- 172.21.15.157:0/2394602464 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f661800bb20 con 0x7f662006af60 2023-10-16T19:57:17.925 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.829+0000 7f661dffb700 1 -- 172.21.15.157:0/2394602464 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6618012430 con 0x7f662006af60 2023-10-16T19:57:17.925 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.829+0000 7f454e405700 1 -- 172.21.15.157:0/3858734019 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45280052f0 con 0x7f45480ca1b0 2023-10-16T19:57:17.926 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.829+0000 7fbe1151d700 1 --2- 172.21.15.157:0/2874792138 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fbdf806b060 0x7fbdf806d520 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fbe0c15be70 tx=0x7fbe0401e040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:17.926 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.830+0000 7fdaddffb700 1 -- 172.21.15.157:0/831745026 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fdae4013cd0 con 0x7fdae806d3d0 2023-10-16T19:57:17.927 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.830+0000 7f662557e700 1 -- 172.21.15.157:0/2394602464 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f662006af60 msgr2=0x7f66200ce910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:17.927 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.830+0000 7f662557e700 1 --2- 172.21.15.157:0/2394602464 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f662006af60 0x7f66200ce910 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f6618009d90 tx=0x7f661800b330 comp rx=0 tx=0).stop 2023-10-16T19:57:17.927 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.830+0000 7f662557e700 1 -- 172.21.15.157:0/2394602464 shutdown_connections 2023-10-16T19:57:17.927 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.830+0000 7f662557e700 1 --2- 172.21.15.157:0/2394602464 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f662015e2f0 0x7f662006d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:17.928 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.830+0000 7f0731d9b700 1 --2- 172.21.15.157:0/3806631517 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f071406afd0 0x7f071406d490 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f07340c99d0 tx=0x7f0728009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:17.928 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.830+0000 7f662557e700 1 --2- 172.21.15.157:0/2394602464 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f662006af60 0x7f66200ce910 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:17.929 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.830+0000 7f662557e700 1 -- 172.21.15.157:0/2394602464 >> 172.21.15.157:0/2394602464 conn(0x7f66200cd4e0 msgr2=0x7f66200cd8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:17.929 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.830+0000 7fdaddffb700 1 --2- 172.21.15.157:0/831745026 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fdad406b010 0x7fdad406d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:17.929 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.830+0000 7fdaddffb700 1 -- 172.21.15.157:0/831745026 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdae40898f0 con 0x7fdae806d3d0 2023-10-16T19:57:17.930 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.830+0000 7fdaed194700 1 --2- 172.21.15.157:0/831745026 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fdad406b010 0x7fdad406d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:17.930 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.830+0000 7f662557e700 1 -- 172.21.15.157:0/2394602464 shutdown_connections 2023-10-16T19:57:17.930 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.830+0000 7f662557e700 1 -- 172.21.15.157:0/2394602464 wait complete. 2023-10-16T19:57:17.931 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.831+0000 7fdaed194700 1 --2- 172.21.15.157:0/831745026 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fdad406b010 0x7fdad406d4d0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fdad8000f60 tx=0x7fdad8007910 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:17.931 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.832+0000 7fbe027fc700 1 -- 172.21.15.157:0/2874792138 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fbdfc053ee0 con 0x7fbe0c06c670 2023-10-16T19:57:17.932 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.832+0000 7f662557e700 1 Processor -- start 2023-10-16T19:57:17.932 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.833+0000 7f662557e700 1 -- start start 2023-10-16T19:57:17.932 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.833+0000 7fdaddffb700 1 -- 172.21.15.157:0/831745026 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fdae40549f0 con 0x7fdae806d3d0 2023-10-16T19:57:17.933 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.835+0000 7f4544ff9700 1 -- 172.21.15.157:0/3858734019 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f4538012c40 con 0x7f45480ca1b0 2023-10-16T19:57:17.933 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.834+0000 7f662557e700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f662006af60 0x7f66200b0d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:17.933 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.834+0000 7f662557e700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f662006de00 0x7f662015ade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:17.933 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.834+0000 7f662557e700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f662015e2f0 0x7f662015b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:17.934 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.834+0000 7f662557e700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66201f6c70 con 0x7f662006af60 2023-10-16T19:57:17.934 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.834+0000 7f662557e700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66201f6ec0 con 0x7f662006de00 2023-10-16T19:57:17.934 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.834+0000 7f662557e700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66201f71a0 con 0x7f662015e2f0 2023-10-16T19:57:17.934 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.834+0000 7f661e7fc700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f662006de00 0x7f662015ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:17.935 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.834+0000 7f661e7fc700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f662006de00 0x7f662015ade0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.157:41098/0 (socket says 172.21.15.157:41098) 2023-10-16T19:57:17.935 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.834+0000 7f661e7fc700 1 -- 172.21.15.157:0/2207789104 learned_addr learned my addr 172.21.15.157:0/2207789104 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:57:17.935 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.834+0000 7f661f7fe700 1 --2- 172.21.15.157:0/2207789104 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f662015e2f0 0x7f662015b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:17.935 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.834+0000 7f661e7fc700 1 -- 172.21.15.157:0/2207789104 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f662015e2f0 msgr2=0x7f662015b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:17.935 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.834+0000 7f661e7fc700 1 --2- 172.21.15.157:0/2207789104 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f662015e2f0 0x7f662015b320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:17.935 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.834+0000 7f661e7fc700 1 -- 172.21.15.157:0/2207789104 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f662006af60 msgr2=0x7f66200b0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:17.936 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.834+0000 7f661e7fc700 1 --2- 172.21.15.157:0/2207789104 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f662006af60 0x7f66200b0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:17.936 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.834+0000 7f661e7fc700 1 -- 172.21.15.157:0/2207789104 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6618009a70 con 0x7f662006de00 2023-10-16T19:57:17.936 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.835+0000 7f661e7fc700 1 --2- 172.21.15.157:0/2207789104 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f662006de00 0x7f662015ade0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f661400c490 tx=0x7f661400c7a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:17.937 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.835+0000 7f4544ff9700 1 --2- 172.21.15.157:0/3858734019 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f453406af00 0x7f453406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:17.937 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.836+0000 7f4544ff9700 1 -- 172.21.15.157:0/3858734019 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f453808a110 con 0x7f45480ca1b0 2023-10-16T19:57:17.937 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.836+0000 7f45477fe700 1 --2- 172.21.15.157:0/3858734019 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f453406af00 0x7f453406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:17.937 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.836+0000 7f45477fe700 1 --2- 172.21.15.157:0/3858734019 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f453406af00 0x7f453406d3c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f453c0090b0 tx=0x7f453c008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:17.938 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.836+0000 7f23017fa700 1 -- 172.21.15.157:0/1927047486 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f22f0054000 con 0x7f23040cdd90 2023-10-16T19:57:17.938 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.839+0000 7f4544ff9700 1 -- 172.21.15.157:0/3858734019 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f45380551c0 con 0x7f45480ca1b0 2023-10-16T19:57:17.939 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.841+0000 7f0722ffd700 1 -- 172.21.15.157:0/3806631517 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0724055c40 con 0x7f073406d0f0 2023-10-16T19:57:17.939 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.850+0000 7f66077fe700 1 -- 172.21.15.157:0/2207789104 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6614005d70 con 0x7f662006de00 2023-10-16T19:57:17.940 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.850+0000 7f66077fe700 1 -- 172.21.15.157:0/2207789104 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66140070d0 con 0x7f662006de00 2023-10-16T19:57:17.940 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.850+0000 7f66077fe700 1 -- 172.21.15.157:0/2207789104 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6614007460 con 0x7f662006de00 2023-10-16T19:57:17.940 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.850+0000 7f662557e700 1 -- 172.21.15.157:0/2207789104 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66201f7480 con 0x7f662006de00 2023-10-16T19:57:17.940 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.850+0000 7f662557e700 1 -- 172.21.15.157:0/2207789104 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66200b1290 con 0x7f662006de00 2023-10-16T19:57:17.940 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.856+0000 7f66077fe700 1 -- 172.21.15.157:0/2207789104 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f66140075c0 con 0x7f662006de00 2023-10-16T19:57:17.940 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.856+0000 7f66077fe700 1 --2- 172.21.15.157:0/2207789104 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f660c06afd0 0x7f660c06d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:17.941 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.856+0000 7f66077fe700 1 -- 172.21.15.157:0/2207789104 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6614088a70 con 0x7f662006de00 2023-10-16T19:57:17.941 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.857+0000 7f662557e700 1 -- 172.21.15.157:0/2207789104 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66000052f0 con 0x7f662006de00 2023-10-16T19:57:17.941 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.858+0000 7f661effd700 1 --2- 172.21.15.157:0/2207789104 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f660c06afd0 0x7f660c06d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:17.941 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.858+0000 7f661effd700 1 --2- 172.21.15.157:0/2207789104 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f660c06afd0 0x7f660c06d490 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f6610006b20 tx=0x7f6610006ab0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:17.941 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:17.862+0000 7f66077fe700 1 -- 172.21.15.157:0/2207789104 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6614053b00 con 0x7f662006de00 2023-10-16T19:57:18.206 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:18.203+0000 7f8441ad8700 1 -- 172.21.15.157:0/3342773935 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f843c04f400 con 0x7f843c1f4400 2023-10-16T19:57:18.206 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:18.204+0000 7f8423fff700 1 -- 172.21.15.157:0/3342773935 <== mon.1 v2:172.21.15.187:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8430021020 con 0x7f843c1f4400 2023-10-16T19:57:18.210 INFO:teuthology.orchestra.run.smithi157.stdout:55834574853 2023-10-16T19:57:18.211 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:18.208+0000 7f8441ad8700 1 -- 172.21.15.157:0/3342773935 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f842806af50 msgr2=0x7f842806d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:18.211 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:18.208+0000 7f8441ad8700 1 --2- 172.21.15.157:0/3342773935 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f842806af50 0x7f842806d410 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f843400c530 tx=0x7f843400b040 comp rx=0 tx=0).stop 2023-10-16T19:57:18.211 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:18.208+0000 7f8441ad8700 1 -- 172.21.15.157:0/3342773935 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f843c1f4400 msgr2=0x7f843c1f48b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:18.211 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:18.208+0000 7f8441ad8700 1 --2- 172.21.15.157:0/3342773935 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f843c1f4400 0x7f843c1f48b0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f843c071e30 tx=0x7f843000eb30 comp rx=0 tx=0).stop 2023-10-16T19:57:18.211 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:18.208+0000 7f8441ad8700 1 -- 172.21.15.157:0/3342773935 shutdown_connections 2023-10-16T19:57:18.212 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:18.208+0000 7f8441ad8700 1 --2- 172.21.15.157:0/3342773935 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f842806af50 0x7f842806d410 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:18.212 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:18.208+0000 7f8441ad8700 1 --2- 172.21.15.157:0/3342773935 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f843c1f4400 0x7f843c1f48b0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:18.212 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:18.208+0000 7f8441ad8700 1 --2- 172.21.15.157:0/3342773935 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f843c15de60 0x7f843c159130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:18.212 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:18.208+0000 7f8441ad8700 1 --2- 172.21.15.157:0/3342773935 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f843c15c390 0x7f843c0c7430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:18.213 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:18.208+0000 7f8441ad8700 1 -- 172.21.15.157:0/3342773935 >> 172.21.15.157:0/3342773935 conn(0x7f843c0cf950 msgr2=0x7f843c0cb500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:18.213 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:18.209+0000 7f8441ad8700 1 -- 172.21.15.157:0/3342773935 shutdown_connections 2023-10-16T19:57:18.213 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:18.209+0000 7f8441ad8700 1 -- 172.21.15.157:0/3342773935 wait complete. 2023-10-16T19:57:18.229 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.3 2023-10-16T19:57:18.235 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:18.233+0000 7f824f5bf700 1 -- 172.21.15.157:0/4284701692 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f82280055a0 con 0x7f82480cdc30 2023-10-16T19:57:18.237 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:18.233+0000 7f823dffb700 1 -- 172.21.15.157:0/4284701692 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8240057b00 con 0x7f82480cdc30 2023-10-16T19:57:18.237 INFO:teuthology.orchestra.run.smithi157.stdout:55834574853 2023-10-16T19:57:18.238 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:18.234+0000 7fbe13f82700 1 -- 172.21.15.157:0/2874792138 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fbdf0005870 con 0x7fbe0c06c670 2023-10-16T19:57:18.238 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:18.234+0000 7fbe027fc700 1 -- 172.21.15.157:0/2874792138 <== mon.1 v2:172.21.15.187:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fbdfc017020 con 0x7fbe0c06c670 2023-10-16T19:57:18.240 INFO:teuthology.orchestra.run.smithi157.stdout:55834574853 2023-10-16T19:57:18.240 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:18.235+0000 7fdaef3f8700 1 -- 172.21.15.157:0/831745026 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fdae80b6aa0 con 0x7fdae806d3d0 2023-10-16T19:57:18.241 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:18.237+0000 7fdaddffb700 1 -- 172.21.15.157:0/831745026 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fdae4021020 con 0x7fdae806d3d0 2023-10-16T19:57:18.241 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:18.237+0000 7f824f5bf700 1 -- 172.21.15.157:0/4284701692 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f822c06af00 msgr2=0x7f822c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:18.241 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:18.237+0000 7f824f5bf700 1 --2- 172.21.15.157:0/4284701692 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f822c06af00 0x7f822c06d3c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8238009b90 tx=0x7f8238008030 comp rx=0 tx=0).stop 2023-10-16T19:57:18.241 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:18.237+0000 7f824f5bf700 1 -- 172.21.15.157:0/4284701692 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f82480cdc30 msgr2=0x7f82481f7690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:18.242 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:18.237+0000 7f824f5bf700 1 --2- 172.21.15.157:0/4284701692 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f82480cdc30 0x7f82481f7690 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f824806d440 tx=0x7f824000e0e0 comp rx=0 tx=0).stop 2023-10-16T19:57:18.242 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:18.237+0000 7f824f5bf700 1 -- 172.21.15.157:0/4284701692 shutdown_connections 2023-10-16T19:57:18.242 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:18.237+0000 7f824f5bf700 1 --2- 172.21.15.157:0/4284701692 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f822c06af00 0x7f822c06d3c0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:18.242 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:18.237+0000 7f824f5bf700 1 --2- 172.21.15.157:0/4284701692 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f82480c2d50 0x7f824815ff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:18.242 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:18.237+0000 7f824f5bf700 1 --2- 172.21.15.157:0/4284701692 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f82480cdc30 0x7f82481f7690 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:18.243 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:18.237+0000 7f824f5bf700 1 --2- 172.21.15.157:0/4284701692 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f82480c9fa0 0x7f82481f7150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:18.243 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:18.237+0000 7f824f5bf700 1 -- 172.21.15.157:0/4284701692 >> 172.21.15.157:0/4284701692 conn(0x7f82480b1540 msgr2=0x7f82480cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:18.243 INFO:teuthology.orchestra.run.smithi157.stdout:55834574853 2023-10-16T19:57:18.244 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:18.238+0000 7fbe13f82700 1 -- 172.21.15.157:0/2874792138 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fbdf806b060 msgr2=0x7fbdf806d520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:18.244 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:18.238+0000 7fbe13f82700 1 --2- 172.21.15.157:0/2874792138 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fbdf806b060 0x7fbdf806d520 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fbe0c15be70 tx=0x7fbe0401e040 comp rx=0 tx=0).stop 2023-10-16T19:57:18.244 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:18.238+0000 7fbe13f82700 1 -- 172.21.15.157:0/2874792138 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbe0c06c670 msgr2=0x7fbe0c0c5d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:18.245 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:18.238+0000 7fbe13f82700 1 --2- 172.21.15.157:0/2874792138 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbe0c06c670 0x7fbe0c0c5d50 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fbdfc00c480 tx=0x7fbdfc00c790 comp rx=0 tx=0).stop 2023-10-16T19:57:18.245 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:18.238+0000 7fbe13f82700 1 -- 172.21.15.157:0/2874792138 shutdown_connections 2023-10-16T19:57:18.245 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:18.238+0000 7fbe13f82700 1 --2- 172.21.15.157:0/2874792138 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fbdf806b060 0x7fbdf806d520 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:18.245 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:18.238+0000 7fbe13f82700 1 --2- 172.21.15.157:0/2874792138 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbe0c06c670 0x7fbe0c0c5d50 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:18.245 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:18.238+0000 7fbe13f82700 1 --2- 172.21.15.157:0/2874792138 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbe0c0c3770 0x7fbe0c15ad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:18.246 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:18.238+0000 7fbe13f82700 1 --2- 172.21.15.157:0/2874792138 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbe0c0cdd90 0x7fbe0c15a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:18.246 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:18.238+0000 7fbe13f82700 1 -- 172.21.15.157:0/2874792138 >> 172.21.15.157:0/2874792138 conn(0x7fbe0c0cceb0 msgr2=0x7fbe0c0cf780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:18.246 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:18.238+0000 7fbe13f82700 1 -- 172.21.15.157:0/2874792138 shutdown_connections 2023-10-16T19:57:18.246 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:18.238+0000 7fbe13f82700 1 -- 172.21.15.157:0/2874792138 wait complete. 2023-10-16T19:57:18.247 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:18.239+0000 7f824f5bf700 1 -- 172.21.15.157:0/4284701692 shutdown_connections 2023-10-16T19:57:18.247 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:18.240+0000 7f824f5bf700 1 -- 172.21.15.157:0/4284701692 wait complete. 2023-10-16T19:57:18.248 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:18.240+0000 7f454e405700 1 -- 172.21.15.157:0/3858734019 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f4528005870 con 0x7f45480ca1b0 2023-10-16T19:57:18.248 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:18.241+0000 7fdaef3f8700 1 -- 172.21.15.157:0/831745026 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fdad406b010 msgr2=0x7fdad406d4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:18.248 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:18.241+0000 7fdaef3f8700 1 --2- 172.21.15.157:0/831745026 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fdad406b010 0x7fdad406d4d0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fdad8000f60 tx=0x7fdad8007910 comp rx=0 tx=0).stop 2023-10-16T19:57:18.248 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:18.241+0000 7fdaef3f8700 1 -- 172.21.15.157:0/831745026 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdae806d3d0 msgr2=0x7fdae80b1d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:18.249 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:18.241+0000 7fdaef3f8700 1 --2- 172.21.15.157:0/831745026 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdae806d3d0 0x7fdae80b1d80 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fdae400e800 tx=0x7fdae400ebc0 comp rx=0 tx=0).stop 2023-10-16T19:57:18.249 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:18.243+0000 7f230ab7a700 1 -- 172.21.15.157:0/1927047486 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f23040af7e0 con 0x7f23040cdd90 2023-10-16T19:57:18.249 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:18.243+0000 7f23017fa700 1 -- 172.21.15.157:0/1927047486 <== mon.1 v2:172.21.15.187:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f22f0057620 con 0x7f23040cdd90 2023-10-16T19:57:18.250 INFO:teuthology.orchestra.run.smithi157.stdout:55834574853 2023-10-16T19:57:18.250 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:18.245+0000 7f4544ff9700 1 -- 172.21.15.157:0/3858734019 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f45380587e0 con 0x7f45480ca1b0 2023-10-16T19:57:18.251 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:18.245+0000 7f0738b81700 1 -- 172.21.15.157:0/3806631517 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f073406f720 con 0x7f073406d0f0 2023-10-16T19:57:18.251 INFO:teuthology.orchestra.run.smithi157.stdout:55834574853 2023-10-16T19:57:18.251 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:18.245+0000 7f0722ffd700 1 -- 172.21.15.157:0/3806631517 <== mon.1 v2:172.21.15.187:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0724003e60 con 0x7f073406d0f0 2023-10-16T19:57:18.252 INFO:teuthology.orchestra.run.smithi157.stdout:55834574853 2023-10-16T19:57:18.253 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:18.246+0000 7fdaef3f8700 1 -- 172.21.15.157:0/831745026 shutdown_connections 2023-10-16T19:57:18.253 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:18.246+0000 7fdaef3f8700 1 --2- 172.21.15.157:0/831745026 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fdad406b010 0x7fdad406d4d0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:18.253 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:18.246+0000 7fdaef3f8700 1 --2- 172.21.15.157:0/831745026 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdae806a850 0x7fdae81571c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:18.253 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:18.246+0000 7fdaef3f8700 1 --2- 172.21.15.157:0/831745026 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdae806dfb0 0x7fdae80cb1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:18.253 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:18.246+0000 7fdaef3f8700 1 --2- 172.21.15.157:0/831745026 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdae806d3d0 0x7fdae80b1d80 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:18.254 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:18.246+0000 7fdaef3f8700 1 -- 172.21.15.157:0/831745026 >> 172.21.15.157:0/831745026 conn(0x7fdae806c0f0 msgr2=0x7fdae80cc790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:18.254 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:18.246+0000 7fdaef3f8700 1 -- 172.21.15.157:0/831745026 shutdown_connections 2023-10-16T19:57:18.254 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:18.246+0000 7fdaef3f8700 1 -- 172.21.15.157:0/831745026 wait complete. 2023-10-16T19:57:18.255 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:18.248+0000 7f454e405700 1 -- 172.21.15.157:0/3858734019 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f453406af00 msgr2=0x7f453406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:18.255 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:18.248+0000 7f454e405700 1 --2- 172.21.15.157:0/3858734019 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f453406af00 0x7f453406d3c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f453c0090b0 tx=0x7f453c008030 comp rx=0 tx=0).stop 2023-10-16T19:57:18.255 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:18.248+0000 7f454e405700 1 -- 172.21.15.157:0/3858734019 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f45480ca1b0 msgr2=0x7f45480b0910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:18.255 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:18.248+0000 7f454e405700 1 --2- 172.21.15.157:0/3858734019 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f45480ca1b0 0x7f45480b0910 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f453800d800 tx=0x7f453800db10 comp rx=0 tx=0).stop 2023-10-16T19:57:18.256 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:18.248+0000 7f454e405700 1 -- 172.21.15.157:0/3858734019 shutdown_connections 2023-10-16T19:57:18.256 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:18.248+0000 7f454e405700 1 --2- 172.21.15.157:0/3858734019 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f453406af00 0x7f453406d3c0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:18.256 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:18.248+0000 7f454e405700 1 --2- 172.21.15.157:0/3858734019 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f454815ad70 0x7f454815d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:18.256 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:18.248+0000 7f454e405700 1 --2- 172.21.15.157:0/3858734019 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f45480ca1b0 0x7f45480b0910 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:18.256 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:18.248+0000 7f454e405700 1 --2- 172.21.15.157:0/3858734019 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f45480cb350 0x7f454815d330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:18.257 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:18.248+0000 7f454e405700 1 -- 172.21.15.157:0/3858734019 >> 172.21.15.157:0/3858734019 conn(0x7f45480b1540 msgr2=0x7f454815ebd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:18.257 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:18.248+0000 7f454e405700 1 -- 172.21.15.157:0/3858734019 shutdown_connections 2023-10-16T19:57:18.257 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:18.248+0000 7f454e405700 1 -- 172.21.15.157:0/3858734019 wait complete. 2023-10-16T19:57:18.258 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:18.250+0000 7f230ab7a700 1 -- 172.21.15.157:0/1927047486 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f22e806af50 msgr2=0x7f22e806d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:18.258 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:18.250+0000 7f230ab7a700 1 --2- 172.21.15.157:0/1927047486 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f22e806af50 0x7f22e806d410 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f22f801b040 tx=0x7f22f8014000 comp rx=0 tx=0).stop 2023-10-16T19:57:18.258 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:18.250+0000 7f230ab7a700 1 -- 172.21.15.157:0/1927047486 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f23040cdd90 msgr2=0x7f2304154570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:18.258 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:18.250+0000 7f230ab7a700 1 --2- 172.21.15.157:0/1927047486 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f23040cdd90 0x7f2304154570 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f22f000c4d0 tx=0x7f22f000c7e0 comp rx=0 tx=0).stop 2023-10-16T19:57:18.259 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:18.250+0000 7f230ab7a700 1 -- 172.21.15.157:0/1927047486 shutdown_connections 2023-10-16T19:57:18.259 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:18.250+0000 7f230ab7a700 1 --2- 172.21.15.157:0/1927047486 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f23040cf110 0x7f23040c5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:18.259 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:18.250+0000 7f230ab7a700 1 --2- 172.21.15.157:0/1927047486 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f230406cd80 0x7f23040b18f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:18.259 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:18.250+0000 7f230ab7a700 1 --2- 172.21.15.157:0/1927047486 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f22e806af50 0x7f22e806d410 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:18.259 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:18.250+0000 7f230ab7a700 1 --2- 172.21.15.157:0/1927047486 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f23040cdd90 0x7f2304154570 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:18.260 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:18.250+0000 7f230ab7a700 1 -- 172.21.15.157:0/1927047486 >> 172.21.15.157:0/1927047486 conn(0x7f23040cceb0 msgr2=0x7f23040cb000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:18.260 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:18.250+0000 7f230ab7a700 1 -- 172.21.15.157:0/1927047486 shutdown_connections 2023-10-16T19:57:18.260 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:18.250+0000 7f230ab7a700 1 -- 172.21.15.157:0/1927047486 wait complete. 2023-10-16T19:57:18.261 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:18.257+0000 7f0738b81700 1 -- 172.21.15.157:0/3806631517 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f071406afd0 msgr2=0x7f071406d490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:18.261 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:18.257+0000 7f0738b81700 1 --2- 172.21.15.157:0/3806631517 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f071406afd0 0x7f071406d490 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f07340c99d0 tx=0x7f0728009040 comp rx=0 tx=0).stop 2023-10-16T19:57:18.261 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:18.257+0000 7f0738b81700 1 -- 172.21.15.157:0/3806631517 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f073406d0f0 msgr2=0x7f07340c9490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:18.261 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:18.257+0000 7f0738b81700 1 --2- 172.21.15.157:0/3806631517 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f073406d0f0 0x7f07340c9490 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f0724016000 tx=0x7f0724004750 comp rx=0 tx=0).stop 2023-10-16T19:57:18.261 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:18.257+0000 7f0738b81700 1 -- 172.21.15.157:0/3806631517 shutdown_connections 2023-10-16T19:57:18.262 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:18.257+0000 7f0738b81700 1 --2- 172.21.15.157:0/3806631517 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f071406afd0 0x7f071406d490 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:18.262 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:18.257+0000 7f0738b81700 1 --2- 172.21.15.157:0/3806631517 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f073406d0f0 0x7f07340c9490 secure :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f0724016000 tx=0x7f0724004750 comp rx=0 tx=0).stop 2023-10-16T19:57:18.262 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:18.257+0000 7f0738b81700 1 --2- 172.21.15.157:0/3806631517 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f073415b130 0x7f0734152010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:18.262 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:18.257+0000 7f0738b81700 1 --2- 172.21.15.157:0/3806631517 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f073406eb20 0x7f07340b5e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:18.262 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:18.257+0000 7f0738b81700 1 -- 172.21.15.157:0/3806631517 >> 172.21.15.157:0/3806631517 conn(0x7f07340cd4e0 msgr2=0x7f073415a3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:18.263 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:18.258+0000 7f662557e700 1 -- 172.21.15.157:0/2207789104 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f66000055a0 con 0x7f662006de00 2023-10-16T19:57:18.263 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:18.258+0000 7f66077fe700 1 -- 172.21.15.157:0/2207789104 <== mon.1 v2:172.21.15.187:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6614017030 con 0x7f662006de00 2023-10-16T19:57:18.264 INFO:teuthology.orchestra.run.smithi157.stdout:55834574853 2023-10-16T19:57:18.265 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.4 2023-10-16T19:57:18.265 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:18.261+0000 7f0738b81700 1 -- 172.21.15.157:0/3806631517 shutdown_connections 2023-10-16T19:57:18.265 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:18.262+0000 7f662557e700 1 -- 172.21.15.157:0/2207789104 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f660c06afd0 msgr2=0x7f660c06d490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:18.266 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:18.262+0000 7f662557e700 1 --2- 172.21.15.157:0/2207789104 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f660c06afd0 0x7f660c06d490 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f6610006b20 tx=0x7f6610006ab0 comp rx=0 tx=0).stop 2023-10-16T19:57:18.266 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:18.262+0000 7f662557e700 1 -- 172.21.15.157:0/2207789104 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f662006de00 msgr2=0x7f662015ade0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:18.266 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:18.262+0000 7f662557e700 1 --2- 172.21.15.157:0/2207789104 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f662006de00 0x7f662015ade0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f661400c490 tx=0x7f661400c7a0 comp rx=0 tx=0).stop 2023-10-16T19:57:18.267 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.1 2023-10-16T19:57:18.267 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:18.263+0000 7f0738b81700 1 -- 172.21.15.157:0/3806631517 wait complete. 2023-10-16T19:57:18.268 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:18.263+0000 7f662557e700 1 -- 172.21.15.157:0/2207789104 shutdown_connections 2023-10-16T19:57:18.268 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:18.263+0000 7f662557e700 1 --2- 172.21.15.157:0/2207789104 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f662015e2f0 0x7f662015b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:18.268 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:18.263+0000 7f662557e700 1 --2- 172.21.15.157:0/2207789104 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f662006af60 0x7f66200b0d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:18.269 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:18.263+0000 7f662557e700 1 --2- 172.21.15.157:0/2207789104 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f660c06afd0 0x7f660c06d490 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:18.269 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:18.263+0000 7f662557e700 1 --2- 172.21.15.157:0/2207789104 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f662006de00 0x7f662015ade0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:18.269 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:18.263+0000 7f662557e700 1 -- 172.21.15.157:0/2207789104 >> 172.21.15.157:0/2207789104 conn(0x7f66200cd4e0 msgr2=0x7f6620159470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:18.269 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:18.263+0000 7f662557e700 1 -- 172.21.15.157:0/2207789104 shutdown_connections 2023-10-16T19:57:18.269 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:18.263+0000 7f662557e700 1 -- 172.21.15.157:0/2207789104 wait complete. 2023-10-16T19:57:18.270 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.2 2023-10-16T19:57:18.278 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.0 2023-10-16T19:57:18.279 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.7 2023-10-16T19:57:18.284 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.6 2023-10-16T19:57:18.284 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.5 2023-10-16T19:57:19.230 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-16T19:57:19.266 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-10-16T19:57:19.268 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-16T19:57:19.271 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-16T19:57:19.279 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-16T19:57:19.280 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-10-16T19:57:19.285 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-10-16T19:57:19.286 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-10-16T19:57:19.428 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.426+0000 7f4616463700 1 Processor -- start 2023-10-16T19:57:19.430 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.426+0000 7f4616463700 1 -- start start 2023-10-16T19:57:19.430 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.428+0000 7f4616463700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4610159f00 0x7f461015da70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:19.430 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.428+0000 7f4616463700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f461015a2e0 con 0x7f46100708d0 2023-10-16T19:57:19.431 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.428+0000 7f4616463700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f461015e2c0 con 0x7f46100cbe90 2023-10-16T19:57:19.431 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.428+0000 7f4616463700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f461015e5a0 con 0x7f4610159f00 2023-10-16T19:57:19.431 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.428+0000 7f4614a00700 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7f46100cbe90 0x7f46100cdd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.157:39368/0 (socket says 172.21.15.157:39368) 2023-10-16T19:57:19.432 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.428+0000 7f4614a00700 1 -- 172.21.15.157:0/4123648998 learned_addr learned my addr 172.21.15.157:0/4123648998 (peer_addr_for_me v1:172.21.15.157:0/0) 2023-10-16T19:57:19.432 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.429+0000 7f460effd700 1 -- 172.21.15.157:0/4123648998 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3530432893 0 0) 0x7f461015e2c0 con 0x7f46100cbe90 2023-10-16T19:57:19.432 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.429+0000 7f460effd700 1 -- 172.21.15.157:0/4123648998 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f45f80035b0 con 0x7f46100cbe90 2023-10-16T19:57:19.432 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.429+0000 7f460ffff700 1 --2- 172.21.15.157:0/4123648998 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4610159f00 0x7f461015da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:19.433 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.430+0000 7f460effd700 1 -- 172.21.15.157:0/4123648998 <== mon.1 v1:172.21.15.187:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2723438953 0 0) 0x7f45f80035b0 con 0x7f46100cbe90 2023-10-16T19:57:19.433 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.430+0000 7f460effd700 1 -- 172.21.15.157:0/4123648998 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4610159f00 msgr2=0x7f461015da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:57:19.433 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.430+0000 7f460effd700 1 --2- 172.21.15.157:0/4123648998 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4610159f00 0x7f461015da70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:19.433 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.430+0000 7f460effd700 1 -- 172.21.15.157:0/4123648998 >> v1:172.21.15.157:6789/0 conn(0x7f46100708d0 legacy=0x7f46100cb780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:57:19.433 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.430+0000 7f460effd700 1 -- 172.21.15.157:0/4123648998 --> v1:172.21.15.187:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f461015e880 con 0x7f46100cbe90 2023-10-16T19:57:19.434 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.430+0000 7f460effd700 1 -- 172.21.15.157:0/4123648998 <== mon.1 v1:172.21.15.187:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4021145519 0 0) 0x7f4600004d40 con 0x7f46100cbe90 2023-10-16T19:57:19.434 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.430+0000 7f460effd700 1 -- 172.21.15.157:0/4123648998 >> v1:172.21.15.187:6789/0 conn(0x7f46100cbe90 legacy=0x7f46100cdd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:19.434 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.430+0000 7f460effd700 1 --2- 172.21.15.157:0/4123648998 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f45f8003a00 0x7f45f8003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:19.434 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.430+0000 7f460effd700 1 --2- 172.21.15.157:0/4123648998 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f45f8004420 0x7f45f80048f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:19.434 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.430+0000 7f460effd700 1 --2- 172.21.15.157:0/4123648998 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f45f8004e30 0x7f45f80052b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:19.435 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.430+0000 7f460effd700 1 -- 172.21.15.157:0/4123648998 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f461015e5a0 con 0x7f45f8004420 2023-10-16T19:57:19.435 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.430+0000 7f460effd700 1 -- 172.21.15.157:0/4123648998 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45f80147b0 con 0x7f45f8003a00 2023-10-16T19:57:19.435 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.430+0000 7f460effd700 1 -- 172.21.15.157:0/4123648998 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45f8014970 con 0x7f45f8004e30 2023-10-16T19:57:19.435 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.430+0000 7f4614a00700 1 --2- 172.21.15.157:0/4123648998 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f45f8004e30 0x7f45f80052b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:19.435 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.430+0000 7f460f7fe700 1 --2- 172.21.15.157:0/4123648998 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f45f8004420 0x7f45f80048f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:19.436 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.431+0000 7f460f7fe700 1 -- 172.21.15.157:0/4123648998 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f45f8004e30 msgr2=0x7f45f80052b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:57:19.436 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.431+0000 7f460f7fe700 1 --2- 172.21.15.157:0/4123648998 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f45f8004e30 0x7f45f80052b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:19.437 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.431+0000 7f460f7fe700 1 -- 172.21.15.157:0/4123648998 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f45f8003a00 msgr2=0x7f45f8003e00 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-16T19:57:19.437 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.431+0000 7f460f7fe700 1 --2- 172.21.15.157:0/4123648998 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f45f8003a00 0x7f45f8003e00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:19.437 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.431+0000 7f460f7fe700 1 -- 172.21.15.157:0/4123648998 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f461015e880 con 0x7f45f8004420 2023-10-16T19:57:19.437 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.432+0000 7f460f7fe700 1 --2- 172.21.15.157:0/4123648998 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f45f8004420 0x7f45f80048f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f46040016e0 tx=0x7f45f8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a60c3ae041bed30 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:19.437 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.432+0000 7f460effd700 1 -- 172.21.15.157:0/4123648998 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4604001180 con 0x7f45f8004420 2023-10-16T19:57:19.438 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.432+0000 7f460effd700 1 -- 172.21.15.157:0/4123648998 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46040052d0 con 0x7f45f8004420 2023-10-16T19:57:19.438 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.432+0000 7f460effd700 1 -- 172.21.15.157:0/4123648998 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46040036a0 con 0x7f45f8004420 2023-10-16T19:57:19.438 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.433+0000 7f4616463700 1 -- 172.21.15.157:0/4123648998 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f45f8004420 msgr2=0x7f45f80048f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:19.438 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.433+0000 7f4616463700 1 --2- 172.21.15.157:0/4123648998 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f45f8004420 0x7f45f80048f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f46040016e0 tx=0x7f45f8005880 comp rx=0 tx=0).stop 2023-10-16T19:57:19.438 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.433+0000 7f4614a00700 1 -- 172.21.15.157:0/4123648998 reap_dead start 2023-10-16T19:57:19.439 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.434+0000 7f4616463700 1 -- 172.21.15.157:0/4123648998 shutdown_connections 2023-10-16T19:57:19.439 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.434+0000 7f4616463700 1 -- 172.21.15.157:0/4123648998 >> 172.21.15.157:0/4123648998 conn(0x7f46100cf950 msgr2=0x7f46100cfd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:19.439 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.434+0000 7f4616463700 1 -- 172.21.15.157:0/4123648998 shutdown_connections 2023-10-16T19:57:19.439 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.434+0000 7f4616463700 1 -- 172.21.15.157:0/4123648998 wait complete. 2023-10-16T19:57:19.440 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.436+0000 7f4616463700 1 Processor -- start 2023-10-16T19:57:19.441 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.437+0000 7f4616463700 1 -- start start 2023-10-16T19:57:19.441 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.438+0000 7f4616463700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f45f8004420 0x7f4610158ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:19.441 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.438+0000 7f4616463700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f46101f54c0 0x7f46101f5940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:19.442 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.438+0000 7f4616463700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f46100c7070 0x7f46100c7520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:19.442 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.438+0000 7f4616463700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46101f6a80 con 0x7f45f8004420 2023-10-16T19:57:19.443 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.438+0000 7f4616463700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46100c6be0 con 0x7f46100c7070 2023-10-16T19:57:19.443 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.438+0000 7f4616463700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46101f61e0 con 0x7f46101f54c0 2023-10-16T19:57:19.444 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.439+0000 7f460f7fe700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f46101f54c0 0x7f46101f5940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:19.444 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.439+0000 7f460f7fe700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f46101f54c0 0x7f46101f5940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.157:55320/0 (socket says 172.21.15.157:55320) 2023-10-16T19:57:19.444 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.439+0000 7f460f7fe700 1 -- 172.21.15.157:0/3095291426 learned_addr learned my addr 172.21.15.157:0/3095291426 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:57:19.445 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.439+0000 7f4614a00700 1 --2- 172.21.15.157:0/3095291426 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f46100c7070 0x7f46100c7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:19.445 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.439+0000 7f460ffff700 1 --2- 172.21.15.157:0/3095291426 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f45f8004420 0x7f4610158ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:19.445 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.440+0000 7f4614a00700 1 -- 172.21.15.157:0/3095291426 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f46101f54c0 msgr2=0x7f46101f5940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:19.445 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.440+0000 7f4614a00700 1 --2- 172.21.15.157:0/3095291426 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f46101f54c0 0x7f46101f5940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:19.445 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.440+0000 7f4614a00700 1 -- 172.21.15.157:0/3095291426 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f45f8004420 msgr2=0x7f4610158ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:19.446 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.440+0000 7f4614a00700 1 --2- 172.21.15.157:0/3095291426 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f45f8004420 0x7f4610158ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:19.446 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.440+0000 7f4614a00700 1 -- 172.21.15.157:0/3095291426 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46101f64c0 con 0x7f46100c7070 2023-10-16T19:57:19.446 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.440+0000 7f4614a00700 1 --2- 172.21.15.157:0/3095291426 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f46100c7070 0x7f46100c7520 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f461006ff00 tx=0x7f4600004d20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:19.446 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.440+0000 7f460cff9700 1 -- 172.21.15.157:0/3095291426 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f460000ea90 con 0x7f46100c7070 2023-10-16T19:57:19.446 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.441+0000 7f460cff9700 1 -- 172.21.15.157:0/3095291426 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4600007070 con 0x7f46100c7070 2023-10-16T19:57:19.447 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.441+0000 7f460cff9700 1 -- 172.21.15.157:0/3095291426 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f460000ee30 con 0x7f46100c7070 2023-10-16T19:57:19.447 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.441+0000 7f4616463700 1 -- 172.21.15.157:0/3095291426 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46101f67a0 con 0x7f46100c7070 2023-10-16T19:57:19.447 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.441+0000 7f4616463700 1 -- 172.21.15.157:0/3095291426 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4610159430 con 0x7f46100c7070 2023-10-16T19:57:19.448 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.444+0000 7f4616463700 1 -- 172.21.15.157:0/3095291426 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45fc005320 con 0x7f46100c7070 2023-10-16T19:57:19.448 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.445+0000 7f460cff9700 1 -- 172.21.15.157:0/3095291426 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f460000a070 con 0x7f46100c7070 2023-10-16T19:57:19.448 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.445+0000 7f460cff9700 1 --2- 172.21.15.157:0/3095291426 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f45f806c900 0x7f45f806edc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:19.448 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.445+0000 7f460cff9700 1 -- 172.21.15.157:0/3095291426 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4600089c40 con 0x7f46100c7070 2023-10-16T19:57:19.449 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.446+0000 7f460ffff700 1 --2- 172.21.15.157:0/3095291426 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f45f806c900 0x7f45f806edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:19.449 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.447+0000 7f460ffff700 1 --2- 172.21.15.157:0/3095291426 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f45f806c900 0x7f45f806edc0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f460800b590 tx=0x7f460800d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:19.451 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.449+0000 7f460cff9700 1 -- 172.21.15.157:0/3095291426 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4600054d60 con 0x7f46100c7070 2023-10-16T19:57:19.466 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.463+0000 7f1afc354700 1 Processor -- start 2023-10-16T19:57:19.466 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.463+0000 7f1afc354700 1 -- start start 2023-10-16T19:57:19.467 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.464+0000 7f1afc354700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1af4154750 0x7f1af415ad70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:19.467 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.464+0000 7f1afc354700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f1af40ce010 0x7f1af40ca380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:19.469 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.464+0000 7f1afc354700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1af4071d80 con 0x7f1af40679d0 2023-10-16T19:57:19.470 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.464+0000 7f1afc354700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1af40cb640 con 0x7f1af40ce010 2023-10-16T19:57:19.470 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.464+0000 7f1afc354700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1af4071fe0 con 0x7f1af4154750 2023-10-16T19:57:19.470 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.465+0000 7f1afa0f0700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1af4154750 0x7f1af415ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:19.470 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.465+0000 7f1afa0f0700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1af4154750 0x7f1af415ad70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.157:55326/0 (socket says 172.21.15.157:55326) 2023-10-16T19:57:19.470 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.465+0000 7f1afa0f0700 1 -- 172.21.15.157:0/3434762183 learned_addr learned my addr 172.21.15.157:0/3434762183 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:57:19.471 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.465+0000 7f1afa0f0700 1 -- 172.21.15.157:0/3434762183 >> v2:172.21.15.157:3300/0 conn(0x7f1af40ce010 msgr2=0x7f1af40ca380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:57:19.471 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.465+0000 7f1afa0f0700 1 --2- 172.21.15.157:0/3434762183 >> v2:172.21.15.157:3300/0 conn(0x7f1af40ce010 0x7f1af40ca380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:19.471 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.465+0000 7f1afa0f0700 1 -- 172.21.15.157:0/3434762183 >> v1:172.21.15.187:6789/0 conn(0x7f1af40679d0 legacy=0x7f1af40cd900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:19.471 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.465+0000 7f1afa0f0700 1 -- 172.21.15.157:0/3434762183 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1af40722c0 con 0x7f1af4154750 2023-10-16T19:57:19.472 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.465+0000 7f1afa0f0700 1 --2- 172.21.15.157:0/3434762183 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1af4154750 0x7f1af415ad70 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f1aec00d150 tx=0x7f1aec00d460 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1abc39440bb6b6bb server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:19.473 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.471+0000 7f1af90ee700 1 -- 172.21.15.157:0/3434762183 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aec010070 con 0x7f1af4154750 2023-10-16T19:57:19.474 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.471+0000 7f1af90ee700 1 -- 172.21.15.157:0/3434762183 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1aec00dbb0 con 0x7f1af4154750 2023-10-16T19:57:19.474 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.471+0000 7f1af90ee700 1 -- 172.21.15.157:0/3434762183 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aec016400 con 0x7f1af4154750 2023-10-16T19:57:19.475 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.472+0000 7f1afc354700 1 -- 172.21.15.157:0/3434762183 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1af4154750 msgr2=0x7f1af415ad70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:19.475 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.472+0000 7f1afc354700 1 --2- 172.21.15.157:0/3434762183 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1af4154750 0x7f1af415ad70 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f1aec00d150 tx=0x7f1aec00d460 comp rx=0 tx=0).stop 2023-10-16T19:57:19.475 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.472+0000 7f1afc354700 1 -- 172.21.15.157:0/3434762183 shutdown_connections 2023-10-16T19:57:19.475 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.472+0000 7f1afc354700 1 --2- 172.21.15.157:0/3434762183 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1af4154750 0x7f1af415ad70 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:19.476 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.472+0000 7f1afc354700 1 --2- 172.21.15.157:0/3434762183 >> v2:172.21.15.157:3300/0 conn(0x7f1af40ce010 0x7f1af40ca380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:19.476 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.472+0000 7f1afc354700 1 -- 172.21.15.157:0/3434762183 >> 172.21.15.157:0/3434762183 conn(0x7f1af40cfd30 msgr2=0x7f1af40d0140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:19.476 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.473+0000 7f1afc354700 1 -- 172.21.15.157:0/3434762183 shutdown_connections 2023-10-16T19:57:19.476 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.474+0000 7f267681b700 1 Processor -- start 2023-10-16T19:57:19.477 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.473+0000 7f1afc354700 1 -- 172.21.15.157:0/3434762183 wait complete. 2023-10-16T19:57:19.477 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.474+0000 7f1afc354700 1 Processor -- start 2023-10-16T19:57:19.478 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.474+0000 7f267681b700 1 -- start start 2023-10-16T19:57:19.478 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.475+0000 7f267681b700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f2670159f00 0x7f267015da70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:19.478 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.475+0000 7f267681b700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f26700cbe90 0x7f26700cdd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:19.478 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.475+0000 7f267681b700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f267015a2e0 con 0x7f26700708d0 2023-10-16T19:57:19.479 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.475+0000 7f267681b700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f267015e2c0 con 0x7f2670159f00 2023-10-16T19:57:19.479 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.475+0000 7f267681b700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f267015e5a0 con 0x7f26700cbe90 2023-10-16T19:57:19.479 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.475+0000 7f266f7fe700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f26700708d0 0x7f26700cb780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:55700/0 (socket says 172.21.15.157:55700) 2023-10-16T19:57:19.479 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.475+0000 7f266f7fe700 1 -- 172.21.15.157:0/246647045 learned_addr learned my addr 172.21.15.157:0/246647045 (peer_addr_for_me v1:172.21.15.157:0/0) 2023-10-16T19:57:19.480 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.475+0000 7f1afc354700 1 -- start start 2023-10-16T19:57:19.480 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.476+0000 7f3f9c672700 1 Processor -- start 2023-10-16T19:57:19.481 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.476+0000 7f266effd700 1 -- 172.21.15.157:0/246647045 <== mon.0 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3503325170 0 0) 0x7f267015a2e0 con 0x7f26700708d0 2023-10-16T19:57:19.481 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.476+0000 7f266effd700 1 -- 172.21.15.157:0/246647045 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f26580035b0 con 0x7f26700708d0 2023-10-16T19:57:19.481 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.477+0000 7f266effd700 1 -- 172.21.15.157:0/246647045 <== mon.0 v1:172.21.15.157:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1256635637 0 0) 0x7f26580035b0 con 0x7f26700708d0 2023-10-16T19:57:19.482 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.477+0000 7f266effd700 1 -- 172.21.15.157:0/246647045 >> v2:172.21.15.187:3300/0 conn(0x7f26700cbe90 msgr2=0x7f26700cdd20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-16T19:57:19.482 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.477+0000 7f266effd700 1 --2- 172.21.15.157:0/246647045 >> v2:172.21.15.187:3300/0 conn(0x7f26700cbe90 0x7f26700cdd20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:19.482 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.477+0000 7f266effd700 1 -- 172.21.15.157:0/246647045 >> v2:172.21.15.157:3300/0 conn(0x7f2670159f00 msgr2=0x7f267015da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:57:19.482 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.477+0000 7f266effd700 1 --2- 172.21.15.157:0/246647045 >> v2:172.21.15.157:3300/0 conn(0x7f2670159f00 0x7f267015da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:19.482 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.477+0000 7f266effd700 1 -- 172.21.15.157:0/246647045 --> v1:172.21.15.157:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f267015e880 con 0x7f26700708d0 2023-10-16T19:57:19.483 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.477+0000 7f266effd700 1 -- 172.21.15.157:0/246647045 <== mon.0 v1:172.21.15.157:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4021145519 0 0) 0x7f26680019f0 con 0x7f26700708d0 2023-10-16T19:57:19.483 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.477+0000 7f266effd700 1 -- 172.21.15.157:0/246647045 >> v1:172.21.15.157:6789/0 conn(0x7f26700708d0 legacy=0x7f26700cb780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:19.483 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.477+0000 7f266effd700 1 --2- 172.21.15.157:0/246647045 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2658003a50 0x7f2658003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:19.483 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.477+0000 7f266effd700 1 --2- 172.21.15.157:0/246647045 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2658004850 0x7f2658004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:19.483 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.477+0000 7f266effd700 1 --2- 172.21.15.157:0/246647045 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2658005410 0x7f265800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:19.483 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.477+0000 7f266effd700 1 -- 172.21.15.157:0/246647045 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f267015e2c0 con 0x7f2658004850 2023-10-16T19:57:19.484 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.477+0000 7f266effd700 1 -- 172.21.15.157:0/246647045 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f267015e5a0 con 0x7f2658005410 2023-10-16T19:57:19.484 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.477+0000 7f266effd700 1 -- 172.21.15.157:0/246647045 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f265800c2f0 con 0x7f2658003a50 2023-10-16T19:57:19.484 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.477+0000 7f266f7fe700 1 --2- 172.21.15.157:0/246647045 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2658004850 0x7f2658004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:19.484 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.476+0000 7f1afc354700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1af40679d0 0x7f1af41f8e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:19.485 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.476+0000 7f1afc354700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1af4154750 0x7f1af40b43b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:19.485 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.476+0000 7f1afc354700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1af41f7af0 0x7f1af40b11c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:19.485 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.476+0000 7f1afc354700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1af40b4bc0 con 0x7f1af4154750 2023-10-16T19:57:19.485 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.476+0000 7f1afc354700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1af40b48f0 con 0x7f1af41f7af0 2023-10-16T19:57:19.485 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.476+0000 7f1afc354700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1af41fb8c0 con 0x7f1af40679d0 2023-10-16T19:57:19.486 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.477+0000 7f1afa0f0700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1af40679d0 0x7f1af41f8e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:19.486 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.477+0000 7f1afa0f0700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1af40679d0 0x7f1af41f8e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.157:55338/0 (socket says 172.21.15.157:55338) 2023-10-16T19:57:19.486 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.477+0000 7f1afa0f0700 1 -- 172.21.15.157:0/3612528601 learned_addr learned my addr 172.21.15.157:0/3612528601 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:57:19.486 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.476+0000 7f3f9c672700 1 -- start start 2023-10-16T19:57:19.487 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.477+0000 7f3f9c672700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3f94071f60 0x7f3f9406d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:19.487 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.477+0000 7f3f9c672700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f940cefc0 con 0x7f3f9415b130 2023-10-16T19:57:19.487 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.478+0000 7f3f9c672700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f9406e090 con 0x7f3f9406eb20 2023-10-16T19:57:19.487 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.478+0000 7f3f9c672700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f940b0050 con 0x7f3f94071f60 2023-10-16T19:57:19.488 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.478+0000 7f266f7fe700 1 -- 172.21.15.157:0/246647045 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2658003a50 msgr2=0x7f2658003e70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-16T19:57:19.488 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.478+0000 7f266f7fe700 1 --2- 172.21.15.157:0/246647045 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2658003a50 0x7f2658003e70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:19.488 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.478+0000 7f266f7fe700 1 -- 172.21.15.157:0/246647045 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2658005410 msgr2=0x7f265800ba10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-16T19:57:19.488 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.478+0000 7f266f7fe700 1 --2- 172.21.15.157:0/246647045 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2658005410 0x7f265800ba10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:19.488 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.478+0000 7f266f7fe700 1 -- 172.21.15.157:0/246647045 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26580035b0 con 0x7f2658004850 2023-10-16T19:57:19.489 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.478+0000 7f3f99c0d700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3f94071f60 0x7f3f9406d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:19.489 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.478+0000 7f3f99c0d700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3f94071f60 0x7f3f9406d0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.157:55344/0 (socket says 172.21.15.157:55344) 2023-10-16T19:57:19.490 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.478+0000 7f3f99c0d700 1 -- 172.21.15.157:0/2012243621 learned_addr learned my addr 172.21.15.157:0/2012243621 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:57:19.490 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.478+0000 7f3f9a40e700 1 --1- 172.21.15.157:0/2012243621 >> v1:172.21.15.157:6789/0 conn(0x7f3f9415b130 0x7f3f940cb970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:55714/0 (socket says 172.21.15.157:55714) 2023-10-16T19:57:19.490 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.478+0000 7f3f99c0d700 1 -- 172.21.15.157:0/2012243621 >> v1:172.21.15.187:6789/0 conn(0x7f3f9406eb20 legacy=0x7f3f940cf450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:57:19.490 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.478+0000 7f3f99c0d700 1 -- 172.21.15.157:0/2012243621 >> v1:172.21.15.157:6789/0 conn(0x7f3f9415b130 legacy=0x7f3f940cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:19.491 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.478+0000 7f3f99c0d700 1 -- 172.21.15.157:0/2012243621 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f9406d7f0 con 0x7f3f94071f60 2023-10-16T19:57:19.491 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.478+0000 7f1afa8f1700 1 --2- 172.21.15.157:0/3612528601 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1af41f7af0 0x7f1af40b11c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:19.491 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.478+0000 7f1afa0f0700 1 -- 172.21.15.157:0/3612528601 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1af41f7af0 msgr2=0x7f1af40b11c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:19.491 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.478+0000 7f1afa0f0700 1 --2- 172.21.15.157:0/3612528601 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1af41f7af0 0x7f1af40b11c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:19.492 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.478+0000 7f1afa0f0700 1 -- 172.21.15.157:0/3612528601 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1af4154750 msgr2=0x7f1af40b43b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-16T19:57:19.492 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.478+0000 7f1afa0f0700 1 --2- 172.21.15.157:0/3612528601 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1af4154750 0x7f1af40b43b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:19.492 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.478+0000 7f1afa0f0700 1 -- 172.21.15.157:0/3612528601 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1aec00bd40 con 0x7f1af40679d0 2023-10-16T19:57:19.493 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.479+0000 7f266f7fe700 1 --2- 172.21.15.157:0/246647045 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2658004850 0x7f2658004cd0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f26680053f0 tx=0x7f2658005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7f1dc1ccf8ff5ca server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:19.493 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.479+0000 7f266effd700 1 -- 172.21.15.157:0/246647045 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2668008ea0 con 0x7f2658004850 2023-10-16T19:57:19.493 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.479+0000 7f266effd700 1 -- 172.21.15.157:0/246647045 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2668008310 con 0x7f2658004850 2023-10-16T19:57:19.493 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.479+0000 7f266effd700 1 -- 172.21.15.157:0/246647045 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2668006770 con 0x7f2658004850 2023-10-16T19:57:19.494 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.480+0000 7f3f99c0d700 1 --2- 172.21.15.157:0/2012243621 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3f94071f60 0x7f3f9406d0f0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f3f90009920 tx=0x7f3f90009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2919a659818a8fd4 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:19.494 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.480+0000 7f2674db8700 1 -- 172.21.15.157:0/246647045 reap_dead start 2023-10-16T19:57:19.495 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.480+0000 7f267681b700 1 -- 172.21.15.157:0/246647045 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2658004850 msgr2=0x7f2658004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:19.495 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.480+0000 7f267681b700 1 --2- 172.21.15.157:0/246647045 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2658004850 0x7f2658004cd0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f26680053f0 tx=0x7f2658005880 comp rx=0 tx=0).stop 2023-10-16T19:57:19.495 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.480+0000 7f267681b700 1 -- 172.21.15.157:0/246647045 shutdown_connections 2023-10-16T19:57:19.495 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.480+0000 7f267681b700 1 --2- 172.21.15.157:0/246647045 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2658004850 0x7f2658004cd0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:19.495 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.480+0000 7f267681b700 1 -- 172.21.15.157:0/246647045 >> 172.21.15.157:0/246647045 conn(0x7f26700cf950 msgr2=0x7f26700cfd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:19.496 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.480+0000 7f3f9940c700 1 -- 172.21.15.157:0/2012243621 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f90004230 con 0x7f3f94071f60 2023-10-16T19:57:19.496 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.481+0000 7f1afa0f0700 1 --2- 172.21.15.157:0/3612528601 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1af40679d0 0x7f1af41f8e80 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f1af40671e0 tx=0x7f1aec004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:19.497 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.481+0000 7f1aeaffd700 1 -- 172.21.15.157:0/3612528601 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aec004240 con 0x7f1af40679d0 2023-10-16T19:57:19.497 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.481+0000 7f1aeaffd700 1 -- 172.21.15.157:0/3612528601 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1aec0043a0 con 0x7f1af40679d0 2023-10-16T19:57:19.497 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.481+0000 7f1aeaffd700 1 -- 172.21.15.157:0/3612528601 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aec004730 con 0x7f1af40679d0 2023-10-16T19:57:19.498 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.480+0000 7f3f9940c700 1 -- 172.21.15.157:0/2012243621 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f90004390 con 0x7f3f94071f60 2023-10-16T19:57:19.498 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.480+0000 7f3f9940c700 1 -- 172.21.15.157:0/2012243621 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f90009e70 con 0x7f3f94071f60 2023-10-16T19:57:19.498 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.481+0000 7f3f9c672700 1 -- 172.21.15.157:0/2012243621 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3f94071f60 msgr2=0x7f3f9406d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:19.498 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.481+0000 7f3f9c672700 1 --2- 172.21.15.157:0/2012243621 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3f94071f60 0x7f3f9406d0f0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f3f90009920 tx=0x7f3f90009c30 comp rx=0 tx=0).stop 2023-10-16T19:57:19.499 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.480+0000 7f267681b700 1 -- 172.21.15.157:0/246647045 shutdown_connections 2023-10-16T19:57:19.499 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.481+0000 7f1afc354700 1 -- 172.21.15.157:0/3612528601 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1af41fbba0 con 0x7f1af40679d0 2023-10-16T19:57:19.499 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.481+0000 7f1afc354700 1 -- 172.21.15.157:0/3612528601 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1af41fc160 con 0x7f1af40679d0 2023-10-16T19:57:19.500 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.481+0000 7f267681b700 1 -- 172.21.15.157:0/246647045 wait complete. 2023-10-16T19:57:19.500 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.483+0000 7f267681b700 1 Processor -- start 2023-10-16T19:57:19.500 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.483+0000 7f1afc354700 1 -- 172.21.15.157:0/3612528601 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1af40c3ec0 con 0x7f1af40679d0 2023-10-16T19:57:19.501 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.483+0000 7f1aeaffd700 1 -- 172.21.15.157:0/3612528601 <== mon.2 v2:172.21.15.187:3301/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f1aec01f440 con 0x7f1af40679d0 2023-10-16T19:57:19.501 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.484+0000 7f1aeaffd700 1 --2- 172.21.15.157:0/3612528601 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f1ad806af00 0x7f1ad806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:19.501 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.484+0000 7f1aeaffd700 1 -- 172.21.15.157:0/3612528601 <== mon.2 v2:172.21.15.187:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1aec08b3a0 con 0x7f1af40679d0 2023-10-16T19:57:19.501 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.484+0000 7f1af98ef700 1 --2- 172.21.15.157:0/3612528601 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f1ad806af00 0x7f1ad806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:19.501 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.484+0000 7f1af98ef700 1 --2- 172.21.15.157:0/3612528601 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f1ad806af00 0x7f1ad806d3c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f1ae4000f60 tx=0x7f1ae4007a40 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:19.502 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.485+0000 7f3f9c672700 1 -- 172.21.15.157:0/2012243621 shutdown_connections 2023-10-16T19:57:19.502 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.485+0000 7f3f9c672700 1 --2- 172.21.15.157:0/2012243621 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3f94071f60 0x7f3f9406d0f0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:19.502 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.485+0000 7f3f9c672700 1 -- 172.21.15.157:0/2012243621 >> 172.21.15.157:0/2012243621 conn(0x7f3f940cd4e0 msgr2=0x7f3f940cd8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:19.503 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.485+0000 7f3f9c672700 1 -- 172.21.15.157:0/2012243621 shutdown_connections 2023-10-16T19:57:19.503 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.484+0000 7f267681b700 1 -- start start 2023-10-16T19:57:19.504 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.485+0000 7f267681b700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2658004850 0x7f267014d860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:19.504 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.485+0000 7f267681b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f267015c9d0 0x7f267015ce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:19.504 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.485+0000 7f267681b700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f267014fda0 0x7f2670150230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:19.504 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.485+0000 7f267681b700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2670152400 con 0x7f2658004850 2023-10-16T19:57:19.504 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.485+0000 7f267681b700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f267014e3b0 con 0x7f267015c9d0 2023-10-16T19:57:19.505 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.485+0000 7f267681b700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2670150fb0 con 0x7f267014fda0 2023-10-16T19:57:19.505 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.485+0000 7f266ffff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2658004850 0x7f267014d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:19.505 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.485+0000 7f266ffff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2658004850 0x7f267014d860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:46046/0 (socket says 172.21.15.157:46046) 2023-10-16T19:57:19.505 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.485+0000 7f266ffff700 1 -- 172.21.15.157:0/2850147502 learned_addr learned my addr 172.21.15.157:0/2850147502 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:57:19.505 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.486+0000 7f266ffff700 1 -- 172.21.15.157:0/2850147502 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f267014fda0 msgr2=0x7f2670150230 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-16T19:57:19.506 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.486+0000 7f266ffff700 1 --2- 172.21.15.157:0/2850147502 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f267014fda0 0x7f2670150230 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:19.506 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.486+0000 7f266ffff700 1 -- 172.21.15.157:0/2850147502 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f267015c9d0 msgr2=0x7f267015ce30 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-16T19:57:19.506 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.486+0000 7f266ffff700 1 --2- 172.21.15.157:0/2850147502 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f267015c9d0 0x7f267015ce30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:19.506 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.486+0000 7f266ffff700 1 -- 172.21.15.157:0/2850147502 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f267015d370 con 0x7f2658004850 2023-10-16T19:57:19.506 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.486+0000 7f266ffff700 1 --2- 172.21.15.157:0/2850147502 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2658004850 0x7f267014d860 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f266400b550 tx=0x7f266400b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:19.507 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.486+0000 7f266cff9700 1 -- 172.21.15.157:0/2850147502 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2664011830 con 0x7f2658004850 2023-10-16T19:57:19.507 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.485+0000 7f3f9c672700 1 -- 172.21.15.157:0/2012243621 wait complete. 2023-10-16T19:57:19.507 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.487+0000 7f3f9c672700 1 Processor -- start 2023-10-16T19:57:19.508 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.486+0000 7f266cff9700 1 -- 172.21.15.157:0/2850147502 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26640119b0 con 0x7f2658004850 2023-10-16T19:57:19.508 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.486+0000 7f266cff9700 1 -- 172.21.15.157:0/2850147502 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2664011d60 con 0x7f2658004850 2023-10-16T19:57:19.508 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.486+0000 7f267681b700 1 -- 172.21.15.157:0/2850147502 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2670150770 con 0x7f2658004850 2023-10-16T19:57:19.508 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.486+0000 7f267681b700 1 -- 172.21.15.157:0/2850147502 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2670150cd0 con 0x7f2658004850 2023-10-16T19:57:19.509 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.488+0000 7f267681b700 1 -- 172.21.15.157:0/2850147502 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f267004f400 con 0x7f2658004850 2023-10-16T19:57:19.509 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.489+0000 7f1aeaffd700 1 -- 172.21.15.157:0/3612528601 <== mon.2 v2:172.21.15.187:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1aec056560 con 0x7f1af40679d0 2023-10-16T19:57:19.509 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.489+0000 7f266cff9700 1 -- 172.21.15.157:0/2850147502 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f2664023430 con 0x7f2658004850 2023-10-16T19:57:19.510 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.490+0000 7f266cff9700 1 --2- 172.21.15.157:0/2850147502 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f265c06af30 0x7f265c06d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:19.510 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.490+0000 7f266cff9700 1 -- 172.21.15.157:0/2850147502 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2664089700 con 0x7f2658004850 2023-10-16T19:57:19.511 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.494+0000 7f3f9c672700 1 -- start start 2023-10-16T19:57:19.511 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.495+0000 7f3f9c672700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3f9406eb20 0x7f3f9415bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:19.511 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.495+0000 7f3f9c672700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3f94071f60 0x7f3f940c7150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:19.512 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.495+0000 7f3f9c672700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3f9415b130 0x7f3f941ffe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:19.512 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.495+0000 7f3f9c672700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f940b66e0 con 0x7f3f9415b130 2023-10-16T19:57:19.512 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.495+0000 7f3f9c672700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f942009a0 con 0x7f3f94071f60 2023-10-16T19:57:19.512 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.495+0000 7f3f9c672700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f94200c80 con 0x7f3f9406eb20 2023-10-16T19:57:19.512 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.495+0000 7f3f9ac0f700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3f9415b130 0x7f3f941ffe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:19.512 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.495+0000 7f3f9ac0f700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3f9415b130 0x7f3f941ffe30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:46054/0 (socket says 172.21.15.157:46054) 2023-10-16T19:57:19.513 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.495+0000 7f3f9ac0f700 1 -- 172.21.15.157:0/529409486 learned_addr learned my addr 172.21.15.157:0/529409486 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:57:19.513 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.496+0000 7f3f9ac0f700 1 -- 172.21.15.157:0/529409486 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3f9406eb20 msgr2=0x7f3f9415bd00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-16T19:57:19.513 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.496+0000 7f3f9ac0f700 1 --2- 172.21.15.157:0/529409486 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3f9406eb20 0x7f3f9415bd00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:19.513 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.496+0000 7f3f9ac0f700 1 -- 172.21.15.157:0/529409486 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3f94071f60 msgr2=0x7f3f940c7150 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-16T19:57:19.513 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.496+0000 7f3f9ac0f700 1 --2- 172.21.15.157:0/529409486 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3f94071f60 0x7f3f940c7150 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:19.514 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.496+0000 7f3f9ac0f700 1 -- 172.21.15.157:0/529409486 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f90009550 con 0x7f3f9415b130 2023-10-16T19:57:19.514 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.496+0000 7f3f9ac0f700 1 --2- 172.21.15.157:0/529409486 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3f9415b130 0x7f3f941ffe30 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f3f8c00b990 tx=0x7f3f8c00bd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:19.514 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.497+0000 7f3f8affd700 1 -- 172.21.15.157:0/529409486 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f8c00c9d0 con 0x7f3f9415b130 2023-10-16T19:57:19.514 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.497+0000 7f3f8affd700 1 -- 172.21.15.157:0/529409486 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f8c00cb30 con 0x7f3f9415b130 2023-10-16T19:57:19.514 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.497+0000 7f3f8affd700 1 -- 172.21.15.157:0/529409486 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f8c014440 con 0x7f3f9415b130 2023-10-16T19:57:19.515 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.497+0000 7f3f9c672700 1 -- 172.21.15.157:0/529409486 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f94200f60 con 0x7f3f9415b130 2023-10-16T19:57:19.515 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.497+0000 7f3f9c672700 1 -- 172.21.15.157:0/529409486 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f94201520 con 0x7f3f9415b130 2023-10-16T19:57:19.515 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.497+0000 7f266cff9700 1 -- 172.21.15.157:0/2850147502 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2664054820 con 0x7f2658004850 2023-10-16T19:57:19.516 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.499+0000 7f3f9c672700 1 -- 172.21.15.157:0/529409486 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f7c0052f0 con 0x7f3f9415b130 2023-10-16T19:57:19.516 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.501+0000 7f3f8affd700 1 -- 172.21.15.157:0/529409486 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f3f8c01d3b0 con 0x7f3f9415b130 2023-10-16T19:57:19.516 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.501+0000 7f3f8affd700 1 --2- 172.21.15.157:0/529409486 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f3f7806af00 0x7f3f7806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:19.516 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.501+0000 7f3f8affd700 1 -- 172.21.15.157:0/529409486 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3f8c089800 con 0x7f3f9415b130 2023-10-16T19:57:19.517 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.503+0000 7f266f7fe700 1 --2- 172.21.15.157:0/2850147502 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f265c06af30 0x7f265c06d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:19.517 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.503+0000 7f3f9a40e700 1 --2- 172.21.15.157:0/529409486 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f3f7806af00 0x7f3f7806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:19.517 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.508+0000 7f3f8affd700 1 -- 172.21.15.157:0/529409486 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3f8c054890 con 0x7f3f9415b130 2023-10-16T19:57:19.518 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.503+0000 7f266f7fe700 1 --2- 172.21.15.157:0/2850147502 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f265c06af30 0x7f265c06d3f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f2668000f80 tx=0x7f266800a000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:19.523 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.521+0000 7f3f9a40e700 1 --2- 172.21.15.157:0/529409486 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f3f7806af00 0x7f3f7806d3c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f3f84001740 tx=0x7f3f84007a30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:19.528 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.526+0000 7fa1a9222700 1 Processor -- start 2023-10-16T19:57:19.530 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.526+0000 7fa1a9222700 1 -- start start 2023-10-16T19:57:19.530 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.527+0000 7fa1a9222700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fa1a40708d0 0x7fa1a40cb780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:19.531 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.527+0000 7fa1a9222700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa1a40cbcc0 0x7fa1a40cdd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:19.531 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.527+0000 7fa1a9222700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1a415a2e0 con 0x7fa1a4159f00 2023-10-16T19:57:19.531 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.527+0000 7fa1a9222700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1a40cc150 con 0x7fa1a40708d0 2023-10-16T19:57:19.531 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.528+0000 7fa1a9222700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1a415e2c0 con 0x7fa1a40cbcc0 2023-10-16T19:57:19.531 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.528+0000 7fa1a259c700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fa1a40708d0 0x7fa1a40cb780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:19.531 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.528+0000 7fa1a259c700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fa1a40708d0 0x7fa1a40cb780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:46060/0 (socket says 172.21.15.157:46060) 2023-10-16T19:57:19.532 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.528+0000 7fa1a259c700 1 -- 172.21.15.157:0/409589184 learned_addr learned my addr 172.21.15.157:0/409589184 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:57:19.532 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.528+0000 7fa1a359e700 1 --2- 172.21.15.157:0/409589184 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa1a40cbcc0 0x7fa1a40cdd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:19.536 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.530+0000 7fa1a359e700 1 -- 172.21.15.157:0/409589184 >> v2:172.21.15.157:3300/0 conn(0x7fa1a40708d0 msgr2=0x7fa1a40cb780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:57:19.536 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.530+0000 7fa1a359e700 1 --2- 172.21.15.157:0/409589184 >> v2:172.21.15.157:3300/0 conn(0x7fa1a40708d0 0x7fa1a40cb780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:19.537 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.530+0000 7fa1a359e700 1 -- 172.21.15.157:0/409589184 >> v1:172.21.15.187:6789/0 conn(0x7fa1a4159f00 legacy=0x7fa1a415da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:19.537 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.530+0000 7fa1a359e700 1 -- 172.21.15.157:0/409589184 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1a415e5a0 con 0x7fa1a40cbcc0 2023-10-16T19:57:19.538 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.534+0000 7fa1a359e700 1 --2- 172.21.15.157:0/409589184 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa1a40cbcc0 0x7fa1a40cdd20 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fa19c009e10 tx=0x7fa19c00d540 comp rx=0 tx=0).ready entity=mon.2 client_cookie=187f1d31a0af613c server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:19.538 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.535+0000 7fa1a1d9b700 1 -- 172.21.15.157:0/409589184 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa19c009ea0 con 0x7fa1a40cbcc0 2023-10-16T19:57:19.538 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.535+0000 7fa1a1d9b700 1 -- 172.21.15.157:0/409589184 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa19c0126e0 con 0x7fa1a40cbcc0 2023-10-16T19:57:19.539 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.535+0000 7fa1a1d9b700 1 -- 172.21.15.157:0/409589184 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa19c012a90 con 0x7fa1a40cbcc0 2023-10-16T19:57:19.539 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.536+0000 7fa1a9222700 1 -- 172.21.15.157:0/409589184 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa1a40cbcc0 msgr2=0x7fa1a40cdd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:19.539 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.536+0000 7fa1a9222700 1 --2- 172.21.15.157:0/409589184 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa1a40cbcc0 0x7fa1a40cdd20 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fa19c009e10 tx=0x7fa19c00d540 comp rx=0 tx=0).stop 2023-10-16T19:57:19.539 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.536+0000 7fa1a9222700 1 -- 172.21.15.157:0/409589184 shutdown_connections 2023-10-16T19:57:19.539 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.536+0000 7fa1a9222700 1 --2- 172.21.15.157:0/409589184 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa1a40cbcc0 0x7fa1a40cdd20 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:19.540 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.536+0000 7fa1a9222700 1 --2- 172.21.15.157:0/409589184 >> v2:172.21.15.157:3300/0 conn(0x7fa1a40708d0 0x7fa1a40cb780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:19.540 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.536+0000 7fa1a9222700 1 -- 172.21.15.157:0/409589184 >> 172.21.15.157:0/409589184 conn(0x7fa1a40cf950 msgr2=0x7fa1a40cfd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:19.540 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.536+0000 7fa1a9222700 1 -- 172.21.15.157:0/409589184 shutdown_connections 2023-10-16T19:57:19.540 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.536+0000 7fa1a9222700 1 -- 172.21.15.157:0/409589184 wait complete. 2023-10-16T19:57:19.541 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.537+0000 7f28c105f700 1 Processor -- start 2023-10-16T19:57:19.541 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.537+0000 7fa1a9222700 1 Processor -- start 2023-10-16T19:57:19.541 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.538+0000 7fa1a9222700 1 -- start start 2023-10-16T19:57:19.542 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.539+0000 7fa1a9222700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa1a40708d0 0x7fa1a41faf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:19.542 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.539+0000 7fa1a9222700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa1a40cbcc0 0x7fa1a414f580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:19.542 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.537+0000 7f28c105f700 1 -- start start 2023-10-16T19:57:19.542 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.539+0000 7f28c105f700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f28bc159f00 0x7f28bc15da70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:19.543 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.539+0000 7f28c105f700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f28bc0708d0 0x7f28bc0cb780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:19.543 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.539+0000 7f28c105f700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28bc15a2e0 con 0x7f28bc0cbcc0 2023-10-16T19:57:19.543 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.539+0000 7f28c105f700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28bc0cc150 con 0x7f28bc0708d0 2023-10-16T19:57:19.543 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.539+0000 7f28c105f700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28bc15e2c0 con 0x7f28bc159f00 2023-10-16T19:57:19.544 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.539+0000 7fa1a9222700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa1a4159f00 0x7fa1a40b0850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:19.544 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.539+0000 7fa1a9222700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1a415b320 con 0x7fa1a40cbcc0 2023-10-16T19:57:19.544 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.539+0000 7fa1a9222700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1a414fac0 con 0x7fa1a4159f00 2023-10-16T19:57:19.545 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.539+0000 7fa1a9222700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1a41fb620 con 0x7fa1a40708d0 2023-10-16T19:57:19.545 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.539+0000 7fa1a259c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa1a40cbcc0 0x7fa1a414f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:19.545 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.539+0000 7fa1a259c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa1a40cbcc0 0x7fa1a414f580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:46064/0 (socket says 172.21.15.157:46064) 2023-10-16T19:57:19.545 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.539+0000 7fa1a259c700 1 -- 172.21.15.157:0/2378575606 learned_addr learned my addr 172.21.15.157:0/2378575606 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:57:19.546 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.539+0000 7f28ba59c700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f28bc0708d0 0x7f28bc0cb780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:19.546 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.539+0000 7fa1a359e700 1 --2- 172.21.15.157:0/2378575606 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa1a4159f00 0x7fa1a40b0850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:19.547 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.539+0000 7fa1a259c700 1 -- 172.21.15.157:0/2378575606 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa1a40708d0 msgr2=0x7fa1a41faf20 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-16T19:57:19.547 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.539+0000 7fa1a259c700 1 --2- 172.21.15.157:0/2378575606 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa1a40708d0 0x7fa1a41faf20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:19.547 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.539+0000 7fa1a259c700 1 -- 172.21.15.157:0/2378575606 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa1a4159f00 msgr2=0x7fa1a40b0850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:19.547 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.539+0000 7fa1a259c700 1 --2- 172.21.15.157:0/2378575606 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa1a4159f00 0x7fa1a40b0850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:19.547 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.539+0000 7fa1a259c700 1 -- 172.21.15.157:0/2378575606 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa19c009a70 con 0x7fa1a40cbcc0 2023-10-16T19:57:19.548 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.540+0000 7fa1a359e700 1 --2- 172.21.15.157:0/2378575606 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa1a4159f00 0x7fa1a40b0850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T19:57:19.548 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.540+0000 7f28ba59c700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f28bc0708d0 0x7f28bc0cb780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.157:41176/0 (socket says 172.21.15.157:41176) 2023-10-16T19:57:19.548 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.540+0000 7f28ba59c700 1 -- 172.21.15.157:0/4003322331 learned_addr learned my addr 172.21.15.157:0/4003322331 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:57:19.548 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.540+0000 7fa1a259c700 1 --2- 172.21.15.157:0/2378575606 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa1a40cbcc0 0x7fa1a414f580 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fa19400f9c0 tx=0x7fa19400fd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:19.549 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.540+0000 7f28bad9d700 1 --2- 172.21.15.157:0/4003322331 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f28bc159f00 0x7f28bc15da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:19.549 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.540+0000 7f28ba59c700 1 -- 172.21.15.157:0/4003322331 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f28bc159f00 msgr2=0x7f28bc15da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:57:19.550 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.540+0000 7f28ba59c700 1 --2- 172.21.15.157:0/4003322331 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f28bc159f00 0x7f28bc15da70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:19.550 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.540+0000 7f28ba59c700 1 -- 172.21.15.157:0/4003322331 >> v1:172.21.15.157:6789/0 conn(0x7f28bc0cbcc0 legacy=0x7f28bc0ca290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:19.550 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.540+0000 7f28ba59c700 1 -- 172.21.15.157:0/4003322331 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28bc15e5a0 con 0x7f28bc0708d0 2023-10-16T19:57:19.550 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.540+0000 7f28ba59c700 1 --2- 172.21.15.157:0/4003322331 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f28bc0708d0 0x7f28bc0cb780 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f28b00092e0 tx=0x7f28b00095f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=41bb6398e4231d9a server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:19.551 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.540+0000 7fa18b7fe700 1 -- 172.21.15.157:0/2378575606 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa19400c070 con 0x7fa1a40cbcc0 2023-10-16T19:57:19.551 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.540+0000 7fa18b7fe700 1 -- 172.21.15.157:0/2378575606 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa19400db60 con 0x7fa1a40cbcc0 2023-10-16T19:57:19.551 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.540+0000 7fa18b7fe700 1 -- 172.21.15.157:0/2378575606 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa194012460 con 0x7fa1a40cbcc0 2023-10-16T19:57:19.551 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.540+0000 7fa1a9222700 1 -- 172.21.15.157:0/2378575606 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1a41fb900 con 0x7fa1a40cbcc0 2023-10-16T19:57:19.552 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.541+0000 7fa1a9222700 1 -- 172.21.15.157:0/2378575606 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1a415b500 con 0x7fa1a40cbcc0 2023-10-16T19:57:19.552 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.542+0000 7f28b9d9b700 1 -- 172.21.15.157:0/4003322331 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28b000c9b0 con 0x7f28bc0708d0 2023-10-16T19:57:19.553 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.542+0000 7f28b9d9b700 1 -- 172.21.15.157:0/4003322331 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28b000cb10 con 0x7f28bc0708d0 2023-10-16T19:57:19.553 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.542+0000 7f28b9d9b700 1 -- 172.21.15.157:0/4003322331 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28b000cea0 con 0x7f28bc0708d0 2023-10-16T19:57:19.553 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.543+0000 7f28c105f700 1 -- 172.21.15.157:0/4003322331 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f28bc0708d0 msgr2=0x7f28bc0cb780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:19.553 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.543+0000 7f28c105f700 1 --2- 172.21.15.157:0/4003322331 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f28bc0708d0 0x7f28bc0cb780 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f28b00092e0 tx=0x7f28b00095f0 comp rx=0 tx=0).stop 2023-10-16T19:57:19.554 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.544+0000 7f28c105f700 1 -- 172.21.15.157:0/4003322331 shutdown_connections 2023-10-16T19:57:19.554 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.544+0000 7f28c105f700 1 --2- 172.21.15.157:0/4003322331 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f28bc159f00 0x7f28bc15da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:19.554 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.544+0000 7f28c105f700 1 --2- 172.21.15.157:0/4003322331 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f28bc0708d0 0x7f28bc0cb780 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:19.554 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.544+0000 7f28c105f700 1 -- 172.21.15.157:0/4003322331 >> 172.21.15.157:0/4003322331 conn(0x7f28bc0cf950 msgr2=0x7f28bc0cfd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:19.555 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.544+0000 7f28c105f700 1 -- 172.21.15.157:0/4003322331 shutdown_connections 2023-10-16T19:57:19.555 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.543+0000 7fa18b7fe700 1 -- 172.21.15.157:0/2378575606 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fa1940125c0 con 0x7fa1a40cbcc0 2023-10-16T19:57:19.555 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.544+0000 7fa18b7fe700 1 --2- 172.21.15.157:0/2378575606 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fa19006af50 0x7fa19006d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:19.556 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.544+0000 7fa18b7fe700 1 -- 172.21.15.157:0/2378575606 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa194089570 con 0x7fa1a40cbcc0 2023-10-16T19:57:19.556 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.544+0000 7f28c105f700 1 -- 172.21.15.157:0/4003322331 wait complete. 2023-10-16T19:57:19.556 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.544+0000 7fa1a9222700 1 -- 172.21.15.157:0/2378575606 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1a415b720 con 0x7fa1a40cbcc0 2023-10-16T19:57:19.557 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.544+0000 7fa1a2d9d700 1 --2- 172.21.15.157:0/2378575606 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fa19006af50 0x7fa19006d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:19.557 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.547+0000 7f28c105f700 1 Processor -- start 2023-10-16T19:57:19.558 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.547+0000 7f28c105f700 1 -- start start 2023-10-16T19:57:19.558 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.548+0000 7f28c105f700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f28bc0708d0 0x7f28bc1fbbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:19.558 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.548+0000 7f28c105f700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f28bc0cbcc0 0x7f28bc1514d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:19.558 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.548+0000 7f28c105f700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f28bc159f00 0x7f28bc06da50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:19.559 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.548+0000 7f28c105f700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28bc1fc0f0 con 0x7f28bc0708d0 2023-10-16T19:57:19.559 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.548+0000 7f28c105f700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28bc15a8b0 con 0x7f28bc0cbcc0 2023-10-16T19:57:19.559 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.548+0000 7f28c105f700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28bc15ab90 con 0x7f28bc159f00 2023-10-16T19:57:19.559 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.548+0000 7f28bad9d700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f28bc0708d0 0x7f28bc1fbbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:19.559 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.549+0000 7f28bad9d700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f28bc0708d0 0x7f28bc1fbbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:46078/0 (socket says 172.21.15.157:46078) 2023-10-16T19:57:19.560 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.549+0000 7f28bad9d700 1 -- 172.21.15.157:0/3170951176 learned_addr learned my addr 172.21.15.157:0/3170951176 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:57:19.560 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.549+0000 7f28bad9d700 1 -- 172.21.15.157:0/3170951176 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f28bc159f00 msgr2=0x7f28bc06da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:19.560 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.549+0000 7f28bad9d700 1 --2- 172.21.15.157:0/3170951176 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f28bc159f00 0x7f28bc06da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:19.560 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.549+0000 7f28bad9d700 1 -- 172.21.15.157:0/3170951176 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f28bc0cbcc0 msgr2=0x7f28bc1514d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:19.561 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.549+0000 7f28bad9d700 1 --2- 172.21.15.157:0/3170951176 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f28bc0cbcc0 0x7f28bc1514d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:19.561 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.549+0000 7f28bad9d700 1 -- 172.21.15.157:0/3170951176 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28b0009de0 con 0x7f28bc0708d0 2023-10-16T19:57:19.561 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.549+0000 7f28bad9d700 1 --2- 172.21.15.157:0/3170951176 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f28bc0708d0 0x7f28bc1fbbb0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f28b400ccd0 tx=0x7f28b400a4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:19.562 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.550+0000 7fa1a2d9d700 1 --2- 172.21.15.157:0/2378575606 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fa19006af50 0x7fa19006d410 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa1a415b2b0 tx=0x7fa198007a60 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:19.562 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.553+0000 7fa18b7fe700 1 -- 172.21.15.157:0/2378575606 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa194054700 con 0x7fa1a40cbcc0 2023-10-16T19:57:19.564 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.553+0000 7f28ab7fe700 1 -- 172.21.15.157:0/3170951176 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28b400ad30 con 0x7f28bc0708d0 2023-10-16T19:57:19.564 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.553+0000 7f28ab7fe700 1 -- 172.21.15.157:0/3170951176 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28b400ae90 con 0x7f28bc0708d0 2023-10-16T19:57:19.564 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.553+0000 7f28ab7fe700 1 -- 172.21.15.157:0/3170951176 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28b4003c20 con 0x7f28bc0708d0 2023-10-16T19:57:19.565 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.554+0000 7f28c105f700 1 -- 172.21.15.157:0/3170951176 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28bc15ae70 con 0x7f28bc0708d0 2023-10-16T19:57:19.565 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.555+0000 7f28c105f700 1 -- 172.21.15.157:0/3170951176 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28bc15b430 con 0x7f28bc0708d0 2023-10-16T19:57:19.565 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.557+0000 7f482c586700 1 Processor -- start 2023-10-16T19:57:19.566 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.557+0000 7f28ab7fe700 1 -- 172.21.15.157:0/3170951176 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f28b4004020 con 0x7f28bc0708d0 2023-10-16T19:57:19.566 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.557+0000 7f28ab7fe700 1 --2- 172.21.15.157:0/3170951176 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f28a006afd0 0x7f28a006d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:19.567 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.557+0000 7f28ab7fe700 1 -- 172.21.15.157:0/3170951176 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f28b40897e0 con 0x7f28bc0708d0 2023-10-16T19:57:19.567 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.553+0000 7f1388be5700 1 Processor -- start 2023-10-16T19:57:19.568 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.553+0000 7f1388be5700 1 -- start start 2023-10-16T19:57:19.568 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.554+0000 7f1388be5700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f138416aa60 0x7f13840aee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:19.568 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.554+0000 7f1388be5700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f13840cdf30 0x7f138406ff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:19.569 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.554+0000 7f1388be5700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13840cef70 con 0x7f1384070490 2023-10-16T19:57:19.569 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.554+0000 7f1388be5700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1384070920 con 0x7f138416aa60 2023-10-16T19:57:19.569 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.554+0000 7f1388be5700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13840ce6d0 con 0x7f13840cdf30 2023-10-16T19:57:19.569 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.555+0000 7f1381d9b700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f13840cdf30 0x7f138406ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:19.569 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.555+0000 7f1381d9b700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f13840cdf30 0x7f138406ff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.157:55390/0 (socket says 172.21.15.157:55390) 2023-10-16T19:57:19.570 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.555+0000 7f138259c700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f138416aa60 0x7f13840aee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:19.570 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.555+0000 7f1381d9b700 1 -- 172.21.15.157:0/2078215173 learned_addr learned my addr 172.21.15.157:0/2078215173 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:57:19.570 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.555+0000 7f138159a700 1 -- 172.21.15.157:0/2078215173 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 291331739 0 0) 0x7f1378001110 con 0x7f1384070490 2023-10-16T19:57:19.571 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.557+0000 7f482c586700 1 -- start start 2023-10-16T19:57:19.571 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.558+0000 7f138159a700 1 -- 172.21.15.157:0/2078215173 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f136c0057c0 con 0x7f1384070490 2023-10-16T19:57:19.572 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.558+0000 7f1381d9b700 1 -- 172.21.15.157:0/2078215173 >> v2:172.21.15.187:3300/0 conn(0x7f138416aa60 msgr2=0x7f13840aee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:57:19.572 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.558+0000 7f1381d9b700 1 --2- 172.21.15.157:0/2078215173 >> v2:172.21.15.187:3300/0 conn(0x7f138416aa60 0x7f13840aee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:19.572 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.558+0000 7f1381d9b700 1 -- 172.21.15.157:0/2078215173 >> v1:172.21.15.187:6789/0 conn(0x7f1384070490 legacy=0x7f138408b060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:19.572 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.558+0000 7f1381d9b700 1 -- 172.21.15.157:0/2078215173 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13840ce9b0 con 0x7f13840cdf30 2023-10-16T19:57:19.572 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.558+0000 7f1381d9b700 1 --2- 172.21.15.157:0/2078215173 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f13840cdf30 0x7f138406ff50 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f137c00d220 tx=0x7f137c00d530 comp rx=0 tx=0).ready entity=mon.2 client_cookie=199648614c7b2c95 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:19.573 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.559+0000 7f482c586700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f4824159f00 0x7f482415da70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:19.573 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.559+0000 7f482c586700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f48240708d0 0x7f48240cb780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:19.574 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.559+0000 7f138159a700 1 -- 172.21.15.157:0/2078215173 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f137c016c20 con 0x7f13840cdf30 2023-10-16T19:57:19.574 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.559+0000 7f138159a700 1 -- 172.21.15.157:0/2078215173 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f137c00b070 con 0x7f13840cdf30 2023-10-16T19:57:19.574 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.559+0000 7f482c586700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f482415a2e0 con 0x7f48240d0440 2023-10-16T19:57:19.575 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.559+0000 7f482c586700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f482415e2c0 con 0x7f4824159f00 2023-10-16T19:57:19.575 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.559+0000 7f482c586700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f482415e5a0 con 0x7f48240708d0 2023-10-16T19:57:19.575 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.559+0000 7f138159a700 1 -- 172.21.15.157:0/2078215173 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f137c00de40 con 0x7f13840cdf30 2023-10-16T19:57:19.576 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.559+0000 7f482ab23700 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7f48240d0440 0x7f48240cab20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.157:39460/0 (socket says 172.21.15.157:39460) 2023-10-16T19:57:19.577 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.559+0000 7f482ab23700 1 -- 172.21.15.157:0/1003181565 learned_addr learned my addr 172.21.15.157:0/1003181565 (peer_addr_for_me v1:172.21.15.157:0/0) 2023-10-16T19:57:19.577 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.559+0000 7f482a322700 1 --2- 172.21.15.157:0/1003181565 >> v2:172.21.15.187:3300/0 conn(0x7f4824159f00 0x7f482415da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:19.577 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.559+0000 7f4829b21700 1 --2- 172.21.15.157:0/1003181565 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f48240708d0 0x7f48240cb780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:19.577 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.559+0000 7f4829320700 1 -- 172.21.15.157:0/1003181565 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3350804173 0 0) 0x7f482415a2e0 con 0x7f48240d0440 2023-10-16T19:57:19.578 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.559+0000 7f4829320700 1 -- 172.21.15.157:0/1003181565 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f48100035b0 con 0x7f48240d0440 2023-10-16T19:57:19.578 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.560+0000 7f4829320700 1 -- 172.21.15.157:0/1003181565 <== mon.1 v1:172.21.15.187:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4130527419 0 0) 0x7f48100035b0 con 0x7f48240d0440 2023-10-16T19:57:19.578 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.560+0000 7f4829320700 1 -- 172.21.15.157:0/1003181565 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f48240708d0 msgr2=0x7f48240cb780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:57:19.578 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.560+0000 7f4829320700 1 --2- 172.21.15.157:0/1003181565 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f48240708d0 0x7f48240cb780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:19.579 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.560+0000 7f4829320700 1 -- 172.21.15.157:0/1003181565 >> v2:172.21.15.187:3300/0 conn(0x7f4824159f00 msgr2=0x7f482415da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:57:19.579 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.560+0000 7f4829320700 1 --2- 172.21.15.157:0/1003181565 >> v2:172.21.15.187:3300/0 conn(0x7f4824159f00 0x7f482415da70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:19.579 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.560+0000 7f4829320700 1 -- 172.21.15.157:0/1003181565 --> v1:172.21.15.187:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f482415e880 con 0x7f48240d0440 2023-10-16T19:57:19.579 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.560+0000 7f4829320700 1 -- 172.21.15.157:0/1003181565 <== mon.1 v1:172.21.15.187:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4021145519 0 0) 0x7f4820001670 con 0x7f48240d0440 2023-10-16T19:57:19.580 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.560+0000 7f4829320700 1 -- 172.21.15.157:0/1003181565 >> v1:172.21.15.187:6789/0 conn(0x7f48240d0440 legacy=0x7f48240cab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:19.580 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.560+0000 7f4829320700 1 --2- 172.21.15.157:0/1003181565 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4810003a00 0x7f4810003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:19.580 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.560+0000 7f4829320700 1 --2- 172.21.15.157:0/1003181565 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4810004850 0x7f4810004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:19.580 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.560+0000 7f4829320700 1 --2- 172.21.15.157:0/1003181565 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4810005210 0x7f481000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:19.580 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.560+0000 7f4829320700 1 -- 172.21.15.157:0/1003181565 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f482415e2c0 con 0x7f4810003a00 2023-10-16T19:57:19.581 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.560+0000 7f4829320700 1 -- 172.21.15.157:0/1003181565 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f482415e5a0 con 0x7f4810004850 2023-10-16T19:57:19.581 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.560+0000 7f4829320700 1 -- 172.21.15.157:0/1003181565 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f481000bf80 con 0x7f4810005210 2023-10-16T19:57:19.581 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.560+0000 7f1388be5700 1 -- 172.21.15.157:0/2078215173 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f13840cdf30 msgr2=0x7f138406ff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:19.582 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.560+0000 7f1388be5700 1 --2- 172.21.15.157:0/2078215173 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f13840cdf30 0x7f138406ff50 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f137c00d220 tx=0x7f137c00d530 comp rx=0 tx=0).stop 2023-10-16T19:57:19.582 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.560+0000 7f1388be5700 1 -- 172.21.15.157:0/2078215173 shutdown_connections 2023-10-16T19:57:19.582 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.560+0000 7f1388be5700 1 --2- 172.21.15.157:0/2078215173 >> v2:172.21.15.187:3300/0 conn(0x7f138416aa60 0x7f13840aee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:19.582 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.560+0000 7f1388be5700 1 --2- 172.21.15.157:0/2078215173 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f13840cdf30 0x7f138406ff50 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:19.583 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.560+0000 7f1388be5700 1 -- 172.21.15.157:0/2078215173 >> 172.21.15.157:0/2078215173 conn(0x7f13840cf950 msgr2=0x7f13840cfd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:19.583 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.560+0000 7f1388be5700 1 -- 172.21.15.157:0/2078215173 shutdown_connections 2023-10-16T19:57:19.583 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.560+0000 7f1388be5700 1 -- 172.21.15.157:0/2078215173 wait complete. 2023-10-16T19:57:19.584 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.560+0000 7f482ab23700 1 --2- 172.21.15.157:0/1003181565 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4810005210 0x7f481000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:19.584 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.560+0000 7f482ab23700 1 -- 172.21.15.157:0/1003181565 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4810004850 msgr2=0x7f4810004cd0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-16T19:57:19.584 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.560+0000 7f482ab23700 1 --2- 172.21.15.157:0/1003181565 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4810004850 0x7f4810004cd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:19.584 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.560+0000 7f482ab23700 1 -- 172.21.15.157:0/1003181565 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4810003a00 msgr2=0x7f4810003e20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-16T19:57:19.585 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.560+0000 7f482ab23700 1 --2- 172.21.15.157:0/1003181565 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4810003a00 0x7f4810003e20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:19.585 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.560+0000 7f482ab23700 1 -- 172.21.15.157:0/1003181565 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f482415e880 con 0x7f4810005210 2023-10-16T19:57:19.585 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.561+0000 7f482ab23700 1 --2- 172.21.15.157:0/1003181565 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4810005210 0x7f481000ba10 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f4820007dc0 tx=0x7f4810005880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=68efd81a10eb7966 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:19.586 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.561+0000 7f4829320700 1 -- 172.21.15.157:0/1003181565 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4820005960 con 0x7f4810005210 2023-10-16T19:57:19.586 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.561+0000 7f4829320700 1 -- 172.21.15.157:0/1003181565 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4820005ac0 con 0x7f4810005210 2023-10-16T19:57:19.587 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.561+0000 7f28ba59c700 1 --2- 172.21.15.157:0/3170951176 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f28a006afd0 0x7f28a006d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:19.587 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.561+0000 7f4829320700 1 -- 172.21.15.157:0/1003181565 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4820005e70 con 0x7f4810005210 2023-10-16T19:57:19.588 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.561+0000 7f28ba59c700 1 --2- 172.21.15.157:0/3170951176 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f28a006afd0 0x7f28a006d490 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f28bc0c6320 tx=0x7f28b0011000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:19.589 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.562+0000 7f482c586700 1 -- 172.21.15.157:0/1003181565 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4810005210 msgr2=0x7f481000ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:19.589 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.562+0000 7f482c586700 1 --2- 172.21.15.157:0/1003181565 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4810005210 0x7f481000ba10 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f4820007dc0 tx=0x7f4810005880 comp rx=0 tx=0).stop 2023-10-16T19:57:19.589 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.562+0000 7f482ab23700 1 -- 172.21.15.157:0/1003181565 reap_dead start 2023-10-16T19:57:19.589 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.562+0000 7f482c586700 1 -- 172.21.15.157:0/1003181565 shutdown_connections 2023-10-16T19:57:19.589 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.562+0000 7f482c586700 1 -- 172.21.15.157:0/1003181565 >> 172.21.15.157:0/1003181565 conn(0x7f48240cf950 msgr2=0x7f48240cfd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:19.591 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.562+0000 7f1388be5700 1 Processor -- start 2023-10-16T19:57:19.591 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.562+0000 7f1388be5700 1 -- start start 2023-10-16T19:57:19.591 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.563+0000 7f1388be5700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1384070490 0x7f13840c2c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:19.591 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.563+0000 7f1388be5700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f138416aa60 0x7f1384169c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:19.592 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.563+0000 7f1388be5700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f13840c4770 0x7f13840c8a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:19.592 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.563+0000 7f1388be5700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13840c3480 con 0x7f1384070490 2023-10-16T19:57:19.592 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.563+0000 7f1388be5700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13840c42e0 con 0x7f138416aa60 2023-10-16T19:57:19.592 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.563+0000 7f1388be5700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13840c31a0 con 0x7f13840c4770 2023-10-16T19:57:19.592 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.563+0000 7f138259c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1384070490 0x7f13840c2c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:19.593 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.563+0000 7f138259c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1384070490 0x7f13840c2c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:46102/0 (socket says 172.21.15.157:46102) 2023-10-16T19:57:19.593 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.563+0000 7f138259c700 1 -- 172.21.15.157:0/3976366174 learned_addr learned my addr 172.21.15.157:0/3976366174 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:57:19.593 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.564+0000 7f138259c700 1 -- 172.21.15.157:0/3976366174 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f13840c4770 msgr2=0x7f13840c8a30 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-16T19:57:19.593 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.564+0000 7f138259c700 1 --2- 172.21.15.157:0/3976366174 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f13840c4770 0x7f13840c8a30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:19.593 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.564+0000 7f138259c700 1 -- 172.21.15.157:0/3976366174 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f138416aa60 msgr2=0x7f1384169c50 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-16T19:57:19.594 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.564+0000 7f138259c700 1 --2- 172.21.15.157:0/3976366174 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f138416aa60 0x7f1384169c50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:19.594 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.564+0000 7f138259c700 1 -- 172.21.15.157:0/3976366174 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f137c007b10 con 0x7f1384070490 2023-10-16T19:57:19.594 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.564+0000 7f138259c700 1 --2- 172.21.15.157:0/3976366174 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1384070490 0x7f13840c2c60 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f137400bb50 tx=0x7f137400bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:19.594 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.564+0000 7f1372ffd700 1 -- 172.21.15.157:0/3976366174 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f137400f570 con 0x7f1384070490 2023-10-16T19:57:19.594 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.564+0000 7f1372ffd700 1 -- 172.21.15.157:0/3976366174 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f137400f6d0 con 0x7f1384070490 2023-10-16T19:57:19.595 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.564+0000 7f1372ffd700 1 -- 172.21.15.157:0/3976366174 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f137400fa40 con 0x7f1384070490 2023-10-16T19:57:19.595 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.564+0000 7f1388be5700 1 -- 172.21.15.157:0/3976366174 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13840c36d0 con 0x7f1384070490 2023-10-16T19:57:19.595 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.564+0000 7f1388be5700 1 -- 172.21.15.157:0/3976366174 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13840c3c90 con 0x7f1384070490 2023-10-16T19:57:19.595 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.566+0000 7f482c586700 1 -- 172.21.15.157:0/1003181565 shutdown_connections 2023-10-16T19:57:19.596 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.566+0000 7f1372ffd700 1 -- 172.21.15.157:0/3976366174 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f1374014070 con 0x7f1384070490 2023-10-16T19:57:19.596 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.566+0000 7f1372ffd700 1 --2- 172.21.15.157:0/3976366174 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f136406af00 0x7f136406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:19.596 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.566+0000 7f1372ffd700 1 -- 172.21.15.157:0/3976366174 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1374088930 con 0x7f1384070490 2023-10-16T19:57:19.598 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.566+0000 7f482c586700 1 -- 172.21.15.157:0/1003181565 wait complete. 2023-10-16T19:57:19.598 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.568+0000 7f482c586700 1 Processor -- start 2023-10-16T19:57:19.598 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.568+0000 7f482c586700 1 -- start start 2023-10-16T19:57:19.598 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.569+0000 7f482c586700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f48240af720 0x7f48241fbde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:19.598 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.569+0000 7f482c586700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f482414f3c0 0x7f4824153b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:19.599 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.569+0000 7f482c586700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f482415d0c0 0x7f4824154060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:19.599 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.569+0000 7f482c586700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48241f89d0 con 0x7f48240af720 2023-10-16T19:57:19.599 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.569+0000 7f482c586700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48241fc320 con 0x7f482415d0c0 2023-10-16T19:57:19.599 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.569+0000 7f482c586700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48241f7e00 con 0x7f482414f3c0 2023-10-16T19:57:19.599 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.569+0000 7f482a322700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f48240af720 0x7f48241fbde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:19.600 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.569+0000 7f482a322700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f48240af720 0x7f48241fbde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:46108/0 (socket says 172.21.15.157:46108) 2023-10-16T19:57:19.600 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.569+0000 7f482a322700 1 -- 172.21.15.157:0/184446194 learned_addr learned my addr 172.21.15.157:0/184446194 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:57:19.600 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.569+0000 7f4829b21700 1 --2- 172.21.15.157:0/184446194 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f482414f3c0 0x7f4824153b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:19.600 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.569+0000 7f482ab23700 1 --2- 172.21.15.157:0/184446194 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f482415d0c0 0x7f4824154060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:19.600 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.570+0000 7f4829b21700 1 -- 172.21.15.157:0/184446194 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f482415d0c0 msgr2=0x7f4824154060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:19.601 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.570+0000 7f4829b21700 1 --2- 172.21.15.157:0/184446194 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f482415d0c0 0x7f4824154060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:19.601 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.570+0000 7f4829b21700 1 -- 172.21.15.157:0/184446194 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f48240af720 msgr2=0x7f48241fbde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:19.601 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.570+0000 7f4829b21700 1 --2- 172.21.15.157:0/184446194 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f48240af720 0x7f48241fbde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:19.601 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.570+0000 7f4829b21700 1 -- 172.21.15.157:0/184446194 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48241f80a0 con 0x7f482414f3c0 2023-10-16T19:57:19.601 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.570+0000 7f4829b21700 1 --2- 172.21.15.157:0/184446194 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f482414f3c0 0x7f4824153b20 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f4824070650 tx=0x7f481400eae0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:19.601 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.570+0000 7f481affd700 1 -- 172.21.15.157:0/184446194 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4814013680 con 0x7f482414f3c0 2023-10-16T19:57:19.602 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.570+0000 7f481affd700 1 -- 172.21.15.157:0/184446194 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48140137e0 con 0x7f482414f3c0 2023-10-16T19:57:19.602 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.570+0000 7f481affd700 1 -- 172.21.15.157:0/184446194 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4814013b90 con 0x7f482414f3c0 2023-10-16T19:57:19.602 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.570+0000 7f482c586700 1 -- 172.21.15.157:0/184446194 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48241f8380 con 0x7f482414f3c0 2023-10-16T19:57:19.602 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.570+0000 7f482c586700 1 -- 172.21.15.157:0/184446194 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48240afb00 con 0x7f482414f3c0 2023-10-16T19:57:19.603 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.571+0000 7f28c105f700 1 -- 172.21.15.157:0/3170951176 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28bc04f400 con 0x7f28bc0708d0 2023-10-16T19:57:19.603 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.572+0000 7f482c586700 1 -- 172.21.15.157:0/184446194 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f482404f400 con 0x7f482414f3c0 2023-10-16T19:57:19.603 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.572+0000 7f1381d9b700 1 --2- 172.21.15.157:0/3976366174 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f136406af00 0x7f136406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:19.604 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.572+0000 7f1381d9b700 1 --2- 172.21.15.157:0/3976366174 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f136406af00 0x7f136406d3c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f13840ae7d0 tx=0x7f137c018000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:19.604 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.573+0000 7f481affd700 1 -- 172.21.15.157:0/184446194 <== mon.2 v2:172.21.15.187:3301/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f4814013cf0 con 0x7f482414f3c0 2023-10-16T19:57:19.605 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.574+0000 7f481affd700 1 --2- 172.21.15.157:0/184446194 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f480806af30 0x7f480806d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:19.605 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.574+0000 7f481affd700 1 -- 172.21.15.157:0/184446194 <== mon.2 v2:172.21.15.187:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4814089a80 con 0x7f482414f3c0 2023-10-16T19:57:19.605 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.574+0000 7f482a322700 1 --2- 172.21.15.157:0/184446194 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f480806af30 0x7f480806d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:19.605 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.575+0000 7f482a322700 1 --2- 172.21.15.157:0/184446194 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f480806af30 0x7f480806d3f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f481c007520 tx=0x7f481c0098d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:19.606 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.576+0000 7f28ab7fe700 1 -- 172.21.15.157:0/3170951176 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f28b401d080 con 0x7f28bc0708d0 2023-10-16T19:57:19.606 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.577+0000 7f481affd700 1 -- 172.21.15.157:0/184446194 <== mon.2 v2:172.21.15.187:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4814054c10 con 0x7f482414f3c0 2023-10-16T19:57:19.606 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.584+0000 7f1388be5700 1 -- 172.21.15.157:0/3976366174 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13680052f0 con 0x7f1384070490 2023-10-16T19:57:19.607 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.593+0000 7f1372ffd700 1 -- 172.21.15.157:0/3976366174 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1374053aa0 con 0x7f1384070490 2023-10-16T19:57:19.845 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.843+0000 7f4616463700 1 -- 172.21.15.157:0/3095291426 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f45fc0055d0 con 0x7f46100c7070 2023-10-16T19:57:19.846 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.844+0000 7f460cff9700 1 -- 172.21.15.157:0/3095291426 <== mon.1 v2:172.21.15.187:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f460001f070 con 0x7f46100c7070 2023-10-16T19:57:19.849 INFO:teuthology.orchestra.run.smithi157.stdout:55834574854 2023-10-16T19:57:19.850 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.848+0000 7f4616463700 1 -- 172.21.15.157:0/3095291426 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f45f806c900 msgr2=0x7f45f806edc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:19.851 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.848+0000 7f4616463700 1 --2- 172.21.15.157:0/3095291426 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f45f806c900 0x7f45f806edc0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f460800b590 tx=0x7f460800d040 comp rx=0 tx=0).stop 2023-10-16T19:57:19.851 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.848+0000 7f4616463700 1 -- 172.21.15.157:0/3095291426 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f46100c7070 msgr2=0x7f46100c7520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:19.851 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.848+0000 7f4616463700 1 --2- 172.21.15.157:0/3095291426 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f46100c7070 0x7f46100c7520 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f461006ff00 tx=0x7f4600004d20 comp rx=0 tx=0).stop 2023-10-16T19:57:19.851 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.848+0000 7f4616463700 1 -- 172.21.15.157:0/3095291426 shutdown_connections 2023-10-16T19:57:19.852 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.848+0000 7f4616463700 1 --2- 172.21.15.157:0/3095291426 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f45f806c900 0x7f45f806edc0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:19.852 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.848+0000 7f4616463700 1 --2- 172.21.15.157:0/3095291426 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f46100c7070 0x7f46100c7520 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:19.852 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.848+0000 7f4616463700 1 --2- 172.21.15.157:0/3095291426 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f45f8004420 0x7f4610158ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:19.852 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.848+0000 7f4616463700 1 --2- 172.21.15.157:0/3095291426 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f46101f54c0 0x7f46101f5940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:19.853 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.848+0000 7f4616463700 1 -- 172.21.15.157:0/3095291426 >> 172.21.15.157:0/3095291426 conn(0x7f46100cf950 msgr2=0x7f46100b0890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:19.854 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.849+0000 7f4616463700 1 -- 172.21.15.157:0/3095291426 shutdown_connections 2023-10-16T19:57:19.854 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.849+0000 7f4616463700 1 -- 172.21.15.157:0/3095291426 wait complete. 2023-10-16T19:57:19.869 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.3 2023-10-16T19:57:19.870 DEBUG:teuthology.parallel:result is None 2023-10-16T19:57:19.878 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.876+0000 7f1afc354700 1 -- 172.21.15.157:0/3612528601 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f1af404f400 con 0x7f1af40679d0 2023-10-16T19:57:19.879 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.877+0000 7f1aeaffd700 1 -- 172.21.15.157:0/3612528601 <== mon.2 v2:172.21.15.187:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1aec059b80 con 0x7f1af40679d0 2023-10-16T19:57:19.879 INFO:teuthology.orchestra.run.smithi157.stdout:55834574854 2023-10-16T19:57:19.883 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.881+0000 7f1afc354700 1 -- 172.21.15.157:0/3612528601 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f1ad806af00 msgr2=0x7f1ad806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:19.883 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.881+0000 7f1afc354700 1 --2- 172.21.15.157:0/3612528601 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f1ad806af00 0x7f1ad806d3c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f1ae4000f60 tx=0x7f1ae4007a40 comp rx=0 tx=0).stop 2023-10-16T19:57:19.883 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.881+0000 7f1afc354700 1 -- 172.21.15.157:0/3612528601 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1af40679d0 msgr2=0x7f1af41f8e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:19.883 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.881+0000 7f1afc354700 1 --2- 172.21.15.157:0/3612528601 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1af40679d0 0x7f1af41f8e80 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f1af40671e0 tx=0x7f1aec004ad0 comp rx=0 tx=0).stop 2023-10-16T19:57:19.884 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.882+0000 7f1afc354700 1 -- 172.21.15.157:0/3612528601 shutdown_connections 2023-10-16T19:57:19.884 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.882+0000 7f1afc354700 1 --2- 172.21.15.157:0/3612528601 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f1ad806af00 0x7f1ad806d3c0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:19.885 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.882+0000 7f1afc354700 1 --2- 172.21.15.157:0/3612528601 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1af41f7af0 0x7f1af40b11c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:19.885 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.882+0000 7f1afc354700 1 --2- 172.21.15.157:0/3612528601 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1af40679d0 0x7f1af41f8e80 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:19.885 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.882+0000 7f1afc354700 1 --2- 172.21.15.157:0/3612528601 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1af4154750 0x7f1af40b43b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:19.885 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.882+0000 7f1afc354700 1 -- 172.21.15.157:0/3612528601 >> 172.21.15.157:0/3612528601 conn(0x7f1af40cfd30 msgr2=0x7f1af406da90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:19.886 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.883+0000 7f1afc354700 1 -- 172.21.15.157:0/3612528601 shutdown_connections 2023-10-16T19:57:19.886 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.883+0000 7f1afc354700 1 -- 172.21.15.157:0/3612528601 wait complete. 2023-10-16T19:57:19.902 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.2 2023-10-16T19:57:19.902 DEBUG:teuthology.parallel:result is None 2023-10-16T19:57:19.910 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.907+0000 7f267681b700 1 -- 172.21.15.157:0/2850147502 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f267006e740 con 0x7f2658004850 2023-10-16T19:57:19.910 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.907+0000 7f266cff9700 1 -- 172.21.15.157:0/2850147502 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2664015020 con 0x7f2658004850 2023-10-16T19:57:19.911 INFO:teuthology.orchestra.run.smithi157.stdout:55834574854 2023-10-16T19:57:19.914 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.911+0000 7f267681b700 1 -- 172.21.15.157:0/2850147502 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f265c06af30 msgr2=0x7f265c06d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:19.914 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.911+0000 7f267681b700 1 --2- 172.21.15.157:0/2850147502 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f265c06af30 0x7f265c06d3f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f2668000f80 tx=0x7f266800a000 comp rx=0 tx=0).stop 2023-10-16T19:57:19.915 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.911+0000 7f267681b700 1 -- 172.21.15.157:0/2850147502 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2658004850 msgr2=0x7f267014d860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:19.915 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.911+0000 7f267681b700 1 --2- 172.21.15.157:0/2850147502 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2658004850 0x7f267014d860 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f266400b550 tx=0x7f266400b910 comp rx=0 tx=0).stop 2023-10-16T19:57:19.915 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.911+0000 7f267681b700 1 -- 172.21.15.157:0/2850147502 shutdown_connections 2023-10-16T19:57:19.915 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.911+0000 7f267681b700 1 --2- 172.21.15.157:0/2850147502 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f267014fda0 0x7f2670150230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:19.915 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.911+0000 7f267681b700 1 --2- 172.21.15.157:0/2850147502 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2658004850 0x7f267014d860 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:19.916 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.911+0000 7f267681b700 1 --2- 172.21.15.157:0/2850147502 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f265c06af30 0x7f265c06d3f0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:19.916 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.911+0000 7f267681b700 1 --2- 172.21.15.157:0/2850147502 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f267015c9d0 0x7f267015ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:19.916 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.911+0000 7f267681b700 1 -- 172.21.15.157:0/2850147502 >> 172.21.15.157:0/2850147502 conn(0x7f26700cf950 msgr2=0x7f267006ff30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:19.916 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.911+0000 7f267681b700 1 -- 172.21.15.157:0/2850147502 shutdown_connections 2023-10-16T19:57:19.916 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.911+0000 7f267681b700 1 -- 172.21.15.157:0/2850147502 wait complete. 2023-10-16T19:57:19.931 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.1 2023-10-16T19:57:19.932 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.929+0000 7fa1a9222700 1 -- 172.21.15.157:0/2378575606 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fa1a404f400 con 0x7fa1a40cbcc0 2023-10-16T19:57:19.932 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.929+0000 7fa18b7fe700 1 -- 172.21.15.157:0/2378575606 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa194021030 con 0x7fa1a40cbcc0 2023-10-16T19:57:19.932 DEBUG:teuthology.parallel:result is None 2023-10-16T19:57:19.933 INFO:teuthology.orchestra.run.smithi157.stdout:55834574854 2023-10-16T19:57:19.933 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.930+0000 7f3f9c672700 1 -- 172.21.15.157:0/529409486 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f3f7c005870 con 0x7f3f9415b130 2023-10-16T19:57:19.934 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.930+0000 7f3f8affd700 1 -- 172.21.15.157:0/529409486 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3f8c019020 con 0x7f3f9415b130 2023-10-16T19:57:19.934 INFO:teuthology.orchestra.run.smithi157.stdout:55834574854 2023-10-16T19:57:19.935 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.933+0000 7fa1a9222700 1 -- 172.21.15.157:0/2378575606 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fa19006af50 msgr2=0x7fa19006d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:19.935 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.933+0000 7fa1a9222700 1 --2- 172.21.15.157:0/2378575606 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fa19006af50 0x7fa19006d410 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa1a415b2b0 tx=0x7fa198007a60 comp rx=0 tx=0).stop 2023-10-16T19:57:19.935 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.933+0000 7fa1a9222700 1 -- 172.21.15.157:0/2378575606 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa1a40cbcc0 msgr2=0x7fa1a414f580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:19.935 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.933+0000 7fa1a9222700 1 --2- 172.21.15.157:0/2378575606 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa1a40cbcc0 0x7fa1a414f580 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fa19400f9c0 tx=0x7fa19400fd80 comp rx=0 tx=0).stop 2023-10-16T19:57:19.936 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.933+0000 7fa1a9222700 1 -- 172.21.15.157:0/2378575606 shutdown_connections 2023-10-16T19:57:19.936 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.933+0000 7fa1a9222700 1 --2- 172.21.15.157:0/2378575606 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fa19006af50 0x7fa19006d410 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:19.937 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.933+0000 7fa1a9222700 1 --2- 172.21.15.157:0/2378575606 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa1a4159f00 0x7fa1a40b0850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:19.937 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.933+0000 7fa1a9222700 1 --2- 172.21.15.157:0/2378575606 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa1a40708d0 0x7fa1a41faf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:19.937 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.933+0000 7fa1a9222700 1 --2- 172.21.15.157:0/2378575606 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa1a40cbcc0 0x7fa1a414f580 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:19.937 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.933+0000 7fa1a9222700 1 -- 172.21.15.157:0/2378575606 >> 172.21.15.157:0/2378575606 conn(0x7fa1a40cf950 msgr2=0x7fa1a40af490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:19.937 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.933+0000 7fa1a9222700 1 -- 172.21.15.157:0/2378575606 shutdown_connections 2023-10-16T19:57:19.938 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.933+0000 7fa1a9222700 1 -- 172.21.15.157:0/2378575606 wait complete. 2023-10-16T19:57:19.939 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.933+0000 7f3f9c672700 1 -- 172.21.15.157:0/529409486 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f3f7806af00 msgr2=0x7f3f7806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:19.939 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.933+0000 7f3f9c672700 1 --2- 172.21.15.157:0/529409486 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f3f7806af00 0x7f3f7806d3c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f3f84001740 tx=0x7f3f84007a30 comp rx=0 tx=0).stop 2023-10-16T19:57:19.940 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.933+0000 7f3f9c672700 1 -- 172.21.15.157:0/529409486 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3f9415b130 msgr2=0x7f3f941ffe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:19.940 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.933+0000 7f3f9c672700 1 --2- 172.21.15.157:0/529409486 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3f9415b130 0x7f3f941ffe30 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f3f8c00b990 tx=0x7f3f8c00bd50 comp rx=0 tx=0).stop 2023-10-16T19:57:19.940 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.935+0000 7f3f9c672700 1 -- 172.21.15.157:0/529409486 shutdown_connections 2023-10-16T19:57:19.940 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.935+0000 7f3f9c672700 1 --2- 172.21.15.157:0/529409486 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3f9415b130 0x7f3f941ffe30 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:19.941 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.935+0000 7f3f9c672700 1 --2- 172.21.15.157:0/529409486 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3f9406eb20 0x7f3f9415bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:19.941 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.935+0000 7f3f9c672700 1 --2- 172.21.15.157:0/529409486 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f3f7806af00 0x7f3f7806d3c0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:19.941 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.935+0000 7f3f9c672700 1 --2- 172.21.15.157:0/529409486 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3f94071f60 0x7f3f940c7150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:19.941 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.935+0000 7f3f9c672700 1 -- 172.21.15.157:0/529409486 >> 172.21.15.157:0/529409486 conn(0x7f3f940cd4e0 msgr2=0x7f3f940c9ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:19.941 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.935+0000 7f3f9c672700 1 -- 172.21.15.157:0/529409486 shutdown_connections 2023-10-16T19:57:19.942 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.935+0000 7f3f9c672700 1 -- 172.21.15.157:0/529409486 wait complete. 2023-10-16T19:57:19.953 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.951+0000 7f482c586700 1 -- 172.21.15.157:0/184446194 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f48240ca070 con 0x7f482414f3c0 2023-10-16T19:57:19.953 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.951+0000 7f481affd700 1 -- 172.21.15.157:0/184446194 <== mon.2 v2:172.21.15.187:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4814017090 con 0x7f482414f3c0 2023-10-16T19:57:19.954 INFO:teuthology.orchestra.run.smithi157.stdout:55834574854 2023-10-16T19:57:19.955 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.0 2023-10-16T19:57:19.955 DEBUG:teuthology.parallel:result is None 2023-10-16T19:57:19.956 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.4 2023-10-16T19:57:19.956 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.953+0000 7f1388be5700 1 -- 172.21.15.157:0/3976366174 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f1368005870 con 0x7f1384070490 2023-10-16T19:57:19.957 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.954+0000 7f1372ffd700 1 -- 172.21.15.157:0/3976366174 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f137401b070 con 0x7f1384070490 2023-10-16T19:57:19.957 DEBUG:teuthology.parallel:result is None 2023-10-16T19:57:19.957 INFO:teuthology.orchestra.run.smithi157.stdout:55834574854 2023-10-16T19:57:19.959 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.954+0000 7f482c586700 1 -- 172.21.15.157:0/184446194 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f480806af30 msgr2=0x7f480806d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:19.959 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.954+0000 7f482c586700 1 --2- 172.21.15.157:0/184446194 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f480806af30 0x7f480806d3f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f481c007520 tx=0x7f481c0098d0 comp rx=0 tx=0).stop 2023-10-16T19:57:19.959 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.954+0000 7f482c586700 1 -- 172.21.15.157:0/184446194 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f482414f3c0 msgr2=0x7f4824153b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:19.959 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.954+0000 7f482c586700 1 --2- 172.21.15.157:0/184446194 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f482414f3c0 0x7f4824153b20 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f4824070650 tx=0x7f481400eae0 comp rx=0 tx=0).stop 2023-10-16T19:57:19.959 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.955+0000 7f482c586700 1 -- 172.21.15.157:0/184446194 shutdown_connections 2023-10-16T19:57:19.960 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.955+0000 7f482c586700 1 --2- 172.21.15.157:0/184446194 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f480806af30 0x7f480806d3f0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:19.960 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.955+0000 7f482c586700 1 --2- 172.21.15.157:0/184446194 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f482415d0c0 0x7f4824154060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:19.960 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.955+0000 7f482c586700 1 --2- 172.21.15.157:0/184446194 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f48240af720 0x7f48241fbde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:19.960 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.955+0000 7f482c586700 1 --2- 172.21.15.157:0/184446194 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f482414f3c0 0x7f4824153b20 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:19.960 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.955+0000 7f482c586700 1 -- 172.21.15.157:0/184446194 >> 172.21.15.157:0/184446194 conn(0x7f48240cf950 msgr2=0x7f48240b0d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:19.961 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.955+0000 7f482c586700 1 -- 172.21.15.157:0/184446194 shutdown_connections 2023-10-16T19:57:19.961 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.955+0000 7f482c586700 1 -- 172.21.15.157:0/184446194 wait complete. 2023-10-16T19:57:19.962 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.956+0000 7f1388be5700 1 -- 172.21.15.157:0/3976366174 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f136406af00 msgr2=0x7f136406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:19.962 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.956+0000 7f1388be5700 1 --2- 172.21.15.157:0/3976366174 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f136406af00 0x7f136406d3c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f13840ae7d0 tx=0x7f137c018000 comp rx=0 tx=0).stop 2023-10-16T19:57:19.962 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.956+0000 7f1388be5700 1 -- 172.21.15.157:0/3976366174 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1384070490 msgr2=0x7f13840c2c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:19.963 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.956+0000 7f1388be5700 1 --2- 172.21.15.157:0/3976366174 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1384070490 0x7f13840c2c60 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f137400bb50 tx=0x7f137400bf10 comp rx=0 tx=0).stop 2023-10-16T19:57:19.963 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.956+0000 7f1388be5700 1 -- 172.21.15.157:0/3976366174 shutdown_connections 2023-10-16T19:57:19.963 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.956+0000 7f1388be5700 1 --2- 172.21.15.157:0/3976366174 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f13840c4770 0x7f13840c8a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:19.963 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.956+0000 7f1388be5700 1 --2- 172.21.15.157:0/3976366174 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1384070490 0x7f13840c2c60 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:19.963 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.956+0000 7f1388be5700 1 --2- 172.21.15.157:0/3976366174 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f136406af00 0x7f136406d3c0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:19.963 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.956+0000 7f1388be5700 1 --2- 172.21.15.157:0/3976366174 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f138416aa60 0x7f1384169c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:19.964 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.956+0000 7f1388be5700 1 -- 172.21.15.157:0/3976366174 >> 172.21.15.157:0/3976366174 conn(0x7f13840cf950 msgr2=0x7f138406dab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:19.964 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.956+0000 7f1388be5700 1 -- 172.21.15.157:0/3976366174 shutdown_connections 2023-10-16T19:57:19.964 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.956+0000 7f1388be5700 1 -- 172.21.15.157:0/3976366174 wait complete. 2023-10-16T19:57:19.965 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.957+0000 7f28c105f700 1 -- 172.21.15.157:0/3170951176 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f28bc15b650 con 0x7f28bc0708d0 2023-10-16T19:57:19.965 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.958+0000 7f28ab7fe700 1 -- 172.21.15.157:0/3170951176 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f28b4054870 con 0x7f28bc0708d0 2023-10-16T19:57:19.965 INFO:teuthology.orchestra.run.smithi157.stdout:55834574854 2023-10-16T19:57:19.966 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.960+0000 7f28c105f700 1 -- 172.21.15.157:0/3170951176 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f28a006afd0 msgr2=0x7f28a006d490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:19.966 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.960+0000 7f28c105f700 1 --2- 172.21.15.157:0/3170951176 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f28a006afd0 0x7f28a006d490 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f28bc0c6320 tx=0x7f28b0011000 comp rx=0 tx=0).stop 2023-10-16T19:57:19.966 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.960+0000 7f28c105f700 1 -- 172.21.15.157:0/3170951176 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f28bc0708d0 msgr2=0x7f28bc1fbbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:19.967 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.960+0000 7f28c105f700 1 --2- 172.21.15.157:0/3170951176 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f28bc0708d0 0x7f28bc1fbbb0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f28b400ccd0 tx=0x7f28b400a4d0 comp rx=0 tx=0).stop 2023-10-16T19:57:19.967 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.960+0000 7f28c105f700 1 -- 172.21.15.157:0/3170951176 shutdown_connections 2023-10-16T19:57:19.967 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.960+0000 7f28c105f700 1 --2- 172.21.15.157:0/3170951176 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f28bc159f00 0x7f28bc06da50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:19.967 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.960+0000 7f28c105f700 1 --2- 172.21.15.157:0/3170951176 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f28bc0708d0 0x7f28bc1fbbb0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:19.967 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.960+0000 7f28c105f700 1 --2- 172.21.15.157:0/3170951176 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f28a006afd0 0x7f28a006d490 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:19.968 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.960+0000 7f28c105f700 1 --2- 172.21.15.157:0/3170951176 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f28bc0cbcc0 0x7f28bc1514d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:19.968 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.960+0000 7f28c105f700 1 -- 172.21.15.157:0/3170951176 >> 172.21.15.157:0/3170951176 conn(0x7f28bc0cf950 msgr2=0x7f28bc0b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:19.968 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.960+0000 7f28c105f700 1 -- 172.21.15.157:0/3170951176 shutdown_connections 2023-10-16T19:57:19.968 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:19.960+0000 7f28c105f700 1 -- 172.21.15.157:0/3170951176 wait complete. 2023-10-16T19:57:19.972 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.7 2023-10-16T19:57:19.973 DEBUG:teuthology.parallel:result is None 2023-10-16T19:57:19.974 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.5 2023-10-16T19:57:19.974 DEBUG:teuthology.parallel:result is None 2023-10-16T19:57:19.976 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.6 2023-10-16T19:57:19.977 DEBUG:teuthology.parallel:result is None 2023-10-16T19:57:19.977 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-10-16T19:57:19.977 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-16T19:57:20.137 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.135+0000 7fbf6321a700 1 Processor -- start 2023-10-16T19:57:20.138 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.135+0000 7fbf6321a700 1 -- start start 2023-10-16T19:57:20.143 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.136+0000 7fbf6321a700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fbf5c15bf50 0x7fbf5c0cef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:20.144 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.136+0000 7fbf6321a700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbf5c0cdf80 0x7fbf5c0d0e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:20.144 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.136+0000 7fbf6321a700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf5c0cf920 con 0x7fbf5c0b76e0 2023-10-16T19:57:20.144 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.136+0000 7fbf6321a700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf5c0cc4b0 con 0x7fbf5c15bf50 2023-10-16T19:57:20.144 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.136+0000 7fbf6321a700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf5c0cfc00 con 0x7fbf5c0cdf80 2023-10-16T19:57:20.144 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.136+0000 7fbf5bfff700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7fbf5c0b76e0 0x7fbf5c0cd870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:55790/0 (socket says 172.21.15.157:55790) 2023-10-16T19:57:20.145 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.136+0000 7fbf5bfff700 1 -- 172.21.15.157:0/1009813722 learned_addr learned my addr 172.21.15.157:0/1009813722 (peer_addr_for_me v1:172.21.15.157:0/0) 2023-10-16T19:57:20.145 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.136+0000 7fbf617b7700 1 --2- 172.21.15.157:0/1009813722 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbf5c0cdf80 0x7fbf5c0d0e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:20.145 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.136+0000 7fbf5b7fe700 1 -- 172.21.15.157:0/1009813722 <== mon.0 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2772375957 0 0) 0x7fbf5c0cf920 con 0x7fbf5c0b76e0 2023-10-16T19:57:20.145 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.136+0000 7fbf5b7fe700 1 -- 172.21.15.157:0/1009813722 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbf4c0035b0 con 0x7fbf5c0b76e0 2023-10-16T19:57:20.145 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.136+0000 7fbf60fb6700 1 --2- 172.21.15.157:0/1009813722 >> v2:172.21.15.187:3300/0 conn(0x7fbf5c15bf50 0x7fbf5c0cef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:20.146 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.136+0000 7fbf5b7fe700 1 -- 172.21.15.157:0/1009813722 <== mon.0 v1:172.21.15.157:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3635046189 0 0) 0x7fbf4c0035b0 con 0x7fbf5c0b76e0 2023-10-16T19:57:20.146 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.137+0000 7fbf5b7fe700 1 -- 172.21.15.157:0/1009813722 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbf5c0cdf80 msgr2=0x7fbf5c0d0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:57:20.146 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.137+0000 7fbf5b7fe700 1 --2- 172.21.15.157:0/1009813722 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbf5c0cdf80 0x7fbf5c0d0e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:20.146 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.137+0000 7fbf5b7fe700 1 -- 172.21.15.157:0/1009813722 >> v2:172.21.15.187:3300/0 conn(0x7fbf5c15bf50 msgr2=0x7fbf5c0cef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:57:20.147 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.137+0000 7fbf5b7fe700 1 --2- 172.21.15.157:0/1009813722 >> v2:172.21.15.187:3300/0 conn(0x7fbf5c15bf50 0x7fbf5c0cef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:20.147 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.137+0000 7fbf5b7fe700 1 -- 172.21.15.157:0/1009813722 --> v1:172.21.15.157:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf5c0cfee0 con 0x7fbf5c0b76e0 2023-10-16T19:57:20.147 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.137+0000 7fbf5b7fe700 1 -- 172.21.15.157:0/1009813722 <== mon.0 v1:172.21.15.157:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4021145519 0 0) 0x7fbf48001670 con 0x7fbf5c0b76e0 2023-10-16T19:57:20.147 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.137+0000 7fbf60fb6700 1 --2- 172.21.15.157:0/1009813722 >> v2:172.21.15.187:3300/0 conn(0x7fbf5c15bf50 0x7fbf5c0cef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T19:57:20.147 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.137+0000 7fbf5b7fe700 1 -- 172.21.15.157:0/1009813722 >> v1:172.21.15.157:6789/0 conn(0x7fbf5c0b76e0 legacy=0x7fbf5c0cd870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:20.148 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.137+0000 7fbf5b7fe700 1 --2- 172.21.15.157:0/1009813722 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbf4c003a00 0x7fbf4c003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:20.148 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.137+0000 7fbf5b7fe700 1 --2- 172.21.15.157:0/1009813722 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbf5c0cdf80 0x7fbf4c004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:20.148 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.137+0000 7fbf5b7fe700 1 --2- 172.21.15.157:0/1009813722 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbf4c004d90 0x7fbf4c005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:20.148 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.137+0000 7fbf5b7fe700 1 -- 172.21.15.157:0/1009813722 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf5c0cc4b0 con 0x7fbf4c004d90 2023-10-16T19:57:20.148 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.137+0000 7fbf5b7fe700 1 -- 172.21.15.157:0/1009813722 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf5c0cfc00 con 0x7fbf4c003a00 2023-10-16T19:57:20.149 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.137+0000 7fbf5b7fe700 1 -- 172.21.15.157:0/1009813722 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf4c00ba10 con 0x7fbf5c0cdf80 2023-10-16T19:57:20.149 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.137+0000 7fbf617b7700 1 --2- 172.21.15.157:0/1009813722 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbf4c004d90 0x7fbf4c005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:20.149 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.137+0000 7fbf60fb6700 1 --2- 172.21.15.157:0/1009813722 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbf4c003a00 0x7fbf4c003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:20.149 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.137+0000 7fbf5bfff700 1 --2- 172.21.15.157:0/1009813722 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbf5c0cdf80 0x7fbf4c004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:20.149 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.137+0000 7fbf617b7700 1 -- 172.21.15.157:0/1009813722 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbf5c0cdf80 msgr2=0x7fbf4c004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:57:20.150 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.137+0000 7fbf617b7700 1 --2- 172.21.15.157:0/1009813722 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbf5c0cdf80 0x7fbf4c004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:20.150 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.137+0000 7fbf617b7700 1 -- 172.21.15.157:0/1009813722 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbf4c003a00 msgr2=0x7fbf4c003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:57:20.150 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.137+0000 7fbf617b7700 1 --2- 172.21.15.157:0/1009813722 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbf4c003a00 0x7fbf4c003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:20.150 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.137+0000 7fbf617b7700 1 -- 172.21.15.157:0/1009813722 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf4c0035b0 con 0x7fbf4c004d90 2023-10-16T19:57:20.150 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.137+0000 7fbf617b7700 1 --2- 172.21.15.157:0/1009813722 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbf4c004d90 0x7fbf4c005210 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fbf5400e170 tx=0x7fbf4c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a99328785241d5d1 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:20.151 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.137+0000 7fbf5b7fe700 1 -- 172.21.15.157:0/1009813722 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf5400ec90 con 0x7fbf4c004d90 2023-10-16T19:57:20.151 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.137+0000 7fbf5b7fe700 1 -- 172.21.15.157:0/1009813722 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf5400f040 con 0x7fbf4c004d90 2023-10-16T19:57:20.151 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.137+0000 7fbf5b7fe700 1 -- 172.21.15.157:0/1009813722 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf54014480 con 0x7fbf4c004d90 2023-10-16T19:57:20.151 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.138+0000 7fbf6321a700 1 -- 172.21.15.157:0/1009813722 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbf4c004d90 msgr2=0x7fbf4c005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:20.151 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.138+0000 7fbf6321a700 1 --2- 172.21.15.157:0/1009813722 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbf4c004d90 0x7fbf4c005210 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fbf5400e170 tx=0x7fbf4c005880 comp rx=0 tx=0).stop 2023-10-16T19:57:20.152 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.138+0000 7fbf617b7700 1 -- 172.21.15.157:0/1009813722 reap_dead start 2023-10-16T19:57:20.152 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.138+0000 7fbf6321a700 1 -- 172.21.15.157:0/1009813722 shutdown_connections 2023-10-16T19:57:20.152 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.138+0000 7fbf6321a700 1 -- 172.21.15.157:0/1009813722 >> 172.21.15.157:0/1009813722 conn(0x7fbf5c06e300 msgr2=0x7fbf5c06e6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:20.152 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.138+0000 7fbf6321a700 1 -- 172.21.15.157:0/1009813722 shutdown_connections 2023-10-16T19:57:20.152 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.138+0000 7fbf6321a700 1 -- 172.21.15.157:0/1009813722 wait complete. 2023-10-16T19:57:20.152 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.139+0000 7fbf6321a700 1 Processor -- start 2023-10-16T19:57:20.153 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.139+0000 7fbf6321a700 1 -- start start 2023-10-16T19:57:20.153 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.140+0000 7fbf6321a700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbf5c0c8400 0x7fbf5c0b3610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:20.153 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.140+0000 7fbf6321a700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbf5c146e20 0x7fbf5c1472a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:20.153 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.140+0000 7fbf6321a700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbf5c0b57f0 0x7fbf5c0b5c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:20.153 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.140+0000 7fbf6321a700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf5c0b61b0 con 0x7fbf5c0b57f0 2023-10-16T19:57:20.154 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.140+0000 7fbf6321a700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf5c0b3180 con 0x7fbf5c146e20 2023-10-16T19:57:20.154 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.140+0000 7fbf6321a700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf5c0b2b50 con 0x7fbf5c0c8400 2023-10-16T19:57:20.154 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.140+0000 7fbf617b7700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbf5c0b57f0 0x7fbf5c0b5c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:20.154 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.140+0000 7fbf617b7700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbf5c0b57f0 0x7fbf5c0b5c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:46132/0 (socket says 172.21.15.157:46132) 2023-10-16T19:57:20.154 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.140+0000 7fbf617b7700 1 -- 172.21.15.157:0/1077950356 learned_addr learned my addr 172.21.15.157:0/1077950356 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:57:20.155 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.140+0000 7fbf60fb6700 1 --2- 172.21.15.157:0/1077950356 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbf5c0c8400 0x7fbf5c0b3610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:20.155 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.140+0000 7fbf5bfff700 1 --2- 172.21.15.157:0/1077950356 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbf5c146e20 0x7fbf5c1472a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:20.155 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.140+0000 7fbf617b7700 1 -- 172.21.15.157:0/1077950356 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbf5c0c8400 msgr2=0x7fbf5c0b3610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:20.155 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.140+0000 7fbf617b7700 1 --2- 172.21.15.157:0/1077950356 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbf5c0c8400 0x7fbf5c0b3610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:20.155 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.140+0000 7fbf617b7700 1 -- 172.21.15.157:0/1077950356 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbf5c146e20 msgr2=0x7fbf5c1472a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:20.155 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.140+0000 7fbf617b7700 1 --2- 172.21.15.157:0/1077950356 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbf5c146e20 0x7fbf5c1472a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:20.156 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.140+0000 7fbf617b7700 1 -- 172.21.15.157:0/1077950356 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf5c15c600 con 0x7fbf5c0b57f0 2023-10-16T19:57:20.156 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.140+0000 7fbf5bfff700 1 --2- 172.21.15.157:0/1077950356 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbf5c146e20 0x7fbf5c1472a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T19:57:20.156 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.140+0000 7fbf617b7700 1 --2- 172.21.15.157:0/1077950356 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbf5c0b57f0 0x7fbf5c0b5c70 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fbf4c004790 tx=0x7fbf54004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:20.156 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.141+0000 7fbf597fa700 1 -- 172.21.15.157:0/1077950356 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf54007000 con 0x7fbf5c0b57f0 2023-10-16T19:57:20.156 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.141+0000 7fbf597fa700 1 -- 172.21.15.157:0/1077950356 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf54003e50 con 0x7fbf5c0b57f0 2023-10-16T19:57:20.157 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.141+0000 7fbf6321a700 1 -- 172.21.15.157:0/1077950356 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf5c147970 con 0x7fbf5c0b57f0 2023-10-16T19:57:20.157 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.141+0000 7fbf597fa700 1 -- 172.21.15.157:0/1077950356 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf54015c50 con 0x7fbf5c0b57f0 2023-10-16T19:57:20.157 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.141+0000 7fbf6321a700 1 -- 172.21.15.157:0/1077950356 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf5c0b2e10 con 0x7fbf5c0b57f0 2023-10-16T19:57:20.158 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.142+0000 7fbf6321a700 1 -- 172.21.15.157:0/1077950356 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf5c0b2fd0 con 0x7fbf5c0b57f0 2023-10-16T19:57:20.158 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.142+0000 7fbf597fa700 1 -- 172.21.15.157:0/1077950356 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fbf54024070 con 0x7fbf5c0b57f0 2023-10-16T19:57:20.159 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.142+0000 7fbf597fa700 1 --2- 172.21.15.157:0/1077950356 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fbf4006af00 0x7fbf4006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:20.159 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.142+0000 7fbf597fa700 1 -- 172.21.15.157:0/1077950356 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbf5408afb0 con 0x7fbf5c0b57f0 2023-10-16T19:57:20.159 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.143+0000 7fbf60fb6700 1 --2- 172.21.15.157:0/1077950356 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fbf4006af00 0x7fbf4006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:20.159 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.143+0000 7fbf60fb6700 1 --2- 172.21.15.157:0/1077950356 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fbf4006af00 0x7fbf4006d3c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fbf50009a80 tx=0x7fbf50008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:20.159 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.147+0000 7fbf597fa700 1 -- 172.21.15.157:0/1077950356 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fbf540560f0 con 0x7fbf5c0b57f0 2023-10-16T19:57:20.333 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.330+0000 7fbf6321a700 1 -- 172.21.15.157:0/1077950356 --> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fbf5c0d04a0 con 0x7fbf4006af00 2023-10-16T19:57:20.340 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.338+0000 7fbf597fa700 1 -- 172.21.15.157:0/1077950356 <== mgr.4100 v2:172.21.15.187:6832/2426285296 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+260270 (secure 0 0 0) 0x7fbf50004030 con 0x7fbf4006af00 2023-10-16T19:57:20.344 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-10-16T19:57:20.346 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.341+0000 7fbf6321a700 1 -- 172.21.15.157:0/1077950356 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fbf4006af00 msgr2=0x7fbf4006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:20.346 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.341+0000 7fbf6321a700 1 --2- 172.21.15.157:0/1077950356 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fbf4006af00 0x7fbf4006d3c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fbf50009a80 tx=0x7fbf50008040 comp rx=0 tx=0).stop 2023-10-16T19:57:20.347 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.341+0000 7fbf6321a700 1 -- 172.21.15.157:0/1077950356 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbf5c0b57f0 msgr2=0x7fbf5c0b5c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:20.347 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.341+0000 7fbf6321a700 1 --2- 172.21.15.157:0/1077950356 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbf5c0b57f0 0x7fbf5c0b5c70 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fbf4c004790 tx=0x7fbf54004b40 comp rx=0 tx=0).stop 2023-10-16T19:57:20.347 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.341+0000 7fbf6321a700 1 -- 172.21.15.157:0/1077950356 shutdown_connections 2023-10-16T19:57:20.347 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.341+0000 7fbf6321a700 1 --2- 172.21.15.157:0/1077950356 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbf5c0b57f0 0x7fbf5c0b5c70 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:20.347 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.341+0000 7fbf6321a700 1 --2- 172.21.15.157:0/1077950356 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbf5c0c8400 0x7fbf5c0b3610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:20.348 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.341+0000 7fbf6321a700 1 --2- 172.21.15.157:0/1077950356 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fbf4006af00 0x7fbf4006d3c0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:20.348 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.341+0000 7fbf6321a700 1 --2- 172.21.15.157:0/1077950356 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbf5c146e20 0x7fbf5c1472a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:20.348 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.341+0000 7fbf6321a700 1 -- 172.21.15.157:0/1077950356 >> 172.21.15.157:0/1077950356 conn(0x7fbf5c06e300 msgr2=0x7fbf5c0d1ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:20.348 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.341+0000 7fbf6321a700 1 -- 172.21.15.157:0/1077950356 shutdown_connections 2023-10-16T19:57:20.348 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.341+0000 7fbf6321a700 1 -- 172.21.15.157:0/1077950356 wait complete. 2023-10-16T19:57:20.349 INFO:teuthology.orchestra.run.smithi157.stderr:dumped all 2023-10-16T19:57:20.356 INFO:teuthology.orchestra.run.smithi157.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2023-10-16T19:57:18.893553+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":1746,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560753,"statfs":{"total":1600000000,"available":1598211172,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.899833"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-16T19:57:07.995517+0000","last_change":"2023-10-16T19:57:07.006384+0000","last_active":"2023-10-16T19:57:07.995517+0000","last_peered":"2023-10-16T19:57:07.995517+0000","last_clean":"2023-10-16T19:57:07.995517+0000","last_became_active":"2023-10-16T19:57:07.005790+0000","last_became_peered":"2023-10-16T19:57:07.005790+0000","last_unstale":"2023-10-16T19:57:07.995517+0000","last_undegraded":"2023-10-16T19:57:07.995517+0000","last_fullsized":"2023-10-16T19:57:07.995517+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:09:12.928664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-16T19:57:07.991019+0000","last_change":"2023-10-16T19:57:06.999389+0000","last_active":"2023-10-16T19:57:07.991019+0000","last_peered":"2023-10-16T19:57:07.991019+0000","last_clean":"2023-10-16T19:57:07.991019+0000","last_became_active":"2023-10-16T19:57:06.999162+0000","last_became_peered":"2023-10-16T19:57:06.999162+0000","last_unstale":"2023-10-16T19:57:07.991019+0000","last_undegraded":"2023-10-16T19:57:07.991019+0000","last_fullsized":"2023-10-16T19:57:07.991019+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:45:06.036665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-16T19:57:08.122675+0000","last_change":"2023-10-16T19:57:06.998825+0000","last_active":"2023-10-16T19:57:08.122675+0000","last_peered":"2023-10-16T19:57:08.122675+0000","last_clean":"2023-10-16T19:57:08.122675+0000","last_became_active":"2023-10-16T19:57:06.998479+0000","last_became_peered":"2023-10-16T19:57:06.998479+0000","last_unstale":"2023-10-16T19:57:08.122675+0000","last_undegraded":"2023-10-16T19:57:08.122675+0000","last_fullsized":"2023-10-16T19:57:08.122675+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:03:58.859315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-16T19:57:08.122859+0000","last_change":"2023-10-16T19:57:06.999838+0000","last_active":"2023-10-16T19:57:08.122859+0000","last_peered":"2023-10-16T19:57:08.122859+0000","last_clean":"2023-10-16T19:57:08.122859+0000","last_became_active":"2023-10-16T19:57:06.999305+0000","last_became_peered":"2023-10-16T19:57:06.999305+0000","last_unstale":"2023-10-16T19:57:08.122859+0000","last_undegraded":"2023-10-16T19:57:08.122859+0000","last_fullsized":"2023-10-16T19:57:08.122859+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:45:06.036665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-16T19:57:07.995504+0000","last_change":"2023-10-16T19:57:07.000324+0000","last_active":"2023-10-16T19:57:07.995504+0000","last_peered":"2023-10-16T19:57:07.995504+0000","last_clean":"2023-10-16T19:57:07.995504+0000","last_became_active":"2023-10-16T19:57:07.000057+0000","last_became_peered":"2023-10-16T19:57:07.000057+0000","last_unstale":"2023-10-16T19:57:07.995504+0000","last_undegraded":"2023-10-16T19:57:07.995504+0000","last_fullsized":"2023-10-16T19:57:07.995504+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:56:13.067804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-16T19:57:08.123449+0000","last_change":"2023-10-16T19:57:07.004149+0000","last_active":"2023-10-16T19:57:08.123449+0000","last_peered":"2023-10-16T19:57:08.123449+0000","last_clean":"2023-10-16T19:57:08.123449+0000","last_became_active":"2023-10-16T19:57:07.003618+0000","last_became_peered":"2023-10-16T19:57:07.003618+0000","last_unstale":"2023-10-16T19:57:08.123449+0000","last_undegraded":"2023-10-16T19:57:08.123449+0000","last_fullsized":"2023-10-16T19:57:08.123449+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:25:58.328485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-16T19:57:07.995466+0000","last_change":"2023-10-16T19:57:07.005978+0000","last_active":"2023-10-16T19:57:07.995466+0000","last_peered":"2023-10-16T19:57:07.995466+0000","last_clean":"2023-10-16T19:57:07.995466+0000","last_became_active":"2023-10-16T19:57:07.005529+0000","last_became_peered":"2023-10-16T19:57:07.005529+0000","last_unstale":"2023-10-16T19:57:07.995466+0000","last_undegraded":"2023-10-16T19:57:07.995466+0000","last_fullsized":"2023-10-16T19:57:07.995466+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:55:10.600360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-16T19:57:08.219621+0000","last_change":"2023-10-16T19:57:06.998520+0000","last_active":"2023-10-16T19:57:08.219621+0000","last_peered":"2023-10-16T19:57:08.219621+0000","last_clean":"2023-10-16T19:57:08.219621+0000","last_became_active":"2023-10-16T19:57:06.998293+0000","last_became_peered":"2023-10-16T19:57:06.998293+0000","last_unstale":"2023-10-16T19:57:08.219621+0000","last_undegraded":"2023-10-16T19:57:08.219621+0000","last_fullsized":"2023-10-16T19:57:08.219621+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:25:48.980225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-16T19:57:07.994923+0000","last_change":"2023-10-16T19:57:07.008535+0000","last_active":"2023-10-16T19:57:07.994923+0000","last_peered":"2023-10-16T19:57:07.994923+0000","last_clean":"2023-10-16T19:57:07.994923+0000","last_became_active":"2023-10-16T19:57:07.008297+0000","last_became_peered":"2023-10-16T19:57:07.008297+0000","last_unstale":"2023-10-16T19:57:07.994923+0000","last_undegraded":"2023-10-16T19:57:07.994923+0000","last_fullsized":"2023-10-16T19:57:07.994923+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:53:43.704346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-16T19:57:07.995044+0000","last_change":"2023-10-16T19:57:06.998253+0000","last_active":"2023-10-16T19:57:07.995044+0000","last_peered":"2023-10-16T19:57:07.995044+0000","last_clean":"2023-10-16T19:57:07.995044+0000","last_became_active":"2023-10-16T19:57:06.998051+0000","last_became_peered":"2023-10-16T19:57:06.998051+0000","last_unstale":"2023-10-16T19:57:07.995044+0000","last_undegraded":"2023-10-16T19:57:07.995044+0000","last_fullsized":"2023-10-16T19:57:07.995044+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:45:06.036665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-16T19:57:07.994446+0000","last_change":"2023-10-16T19:57:06.999597+0000","last_active":"2023-10-16T19:57:07.994446+0000","last_peered":"2023-10-16T19:57:07.994446+0000","last_clean":"2023-10-16T19:57:07.994446+0000","last_became_active":"2023-10-16T19:57:06.999312+0000","last_became_peered":"2023-10-16T19:57:06.999312+0000","last_unstale":"2023-10-16T19:57:07.994446+0000","last_undegraded":"2023-10-16T19:57:07.994446+0000","last_fullsized":"2023-10-16T19:57:07.994446+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:41:51.205240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-16T19:57:08.123128+0000","last_change":"2023-10-16T19:57:07.002089+0000","last_active":"2023-10-16T19:57:08.123128+0000","last_peered":"2023-10-16T19:57:08.123128+0000","last_clean":"2023-10-16T19:57:08.123128+0000","last_became_active":"2023-10-16T19:57:07.001847+0000","last_became_peered":"2023-10-16T19:57:07.001847+0000","last_unstale":"2023-10-16T19:57:08.123128+0000","last_undegraded":"2023-10-16T19:57:08.123128+0000","last_fullsized":"2023-10-16T19:57:08.123128+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:19:58.543996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-16T19:57:08.219751+0000","last_change":"2023-10-16T19:57:06.993639+0000","last_active":"2023-10-16T19:57:08.219751+0000","last_peered":"2023-10-16T19:57:08.219751+0000","last_clean":"2023-10-16T19:57:08.219751+0000","last_became_active":"2023-10-16T19:57:06.993396+0000","last_became_peered":"2023-10-16T19:57:06.993396+0000","last_unstale":"2023-10-16T19:57:08.219751+0000","last_undegraded":"2023-10-16T19:57:08.219751+0000","last_fullsized":"2023-10-16T19:57:08.219751+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:31:11.770822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-16T19:57:08.122373+0000","last_change":"2023-10-16T19:57:07.001284+0000","last_active":"2023-10-16T19:57:08.122373+0000","last_peered":"2023-10-16T19:57:08.122373+0000","last_clean":"2023-10-16T19:57:08.122373+0000","last_became_active":"2023-10-16T19:57:07.001063+0000","last_became_peered":"2023-10-16T19:57:07.001063+0000","last_unstale":"2023-10-16T19:57:08.122373+0000","last_undegraded":"2023-10-16T19:57:08.122373+0000","last_fullsized":"2023-10-16T19:57:08.122373+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:41:51.205240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-16T19:57:07.990740+0000","last_change":"2023-10-16T19:57:06.997709+0000","last_active":"2023-10-16T19:57:07.990740+0000","last_peered":"2023-10-16T19:57:07.990740+0000","last_clean":"2023-10-16T19:57:07.990740+0000","last_became_active":"2023-10-16T19:57:06.997354+0000","last_became_peered":"2023-10-16T19:57:06.997354+0000","last_unstale":"2023-10-16T19:57:07.990740+0000","last_undegraded":"2023-10-16T19:57:07.990740+0000","last_fullsized":"2023-10-16T19:57:07.990740+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:41:51.205240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-16T19:57:08.123798+0000","last_change":"2023-10-16T19:57:07.003971+0000","last_active":"2023-10-16T19:57:08.123798+0000","last_peered":"2023-10-16T19:57:08.123798+0000","last_clean":"2023-10-16T19:57:08.123798+0000","last_became_active":"2023-10-16T19:57:07.003330+0000","last_became_peered":"2023-10-16T19:57:07.003330+0000","last_unstale":"2023-10-16T19:57:08.123798+0000","last_undegraded":"2023-10-16T19:57:08.123798+0000","last_fullsized":"2023-10-16T19:57:08.123798+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:31:11.770822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-16T19:57:08.124416+0000","last_change":"2023-10-16T19:57:07.006715+0000","last_active":"2023-10-16T19:57:08.124416+0000","last_peered":"2023-10-16T19:57:08.124416+0000","last_clean":"2023-10-16T19:57:08.124416+0000","last_became_active":"2023-10-16T19:57:07.006217+0000","last_became_peered":"2023-10-16T19:57:07.006217+0000","last_unstale":"2023-10-16T19:57:08.124416+0000","last_undegraded":"2023-10-16T19:57:08.124416+0000","last_fullsized":"2023-10-16T19:57:08.124416+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:46:01.293187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-16T19:57:08.219133+0000","last_change":"2023-10-16T19:57:06.993961+0000","last_active":"2023-10-16T19:57:08.219133+0000","last_peered":"2023-10-16T19:57:08.219133+0000","last_clean":"2023-10-16T19:57:08.219133+0000","last_became_active":"2023-10-16T19:57:06.993724+0000","last_became_peered":"2023-10-16T19:57:06.993724+0000","last_unstale":"2023-10-16T19:57:08.219133+0000","last_undegraded":"2023-10-16T19:57:08.219133+0000","last_fullsized":"2023-10-16T19:57:08.219133+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:19:58.543996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-16T19:57:07.994655+0000","last_change":"2023-10-16T19:57:07.005634+0000","last_active":"2023-10-16T19:57:07.994655+0000","last_peered":"2023-10-16T19:57:07.994655+0000","last_clean":"2023-10-16T19:57:07.994655+0000","last_became_active":"2023-10-16T19:57:07.005057+0000","last_became_peered":"2023-10-16T19:57:07.005057+0000","last_unstale":"2023-10-16T19:57:07.994655+0000","last_undegraded":"2023-10-16T19:57:07.994655+0000","last_fullsized":"2023-10-16T19:57:07.994655+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:58:54.518707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T19:57:07.018064+0000","last_change":"2023-10-16T19:57:05.987741+0000","last_active":"2023-10-16T19:57:07.018064+0000","last_peered":"2023-10-16T19:57:07.018064+0000","last_clean":"2023-10-16T19:57:07.018064+0000","last_became_active":"2023-10-16T19:57:05.987520+0000","last_became_peered":"2023-10-16T19:57:05.987520+0000","last_unstale":"2023-10-16T19:57:07.018064+0000","last_undegraded":"2023-10-16T19:57:07.018064+0000","last_fullsized":"2023-10-16T19:57:07.018064+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:15:56.693134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-16T19:57:08.219412+0000","last_change":"2023-10-16T19:57:06.993252+0000","last_active":"2023-10-16T19:57:08.219412+0000","last_peered":"2023-10-16T19:57:08.219412+0000","last_clean":"2023-10-16T19:57:08.219412+0000","last_became_active":"2023-10-16T19:57:06.993020+0000","last_became_peered":"2023-10-16T19:57:06.993020+0000","last_unstale":"2023-10-16T19:57:08.219412+0000","last_undegraded":"2023-10-16T19:57:08.219412+0000","last_fullsized":"2023-10-16T19:57:08.219412+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:45:06.036665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T19:57:07.017741+0000","last_change":"2023-10-16T19:57:05.983983+0000","last_active":"2023-10-16T19:57:07.017741+0000","last_peered":"2023-10-16T19:57:07.017741+0000","last_clean":"2023-10-16T19:57:07.017741+0000","last_became_active":"2023-10-16T19:57:05.983622+0000","last_became_peered":"2023-10-16T19:57:05.983622+0000","last_unstale":"2023-10-16T19:57:07.017741+0000","last_undegraded":"2023-10-16T19:57:07.017741+0000","last_fullsized":"2023-10-16T19:57:07.017741+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:06:23.036752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-16T19:57:08.122603+0000","last_change":"2023-10-16T19:57:06.997914+0000","last_active":"2023-10-16T19:57:08.122603+0000","last_peered":"2023-10-16T19:57:08.122603+0000","last_clean":"2023-10-16T19:57:08.122603+0000","last_became_active":"2023-10-16T19:57:06.997690+0000","last_became_peered":"2023-10-16T19:57:06.997690+0000","last_unstale":"2023-10-16T19:57:08.122603+0000","last_undegraded":"2023-10-16T19:57:08.122603+0000","last_fullsized":"2023-10-16T19:57:08.122603+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:24:55.061118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T19:57:07.015417+0000","last_change":"2023-10-16T19:57:05.987000+0000","last_active":"2023-10-16T19:57:07.015417+0000","last_peered":"2023-10-16T19:57:07.015417+0000","last_clean":"2023-10-16T19:57:07.015417+0000","last_became_active":"2023-10-16T19:57:05.986803+0000","last_became_peered":"2023-10-16T19:57:05.986803+0000","last_unstale":"2023-10-16T19:57:07.015417+0000","last_undegraded":"2023-10-16T19:57:07.015417+0000","last_fullsized":"2023-10-16T19:57:07.015417+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:20:23.642933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-16T19:57:08.123957+0000","last_change":"2023-10-16T19:57:06.997052+0000","last_active":"2023-10-16T19:57:08.123957+0000","last_peered":"2023-10-16T19:57:08.123957+0000","last_clean":"2023-10-16T19:57:08.123957+0000","last_became_active":"2023-10-16T19:57:06.996662+0000","last_became_peered":"2023-10-16T19:57:06.996662+0000","last_unstale":"2023-10-16T19:57:08.123957+0000","last_undegraded":"2023-10-16T19:57:08.123957+0000","last_fullsized":"2023-10-16T19:57:08.123957+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:58:54.518707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T19:57:07.015115+0000","last_change":"2023-10-16T19:57:05.989284+0000","last_active":"2023-10-16T19:57:07.015115+0000","last_peered":"2023-10-16T19:57:07.015115+0000","last_clean":"2023-10-16T19:57:07.015115+0000","last_became_active":"2023-10-16T19:57:05.989033+0000","last_became_peered":"2023-10-16T19:57:05.989033+0000","last_unstale":"2023-10-16T19:57:07.015115+0000","last_undegraded":"2023-10-16T19:57:07.015115+0000","last_fullsized":"2023-10-16T19:57:07.015115+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:15:01.090446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-16T19:57:08.123335+0000","last_change":"2023-10-16T19:57:06.997386+0000","last_active":"2023-10-16T19:57:08.123335+0000","last_peered":"2023-10-16T19:57:08.123335+0000","last_clean":"2023-10-16T19:57:08.123335+0000","last_became_active":"2023-10-16T19:57:06.997156+0000","last_became_peered":"2023-10-16T19:57:06.997156+0000","last_unstale":"2023-10-16T19:57:08.123335+0000","last_undegraded":"2023-10-16T19:57:08.123335+0000","last_fullsized":"2023-10-16T19:57:08.123335+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:25:48.980225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T19:57:07.016041+0000","last_change":"2023-10-16T19:57:05.985822+0000","last_active":"2023-10-16T19:57:07.016041+0000","last_peered":"2023-10-16T19:57:07.016041+0000","last_clean":"2023-10-16T19:57:07.016041+0000","last_became_active":"2023-10-16T19:57:05.985592+0000","last_became_peered":"2023-10-16T19:57:05.985592+0000","last_unstale":"2023-10-16T19:57:07.016041+0000","last_undegraded":"2023-10-16T19:57:07.016041+0000","last_fullsized":"2023-10-16T19:57:07.016041+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:57:35.959611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-16T19:57:08.123129+0000","last_change":"2023-10-16T19:57:06.993561+0000","last_active":"2023-10-16T19:57:08.123129+0000","last_peered":"2023-10-16T19:57:08.123129+0000","last_clean":"2023-10-16T19:57:08.123129+0000","last_became_active":"2023-10-16T19:57:06.993306+0000","last_became_peered":"2023-10-16T19:57:06.993306+0000","last_unstale":"2023-10-16T19:57:08.123129+0000","last_undegraded":"2023-10-16T19:57:08.123129+0000","last_fullsized":"2023-10-16T19:57:08.123129+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:06:24.040436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T19:57:07.014669+0000","last_change":"2023-10-16T19:57:05.979963+0000","last_active":"2023-10-16T19:57:07.014669+0000","last_peered":"2023-10-16T19:57:07.014669+0000","last_clean":"2023-10-16T19:57:07.014669+0000","last_became_active":"2023-10-16T19:57:05.979710+0000","last_became_peered":"2023-10-16T19:57:05.979710+0000","last_unstale":"2023-10-16T19:57:07.014669+0000","last_undegraded":"2023-10-16T19:57:07.014669+0000","last_fullsized":"2023-10-16T19:57:07.014669+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:19:58.141677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-16T19:57:08.122506+0000","last_change":"2023-10-16T19:57:06.999329+0000","last_active":"2023-10-16T19:57:08.122506+0000","last_peered":"2023-10-16T19:57:08.122506+0000","last_clean":"2023-10-16T19:57:08.122506+0000","last_became_active":"2023-10-16T19:57:06.999101+0000","last_became_peered":"2023-10-16T19:57:06.999101+0000","last_unstale":"2023-10-16T19:57:08.122506+0000","last_undegraded":"2023-10-16T19:57:08.122506+0000","last_fullsized":"2023-10-16T19:57:08.122506+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:45:06.036665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T19:57:06.989953+0000","last_change":"2023-10-16T19:57:05.983843+0000","last_active":"2023-10-16T19:57:06.989953+0000","last_peered":"2023-10-16T19:57:06.989953+0000","last_clean":"2023-10-16T19:57:06.989953+0000","last_became_active":"2023-10-16T19:57:05.983163+0000","last_became_peered":"2023-10-16T19:57:05.983163+0000","last_unstale":"2023-10-16T19:57:06.989953+0000","last_undegraded":"2023-10-16T19:57:06.989953+0000","last_fullsized":"2023-10-16T19:57:06.989953+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:15:01.090446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-16T19:57:08.219610+0000","last_change":"2023-10-16T19:57:06.999441+0000","last_active":"2023-10-16T19:57:08.219610+0000","last_peered":"2023-10-16T19:57:08.219610+0000","last_clean":"2023-10-16T19:57:08.219610+0000","last_became_active":"2023-10-16T19:57:06.999162+0000","last_became_peered":"2023-10-16T19:57:06.999162+0000","last_unstale":"2023-10-16T19:57:08.219610+0000","last_undegraded":"2023-10-16T19:57:08.219610+0000","last_fullsized":"2023-10-16T19:57:08.219610+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:21:23.357923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T19:57:06.994513+0000","last_change":"2023-10-16T19:57:05.989194+0000","last_active":"2023-10-16T19:57:06.994513+0000","last_peered":"2023-10-16T19:57:06.994513+0000","last_clean":"2023-10-16T19:57:06.994513+0000","last_became_active":"2023-10-16T19:57:05.988926+0000","last_became_peered":"2023-10-16T19:57:05.988926+0000","last_unstale":"2023-10-16T19:57:06.994513+0000","last_undegraded":"2023-10-16T19:57:06.994513+0000","last_fullsized":"2023-10-16T19:57:06.994513+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:34:39.732847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-16T19:57:07.990808+0000","last_change":"2023-10-16T19:57:06.996063+0000","last_active":"2023-10-16T19:57:07.990808+0000","last_peered":"2023-10-16T19:57:07.990808+0000","last_clean":"2023-10-16T19:57:07.990808+0000","last_became_active":"2023-10-16T19:57:06.995511+0000","last_became_peered":"2023-10-16T19:57:06.995511+0000","last_unstale":"2023-10-16T19:57:07.990808+0000","last_undegraded":"2023-10-16T19:57:07.990808+0000","last_fullsized":"2023-10-16T19:57:07.990808+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:20:24.646617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T19:57:06.992213+0000","last_change":"2023-10-16T19:57:05.984937+0000","last_active":"2023-10-16T19:57:06.992213+0000","last_peered":"2023-10-16T19:57:06.992213+0000","last_clean":"2023-10-16T19:57:06.992213+0000","last_became_active":"2023-10-16T19:57:05.984623+0000","last_became_peered":"2023-10-16T19:57:05.984623+0000","last_unstale":"2023-10-16T19:57:06.992213+0000","last_undegraded":"2023-10-16T19:57:06.992213+0000","last_fullsized":"2023-10-16T19:57:06.992213+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:15:01.090446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-16T19:57:08.124150+0000","last_change":"2023-10-16T19:57:07.006439+0000","last_active":"2023-10-16T19:57:08.124150+0000","last_peered":"2023-10-16T19:57:08.124150+0000","last_clean":"2023-10-16T19:57:08.124150+0000","last_became_active":"2023-10-16T19:57:07.005621+0000","last_became_peered":"2023-10-16T19:57:07.005621+0000","last_unstale":"2023-10-16T19:57:08.124150+0000","last_undegraded":"2023-10-16T19:57:08.124150+0000","last_fullsized":"2023-10-16T19:57:08.124150+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:53:43.704346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T19:57:06.998505+0000","last_change":"2023-10-16T19:57:05.988154+0000","last_active":"2023-10-16T19:57:06.998505+0000","last_peered":"2023-10-16T19:57:06.998505+0000","last_clean":"2023-10-16T19:57:06.998505+0000","last_became_active":"2023-10-16T19:57:05.986384+0000","last_became_peered":"2023-10-16T19:57:05.986384+0000","last_unstale":"2023-10-16T19:57:06.998505+0000","last_undegraded":"2023-10-16T19:57:06.998505+0000","last_fullsized":"2023-10-16T19:57:06.998505+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:01:18.011775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-16T19:57:08.122337+0000","last_change":"2023-10-16T19:57:07.002146+0000","last_active":"2023-10-16T19:57:08.122337+0000","last_peered":"2023-10-16T19:57:08.122337+0000","last_clean":"2023-10-16T19:57:08.122337+0000","last_became_active":"2023-10-16T19:57:07.001914+0000","last_became_peered":"2023-10-16T19:57:07.001914+0000","last_unstale":"2023-10-16T19:57:08.122337+0000","last_undegraded":"2023-10-16T19:57:08.122337+0000","last_fullsized":"2023-10-16T19:57:08.122337+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:17:52.307869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T19:57:07.014816+0000","last_change":"2023-10-16T19:57:05.983913+0000","last_active":"2023-10-16T19:57:07.014816+0000","last_peered":"2023-10-16T19:57:07.014816+0000","last_clean":"2023-10-16T19:57:07.014816+0000","last_became_active":"2023-10-16T19:57:05.983697+0000","last_became_peered":"2023-10-16T19:57:05.983697+0000","last_unstale":"2023-10-16T19:57:07.014816+0000","last_undegraded":"2023-10-16T19:57:07.014816+0000","last_fullsized":"2023-10-16T19:57:07.014816+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:22:25.206288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-16T19:57:08.123063+0000","last_change":"2023-10-16T19:57:07.005291+0000","last_active":"2023-10-16T19:57:08.123063+0000","last_peered":"2023-10-16T19:57:08.123063+0000","last_clean":"2023-10-16T19:57:08.123063+0000","last_became_active":"2023-10-16T19:57:07.005076+0000","last_became_peered":"2023-10-16T19:57:07.005076+0000","last_unstale":"2023-10-16T19:57:08.123063+0000","last_undegraded":"2023-10-16T19:57:08.123063+0000","last_fullsized":"2023-10-16T19:57:08.123063+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:57:36.963296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T19:57:07.018757+0000","last_change":"2023-10-16T19:57:05.986612+0000","last_active":"2023-10-16T19:57:07.018757+0000","last_peered":"2023-10-16T19:57:07.018757+0000","last_clean":"2023-10-16T19:57:07.018757+0000","last_became_active":"2023-10-16T19:57:05.986376+0000","last_became_peered":"2023-10-16T19:57:05.986376+0000","last_unstale":"2023-10-16T19:57:07.018757+0000","last_undegraded":"2023-10-16T19:57:07.018757+0000","last_fullsized":"2023-10-16T19:57:07.018757+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:52:39.590803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-16T19:57:07.994878+0000","last_change":"2023-10-16T19:57:07.003484+0000","last_active":"2023-10-16T19:57:07.994878+0000","last_peered":"2023-10-16T19:57:07.994878+0000","last_clean":"2023-10-16T19:57:07.994878+0000","last_became_active":"2023-10-16T19:57:07.003250+0000","last_became_peered":"2023-10-16T19:57:07.003250+0000","last_unstale":"2023-10-16T19:57:07.994878+0000","last_undegraded":"2023-10-16T19:57:07.994878+0000","last_fullsized":"2023-10-16T19:57:07.994878+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:39:24.484888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T19:57:07.016866+0000","last_change":"2023-10-16T19:57:05.986994+0000","last_active":"2023-10-16T19:57:07.016866+0000","last_peered":"2023-10-16T19:57:07.016866+0000","last_clean":"2023-10-16T19:57:07.016866+0000","last_became_active":"2023-10-16T19:57:05.986599+0000","last_became_peered":"2023-10-16T19:57:05.986599+0000","last_unstale":"2023-10-16T19:57:07.016866+0000","last_undegraded":"2023-10-16T19:57:07.016866+0000","last_fullsized":"2023-10-16T19:57:07.016866+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:34:39.732847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-16T19:57:08.122472+0000","last_change":"2023-10-16T19:57:07.007947+0000","last_active":"2023-10-16T19:57:08.122472+0000","last_peered":"2023-10-16T19:57:08.122472+0000","last_clean":"2023-10-16T19:57:08.122472+0000","last_became_active":"2023-10-16T19:57:07.007510+0000","last_became_peered":"2023-10-16T19:57:07.007510+0000","last_unstale":"2023-10-16T19:57:08.122472+0000","last_undegraded":"2023-10-16T19:57:08.122472+0000","last_fullsized":"2023-10-16T19:57:08.122472+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:01:19.015459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T19:57:06.995603+0000","last_change":"2023-10-16T19:57:05.987167+0000","last_active":"2023-10-16T19:57:06.995603+0000","last_peered":"2023-10-16T19:57:06.995603+0000","last_clean":"2023-10-16T19:57:06.995603+0000","last_became_active":"2023-10-16T19:57:05.986764+0000","last_became_peered":"2023-10-16T19:57:05.986764+0000","last_unstale":"2023-10-16T19:57:06.995603+0000","last_undegraded":"2023-10-16T19:57:06.995603+0000","last_fullsized":"2023-10-16T19:57:06.995603+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:20:23.642933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-16T19:57:07.995599+0000","last_change":"2023-10-16T19:57:07.001344+0000","last_active":"2023-10-16T19:57:07.995599+0000","last_peered":"2023-10-16T19:57:07.995599+0000","last_clean":"2023-10-16T19:57:07.995599+0000","last_became_active":"2023-10-16T19:57:07.000758+0000","last_became_peered":"2023-10-16T19:57:07.000758+0000","last_unstale":"2023-10-16T19:57:07.995599+0000","last_undegraded":"2023-10-16T19:57:07.995599+0000","last_fullsized":"2023-10-16T19:57:07.995599+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:18:03.774335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T19:57:06.991741+0000","last_change":"2023-10-16T19:57:05.981794+0000","last_active":"2023-10-16T19:57:06.991741+0000","last_peered":"2023-10-16T19:57:06.991741+0000","last_clean":"2023-10-16T19:57:06.991741+0000","last_became_active":"2023-10-16T19:57:05.981583+0000","last_became_peered":"2023-10-16T19:57:05.981583+0000","last_unstale":"2023-10-16T19:57:06.991741+0000","last_undegraded":"2023-10-16T19:57:06.991741+0000","last_fullsized":"2023-10-16T19:57:06.991741+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:06:23.036752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-16T19:57:07.994645+0000","last_change":"2023-10-16T19:57:07.000451+0000","last_active":"2023-10-16T19:57:07.994645+0000","last_peered":"2023-10-16T19:57:07.994645+0000","last_clean":"2023-10-16T19:57:07.994645+0000","last_became_active":"2023-10-16T19:57:07.000132+0000","last_became_peered":"2023-10-16T19:57:07.000132+0000","last_unstale":"2023-10-16T19:57:07.994645+0000","last_undegraded":"2023-10-16T19:57:07.994645+0000","last_fullsized":"2023-10-16T19:57:07.994645+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:20:24.646617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T19:57:07.017505+0000","last_change":"2023-10-16T19:57:05.983364+0000","last_active":"2023-10-16T19:57:07.017505+0000","last_peered":"2023-10-16T19:57:07.017505+0000","last_clean":"2023-10-16T19:57:07.017505+0000","last_became_active":"2023-10-16T19:57:05.982833+0000","last_became_peered":"2023-10-16T19:57:05.982833+0000","last_unstale":"2023-10-16T19:57:07.017505+0000","last_undegraded":"2023-10-16T19:57:07.017505+0000","last_fullsized":"2023-10-16T19:57:07.017505+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:57:35.959611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-16T19:57:07.995235+0000","last_change":"2023-10-16T19:57:07.005825+0000","last_active":"2023-10-16T19:57:07.995235+0000","last_peered":"2023-10-16T19:57:07.995235+0000","last_clean":"2023-10-16T19:57:07.995235+0000","last_became_active":"2023-10-16T19:57:07.004948+0000","last_became_peered":"2023-10-16T19:57:07.004948+0000","last_unstale":"2023-10-16T19:57:07.995235+0000","last_undegraded":"2023-10-16T19:57:07.995235+0000","last_fullsized":"2023-10-16T19:57:07.995235+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:32:45.323575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T19:57:07.015859+0000","last_change":"2023-10-16T19:57:05.982827+0000","last_active":"2023-10-16T19:57:07.015859+0000","last_peered":"2023-10-16T19:57:07.015859+0000","last_clean":"2023-10-16T19:57:07.015859+0000","last_became_active":"2023-10-16T19:57:05.982621+0000","last_became_peered":"2023-10-16T19:57:05.982621+0000","last_unstale":"2023-10-16T19:57:07.015859+0000","last_undegraded":"2023-10-16T19:57:07.015859+0000","last_fullsized":"2023-10-16T19:57:07.015859+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:20:16.603179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-16T19:57:07.995680+0000","last_change":"2023-10-16T19:57:07.001478+0000","last_active":"2023-10-16T19:57:07.995680+0000","last_peered":"2023-10-16T19:57:07.995680+0000","last_clean":"2023-10-16T19:57:07.995680+0000","last_became_active":"2023-10-16T19:57:07.001102+0000","last_became_peered":"2023-10-16T19:57:07.001102+0000","last_unstale":"2023-10-16T19:57:07.995680+0000","last_undegraded":"2023-10-16T19:57:07.995680+0000","last_fullsized":"2023-10-16T19:57:07.995680+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:02:43.240567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T19:57:06.992538+0000","last_change":"2023-10-16T19:57:05.984208+0000","last_active":"2023-10-16T19:57:06.992538+0000","last_peered":"2023-10-16T19:57:06.992538+0000","last_clean":"2023-10-16T19:57:06.992538+0000","last_became_active":"2023-10-16T19:57:05.983817+0000","last_became_peered":"2023-10-16T19:57:05.983817+0000","last_unstale":"2023-10-16T19:57:06.992538+0000","last_undegraded":"2023-10-16T19:57:06.992538+0000","last_fullsized":"2023-10-16T19:57:06.992538+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:34:39.732847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-16T19:57:08.123002+0000","last_change":"2023-10-16T19:57:06.999700+0000","last_active":"2023-10-16T19:57:08.123002+0000","last_peered":"2023-10-16T19:57:08.123002+0000","last_clean":"2023-10-16T19:57:08.123002+0000","last_became_active":"2023-10-16T19:57:06.999001+0000","last_became_peered":"2023-10-16T19:57:06.999001+0000","last_unstale":"2023-10-16T19:57:08.123002+0000","last_undegraded":"2023-10-16T19:57:08.123002+0000","last_fullsized":"2023-10-16T19:57:08.123002+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:24:55.061118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T19:57:06.998668+0000","last_change":"2023-10-16T19:57:05.988394+0000","last_active":"2023-10-16T19:57:06.998668+0000","last_peered":"2023-10-16T19:57:06.998668+0000","last_clean":"2023-10-16T19:57:06.998668+0000","last_became_active":"2023-10-16T19:57:05.987547+0000","last_became_peered":"2023-10-16T19:57:05.987547+0000","last_unstale":"2023-10-16T19:57:06.998668+0000","last_undegraded":"2023-10-16T19:57:06.998668+0000","last_fullsized":"2023-10-16T19:57:06.998668+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:51:43.832499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-16T19:57:08.123381+0000","last_change":"2023-10-16T19:57:07.002567+0000","last_active":"2023-10-16T19:57:08.123381+0000","last_peered":"2023-10-16T19:57:08.123381+0000","last_clean":"2023-10-16T19:57:08.123381+0000","last_became_active":"2023-10-16T19:57:07.002314+0000","last_became_peered":"2023-10-16T19:57:07.002314+0000","last_unstale":"2023-10-16T19:57:08.123381+0000","last_undegraded":"2023-10-16T19:57:08.123381+0000","last_fullsized":"2023-10-16T19:57:08.123381+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:52:40.594488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-16T19:57:07.991098+0000","last_change":"2023-10-16T19:57:06.996216+0000","last_active":"2023-10-16T19:57:07.991098+0000","last_peered":"2023-10-16T19:57:07.991098+0000","last_clean":"2023-10-16T19:57:07.991098+0000","last_became_active":"2023-10-16T19:57:06.995818+0000","last_became_peered":"2023-10-16T19:57:06.995818+0000","last_unstale":"2023-10-16T19:57:07.991098+0000","last_undegraded":"2023-10-16T19:57:07.991098+0000","last_fullsized":"2023-10-16T19:57:07.991098+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:24:55.061118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T19:57:06.992752+0000","last_change":"2023-10-16T19:57:05.983515+0000","last_active":"2023-10-16T19:57:06.992752+0000","last_peered":"2023-10-16T19:57:06.992752+0000","last_clean":"2023-10-16T19:57:06.992752+0000","last_became_active":"2023-10-16T19:57:05.983096+0000","last_became_peered":"2023-10-16T19:57:05.983096+0000","last_unstale":"2023-10-16T19:57:06.992752+0000","last_undegraded":"2023-10-16T19:57:06.992752+0000","last_fullsized":"2023-10-16T19:57:06.992752+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:03:35.140465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-16T19:57:08.219540+0000","last_change":"2023-10-16T19:57:07.002274+0000","last_active":"2023-10-16T19:57:08.219540+0000","last_peered":"2023-10-16T19:57:08.219540+0000","last_clean":"2023-10-16T19:57:08.219540+0000","last_became_active":"2023-10-16T19:57:07.001797+0000","last_became_peered":"2023-10-16T19:57:07.001797+0000","last_unstale":"2023-10-16T19:57:08.219540+0000","last_undegraded":"2023-10-16T19:57:08.219540+0000","last_fullsized":"2023-10-16T19:57:08.219540+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:03:58.859315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T19:57:06.995366+0000","last_change":"2023-10-16T19:57:05.983807+0000","last_active":"2023-10-16T19:57:06.995366+0000","last_peered":"2023-10-16T19:57:06.995366+0000","last_clean":"2023-10-16T19:57:06.995366+0000","last_became_active":"2023-10-16T19:57:05.983538+0000","last_became_peered":"2023-10-16T19:57:05.983538+0000","last_unstale":"2023-10-16T19:57:06.995366+0000","last_undegraded":"2023-10-16T19:57:06.995366+0000","last_fullsized":"2023-10-16T19:57:06.995366+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:41:50.201556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":165,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T19:57:07.004328+0000","last_change":"2023-10-16T19:56:58.775782+0000","last_active":"2023-10-16T19:57:07.004328+0000","last_peered":"2023-10-16T19:57:07.004328+0000","last_clean":"2023-10-16T19:57:07.004328+0000","last_became_active":"2023-10-16T19:56:58.775567+0000","last_became_peered":"2023-10-16T19:56:58.775567+0000","last_unstale":"2023-10-16T19:57:07.004328+0000","last_undegraded":"2023-10-16T19:57:07.004328+0000","last_fullsized":"2023-10-16T19:57:07.004328+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:56:57.693332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:56:57.693332+0000","last_clean_scrub_stamp":"2023-10-16T19:56:57.693332+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:10:23.849736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-16T19:57:08.122492+0000","last_change":"2023-10-16T19:57:07.000186+0000","last_active":"2023-10-16T19:57:08.122492+0000","last_peered":"2023-10-16T19:57:08.122492+0000","last_clean":"2023-10-16T19:57:08.122492+0000","last_became_active":"2023-10-16T19:57:06.999922+0000","last_became_peered":"2023-10-16T19:57:06.999922+0000","last_unstale":"2023-10-16T19:57:08.122492+0000","last_undegraded":"2023-10-16T19:57:08.122492+0000","last_fullsized":"2023-10-16T19:57:08.122492+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:51:44.836184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T19:57:07.002178+0000","last_change":"2023-10-16T19:57:05.986507+0000","last_active":"2023-10-16T19:57:07.002178+0000","last_peered":"2023-10-16T19:57:07.002178+0000","last_clean":"2023-10-16T19:57:07.002178+0000","last_became_active":"2023-10-16T19:57:05.986234+0000","last_became_peered":"2023-10-16T19:57:05.986234+0000","last_unstale":"2023-10-16T19:57:07.002178+0000","last_undegraded":"2023-10-16T19:57:07.002178+0000","last_fullsized":"2023-10-16T19:57:07.002178+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:45:05.032981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T19:57:07.002307+0000","last_change":"2023-10-16T19:57:05.988441+0000","last_active":"2023-10-16T19:57:07.002307+0000","last_peered":"2023-10-16T19:57:07.002307+0000","last_clean":"2023-10-16T19:57:07.002307+0000","last_became_active":"2023-10-16T19:57:05.987113+0000","last_became_peered":"2023-10-16T19:57:05.987113+0000","last_unstale":"2023-10-16T19:57:07.002307+0000","last_undegraded":"2023-10-16T19:57:07.002307+0000","last_fullsized":"2023-10-16T19:57:07.002307+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:24:54.057434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-16T19:57:07.990900+0000","last_change":"2023-10-16T19:57:06.997577+0000","last_active":"2023-10-16T19:57:07.990900+0000","last_peered":"2023-10-16T19:57:07.990900+0000","last_clean":"2023-10-16T19:57:07.990900+0000","last_became_active":"2023-10-16T19:57:06.997051+0000","last_became_peered":"2023-10-16T19:57:06.997051+0000","last_unstale":"2023-10-16T19:57:07.990900+0000","last_undegraded":"2023-10-16T19:57:07.990900+0000","last_fullsized":"2023-10-16T19:57:07.990900+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:51:44.836184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-16T19:57:07.990858+0000","last_change":"2023-10-16T19:57:05.981020+0000","last_active":"2023-10-16T19:57:07.990858+0000","last_peered":"2023-10-16T19:57:07.990858+0000","last_clean":"2023-10-16T19:57:07.990858+0000","last_became_active":"2023-10-16T19:57:05.980784+0000","last_became_peered":"2023-10-16T19:57:05.980784+0000","last_unstale":"2023-10-16T19:57:07.990858+0000","last_undegraded":"2023-10-16T19:57:07.990858+0000","last_fullsized":"2023-10-16T19:57:07.990858+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:15:01.090446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-16T19:57:08.219259+0000","last_change":"2023-10-16T19:57:07.002362+0000","last_active":"2023-10-16T19:57:08.219259+0000","last_peered":"2023-10-16T19:57:08.219259+0000","last_clean":"2023-10-16T19:57:08.219259+0000","last_became_active":"2023-10-16T19:57:07.002080+0000","last_became_peered":"2023-10-16T19:57:07.002080+0000","last_unstale":"2023-10-16T19:57:08.219259+0000","last_undegraded":"2023-10-16T19:57:08.219259+0000","last_fullsized":"2023-10-16T19:57:08.219259+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:41:51.205240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T19:57:07.015539+0000","last_change":"2023-10-16T19:57:05.985909+0000","last_active":"2023-10-16T19:57:07.015539+0000","last_peered":"2023-10-16T19:57:07.015539+0000","last_clean":"2023-10-16T19:57:07.015539+0000","last_became_active":"2023-10-16T19:57:05.985720+0000","last_became_peered":"2023-10-16T19:57:05.985720+0000","last_unstale":"2023-10-16T19:57:07.015539+0000","last_undegraded":"2023-10-16T19:57:07.015539+0000","last_fullsized":"2023-10-16T19:57:07.015539+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:57:35.959611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-16T19:57:08.122386+0000","last_change":"2023-10-16T19:57:06.999291+0000","last_active":"2023-10-16T19:57:08.122386+0000","last_peered":"2023-10-16T19:57:08.122386+0000","last_clean":"2023-10-16T19:57:08.122386+0000","last_became_active":"2023-10-16T19:57:06.999034+0000","last_became_peered":"2023-10-16T19:57:06.999034+0000","last_unstale":"2023-10-16T19:57:08.122386+0000","last_undegraded":"2023-10-16T19:57:08.122386+0000","last_fullsized":"2023-10-16T19:57:08.122386+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:20:24.646617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T19:57:06.996025+0000","last_change":"2023-10-16T19:57:05.987808+0000","last_active":"2023-10-16T19:57:06.996025+0000","last_peered":"2023-10-16T19:57:06.996025+0000","last_clean":"2023-10-16T19:57:06.996025+0000","last_became_active":"2023-10-16T19:57:05.987595+0000","last_became_peered":"2023-10-16T19:57:05.987595+0000","last_unstale":"2023-10-16T19:57:06.996025+0000","last_undegraded":"2023-10-16T19:57:06.996025+0000","last_fullsized":"2023-10-16T19:57:06.996025+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:15:56.693134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-16T19:57:08.123801+0000","last_change":"2023-10-16T19:57:06.996295+0000","last_active":"2023-10-16T19:57:08.123801+0000","last_peered":"2023-10-16T19:57:08.123801+0000","last_clean":"2023-10-16T19:57:08.123801+0000","last_became_active":"2023-10-16T19:57:06.995604+0000","last_became_peered":"2023-10-16T19:57:06.995604+0000","last_unstale":"2023-10-16T19:57:08.123801+0000","last_undegraded":"2023-10-16T19:57:08.123801+0000","last_fullsized":"2023-10-16T19:57:08.123801+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:15:02.094131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T19:57:06.992662+0000","last_change":"2023-10-16T19:57:05.985744+0000","last_active":"2023-10-16T19:57:06.992662+0000","last_peered":"2023-10-16T19:57:06.992662+0000","last_clean":"2023-10-16T19:57:06.992662+0000","last_became_active":"2023-10-16T19:57:05.985591+0000","last_became_peered":"2023-10-16T19:57:05.985591+0000","last_unstale":"2023-10-16T19:57:06.992662+0000","last_undegraded":"2023-10-16T19:57:06.992662+0000","last_fullsized":"2023-10-16T19:57:06.992662+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:31:52.657457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-16T19:57:08.219291+0000","last_change":"2023-10-16T19:57:06.993916+0000","last_active":"2023-10-16T19:57:08.219291+0000","last_peered":"2023-10-16T19:57:08.219291+0000","last_clean":"2023-10-16T19:57:08.219291+0000","last_became_active":"2023-10-16T19:57:06.993732+0000","last_became_peered":"2023-10-16T19:57:06.993732+0000","last_unstale":"2023-10-16T19:57:08.219291+0000","last_undegraded":"2023-10-16T19:57:08.219291+0000","last_fullsized":"2023-10-16T19:57:08.219291+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:20:24.646617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T19:57:06.992674+0000","last_change":"2023-10-16T19:57:05.981641+0000","last_active":"2023-10-16T19:57:06.992674+0000","last_peered":"2023-10-16T19:57:06.992674+0000","last_clean":"2023-10-16T19:57:06.992674+0000","last_became_active":"2023-10-16T19:57:05.981424+0000","last_became_peered":"2023-10-16T19:57:05.981424+0000","last_unstale":"2023-10-16T19:57:06.992674+0000","last_undegraded":"2023-10-16T19:57:06.992674+0000","last_fullsized":"2023-10-16T19:57:06.992674+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:17:51.304185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-16T19:57:08.219535+0000","last_change":"2023-10-16T19:57:06.999753+0000","last_active":"2023-10-16T19:57:08.219535+0000","last_peered":"2023-10-16T19:57:08.219535+0000","last_clean":"2023-10-16T19:57:08.219535+0000","last_became_active":"2023-10-16T19:57:06.999499+0000","last_became_peered":"2023-10-16T19:57:06.999499+0000","last_unstale":"2023-10-16T19:57:08.219535+0000","last_undegraded":"2023-10-16T19:57:08.219535+0000","last_fullsized":"2023-10-16T19:57:08.219535+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:24:55.061118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T19:57:07.015534+0000","last_change":"2023-10-16T19:57:05.987589+0000","last_active":"2023-10-16T19:57:07.015534+0000","last_peered":"2023-10-16T19:57:07.015534+0000","last_clean":"2023-10-16T19:57:07.015534+0000","last_became_active":"2023-10-16T19:57:05.987345+0000","last_became_peered":"2023-10-16T19:57:05.987345+0000","last_unstale":"2023-10-16T19:57:07.015534+0000","last_undegraded":"2023-10-16T19:57:07.015534+0000","last_fullsized":"2023-10-16T19:57:07.015534+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:19:57.540312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-16T19:57:07.994730+0000","last_change":"2023-10-16T19:57:07.002297+0000","last_active":"2023-10-16T19:57:07.994730+0000","last_peered":"2023-10-16T19:57:07.994730+0000","last_clean":"2023-10-16T19:57:07.994730+0000","last_became_active":"2023-10-16T19:57:07.002036+0000","last_became_peered":"2023-10-16T19:57:07.002036+0000","last_unstale":"2023-10-16T19:57:07.994730+0000","last_undegraded":"2023-10-16T19:57:07.994730+0000","last_fullsized":"2023-10-16T19:57:07.994730+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:17:52.307869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T19:57:06.991993+0000","last_change":"2023-10-16T19:57:05.989449+0000","last_active":"2023-10-16T19:57:06.991993+0000","last_peered":"2023-10-16T19:57:06.991993+0000","last_clean":"2023-10-16T19:57:06.991993+0000","last_became_active":"2023-10-16T19:57:05.989136+0000","last_became_peered":"2023-10-16T19:57:05.989136+0000","last_unstale":"2023-10-16T19:57:06.991993+0000","last_undegraded":"2023-10-16T19:57:06.991993+0000","last_fullsized":"2023-10-16T19:57:06.991993+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:20:16.603179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-16T19:57:07.995372+0000","last_change":"2023-10-16T19:57:07.006520+0000","last_active":"2023-10-16T19:57:07.995372+0000","last_peered":"2023-10-16T19:57:07.995372+0000","last_clean":"2023-10-16T19:57:07.995372+0000","last_became_active":"2023-10-16T19:57:07.006154+0000","last_became_peered":"2023-10-16T19:57:07.006154+0000","last_unstale":"2023-10-16T19:57:07.995372+0000","last_undegraded":"2023-10-16T19:57:07.995372+0000","last_fullsized":"2023-10-16T19:57:07.995372+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:46:01.293187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T19:57:07.015059+0000","last_change":"2023-10-16T19:57:05.976185+0000","last_active":"2023-10-16T19:57:07.015059+0000","last_peered":"2023-10-16T19:57:07.015059+0000","last_clean":"2023-10-16T19:57:07.015059+0000","last_became_active":"2023-10-16T19:57:05.975953+0000","last_became_peered":"2023-10-16T19:57:05.975953+0000","last_unstale":"2023-10-16T19:57:07.015059+0000","last_undegraded":"2023-10-16T19:57:07.015059+0000","last_fullsized":"2023-10-16T19:57:07.015059+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:15:56.693134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-16T19:57:08.124279+0000","last_change":"2023-10-16T19:57:06.999678+0000","last_active":"2023-10-16T19:57:08.124279+0000","last_peered":"2023-10-16T19:57:08.124279+0000","last_clean":"2023-10-16T19:57:08.124279+0000","last_became_active":"2023-10-16T19:57:06.999426+0000","last_became_peered":"2023-10-16T19:57:06.999426+0000","last_unstale":"2023-10-16T19:57:08.124279+0000","last_undegraded":"2023-10-16T19:57:08.124279+0000","last_fullsized":"2023-10-16T19:57:08.124279+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:32:45.323575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T19:57:07.017013+0000","last_change":"2023-10-16T19:57:05.978522+0000","last_active":"2023-10-16T19:57:07.017013+0000","last_peered":"2023-10-16T19:57:07.017013+0000","last_clean":"2023-10-16T19:57:07.017013+0000","last_became_active":"2023-10-16T19:57:05.978289+0000","last_became_peered":"2023-10-16T19:57:05.978289+0000","last_unstale":"2023-10-16T19:57:07.017013+0000","last_undegraded":"2023-10-16T19:57:07.017013+0000","last_fullsized":"2023-10-16T19:57:07.017013+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:06:23.036752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-16T19:57:07.994495+0000","last_change":"2023-10-16T19:57:07.005818+0000","last_active":"2023-10-16T19:57:07.994495+0000","last_peered":"2023-10-16T19:57:07.994495+0000","last_clean":"2023-10-16T19:57:07.994495+0000","last_became_active":"2023-10-16T19:57:07.005393+0000","last_became_peered":"2023-10-16T19:57:07.005393+0000","last_unstale":"2023-10-16T19:57:07.994495+0000","last_undegraded":"2023-10-16T19:57:07.994495+0000","last_fullsized":"2023-10-16T19:57:07.994495+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:31:11.770822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-16T19:57:07.995096+0000","last_change":"2023-10-16T19:57:07.000189+0000","last_active":"2023-10-16T19:57:07.995096+0000","last_peered":"2023-10-16T19:57:07.995096+0000","last_clean":"2023-10-16T19:57:07.995096+0000","last_became_active":"2023-10-16T19:57:06.999930+0000","last_became_peered":"2023-10-16T19:57:06.999930+0000","last_unstale":"2023-10-16T19:57:07.995096+0000","last_undegraded":"2023-10-16T19:57:07.995096+0000","last_fullsized":"2023-10-16T19:57:07.995096+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:24:55.061118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-16T19:57:08.219189+0000","last_change":"2023-10-16T19:57:06.997514+0000","last_active":"2023-10-16T19:57:08.219189+0000","last_peered":"2023-10-16T19:57:08.219189+0000","last_clean":"2023-10-16T19:57:08.219189+0000","last_became_active":"2023-10-16T19:57:06.997292+0000","last_became_peered":"2023-10-16T19:57:06.997292+0000","last_unstale":"2023-10-16T19:57:08.219189+0000","last_undegraded":"2023-10-16T19:57:08.219189+0000","last_fullsized":"2023-10-16T19:57:08.219189+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:52:40.594488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-16T19:57:08.123089+0000","last_change":"2023-10-16T19:57:06.999829+0000","last_active":"2023-10-16T19:57:08.123089+0000","last_peered":"2023-10-16T19:57:08.123089+0000","last_clean":"2023-10-16T19:57:08.123089+0000","last_became_active":"2023-10-16T19:57:06.999557+0000","last_became_peered":"2023-10-16T19:57:06.999557+0000","last_unstale":"2023-10-16T19:57:08.123089+0000","last_undegraded":"2023-10-16T19:57:08.123089+0000","last_fullsized":"2023-10-16T19:57:08.123089+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:03:58.859315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-16T19:57:08.122165+0000","last_change":"2023-10-16T19:57:06.998834+0000","last_active":"2023-10-16T19:57:08.122165+0000","last_peered":"2023-10-16T19:57:08.122165+0000","last_clean":"2023-10-16T19:57:08.122165+0000","last_became_active":"2023-10-16T19:57:06.998620+0000","last_became_peered":"2023-10-16T19:57:06.998620+0000","last_unstale":"2023-10-16T19:57:08.122165+0000","last_undegraded":"2023-10-16T19:57:08.122165+0000","last_fullsized":"2023-10-16T19:57:08.122165+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:31:53.661141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-16T19:57:08.219407+0000","last_change":"2023-10-16T19:57:07.002242+0000","last_active":"2023-10-16T19:57:08.219407+0000","last_peered":"2023-10-16T19:57:08.219407+0000","last_clean":"2023-10-16T19:57:08.219407+0000","last_became_active":"2023-10-16T19:57:07.001663+0000","last_became_peered":"2023-10-16T19:57:07.001663+0000","last_unstale":"2023-10-16T19:57:08.219407+0000","last_undegraded":"2023-10-16T19:57:08.219407+0000","last_fullsized":"2023-10-16T19:57:08.219407+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:51:44.836184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-16T19:57:07.990887+0000","last_change":"2023-10-16T19:57:06.995596+0000","last_active":"2023-10-16T19:57:07.990887+0000","last_peered":"2023-10-16T19:57:07.990887+0000","last_clean":"2023-10-16T19:57:07.990887+0000","last_became_active":"2023-10-16T19:57:06.995350+0000","last_became_peered":"2023-10-16T19:57:06.995350+0000","last_unstale":"2023-10-16T19:57:07.990887+0000","last_undegraded":"2023-10-16T19:57:07.990887+0000","last_fullsized":"2023-10-16T19:57:07.990887+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:01:19.015459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-16T19:57:07.994691+0000","last_change":"2023-10-16T19:57:07.006772+0000","last_active":"2023-10-16T19:57:07.994691+0000","last_peered":"2023-10-16T19:57:07.994691+0000","last_clean":"2023-10-16T19:57:07.994691+0000","last_became_active":"2023-10-16T19:57:07.006400+0000","last_became_peered":"2023-10-16T19:57:07.006400+0000","last_unstale":"2023-10-16T19:57:07.994691+0000","last_undegraded":"2023-10-16T19:57:07.994691+0000","last_fullsized":"2023-10-16T19:57:07.994691+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:01:19.015459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-16T19:57:08.219340+0000","last_change":"2023-10-16T19:57:07.000947+0000","last_active":"2023-10-16T19:57:08.219340+0000","last_peered":"2023-10-16T19:57:08.219340+0000","last_clean":"2023-10-16T19:57:08.219340+0000","last_became_active":"2023-10-16T19:57:07.000759+0000","last_became_peered":"2023-10-16T19:57:07.000759+0000","last_unstale":"2023-10-16T19:57:08.219340+0000","last_undegraded":"2023-10-16T19:57:08.219340+0000","last_fullsized":"2023-10-16T19:57:08.219340+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:01:19.015459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-16T19:57:08.123164+0000","last_change":"2023-10-16T19:57:06.999553+0000","last_active":"2023-10-16T19:57:08.123164+0000","last_peered":"2023-10-16T19:57:08.123164+0000","last_clean":"2023-10-16T19:57:08.123164+0000","last_became_active":"2023-10-16T19:57:06.998666+0000","last_became_peered":"2023-10-16T19:57:06.998666+0000","last_unstale":"2023-10-16T19:57:08.123164+0000","last_undegraded":"2023-10-16T19:57:08.123164+0000","last_fullsized":"2023-10-16T19:57:08.123164+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:21:23.357923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-16T19:57:08.219688+0000","last_change":"2023-10-16T19:57:07.002395+0000","last_active":"2023-10-16T19:57:08.219688+0000","last_peered":"2023-10-16T19:57:08.219688+0000","last_clean":"2023-10-16T19:57:08.219688+0000","last_became_active":"2023-10-16T19:57:07.002046+0000","last_became_peered":"2023-10-16T19:57:07.002046+0000","last_unstale":"2023-10-16T19:57:08.219688+0000","last_undegraded":"2023-10-16T19:57:08.219688+0000","last_fullsized":"2023-10-16T19:57:08.219688+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:25:58.328485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-16T19:57:08.123979+0000","last_change":"2023-10-16T19:57:07.006579+0000","last_active":"2023-10-16T19:57:08.123979+0000","last_peered":"2023-10-16T19:57:08.123979+0000","last_clean":"2023-10-16T19:57:08.123979+0000","last_became_active":"2023-10-16T19:57:07.005912+0000","last_became_peered":"2023-10-16T19:57:07.005912+0000","last_unstale":"2023-10-16T19:57:08.123979+0000","last_undegraded":"2023-10-16T19:57:08.123979+0000","last_fullsized":"2023-10-16T19:57:08.123979+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:39:24.484888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-16T19:57:08.122786+0000","last_change":"2023-10-16T19:57:07.007756+0000","last_active":"2023-10-16T19:57:08.122786+0000","last_peered":"2023-10-16T19:57:08.122786+0000","last_clean":"2023-10-16T19:57:08.122786+0000","last_became_active":"2023-10-16T19:57:07.007189+0000","last_became_peered":"2023-10-16T19:57:07.007189+0000","last_unstale":"2023-10-16T19:57:08.122786+0000","last_undegraded":"2023-10-16T19:57:08.122786+0000","last_fullsized":"2023-10-16T19:57:08.122786+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:21:23.357923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-16T19:57:07.994884+0000","last_change":"2023-10-16T19:57:07.003763+0000","last_active":"2023-10-16T19:57:07.994884+0000","last_peered":"2023-10-16T19:57:07.994884+0000","last_clean":"2023-10-16T19:57:07.994884+0000","last_became_active":"2023-10-16T19:57:07.003612+0000","last_became_peered":"2023-10-16T19:57:07.003612+0000","last_unstale":"2023-10-16T19:57:07.994884+0000","last_undegraded":"2023-10-16T19:57:07.994884+0000","last_fullsized":"2023-10-16T19:57:07.994884+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:51:44.836184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":650,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194661,"statfs":{"total":200000000,"available":199333641,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44600000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60699999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36199999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41099999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":75,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195237,"statfs":{"total":200000000,"available":199922979,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33400000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42799999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38100000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36299999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41099999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":73,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195238,"statfs":{"total":200000000,"available":199924431,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35799999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45700000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83799999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79800000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73199999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90000000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":650,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194661,"statfs":{"total":200000000,"available":199333585,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34000000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59099999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55500000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60699999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":13,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":73,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195238,"statfs":{"total":200000000,"available":199924591,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40799999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47199999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45000000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83299999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67600000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69199999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81999999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":75,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195237,"statfs":{"total":200000000,"available":199922979,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27900000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29299999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33700000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44700000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42199999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48399999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":73,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195238,"statfs":{"total":200000000,"available":199924465,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.373}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44400000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66200000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59899999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42299999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":73,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195238,"statfs":{"total":200000000,"available":199924501,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44700000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38600000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36299999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60299999999999998}]}]}],"pool_statfs":[]}} 2023-10-16T19:57:20.361 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-16T19:57:20.517 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.515+0000 7f3d00246700 1 Processor -- start 2023-10-16T19:57:20.517 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.515+0000 7f3d00246700 1 -- start start 2023-10-16T19:57:20.519 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.516+0000 7f3d00246700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f3cf8071f60 0x7f3cf806d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:20.520 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.516+0000 7f3d00246700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f3cf806eb20 0x7f3cf806ef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:20.520 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.516+0000 7f3d00246700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3cf80cefc0 con 0x7f3cf815b130 2023-10-16T19:57:20.520 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.516+0000 7f3d00246700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3cf80b0050 con 0x7f3cf8071f60 2023-10-16T19:57:20.520 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.516+0000 7f3d00246700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3cf80723e0 con 0x7f3cf806eb20 2023-10-16T19:57:20.520 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.516+0000 7f3cfd7e1700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f3cf8071f60 0x7f3cf806d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:20.521 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.516+0000 7f3cfdfe2700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f3cf815b130 0x7f3cf80cb970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:55808/0 (socket says 172.21.15.157:55808) 2023-10-16T19:57:20.521 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.516+0000 7f3cfdfe2700 1 -- 172.21.15.157:0/2219348618 learned_addr learned my addr 172.21.15.157:0/2219348618 (peer_addr_for_me v1:172.21.15.157:0/0) 2023-10-16T19:57:20.521 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.516+0000 7f3cfe7e3700 1 --2- 172.21.15.157:0/2219348618 >> v2:172.21.15.187:3300/0 conn(0x7f3cf806eb20 0x7f3cf806ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:20.521 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.516+0000 7f3cfd7e1700 1 -- 172.21.15.157:0/2219348618 >> v2:172.21.15.187:3300/0 conn(0x7f3cf806eb20 msgr2=0x7f3cf806ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:57:20.522 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.516+0000 7f3cfd7e1700 1 --2- 172.21.15.157:0/2219348618 >> v2:172.21.15.187:3300/0 conn(0x7f3cf806eb20 0x7f3cf806ef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:20.522 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.516+0000 7f3cfd7e1700 1 -- 172.21.15.157:0/2219348618 >> v1:172.21.15.157:6789/0 conn(0x7f3cf815b130 legacy=0x7f3cf80cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:20.522 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.516+0000 7f3cfd7e1700 1 -- 172.21.15.157:0/2219348618 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cf806e090 con 0x7f3cf8071f60 2023-10-16T19:57:20.522 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.516+0000 7f3cfcfe0700 1 -- 172.21.15.157:0/2219348618 <== mon.0 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 492627822 0 0) 0x7f3cf80cefc0 con 0x7f3cf815b130 2023-10-16T19:57:20.523 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.516+0000 7f3cfd7e1700 1 --2- 172.21.15.157:0/2219348618 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3cf8071f60 0x7f3cf806d0f0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f3cf80ce650 tx=0x7f3cf4009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=108a3d3f854d8579 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:20.523 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.516+0000 7f3cfcfe0700 1 -- 172.21.15.157:0/2219348618 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cf4011830 con 0x7f3cf8071f60 2023-10-16T19:57:20.523 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.516+0000 7f3cfcfe0700 1 -- 172.21.15.157:0/2219348618 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cf4011990 con 0x7f3cf8071f60 2023-10-16T19:57:20.523 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.516+0000 7f3cfcfe0700 1 -- 172.21.15.157:0/2219348618 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cf4011d20 con 0x7f3cf8071f60 2023-10-16T19:57:20.523 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.517+0000 7f3d00246700 1 -- 172.21.15.157:0/2219348618 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3cf8071f60 msgr2=0x7f3cf806d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:20.524 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.517+0000 7f3d00246700 1 --2- 172.21.15.157:0/2219348618 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3cf8071f60 0x7f3cf806d0f0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f3cf80ce650 tx=0x7f3cf4009b20 comp rx=0 tx=0).stop 2023-10-16T19:57:20.524 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.517+0000 7f3d00246700 1 -- 172.21.15.157:0/2219348618 shutdown_connections 2023-10-16T19:57:20.524 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.517+0000 7f3d00246700 1 --2- 172.21.15.157:0/2219348618 >> v2:172.21.15.187:3300/0 conn(0x7f3cf806eb20 0x7f3cf806ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:20.524 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.517+0000 7f3d00246700 1 --2- 172.21.15.157:0/2219348618 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3cf8071f60 0x7f3cf806d0f0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:20.524 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.517+0000 7f3d00246700 1 -- 172.21.15.157:0/2219348618 >> 172.21.15.157:0/2219348618 conn(0x7f3cf80cd4e0 msgr2=0x7f3cf80cd8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:20.525 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.517+0000 7f3d00246700 1 -- 172.21.15.157:0/2219348618 shutdown_connections 2023-10-16T19:57:20.525 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.517+0000 7f3d00246700 1 -- 172.21.15.157:0/2219348618 wait complete. 2023-10-16T19:57:20.527 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.518+0000 7f3d00246700 1 Processor -- start 2023-10-16T19:57:20.527 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.518+0000 7f3d00246700 1 -- start start 2023-10-16T19:57:20.528 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.519+0000 7f3d00246700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3cf806eb20 0x7f3cf81579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:20.528 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.519+0000 7f3d00246700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3cf8071f60 0x7f3cf81f1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:20.528 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.519+0000 7f3d00246700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3cf815b130 0x7f3cf80b0d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:20.528 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.519+0000 7f3d00246700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cf8155740 con 0x7f3cf8071f60 2023-10-16T19:57:20.529 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.519+0000 7f3d00246700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cf8157ee0 con 0x7f3cf806eb20 2023-10-16T19:57:20.529 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.519+0000 7f3d00246700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cf81517b0 con 0x7f3cf815b130 2023-10-16T19:57:20.529 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.519+0000 7f3cfd7e1700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3cf8071f60 0x7f3cf81f1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:20.529 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.519+0000 7f3cfd7e1700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3cf8071f60 0x7f3cf81f1cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:46142/0 (socket says 172.21.15.157:46142) 2023-10-16T19:57:20.529 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.519+0000 7f3cfd7e1700 1 -- 172.21.15.157:0/2871196371 learned_addr learned my addr 172.21.15.157:0/2871196371 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:57:20.530 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.519+0000 7f3cfe7e3700 1 --2- 172.21.15.157:0/2871196371 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3cf815b130 0x7f3cf80b0d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:20.530 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.519+0000 7f3cfdfe2700 1 --2- 172.21.15.157:0/2871196371 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3cf806eb20 0x7f3cf81579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:20.530 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.519+0000 7f3cfd7e1700 1 -- 172.21.15.157:0/2871196371 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3cf815b130 msgr2=0x7f3cf80b0d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:20.530 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.519+0000 7f3cfd7e1700 1 --2- 172.21.15.157:0/2871196371 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3cf815b130 0x7f3cf80b0d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:20.530 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.519+0000 7f3cfd7e1700 1 -- 172.21.15.157:0/2871196371 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3cf806eb20 msgr2=0x7f3cf81579a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:20.531 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.519+0000 7f3cfd7e1700 1 --2- 172.21.15.157:0/2871196371 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3cf806eb20 0x7f3cf81579a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:20.531 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.519+0000 7f3cfd7e1700 1 -- 172.21.15.157:0/2871196371 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cf40094a0 con 0x7f3cf8071f60 2023-10-16T19:57:20.531 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.520+0000 7f3cfd7e1700 1 --2- 172.21.15.157:0/2871196371 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3cf8071f60 0x7f3cf81f1cf0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f3cf8072f20 tx=0x7f3cf4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:20.531 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.520+0000 7f3cee7fc700 1 -- 172.21.15.157:0/2871196371 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cf40038a0 con 0x7f3cf8071f60 2023-10-16T19:57:20.532 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.520+0000 7f3cee7fc700 1 -- 172.21.15.157:0/2871196371 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cf401f070 con 0x7f3cf8071f60 2023-10-16T19:57:20.532 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.520+0000 7f3d00246700 1 -- 172.21.15.157:0/2871196371 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cf81f18d0 con 0x7f3cf8071f60 2023-10-16T19:57:20.532 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.520+0000 7f3cee7fc700 1 -- 172.21.15.157:0/2871196371 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cf4003c40 con 0x7f3cf8071f60 2023-10-16T19:57:20.532 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.520+0000 7f3d00246700 1 -- 172.21.15.157:0/2871196371 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cf8155360 con 0x7f3cf8071f60 2023-10-16T19:57:20.533 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.521+0000 7f3d00246700 1 -- 172.21.15.157:0/2871196371 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3cf8155880 con 0x7f3cf8071f60 2023-10-16T19:57:20.533 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.521+0000 7f3cee7fc700 1 -- 172.21.15.157:0/2871196371 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f3cf4026480 con 0x7f3cf8071f60 2023-10-16T19:57:20.533 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.521+0000 7f3cee7fc700 1 --2- 172.21.15.157:0/2871196371 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f3cdc06af00 0x7f3cdc06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:20.533 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.521+0000 7f3cee7fc700 1 -- 172.21.15.157:0/2871196371 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3cf4021070 con 0x7f3cf8071f60 2023-10-16T19:57:20.534 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.522+0000 7f3cfdfe2700 1 --2- 172.21.15.157:0/2871196371 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f3cdc06af00 0x7f3cdc06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:20.534 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.522+0000 7f3cfdfe2700 1 --2- 172.21.15.157:0/2871196371 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f3cdc06af00 0x7f3cdc06d3c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3ce8000f60 tx=0x7f3ce8007c90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:20.535 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.526+0000 7f3cee7fc700 1 -- 172.21.15.157:0/2871196371 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3cf8155880 con 0x7f3cf8071f60 2023-10-16T19:57:20.715 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.712+0000 7f3d00246700 1 -- 172.21.15.157:0/2871196371 --> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3cf806d7f0 con 0x7f3cdc06af00 2023-10-16T19:57:20.722 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.720+0000 7f3cee7fc700 1 -- 172.21.15.157:0/2871196371 <== mgr.4100 v2:172.21.15.187:6832/2426285296 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+260270 (secure 0 0 0) 0x7f3ce8005b90 con 0x7f3cdc06af00 2023-10-16T19:57:20.725 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-10-16T19:57:20.727 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.723+0000 7f3d00246700 1 -- 172.21.15.157:0/2871196371 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f3cdc06af00 msgr2=0x7f3cdc06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:20.728 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.723+0000 7f3d00246700 1 --2- 172.21.15.157:0/2871196371 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f3cdc06af00 0x7f3cdc06d3c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3ce8000f60 tx=0x7f3ce8007c90 comp rx=0 tx=0).stop 2023-10-16T19:57:20.728 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.723+0000 7f3d00246700 1 -- 172.21.15.157:0/2871196371 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3cf8071f60 msgr2=0x7f3cf81f1cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:20.728 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.723+0000 7f3d00246700 1 --2- 172.21.15.157:0/2871196371 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3cf8071f60 0x7f3cf81f1cf0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f3cf8072f20 tx=0x7f3cf4004750 comp rx=0 tx=0).stop 2023-10-16T19:57:20.728 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.723+0000 7f3d00246700 1 -- 172.21.15.157:0/2871196371 shutdown_connections 2023-10-16T19:57:20.729 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.723+0000 7f3d00246700 1 --2- 172.21.15.157:0/2871196371 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f3cdc06af00 0x7f3cdc06d3c0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:20.729 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.723+0000 7f3d00246700 1 --2- 172.21.15.157:0/2871196371 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3cf806eb20 0x7f3cf81579a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:20.729 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.723+0000 7f3d00246700 1 --2- 172.21.15.157:0/2871196371 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3cf815b130 0x7f3cf80b0d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:20.729 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.723+0000 7f3d00246700 1 --2- 172.21.15.157:0/2871196371 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3cf8071f60 0x7f3cf81f1cf0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:20.729 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.723+0000 7f3d00246700 1 -- 172.21.15.157:0/2871196371 >> 172.21.15.157:0/2871196371 conn(0x7f3cf80cd4e0 msgr2=0x7f3cf80b1eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:20.730 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.723+0000 7f3d00246700 1 -- 172.21.15.157:0/2871196371 shutdown_connections 2023-10-16T19:57:20.730 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.723+0000 7f3d00246700 1 -- 172.21.15.157:0/2871196371 wait complete. 2023-10-16T19:57:20.730 INFO:teuthology.orchestra.run.smithi157.stderr:dumped all 2023-10-16T19:57:20.737 INFO:teuthology.orchestra.run.smithi157.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2023-10-16T19:57:18.893553+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":1746,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560753,"statfs":{"total":1600000000,"available":1598211172,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.899833"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-16T19:57:07.995517+0000","last_change":"2023-10-16T19:57:07.006384+0000","last_active":"2023-10-16T19:57:07.995517+0000","last_peered":"2023-10-16T19:57:07.995517+0000","last_clean":"2023-10-16T19:57:07.995517+0000","last_became_active":"2023-10-16T19:57:07.005790+0000","last_became_peered":"2023-10-16T19:57:07.005790+0000","last_unstale":"2023-10-16T19:57:07.995517+0000","last_undegraded":"2023-10-16T19:57:07.995517+0000","last_fullsized":"2023-10-16T19:57:07.995517+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:09:12.928664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-16T19:57:07.991019+0000","last_change":"2023-10-16T19:57:06.999389+0000","last_active":"2023-10-16T19:57:07.991019+0000","last_peered":"2023-10-16T19:57:07.991019+0000","last_clean":"2023-10-16T19:57:07.991019+0000","last_became_active":"2023-10-16T19:57:06.999162+0000","last_became_peered":"2023-10-16T19:57:06.999162+0000","last_unstale":"2023-10-16T19:57:07.991019+0000","last_undegraded":"2023-10-16T19:57:07.991019+0000","last_fullsized":"2023-10-16T19:57:07.991019+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:45:06.036665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-16T19:57:08.122675+0000","last_change":"2023-10-16T19:57:06.998825+0000","last_active":"2023-10-16T19:57:08.122675+0000","last_peered":"2023-10-16T19:57:08.122675+0000","last_clean":"2023-10-16T19:57:08.122675+0000","last_became_active":"2023-10-16T19:57:06.998479+0000","last_became_peered":"2023-10-16T19:57:06.998479+0000","last_unstale":"2023-10-16T19:57:08.122675+0000","last_undegraded":"2023-10-16T19:57:08.122675+0000","last_fullsized":"2023-10-16T19:57:08.122675+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:03:58.859315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-16T19:57:08.122859+0000","last_change":"2023-10-16T19:57:06.999838+0000","last_active":"2023-10-16T19:57:08.122859+0000","last_peered":"2023-10-16T19:57:08.122859+0000","last_clean":"2023-10-16T19:57:08.122859+0000","last_became_active":"2023-10-16T19:57:06.999305+0000","last_became_peered":"2023-10-16T19:57:06.999305+0000","last_unstale":"2023-10-16T19:57:08.122859+0000","last_undegraded":"2023-10-16T19:57:08.122859+0000","last_fullsized":"2023-10-16T19:57:08.122859+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:45:06.036665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-16T19:57:07.995504+0000","last_change":"2023-10-16T19:57:07.000324+0000","last_active":"2023-10-16T19:57:07.995504+0000","last_peered":"2023-10-16T19:57:07.995504+0000","last_clean":"2023-10-16T19:57:07.995504+0000","last_became_active":"2023-10-16T19:57:07.000057+0000","last_became_peered":"2023-10-16T19:57:07.000057+0000","last_unstale":"2023-10-16T19:57:07.995504+0000","last_undegraded":"2023-10-16T19:57:07.995504+0000","last_fullsized":"2023-10-16T19:57:07.995504+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:56:13.067804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-16T19:57:08.123449+0000","last_change":"2023-10-16T19:57:07.004149+0000","last_active":"2023-10-16T19:57:08.123449+0000","last_peered":"2023-10-16T19:57:08.123449+0000","last_clean":"2023-10-16T19:57:08.123449+0000","last_became_active":"2023-10-16T19:57:07.003618+0000","last_became_peered":"2023-10-16T19:57:07.003618+0000","last_unstale":"2023-10-16T19:57:08.123449+0000","last_undegraded":"2023-10-16T19:57:08.123449+0000","last_fullsized":"2023-10-16T19:57:08.123449+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:25:58.328485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-16T19:57:07.995466+0000","last_change":"2023-10-16T19:57:07.005978+0000","last_active":"2023-10-16T19:57:07.995466+0000","last_peered":"2023-10-16T19:57:07.995466+0000","last_clean":"2023-10-16T19:57:07.995466+0000","last_became_active":"2023-10-16T19:57:07.005529+0000","last_became_peered":"2023-10-16T19:57:07.005529+0000","last_unstale":"2023-10-16T19:57:07.995466+0000","last_undegraded":"2023-10-16T19:57:07.995466+0000","last_fullsized":"2023-10-16T19:57:07.995466+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:55:10.600360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-16T19:57:08.219621+0000","last_change":"2023-10-16T19:57:06.998520+0000","last_active":"2023-10-16T19:57:08.219621+0000","last_peered":"2023-10-16T19:57:08.219621+0000","last_clean":"2023-10-16T19:57:08.219621+0000","last_became_active":"2023-10-16T19:57:06.998293+0000","last_became_peered":"2023-10-16T19:57:06.998293+0000","last_unstale":"2023-10-16T19:57:08.219621+0000","last_undegraded":"2023-10-16T19:57:08.219621+0000","last_fullsized":"2023-10-16T19:57:08.219621+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:25:48.980225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-16T19:57:07.994923+0000","last_change":"2023-10-16T19:57:07.008535+0000","last_active":"2023-10-16T19:57:07.994923+0000","last_peered":"2023-10-16T19:57:07.994923+0000","last_clean":"2023-10-16T19:57:07.994923+0000","last_became_active":"2023-10-16T19:57:07.008297+0000","last_became_peered":"2023-10-16T19:57:07.008297+0000","last_unstale":"2023-10-16T19:57:07.994923+0000","last_undegraded":"2023-10-16T19:57:07.994923+0000","last_fullsized":"2023-10-16T19:57:07.994923+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:53:43.704346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-16T19:57:07.995044+0000","last_change":"2023-10-16T19:57:06.998253+0000","last_active":"2023-10-16T19:57:07.995044+0000","last_peered":"2023-10-16T19:57:07.995044+0000","last_clean":"2023-10-16T19:57:07.995044+0000","last_became_active":"2023-10-16T19:57:06.998051+0000","last_became_peered":"2023-10-16T19:57:06.998051+0000","last_unstale":"2023-10-16T19:57:07.995044+0000","last_undegraded":"2023-10-16T19:57:07.995044+0000","last_fullsized":"2023-10-16T19:57:07.995044+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:45:06.036665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-16T19:57:07.994446+0000","last_change":"2023-10-16T19:57:06.999597+0000","last_active":"2023-10-16T19:57:07.994446+0000","last_peered":"2023-10-16T19:57:07.994446+0000","last_clean":"2023-10-16T19:57:07.994446+0000","last_became_active":"2023-10-16T19:57:06.999312+0000","last_became_peered":"2023-10-16T19:57:06.999312+0000","last_unstale":"2023-10-16T19:57:07.994446+0000","last_undegraded":"2023-10-16T19:57:07.994446+0000","last_fullsized":"2023-10-16T19:57:07.994446+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:41:51.205240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-16T19:57:08.123128+0000","last_change":"2023-10-16T19:57:07.002089+0000","last_active":"2023-10-16T19:57:08.123128+0000","last_peered":"2023-10-16T19:57:08.123128+0000","last_clean":"2023-10-16T19:57:08.123128+0000","last_became_active":"2023-10-16T19:57:07.001847+0000","last_became_peered":"2023-10-16T19:57:07.001847+0000","last_unstale":"2023-10-16T19:57:08.123128+0000","last_undegraded":"2023-10-16T19:57:08.123128+0000","last_fullsized":"2023-10-16T19:57:08.123128+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:19:58.543996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-16T19:57:08.219751+0000","last_change":"2023-10-16T19:57:06.993639+0000","last_active":"2023-10-16T19:57:08.219751+0000","last_peered":"2023-10-16T19:57:08.219751+0000","last_clean":"2023-10-16T19:57:08.219751+0000","last_became_active":"2023-10-16T19:57:06.993396+0000","last_became_peered":"2023-10-16T19:57:06.993396+0000","last_unstale":"2023-10-16T19:57:08.219751+0000","last_undegraded":"2023-10-16T19:57:08.219751+0000","last_fullsized":"2023-10-16T19:57:08.219751+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:31:11.770822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-16T19:57:08.122373+0000","last_change":"2023-10-16T19:57:07.001284+0000","last_active":"2023-10-16T19:57:08.122373+0000","last_peered":"2023-10-16T19:57:08.122373+0000","last_clean":"2023-10-16T19:57:08.122373+0000","last_became_active":"2023-10-16T19:57:07.001063+0000","last_became_peered":"2023-10-16T19:57:07.001063+0000","last_unstale":"2023-10-16T19:57:08.122373+0000","last_undegraded":"2023-10-16T19:57:08.122373+0000","last_fullsized":"2023-10-16T19:57:08.122373+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:41:51.205240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-16T19:57:07.990740+0000","last_change":"2023-10-16T19:57:06.997709+0000","last_active":"2023-10-16T19:57:07.990740+0000","last_peered":"2023-10-16T19:57:07.990740+0000","last_clean":"2023-10-16T19:57:07.990740+0000","last_became_active":"2023-10-16T19:57:06.997354+0000","last_became_peered":"2023-10-16T19:57:06.997354+0000","last_unstale":"2023-10-16T19:57:07.990740+0000","last_undegraded":"2023-10-16T19:57:07.990740+0000","last_fullsized":"2023-10-16T19:57:07.990740+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:41:51.205240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-16T19:57:08.123798+0000","last_change":"2023-10-16T19:57:07.003971+0000","last_active":"2023-10-16T19:57:08.123798+0000","last_peered":"2023-10-16T19:57:08.123798+0000","last_clean":"2023-10-16T19:57:08.123798+0000","last_became_active":"2023-10-16T19:57:07.003330+0000","last_became_peered":"2023-10-16T19:57:07.003330+0000","last_unstale":"2023-10-16T19:57:08.123798+0000","last_undegraded":"2023-10-16T19:57:08.123798+0000","last_fullsized":"2023-10-16T19:57:08.123798+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:31:11.770822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-16T19:57:08.124416+0000","last_change":"2023-10-16T19:57:07.006715+0000","last_active":"2023-10-16T19:57:08.124416+0000","last_peered":"2023-10-16T19:57:08.124416+0000","last_clean":"2023-10-16T19:57:08.124416+0000","last_became_active":"2023-10-16T19:57:07.006217+0000","last_became_peered":"2023-10-16T19:57:07.006217+0000","last_unstale":"2023-10-16T19:57:08.124416+0000","last_undegraded":"2023-10-16T19:57:08.124416+0000","last_fullsized":"2023-10-16T19:57:08.124416+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:46:01.293187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-16T19:57:08.219133+0000","last_change":"2023-10-16T19:57:06.993961+0000","last_active":"2023-10-16T19:57:08.219133+0000","last_peered":"2023-10-16T19:57:08.219133+0000","last_clean":"2023-10-16T19:57:08.219133+0000","last_became_active":"2023-10-16T19:57:06.993724+0000","last_became_peered":"2023-10-16T19:57:06.993724+0000","last_unstale":"2023-10-16T19:57:08.219133+0000","last_undegraded":"2023-10-16T19:57:08.219133+0000","last_fullsized":"2023-10-16T19:57:08.219133+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:19:58.543996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-16T19:57:07.994655+0000","last_change":"2023-10-16T19:57:07.005634+0000","last_active":"2023-10-16T19:57:07.994655+0000","last_peered":"2023-10-16T19:57:07.994655+0000","last_clean":"2023-10-16T19:57:07.994655+0000","last_became_active":"2023-10-16T19:57:07.005057+0000","last_became_peered":"2023-10-16T19:57:07.005057+0000","last_unstale":"2023-10-16T19:57:07.994655+0000","last_undegraded":"2023-10-16T19:57:07.994655+0000","last_fullsized":"2023-10-16T19:57:07.994655+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:58:54.518707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T19:57:07.018064+0000","last_change":"2023-10-16T19:57:05.987741+0000","last_active":"2023-10-16T19:57:07.018064+0000","last_peered":"2023-10-16T19:57:07.018064+0000","last_clean":"2023-10-16T19:57:07.018064+0000","last_became_active":"2023-10-16T19:57:05.987520+0000","last_became_peered":"2023-10-16T19:57:05.987520+0000","last_unstale":"2023-10-16T19:57:07.018064+0000","last_undegraded":"2023-10-16T19:57:07.018064+0000","last_fullsized":"2023-10-16T19:57:07.018064+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:15:56.693134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-16T19:57:08.219412+0000","last_change":"2023-10-16T19:57:06.993252+0000","last_active":"2023-10-16T19:57:08.219412+0000","last_peered":"2023-10-16T19:57:08.219412+0000","last_clean":"2023-10-16T19:57:08.219412+0000","last_became_active":"2023-10-16T19:57:06.993020+0000","last_became_peered":"2023-10-16T19:57:06.993020+0000","last_unstale":"2023-10-16T19:57:08.219412+0000","last_undegraded":"2023-10-16T19:57:08.219412+0000","last_fullsized":"2023-10-16T19:57:08.219412+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:45:06.036665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T19:57:07.017741+0000","last_change":"2023-10-16T19:57:05.983983+0000","last_active":"2023-10-16T19:57:07.017741+0000","last_peered":"2023-10-16T19:57:07.017741+0000","last_clean":"2023-10-16T19:57:07.017741+0000","last_became_active":"2023-10-16T19:57:05.983622+0000","last_became_peered":"2023-10-16T19:57:05.983622+0000","last_unstale":"2023-10-16T19:57:07.017741+0000","last_undegraded":"2023-10-16T19:57:07.017741+0000","last_fullsized":"2023-10-16T19:57:07.017741+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:06:23.036752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-16T19:57:08.122603+0000","last_change":"2023-10-16T19:57:06.997914+0000","last_active":"2023-10-16T19:57:08.122603+0000","last_peered":"2023-10-16T19:57:08.122603+0000","last_clean":"2023-10-16T19:57:08.122603+0000","last_became_active":"2023-10-16T19:57:06.997690+0000","last_became_peered":"2023-10-16T19:57:06.997690+0000","last_unstale":"2023-10-16T19:57:08.122603+0000","last_undegraded":"2023-10-16T19:57:08.122603+0000","last_fullsized":"2023-10-16T19:57:08.122603+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:24:55.061118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T19:57:07.015417+0000","last_change":"2023-10-16T19:57:05.987000+0000","last_active":"2023-10-16T19:57:07.015417+0000","last_peered":"2023-10-16T19:57:07.015417+0000","last_clean":"2023-10-16T19:57:07.015417+0000","last_became_active":"2023-10-16T19:57:05.986803+0000","last_became_peered":"2023-10-16T19:57:05.986803+0000","last_unstale":"2023-10-16T19:57:07.015417+0000","last_undegraded":"2023-10-16T19:57:07.015417+0000","last_fullsized":"2023-10-16T19:57:07.015417+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:20:23.642933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-16T19:57:08.123957+0000","last_change":"2023-10-16T19:57:06.997052+0000","last_active":"2023-10-16T19:57:08.123957+0000","last_peered":"2023-10-16T19:57:08.123957+0000","last_clean":"2023-10-16T19:57:08.123957+0000","last_became_active":"2023-10-16T19:57:06.996662+0000","last_became_peered":"2023-10-16T19:57:06.996662+0000","last_unstale":"2023-10-16T19:57:08.123957+0000","last_undegraded":"2023-10-16T19:57:08.123957+0000","last_fullsized":"2023-10-16T19:57:08.123957+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:58:54.518707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T19:57:07.015115+0000","last_change":"2023-10-16T19:57:05.989284+0000","last_active":"2023-10-16T19:57:07.015115+0000","last_peered":"2023-10-16T19:57:07.015115+0000","last_clean":"2023-10-16T19:57:07.015115+0000","last_became_active":"2023-10-16T19:57:05.989033+0000","last_became_peered":"2023-10-16T19:57:05.989033+0000","last_unstale":"2023-10-16T19:57:07.015115+0000","last_undegraded":"2023-10-16T19:57:07.015115+0000","last_fullsized":"2023-10-16T19:57:07.015115+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:15:01.090446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-16T19:57:08.123335+0000","last_change":"2023-10-16T19:57:06.997386+0000","last_active":"2023-10-16T19:57:08.123335+0000","last_peered":"2023-10-16T19:57:08.123335+0000","last_clean":"2023-10-16T19:57:08.123335+0000","last_became_active":"2023-10-16T19:57:06.997156+0000","last_became_peered":"2023-10-16T19:57:06.997156+0000","last_unstale":"2023-10-16T19:57:08.123335+0000","last_undegraded":"2023-10-16T19:57:08.123335+0000","last_fullsized":"2023-10-16T19:57:08.123335+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:25:48.980225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T19:57:07.016041+0000","last_change":"2023-10-16T19:57:05.985822+0000","last_active":"2023-10-16T19:57:07.016041+0000","last_peered":"2023-10-16T19:57:07.016041+0000","last_clean":"2023-10-16T19:57:07.016041+0000","last_became_active":"2023-10-16T19:57:05.985592+0000","last_became_peered":"2023-10-16T19:57:05.985592+0000","last_unstale":"2023-10-16T19:57:07.016041+0000","last_undegraded":"2023-10-16T19:57:07.016041+0000","last_fullsized":"2023-10-16T19:57:07.016041+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:57:35.959611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-16T19:57:08.123129+0000","last_change":"2023-10-16T19:57:06.993561+0000","last_active":"2023-10-16T19:57:08.123129+0000","last_peered":"2023-10-16T19:57:08.123129+0000","last_clean":"2023-10-16T19:57:08.123129+0000","last_became_active":"2023-10-16T19:57:06.993306+0000","last_became_peered":"2023-10-16T19:57:06.993306+0000","last_unstale":"2023-10-16T19:57:08.123129+0000","last_undegraded":"2023-10-16T19:57:08.123129+0000","last_fullsized":"2023-10-16T19:57:08.123129+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:06:24.040436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T19:57:07.014669+0000","last_change":"2023-10-16T19:57:05.979963+0000","last_active":"2023-10-16T19:57:07.014669+0000","last_peered":"2023-10-16T19:57:07.014669+0000","last_clean":"2023-10-16T19:57:07.014669+0000","last_became_active":"2023-10-16T19:57:05.979710+0000","last_became_peered":"2023-10-16T19:57:05.979710+0000","last_unstale":"2023-10-16T19:57:07.014669+0000","last_undegraded":"2023-10-16T19:57:07.014669+0000","last_fullsized":"2023-10-16T19:57:07.014669+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:19:58.141677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-16T19:57:08.122506+0000","last_change":"2023-10-16T19:57:06.999329+0000","last_active":"2023-10-16T19:57:08.122506+0000","last_peered":"2023-10-16T19:57:08.122506+0000","last_clean":"2023-10-16T19:57:08.122506+0000","last_became_active":"2023-10-16T19:57:06.999101+0000","last_became_peered":"2023-10-16T19:57:06.999101+0000","last_unstale":"2023-10-16T19:57:08.122506+0000","last_undegraded":"2023-10-16T19:57:08.122506+0000","last_fullsized":"2023-10-16T19:57:08.122506+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:45:06.036665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T19:57:06.989953+0000","last_change":"2023-10-16T19:57:05.983843+0000","last_active":"2023-10-16T19:57:06.989953+0000","last_peered":"2023-10-16T19:57:06.989953+0000","last_clean":"2023-10-16T19:57:06.989953+0000","last_became_active":"2023-10-16T19:57:05.983163+0000","last_became_peered":"2023-10-16T19:57:05.983163+0000","last_unstale":"2023-10-16T19:57:06.989953+0000","last_undegraded":"2023-10-16T19:57:06.989953+0000","last_fullsized":"2023-10-16T19:57:06.989953+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:15:01.090446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-16T19:57:08.219610+0000","last_change":"2023-10-16T19:57:06.999441+0000","last_active":"2023-10-16T19:57:08.219610+0000","last_peered":"2023-10-16T19:57:08.219610+0000","last_clean":"2023-10-16T19:57:08.219610+0000","last_became_active":"2023-10-16T19:57:06.999162+0000","last_became_peered":"2023-10-16T19:57:06.999162+0000","last_unstale":"2023-10-16T19:57:08.219610+0000","last_undegraded":"2023-10-16T19:57:08.219610+0000","last_fullsized":"2023-10-16T19:57:08.219610+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:21:23.357923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T19:57:06.994513+0000","last_change":"2023-10-16T19:57:05.989194+0000","last_active":"2023-10-16T19:57:06.994513+0000","last_peered":"2023-10-16T19:57:06.994513+0000","last_clean":"2023-10-16T19:57:06.994513+0000","last_became_active":"2023-10-16T19:57:05.988926+0000","last_became_peered":"2023-10-16T19:57:05.988926+0000","last_unstale":"2023-10-16T19:57:06.994513+0000","last_undegraded":"2023-10-16T19:57:06.994513+0000","last_fullsized":"2023-10-16T19:57:06.994513+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:34:39.732847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-16T19:57:07.990808+0000","last_change":"2023-10-16T19:57:06.996063+0000","last_active":"2023-10-16T19:57:07.990808+0000","last_peered":"2023-10-16T19:57:07.990808+0000","last_clean":"2023-10-16T19:57:07.990808+0000","last_became_active":"2023-10-16T19:57:06.995511+0000","last_became_peered":"2023-10-16T19:57:06.995511+0000","last_unstale":"2023-10-16T19:57:07.990808+0000","last_undegraded":"2023-10-16T19:57:07.990808+0000","last_fullsized":"2023-10-16T19:57:07.990808+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:20:24.646617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T19:57:06.992213+0000","last_change":"2023-10-16T19:57:05.984937+0000","last_active":"2023-10-16T19:57:06.992213+0000","last_peered":"2023-10-16T19:57:06.992213+0000","last_clean":"2023-10-16T19:57:06.992213+0000","last_became_active":"2023-10-16T19:57:05.984623+0000","last_became_peered":"2023-10-16T19:57:05.984623+0000","last_unstale":"2023-10-16T19:57:06.992213+0000","last_undegraded":"2023-10-16T19:57:06.992213+0000","last_fullsized":"2023-10-16T19:57:06.992213+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:15:01.090446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-16T19:57:08.124150+0000","last_change":"2023-10-16T19:57:07.006439+0000","last_active":"2023-10-16T19:57:08.124150+0000","last_peered":"2023-10-16T19:57:08.124150+0000","last_clean":"2023-10-16T19:57:08.124150+0000","last_became_active":"2023-10-16T19:57:07.005621+0000","last_became_peered":"2023-10-16T19:57:07.005621+0000","last_unstale":"2023-10-16T19:57:08.124150+0000","last_undegraded":"2023-10-16T19:57:08.124150+0000","last_fullsized":"2023-10-16T19:57:08.124150+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:53:43.704346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T19:57:06.998505+0000","last_change":"2023-10-16T19:57:05.988154+0000","last_active":"2023-10-16T19:57:06.998505+0000","last_peered":"2023-10-16T19:57:06.998505+0000","last_clean":"2023-10-16T19:57:06.998505+0000","last_became_active":"2023-10-16T19:57:05.986384+0000","last_became_peered":"2023-10-16T19:57:05.986384+0000","last_unstale":"2023-10-16T19:57:06.998505+0000","last_undegraded":"2023-10-16T19:57:06.998505+0000","last_fullsized":"2023-10-16T19:57:06.998505+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:01:18.011775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-16T19:57:08.122337+0000","last_change":"2023-10-16T19:57:07.002146+0000","last_active":"2023-10-16T19:57:08.122337+0000","last_peered":"2023-10-16T19:57:08.122337+0000","last_clean":"2023-10-16T19:57:08.122337+0000","last_became_active":"2023-10-16T19:57:07.001914+0000","last_became_peered":"2023-10-16T19:57:07.001914+0000","last_unstale":"2023-10-16T19:57:08.122337+0000","last_undegraded":"2023-10-16T19:57:08.122337+0000","last_fullsized":"2023-10-16T19:57:08.122337+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:17:52.307869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T19:57:07.014816+0000","last_change":"2023-10-16T19:57:05.983913+0000","last_active":"2023-10-16T19:57:07.014816+0000","last_peered":"2023-10-16T19:57:07.014816+0000","last_clean":"2023-10-16T19:57:07.014816+0000","last_became_active":"2023-10-16T19:57:05.983697+0000","last_became_peered":"2023-10-16T19:57:05.983697+0000","last_unstale":"2023-10-16T19:57:07.014816+0000","last_undegraded":"2023-10-16T19:57:07.014816+0000","last_fullsized":"2023-10-16T19:57:07.014816+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:22:25.206288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-16T19:57:08.123063+0000","last_change":"2023-10-16T19:57:07.005291+0000","last_active":"2023-10-16T19:57:08.123063+0000","last_peered":"2023-10-16T19:57:08.123063+0000","last_clean":"2023-10-16T19:57:08.123063+0000","last_became_active":"2023-10-16T19:57:07.005076+0000","last_became_peered":"2023-10-16T19:57:07.005076+0000","last_unstale":"2023-10-16T19:57:08.123063+0000","last_undegraded":"2023-10-16T19:57:08.123063+0000","last_fullsized":"2023-10-16T19:57:08.123063+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:57:36.963296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T19:57:07.018757+0000","last_change":"2023-10-16T19:57:05.986612+0000","last_active":"2023-10-16T19:57:07.018757+0000","last_peered":"2023-10-16T19:57:07.018757+0000","last_clean":"2023-10-16T19:57:07.018757+0000","last_became_active":"2023-10-16T19:57:05.986376+0000","last_became_peered":"2023-10-16T19:57:05.986376+0000","last_unstale":"2023-10-16T19:57:07.018757+0000","last_undegraded":"2023-10-16T19:57:07.018757+0000","last_fullsized":"2023-10-16T19:57:07.018757+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:52:39.590803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-16T19:57:07.994878+0000","last_change":"2023-10-16T19:57:07.003484+0000","last_active":"2023-10-16T19:57:07.994878+0000","last_peered":"2023-10-16T19:57:07.994878+0000","last_clean":"2023-10-16T19:57:07.994878+0000","last_became_active":"2023-10-16T19:57:07.003250+0000","last_became_peered":"2023-10-16T19:57:07.003250+0000","last_unstale":"2023-10-16T19:57:07.994878+0000","last_undegraded":"2023-10-16T19:57:07.994878+0000","last_fullsized":"2023-10-16T19:57:07.994878+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:39:24.484888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T19:57:07.016866+0000","last_change":"2023-10-16T19:57:05.986994+0000","last_active":"2023-10-16T19:57:07.016866+0000","last_peered":"2023-10-16T19:57:07.016866+0000","last_clean":"2023-10-16T19:57:07.016866+0000","last_became_active":"2023-10-16T19:57:05.986599+0000","last_became_peered":"2023-10-16T19:57:05.986599+0000","last_unstale":"2023-10-16T19:57:07.016866+0000","last_undegraded":"2023-10-16T19:57:07.016866+0000","last_fullsized":"2023-10-16T19:57:07.016866+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:34:39.732847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-16T19:57:08.122472+0000","last_change":"2023-10-16T19:57:07.007947+0000","last_active":"2023-10-16T19:57:08.122472+0000","last_peered":"2023-10-16T19:57:08.122472+0000","last_clean":"2023-10-16T19:57:08.122472+0000","last_became_active":"2023-10-16T19:57:07.007510+0000","last_became_peered":"2023-10-16T19:57:07.007510+0000","last_unstale":"2023-10-16T19:57:08.122472+0000","last_undegraded":"2023-10-16T19:57:08.122472+0000","last_fullsized":"2023-10-16T19:57:08.122472+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:01:19.015459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T19:57:06.995603+0000","last_change":"2023-10-16T19:57:05.987167+0000","last_active":"2023-10-16T19:57:06.995603+0000","last_peered":"2023-10-16T19:57:06.995603+0000","last_clean":"2023-10-16T19:57:06.995603+0000","last_became_active":"2023-10-16T19:57:05.986764+0000","last_became_peered":"2023-10-16T19:57:05.986764+0000","last_unstale":"2023-10-16T19:57:06.995603+0000","last_undegraded":"2023-10-16T19:57:06.995603+0000","last_fullsized":"2023-10-16T19:57:06.995603+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:20:23.642933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-16T19:57:07.995599+0000","last_change":"2023-10-16T19:57:07.001344+0000","last_active":"2023-10-16T19:57:07.995599+0000","last_peered":"2023-10-16T19:57:07.995599+0000","last_clean":"2023-10-16T19:57:07.995599+0000","last_became_active":"2023-10-16T19:57:07.000758+0000","last_became_peered":"2023-10-16T19:57:07.000758+0000","last_unstale":"2023-10-16T19:57:07.995599+0000","last_undegraded":"2023-10-16T19:57:07.995599+0000","last_fullsized":"2023-10-16T19:57:07.995599+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:18:03.774335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T19:57:06.991741+0000","last_change":"2023-10-16T19:57:05.981794+0000","last_active":"2023-10-16T19:57:06.991741+0000","last_peered":"2023-10-16T19:57:06.991741+0000","last_clean":"2023-10-16T19:57:06.991741+0000","last_became_active":"2023-10-16T19:57:05.981583+0000","last_became_peered":"2023-10-16T19:57:05.981583+0000","last_unstale":"2023-10-16T19:57:06.991741+0000","last_undegraded":"2023-10-16T19:57:06.991741+0000","last_fullsized":"2023-10-16T19:57:06.991741+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:06:23.036752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-16T19:57:07.994645+0000","last_change":"2023-10-16T19:57:07.000451+0000","last_active":"2023-10-16T19:57:07.994645+0000","last_peered":"2023-10-16T19:57:07.994645+0000","last_clean":"2023-10-16T19:57:07.994645+0000","last_became_active":"2023-10-16T19:57:07.000132+0000","last_became_peered":"2023-10-16T19:57:07.000132+0000","last_unstale":"2023-10-16T19:57:07.994645+0000","last_undegraded":"2023-10-16T19:57:07.994645+0000","last_fullsized":"2023-10-16T19:57:07.994645+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:20:24.646617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T19:57:07.017505+0000","last_change":"2023-10-16T19:57:05.983364+0000","last_active":"2023-10-16T19:57:07.017505+0000","last_peered":"2023-10-16T19:57:07.017505+0000","last_clean":"2023-10-16T19:57:07.017505+0000","last_became_active":"2023-10-16T19:57:05.982833+0000","last_became_peered":"2023-10-16T19:57:05.982833+0000","last_unstale":"2023-10-16T19:57:07.017505+0000","last_undegraded":"2023-10-16T19:57:07.017505+0000","last_fullsized":"2023-10-16T19:57:07.017505+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:57:35.959611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-16T19:57:07.995235+0000","last_change":"2023-10-16T19:57:07.005825+0000","last_active":"2023-10-16T19:57:07.995235+0000","last_peered":"2023-10-16T19:57:07.995235+0000","last_clean":"2023-10-16T19:57:07.995235+0000","last_became_active":"2023-10-16T19:57:07.004948+0000","last_became_peered":"2023-10-16T19:57:07.004948+0000","last_unstale":"2023-10-16T19:57:07.995235+0000","last_undegraded":"2023-10-16T19:57:07.995235+0000","last_fullsized":"2023-10-16T19:57:07.995235+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:32:45.323575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T19:57:07.015859+0000","last_change":"2023-10-16T19:57:05.982827+0000","last_active":"2023-10-16T19:57:07.015859+0000","last_peered":"2023-10-16T19:57:07.015859+0000","last_clean":"2023-10-16T19:57:07.015859+0000","last_became_active":"2023-10-16T19:57:05.982621+0000","last_became_peered":"2023-10-16T19:57:05.982621+0000","last_unstale":"2023-10-16T19:57:07.015859+0000","last_undegraded":"2023-10-16T19:57:07.015859+0000","last_fullsized":"2023-10-16T19:57:07.015859+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:20:16.603179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-16T19:57:07.995680+0000","last_change":"2023-10-16T19:57:07.001478+0000","last_active":"2023-10-16T19:57:07.995680+0000","last_peered":"2023-10-16T19:57:07.995680+0000","last_clean":"2023-10-16T19:57:07.995680+0000","last_became_active":"2023-10-16T19:57:07.001102+0000","last_became_peered":"2023-10-16T19:57:07.001102+0000","last_unstale":"2023-10-16T19:57:07.995680+0000","last_undegraded":"2023-10-16T19:57:07.995680+0000","last_fullsized":"2023-10-16T19:57:07.995680+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:02:43.240567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T19:57:06.992538+0000","last_change":"2023-10-16T19:57:05.984208+0000","last_active":"2023-10-16T19:57:06.992538+0000","last_peered":"2023-10-16T19:57:06.992538+0000","last_clean":"2023-10-16T19:57:06.992538+0000","last_became_active":"2023-10-16T19:57:05.983817+0000","last_became_peered":"2023-10-16T19:57:05.983817+0000","last_unstale":"2023-10-16T19:57:06.992538+0000","last_undegraded":"2023-10-16T19:57:06.992538+0000","last_fullsized":"2023-10-16T19:57:06.992538+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:34:39.732847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-16T19:57:08.123002+0000","last_change":"2023-10-16T19:57:06.999700+0000","last_active":"2023-10-16T19:57:08.123002+0000","last_peered":"2023-10-16T19:57:08.123002+0000","last_clean":"2023-10-16T19:57:08.123002+0000","last_became_active":"2023-10-16T19:57:06.999001+0000","last_became_peered":"2023-10-16T19:57:06.999001+0000","last_unstale":"2023-10-16T19:57:08.123002+0000","last_undegraded":"2023-10-16T19:57:08.123002+0000","last_fullsized":"2023-10-16T19:57:08.123002+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:24:55.061118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T19:57:06.998668+0000","last_change":"2023-10-16T19:57:05.988394+0000","last_active":"2023-10-16T19:57:06.998668+0000","last_peered":"2023-10-16T19:57:06.998668+0000","last_clean":"2023-10-16T19:57:06.998668+0000","last_became_active":"2023-10-16T19:57:05.987547+0000","last_became_peered":"2023-10-16T19:57:05.987547+0000","last_unstale":"2023-10-16T19:57:06.998668+0000","last_undegraded":"2023-10-16T19:57:06.998668+0000","last_fullsized":"2023-10-16T19:57:06.998668+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:51:43.832499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-16T19:57:08.123381+0000","last_change":"2023-10-16T19:57:07.002567+0000","last_active":"2023-10-16T19:57:08.123381+0000","last_peered":"2023-10-16T19:57:08.123381+0000","last_clean":"2023-10-16T19:57:08.123381+0000","last_became_active":"2023-10-16T19:57:07.002314+0000","last_became_peered":"2023-10-16T19:57:07.002314+0000","last_unstale":"2023-10-16T19:57:08.123381+0000","last_undegraded":"2023-10-16T19:57:08.123381+0000","last_fullsized":"2023-10-16T19:57:08.123381+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:52:40.594488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-16T19:57:07.991098+0000","last_change":"2023-10-16T19:57:06.996216+0000","last_active":"2023-10-16T19:57:07.991098+0000","last_peered":"2023-10-16T19:57:07.991098+0000","last_clean":"2023-10-16T19:57:07.991098+0000","last_became_active":"2023-10-16T19:57:06.995818+0000","last_became_peered":"2023-10-16T19:57:06.995818+0000","last_unstale":"2023-10-16T19:57:07.991098+0000","last_undegraded":"2023-10-16T19:57:07.991098+0000","last_fullsized":"2023-10-16T19:57:07.991098+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:24:55.061118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T19:57:06.992752+0000","last_change":"2023-10-16T19:57:05.983515+0000","last_active":"2023-10-16T19:57:06.992752+0000","last_peered":"2023-10-16T19:57:06.992752+0000","last_clean":"2023-10-16T19:57:06.992752+0000","last_became_active":"2023-10-16T19:57:05.983096+0000","last_became_peered":"2023-10-16T19:57:05.983096+0000","last_unstale":"2023-10-16T19:57:06.992752+0000","last_undegraded":"2023-10-16T19:57:06.992752+0000","last_fullsized":"2023-10-16T19:57:06.992752+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:03:35.140465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-16T19:57:08.219540+0000","last_change":"2023-10-16T19:57:07.002274+0000","last_active":"2023-10-16T19:57:08.219540+0000","last_peered":"2023-10-16T19:57:08.219540+0000","last_clean":"2023-10-16T19:57:08.219540+0000","last_became_active":"2023-10-16T19:57:07.001797+0000","last_became_peered":"2023-10-16T19:57:07.001797+0000","last_unstale":"2023-10-16T19:57:08.219540+0000","last_undegraded":"2023-10-16T19:57:08.219540+0000","last_fullsized":"2023-10-16T19:57:08.219540+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:03:58.859315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T19:57:06.995366+0000","last_change":"2023-10-16T19:57:05.983807+0000","last_active":"2023-10-16T19:57:06.995366+0000","last_peered":"2023-10-16T19:57:06.995366+0000","last_clean":"2023-10-16T19:57:06.995366+0000","last_became_active":"2023-10-16T19:57:05.983538+0000","last_became_peered":"2023-10-16T19:57:05.983538+0000","last_unstale":"2023-10-16T19:57:06.995366+0000","last_undegraded":"2023-10-16T19:57:06.995366+0000","last_fullsized":"2023-10-16T19:57:06.995366+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:41:50.201556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":165,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T19:57:07.004328+0000","last_change":"2023-10-16T19:56:58.775782+0000","last_active":"2023-10-16T19:57:07.004328+0000","last_peered":"2023-10-16T19:57:07.004328+0000","last_clean":"2023-10-16T19:57:07.004328+0000","last_became_active":"2023-10-16T19:56:58.775567+0000","last_became_peered":"2023-10-16T19:56:58.775567+0000","last_unstale":"2023-10-16T19:57:07.004328+0000","last_undegraded":"2023-10-16T19:57:07.004328+0000","last_fullsized":"2023-10-16T19:57:07.004328+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:56:57.693332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:56:57.693332+0000","last_clean_scrub_stamp":"2023-10-16T19:56:57.693332+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:10:23.849736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-16T19:57:08.122492+0000","last_change":"2023-10-16T19:57:07.000186+0000","last_active":"2023-10-16T19:57:08.122492+0000","last_peered":"2023-10-16T19:57:08.122492+0000","last_clean":"2023-10-16T19:57:08.122492+0000","last_became_active":"2023-10-16T19:57:06.999922+0000","last_became_peered":"2023-10-16T19:57:06.999922+0000","last_unstale":"2023-10-16T19:57:08.122492+0000","last_undegraded":"2023-10-16T19:57:08.122492+0000","last_fullsized":"2023-10-16T19:57:08.122492+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:51:44.836184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T19:57:07.002178+0000","last_change":"2023-10-16T19:57:05.986507+0000","last_active":"2023-10-16T19:57:07.002178+0000","last_peered":"2023-10-16T19:57:07.002178+0000","last_clean":"2023-10-16T19:57:07.002178+0000","last_became_active":"2023-10-16T19:57:05.986234+0000","last_became_peered":"2023-10-16T19:57:05.986234+0000","last_unstale":"2023-10-16T19:57:07.002178+0000","last_undegraded":"2023-10-16T19:57:07.002178+0000","last_fullsized":"2023-10-16T19:57:07.002178+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:45:05.032981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T19:57:07.002307+0000","last_change":"2023-10-16T19:57:05.988441+0000","last_active":"2023-10-16T19:57:07.002307+0000","last_peered":"2023-10-16T19:57:07.002307+0000","last_clean":"2023-10-16T19:57:07.002307+0000","last_became_active":"2023-10-16T19:57:05.987113+0000","last_became_peered":"2023-10-16T19:57:05.987113+0000","last_unstale":"2023-10-16T19:57:07.002307+0000","last_undegraded":"2023-10-16T19:57:07.002307+0000","last_fullsized":"2023-10-16T19:57:07.002307+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:24:54.057434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-16T19:57:07.990900+0000","last_change":"2023-10-16T19:57:06.997577+0000","last_active":"2023-10-16T19:57:07.990900+0000","last_peered":"2023-10-16T19:57:07.990900+0000","last_clean":"2023-10-16T19:57:07.990900+0000","last_became_active":"2023-10-16T19:57:06.997051+0000","last_became_peered":"2023-10-16T19:57:06.997051+0000","last_unstale":"2023-10-16T19:57:07.990900+0000","last_undegraded":"2023-10-16T19:57:07.990900+0000","last_fullsized":"2023-10-16T19:57:07.990900+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:51:44.836184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-16T19:57:07.990858+0000","last_change":"2023-10-16T19:57:05.981020+0000","last_active":"2023-10-16T19:57:07.990858+0000","last_peered":"2023-10-16T19:57:07.990858+0000","last_clean":"2023-10-16T19:57:07.990858+0000","last_became_active":"2023-10-16T19:57:05.980784+0000","last_became_peered":"2023-10-16T19:57:05.980784+0000","last_unstale":"2023-10-16T19:57:07.990858+0000","last_undegraded":"2023-10-16T19:57:07.990858+0000","last_fullsized":"2023-10-16T19:57:07.990858+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:15:01.090446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-16T19:57:08.219259+0000","last_change":"2023-10-16T19:57:07.002362+0000","last_active":"2023-10-16T19:57:08.219259+0000","last_peered":"2023-10-16T19:57:08.219259+0000","last_clean":"2023-10-16T19:57:08.219259+0000","last_became_active":"2023-10-16T19:57:07.002080+0000","last_became_peered":"2023-10-16T19:57:07.002080+0000","last_unstale":"2023-10-16T19:57:08.219259+0000","last_undegraded":"2023-10-16T19:57:08.219259+0000","last_fullsized":"2023-10-16T19:57:08.219259+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:41:51.205240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T19:57:07.015539+0000","last_change":"2023-10-16T19:57:05.985909+0000","last_active":"2023-10-16T19:57:07.015539+0000","last_peered":"2023-10-16T19:57:07.015539+0000","last_clean":"2023-10-16T19:57:07.015539+0000","last_became_active":"2023-10-16T19:57:05.985720+0000","last_became_peered":"2023-10-16T19:57:05.985720+0000","last_unstale":"2023-10-16T19:57:07.015539+0000","last_undegraded":"2023-10-16T19:57:07.015539+0000","last_fullsized":"2023-10-16T19:57:07.015539+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:57:35.959611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-16T19:57:08.122386+0000","last_change":"2023-10-16T19:57:06.999291+0000","last_active":"2023-10-16T19:57:08.122386+0000","last_peered":"2023-10-16T19:57:08.122386+0000","last_clean":"2023-10-16T19:57:08.122386+0000","last_became_active":"2023-10-16T19:57:06.999034+0000","last_became_peered":"2023-10-16T19:57:06.999034+0000","last_unstale":"2023-10-16T19:57:08.122386+0000","last_undegraded":"2023-10-16T19:57:08.122386+0000","last_fullsized":"2023-10-16T19:57:08.122386+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:20:24.646617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T19:57:06.996025+0000","last_change":"2023-10-16T19:57:05.987808+0000","last_active":"2023-10-16T19:57:06.996025+0000","last_peered":"2023-10-16T19:57:06.996025+0000","last_clean":"2023-10-16T19:57:06.996025+0000","last_became_active":"2023-10-16T19:57:05.987595+0000","last_became_peered":"2023-10-16T19:57:05.987595+0000","last_unstale":"2023-10-16T19:57:06.996025+0000","last_undegraded":"2023-10-16T19:57:06.996025+0000","last_fullsized":"2023-10-16T19:57:06.996025+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:15:56.693134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-16T19:57:08.123801+0000","last_change":"2023-10-16T19:57:06.996295+0000","last_active":"2023-10-16T19:57:08.123801+0000","last_peered":"2023-10-16T19:57:08.123801+0000","last_clean":"2023-10-16T19:57:08.123801+0000","last_became_active":"2023-10-16T19:57:06.995604+0000","last_became_peered":"2023-10-16T19:57:06.995604+0000","last_unstale":"2023-10-16T19:57:08.123801+0000","last_undegraded":"2023-10-16T19:57:08.123801+0000","last_fullsized":"2023-10-16T19:57:08.123801+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:15:02.094131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T19:57:06.992662+0000","last_change":"2023-10-16T19:57:05.985744+0000","last_active":"2023-10-16T19:57:06.992662+0000","last_peered":"2023-10-16T19:57:06.992662+0000","last_clean":"2023-10-16T19:57:06.992662+0000","last_became_active":"2023-10-16T19:57:05.985591+0000","last_became_peered":"2023-10-16T19:57:05.985591+0000","last_unstale":"2023-10-16T19:57:06.992662+0000","last_undegraded":"2023-10-16T19:57:06.992662+0000","last_fullsized":"2023-10-16T19:57:06.992662+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:31:52.657457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-16T19:57:08.219291+0000","last_change":"2023-10-16T19:57:06.993916+0000","last_active":"2023-10-16T19:57:08.219291+0000","last_peered":"2023-10-16T19:57:08.219291+0000","last_clean":"2023-10-16T19:57:08.219291+0000","last_became_active":"2023-10-16T19:57:06.993732+0000","last_became_peered":"2023-10-16T19:57:06.993732+0000","last_unstale":"2023-10-16T19:57:08.219291+0000","last_undegraded":"2023-10-16T19:57:08.219291+0000","last_fullsized":"2023-10-16T19:57:08.219291+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:20:24.646617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T19:57:06.992674+0000","last_change":"2023-10-16T19:57:05.981641+0000","last_active":"2023-10-16T19:57:06.992674+0000","last_peered":"2023-10-16T19:57:06.992674+0000","last_clean":"2023-10-16T19:57:06.992674+0000","last_became_active":"2023-10-16T19:57:05.981424+0000","last_became_peered":"2023-10-16T19:57:05.981424+0000","last_unstale":"2023-10-16T19:57:06.992674+0000","last_undegraded":"2023-10-16T19:57:06.992674+0000","last_fullsized":"2023-10-16T19:57:06.992674+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:17:51.304185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-16T19:57:08.219535+0000","last_change":"2023-10-16T19:57:06.999753+0000","last_active":"2023-10-16T19:57:08.219535+0000","last_peered":"2023-10-16T19:57:08.219535+0000","last_clean":"2023-10-16T19:57:08.219535+0000","last_became_active":"2023-10-16T19:57:06.999499+0000","last_became_peered":"2023-10-16T19:57:06.999499+0000","last_unstale":"2023-10-16T19:57:08.219535+0000","last_undegraded":"2023-10-16T19:57:08.219535+0000","last_fullsized":"2023-10-16T19:57:08.219535+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:24:55.061118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T19:57:07.015534+0000","last_change":"2023-10-16T19:57:05.987589+0000","last_active":"2023-10-16T19:57:07.015534+0000","last_peered":"2023-10-16T19:57:07.015534+0000","last_clean":"2023-10-16T19:57:07.015534+0000","last_became_active":"2023-10-16T19:57:05.987345+0000","last_became_peered":"2023-10-16T19:57:05.987345+0000","last_unstale":"2023-10-16T19:57:07.015534+0000","last_undegraded":"2023-10-16T19:57:07.015534+0000","last_fullsized":"2023-10-16T19:57:07.015534+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:19:57.540312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-16T19:57:07.994730+0000","last_change":"2023-10-16T19:57:07.002297+0000","last_active":"2023-10-16T19:57:07.994730+0000","last_peered":"2023-10-16T19:57:07.994730+0000","last_clean":"2023-10-16T19:57:07.994730+0000","last_became_active":"2023-10-16T19:57:07.002036+0000","last_became_peered":"2023-10-16T19:57:07.002036+0000","last_unstale":"2023-10-16T19:57:07.994730+0000","last_undegraded":"2023-10-16T19:57:07.994730+0000","last_fullsized":"2023-10-16T19:57:07.994730+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:17:52.307869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T19:57:06.991993+0000","last_change":"2023-10-16T19:57:05.989449+0000","last_active":"2023-10-16T19:57:06.991993+0000","last_peered":"2023-10-16T19:57:06.991993+0000","last_clean":"2023-10-16T19:57:06.991993+0000","last_became_active":"2023-10-16T19:57:05.989136+0000","last_became_peered":"2023-10-16T19:57:05.989136+0000","last_unstale":"2023-10-16T19:57:06.991993+0000","last_undegraded":"2023-10-16T19:57:06.991993+0000","last_fullsized":"2023-10-16T19:57:06.991993+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:20:16.603179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-16T19:57:07.995372+0000","last_change":"2023-10-16T19:57:07.006520+0000","last_active":"2023-10-16T19:57:07.995372+0000","last_peered":"2023-10-16T19:57:07.995372+0000","last_clean":"2023-10-16T19:57:07.995372+0000","last_became_active":"2023-10-16T19:57:07.006154+0000","last_became_peered":"2023-10-16T19:57:07.006154+0000","last_unstale":"2023-10-16T19:57:07.995372+0000","last_undegraded":"2023-10-16T19:57:07.995372+0000","last_fullsized":"2023-10-16T19:57:07.995372+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:46:01.293187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T19:57:07.015059+0000","last_change":"2023-10-16T19:57:05.976185+0000","last_active":"2023-10-16T19:57:07.015059+0000","last_peered":"2023-10-16T19:57:07.015059+0000","last_clean":"2023-10-16T19:57:07.015059+0000","last_became_active":"2023-10-16T19:57:05.975953+0000","last_became_peered":"2023-10-16T19:57:05.975953+0000","last_unstale":"2023-10-16T19:57:07.015059+0000","last_undegraded":"2023-10-16T19:57:07.015059+0000","last_fullsized":"2023-10-16T19:57:07.015059+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:15:56.693134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-16T19:57:08.124279+0000","last_change":"2023-10-16T19:57:06.999678+0000","last_active":"2023-10-16T19:57:08.124279+0000","last_peered":"2023-10-16T19:57:08.124279+0000","last_clean":"2023-10-16T19:57:08.124279+0000","last_became_active":"2023-10-16T19:57:06.999426+0000","last_became_peered":"2023-10-16T19:57:06.999426+0000","last_unstale":"2023-10-16T19:57:08.124279+0000","last_undegraded":"2023-10-16T19:57:08.124279+0000","last_fullsized":"2023-10-16T19:57:08.124279+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:32:45.323575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T19:57:07.017013+0000","last_change":"2023-10-16T19:57:05.978522+0000","last_active":"2023-10-16T19:57:07.017013+0000","last_peered":"2023-10-16T19:57:07.017013+0000","last_clean":"2023-10-16T19:57:07.017013+0000","last_became_active":"2023-10-16T19:57:05.978289+0000","last_became_peered":"2023-10-16T19:57:05.978289+0000","last_unstale":"2023-10-16T19:57:07.017013+0000","last_undegraded":"2023-10-16T19:57:07.017013+0000","last_fullsized":"2023-10-16T19:57:07.017013+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:04.967702+0000","last_clean_scrub_stamp":"2023-10-16T19:57:04.967702+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:06:23.036752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-16T19:57:07.994495+0000","last_change":"2023-10-16T19:57:07.005818+0000","last_active":"2023-10-16T19:57:07.994495+0000","last_peered":"2023-10-16T19:57:07.994495+0000","last_clean":"2023-10-16T19:57:07.994495+0000","last_became_active":"2023-10-16T19:57:07.005393+0000","last_became_peered":"2023-10-16T19:57:07.005393+0000","last_unstale":"2023-10-16T19:57:07.994495+0000","last_undegraded":"2023-10-16T19:57:07.994495+0000","last_fullsized":"2023-10-16T19:57:07.994495+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:31:11.770822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-16T19:57:07.995096+0000","last_change":"2023-10-16T19:57:07.000189+0000","last_active":"2023-10-16T19:57:07.995096+0000","last_peered":"2023-10-16T19:57:07.995096+0000","last_clean":"2023-10-16T19:57:07.995096+0000","last_became_active":"2023-10-16T19:57:06.999930+0000","last_became_peered":"2023-10-16T19:57:06.999930+0000","last_unstale":"2023-10-16T19:57:07.995096+0000","last_undegraded":"2023-10-16T19:57:07.995096+0000","last_fullsized":"2023-10-16T19:57:07.995096+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:24:55.061118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-16T19:57:08.219189+0000","last_change":"2023-10-16T19:57:06.997514+0000","last_active":"2023-10-16T19:57:08.219189+0000","last_peered":"2023-10-16T19:57:08.219189+0000","last_clean":"2023-10-16T19:57:08.219189+0000","last_became_active":"2023-10-16T19:57:06.997292+0000","last_became_peered":"2023-10-16T19:57:06.997292+0000","last_unstale":"2023-10-16T19:57:08.219189+0000","last_undegraded":"2023-10-16T19:57:08.219189+0000","last_fullsized":"2023-10-16T19:57:08.219189+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:52:40.594488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-16T19:57:08.123089+0000","last_change":"2023-10-16T19:57:06.999829+0000","last_active":"2023-10-16T19:57:08.123089+0000","last_peered":"2023-10-16T19:57:08.123089+0000","last_clean":"2023-10-16T19:57:08.123089+0000","last_became_active":"2023-10-16T19:57:06.999557+0000","last_became_peered":"2023-10-16T19:57:06.999557+0000","last_unstale":"2023-10-16T19:57:08.123089+0000","last_undegraded":"2023-10-16T19:57:08.123089+0000","last_fullsized":"2023-10-16T19:57:08.123089+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:03:58.859315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-16T19:57:08.122165+0000","last_change":"2023-10-16T19:57:06.998834+0000","last_active":"2023-10-16T19:57:08.122165+0000","last_peered":"2023-10-16T19:57:08.122165+0000","last_clean":"2023-10-16T19:57:08.122165+0000","last_became_active":"2023-10-16T19:57:06.998620+0000","last_became_peered":"2023-10-16T19:57:06.998620+0000","last_unstale":"2023-10-16T19:57:08.122165+0000","last_undegraded":"2023-10-16T19:57:08.122165+0000","last_fullsized":"2023-10-16T19:57:08.122165+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:31:53.661141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-16T19:57:08.219407+0000","last_change":"2023-10-16T19:57:07.002242+0000","last_active":"2023-10-16T19:57:08.219407+0000","last_peered":"2023-10-16T19:57:08.219407+0000","last_clean":"2023-10-16T19:57:08.219407+0000","last_became_active":"2023-10-16T19:57:07.001663+0000","last_became_peered":"2023-10-16T19:57:07.001663+0000","last_unstale":"2023-10-16T19:57:08.219407+0000","last_undegraded":"2023-10-16T19:57:08.219407+0000","last_fullsized":"2023-10-16T19:57:08.219407+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:51:44.836184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-16T19:57:07.990887+0000","last_change":"2023-10-16T19:57:06.995596+0000","last_active":"2023-10-16T19:57:07.990887+0000","last_peered":"2023-10-16T19:57:07.990887+0000","last_clean":"2023-10-16T19:57:07.990887+0000","last_became_active":"2023-10-16T19:57:06.995350+0000","last_became_peered":"2023-10-16T19:57:06.995350+0000","last_unstale":"2023-10-16T19:57:07.990887+0000","last_undegraded":"2023-10-16T19:57:07.990887+0000","last_fullsized":"2023-10-16T19:57:07.990887+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:01:19.015459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-16T19:57:07.994691+0000","last_change":"2023-10-16T19:57:07.006772+0000","last_active":"2023-10-16T19:57:07.994691+0000","last_peered":"2023-10-16T19:57:07.994691+0000","last_clean":"2023-10-16T19:57:07.994691+0000","last_became_active":"2023-10-16T19:57:07.006400+0000","last_became_peered":"2023-10-16T19:57:07.006400+0000","last_unstale":"2023-10-16T19:57:07.994691+0000","last_undegraded":"2023-10-16T19:57:07.994691+0000","last_fullsized":"2023-10-16T19:57:07.994691+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:01:19.015459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-16T19:57:08.219340+0000","last_change":"2023-10-16T19:57:07.000947+0000","last_active":"2023-10-16T19:57:08.219340+0000","last_peered":"2023-10-16T19:57:08.219340+0000","last_clean":"2023-10-16T19:57:08.219340+0000","last_became_active":"2023-10-16T19:57:07.000759+0000","last_became_peered":"2023-10-16T19:57:07.000759+0000","last_unstale":"2023-10-16T19:57:08.219340+0000","last_undegraded":"2023-10-16T19:57:08.219340+0000","last_fullsized":"2023-10-16T19:57:08.219340+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:01:19.015459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-16T19:57:08.123164+0000","last_change":"2023-10-16T19:57:06.999553+0000","last_active":"2023-10-16T19:57:08.123164+0000","last_peered":"2023-10-16T19:57:08.123164+0000","last_clean":"2023-10-16T19:57:08.123164+0000","last_became_active":"2023-10-16T19:57:06.998666+0000","last_became_peered":"2023-10-16T19:57:06.998666+0000","last_unstale":"2023-10-16T19:57:08.123164+0000","last_undegraded":"2023-10-16T19:57:08.123164+0000","last_fullsized":"2023-10-16T19:57:08.123164+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:21:23.357923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-16T19:57:08.219688+0000","last_change":"2023-10-16T19:57:07.002395+0000","last_active":"2023-10-16T19:57:08.219688+0000","last_peered":"2023-10-16T19:57:08.219688+0000","last_clean":"2023-10-16T19:57:08.219688+0000","last_became_active":"2023-10-16T19:57:07.002046+0000","last_became_peered":"2023-10-16T19:57:07.002046+0000","last_unstale":"2023-10-16T19:57:08.219688+0000","last_undegraded":"2023-10-16T19:57:08.219688+0000","last_fullsized":"2023-10-16T19:57:08.219688+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:25:58.328485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-16T19:57:08.123979+0000","last_change":"2023-10-16T19:57:07.006579+0000","last_active":"2023-10-16T19:57:08.123979+0000","last_peered":"2023-10-16T19:57:08.123979+0000","last_clean":"2023-10-16T19:57:08.123979+0000","last_became_active":"2023-10-16T19:57:07.005912+0000","last_became_peered":"2023-10-16T19:57:07.005912+0000","last_unstale":"2023-10-16T19:57:08.123979+0000","last_undegraded":"2023-10-16T19:57:08.123979+0000","last_fullsized":"2023-10-16T19:57:08.123979+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:39:24.484888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-16T19:57:08.122786+0000","last_change":"2023-10-16T19:57:07.007756+0000","last_active":"2023-10-16T19:57:08.122786+0000","last_peered":"2023-10-16T19:57:08.122786+0000","last_clean":"2023-10-16T19:57:08.122786+0000","last_became_active":"2023-10-16T19:57:07.007189+0000","last_became_peered":"2023-10-16T19:57:07.007189+0000","last_unstale":"2023-10-16T19:57:08.122786+0000","last_undegraded":"2023-10-16T19:57:08.122786+0000","last_fullsized":"2023-10-16T19:57:08.122786+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:21:23.357923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-16T19:57:07.994884+0000","last_change":"2023-10-16T19:57:07.003763+0000","last_active":"2023-10-16T19:57:07.994884+0000","last_peered":"2023-10-16T19:57:07.994884+0000","last_clean":"2023-10-16T19:57:07.994884+0000","last_became_active":"2023-10-16T19:57:07.003612+0000","last_became_peered":"2023-10-16T19:57:07.003612+0000","last_unstale":"2023-10-16T19:57:07.994884+0000","last_undegraded":"2023-10-16T19:57:07.994884+0000","last_fullsized":"2023-10-16T19:57:07.994884+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:57:05.971386+0000","last_clean_scrub_stamp":"2023-10-16T19:57:05.971386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:51:44.836184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":650,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194661,"statfs":{"total":200000000,"available":199333641,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44600000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60699999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36199999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41099999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":75,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195237,"statfs":{"total":200000000,"available":199922979,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33400000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42799999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38100000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36299999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41099999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":73,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195238,"statfs":{"total":200000000,"available":199924431,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35799999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45700000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83799999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79800000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73199999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90000000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":650,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194661,"statfs":{"total":200000000,"available":199333585,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34000000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59099999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55500000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60699999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":13,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":73,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195238,"statfs":{"total":200000000,"available":199924591,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40799999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47199999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45000000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83299999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67600000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69199999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81999999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":75,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195237,"statfs":{"total":200000000,"available":199922979,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27900000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29299999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33700000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44700000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42199999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48399999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":73,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195238,"statfs":{"total":200000000,"available":199924465,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.373}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44400000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66200000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59899999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42299999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":73,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195238,"statfs":{"total":200000000,"available":199924501,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44700000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38600000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36299999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60299999999999998}]}]}],"pool_statfs":[]}} 2023-10-16T19:57:20.744 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-10-16T19:57:20.744 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-10-16T19:57:20.745 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-10-16T19:57:20.745 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-16T19:57:20.897 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.895+0000 7f7bb4067700 1 Processor -- start 2023-10-16T19:57:20.898 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.895+0000 7f7bb4067700 1 -- start start 2023-10-16T19:57:20.900 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.896+0000 7f7bb4067700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7bac0b2710 0x7f7bac0b2b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:20.900 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.896+0000 7f7bb4067700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f7bac071080 0x7f7bac071510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:20.900 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.896+0000 7f7bb4067700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7bac06e180 con 0x7f7bac143bd0 2023-10-16T19:57:20.900 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.896+0000 7f7bb4067700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7bac0b30d0 con 0x7f7bac071080 2023-10-16T19:57:20.901 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.896+0000 7f7bb4067700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bac071a50 con 0x7f7bac0b2710 2023-10-16T19:57:20.901 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.897+0000 7f7bb1e03700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f7bac143bd0 0x7f7bac0cef80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:55822/0 (socket says 172.21.15.157:55822) 2023-10-16T19:57:20.901 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.897+0000 7f7bb1e03700 1 -- 172.21.15.157:0/3123629059 learned_addr learned my addr 172.21.15.157:0/3123629059 (peer_addr_for_me v1:172.21.15.157:0/0) 2023-10-16T19:57:20.901 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.897+0000 7f7bb2604700 1 --2- 172.21.15.157:0/3123629059 >> v2:172.21.15.187:3300/0 conn(0x7f7bac071080 0x7f7bac071510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:20.901 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.897+0000 7f7bb1602700 1 --2- 172.21.15.157:0/3123629059 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7bac0b2710 0x7f7bac0b2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:20.902 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.897+0000 7f7bb1602700 1 -- 172.21.15.157:0/3123629059 >> v2:172.21.15.187:3300/0 conn(0x7f7bac071080 msgr2=0x7f7bac071510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:57:20.902 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.897+0000 7f7bb1602700 1 --2- 172.21.15.157:0/3123629059 >> v2:172.21.15.187:3300/0 conn(0x7f7bac071080 0x7f7bac071510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:20.902 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.897+0000 7f7bb1602700 1 -- 172.21.15.157:0/3123629059 >> v1:172.21.15.157:6789/0 conn(0x7f7bac143bd0 legacy=0x7f7bac0cef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:20.905 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.897+0000 7f7bb0e01700 1 -- 172.21.15.157:0/3123629059 <== mon.0 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4004472451 0 0) 0x7f7bac06e180 con 0x7f7bac143bd0 2023-10-16T19:57:20.905 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.897+0000 7f7bb1602700 1 -- 172.21.15.157:0/3123629059 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bac144480 con 0x7f7bac0b2710 2023-10-16T19:57:20.905 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.897+0000 7f7bb1602700 1 --2- 172.21.15.157:0/3123629059 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7bac0b2710 0x7f7bac0b2b90 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f7b9c009840 tx=0x7f7b9c009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7099bf103938265e server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:20.905 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.898+0000 7f7bb0e01700 1 -- 172.21.15.157:0/3123629059 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b9c011830 con 0x7f7bac0b2710 2023-10-16T19:57:20.906 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.898+0000 7f7bb0e01700 1 -- 172.21.15.157:0/3123629059 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b9c011990 con 0x7f7bac0b2710 2023-10-16T19:57:20.906 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.898+0000 7f7bb0e01700 1 -- 172.21.15.157:0/3123629059 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b9c011d20 con 0x7f7bac0b2710 2023-10-16T19:57:20.910 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.898+0000 7f7bb4067700 1 -- 172.21.15.157:0/3123629059 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7bac0b2710 msgr2=0x7f7bac0b2b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:20.910 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.898+0000 7f7bb4067700 1 --2- 172.21.15.157:0/3123629059 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7bac0b2710 0x7f7bac0b2b90 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f7b9c009840 tx=0x7f7b9c009b50 comp rx=0 tx=0).stop 2023-10-16T19:57:20.910 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.898+0000 7f7bb4067700 1 -- 172.21.15.157:0/3123629059 shutdown_connections 2023-10-16T19:57:20.910 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.898+0000 7f7bb4067700 1 --2- 172.21.15.157:0/3123629059 >> v2:172.21.15.187:3300/0 conn(0x7f7bac071080 0x7f7bac071510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:20.910 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.898+0000 7f7bb4067700 1 --2- 172.21.15.157:0/3123629059 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7bac0b2710 0x7f7bac0b2b90 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:20.911 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.898+0000 7f7bb4067700 1 -- 172.21.15.157:0/3123629059 >> 172.21.15.157:0/3123629059 conn(0x7f7bac0d0b30 msgr2=0x7f7bac0d0f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:20.911 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.899+0000 7f7bb4067700 1 -- 172.21.15.157:0/3123629059 shutdown_connections 2023-10-16T19:57:20.911 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.899+0000 7f7bb4067700 1 -- 172.21.15.157:0/3123629059 wait complete. 2023-10-16T19:57:20.911 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.900+0000 7f7bb4067700 1 Processor -- start 2023-10-16T19:57:20.912 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.900+0000 7f7bb4067700 1 -- start start 2023-10-16T19:57:20.912 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.900+0000 7f7bb4067700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7bac071080 0x7f7bac0c85e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:20.912 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.901+0000 7f7bb4067700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7bac0b2710 0x7f7bac1f0da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:20.912 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.901+0000 7f7bb4067700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7bac143bd0 0x7f7bac137140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:20.912 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.901+0000 7f7bb4067700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bac0c8b20 con 0x7f7bac071080 2023-10-16T19:57:20.913 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.901+0000 7f7bb4067700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bac1f12e0 con 0x7f7bac143bd0 2023-10-16T19:57:20.913 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.901+0000 7f7bb4067700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bac137680 con 0x7f7bac0b2710 2023-10-16T19:57:20.913 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.901+0000 7f7bb1e03700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7bac071080 0x7f7bac0c85e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:20.913 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.901+0000 7f7bb1e03700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7bac071080 0x7f7bac0c85e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:46156/0 (socket says 172.21.15.157:46156) 2023-10-16T19:57:20.913 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.901+0000 7f7bb1e03700 1 -- 172.21.15.157:0/4267930976 learned_addr learned my addr 172.21.15.157:0/4267930976 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:57:20.914 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.901+0000 7f7bb1602700 1 --2- 172.21.15.157:0/4267930976 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7bac0b2710 0x7f7bac1f0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:20.914 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.901+0000 7f7bb2604700 1 --2- 172.21.15.157:0/4267930976 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7bac143bd0 0x7f7bac137140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:20.914 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.901+0000 7f7bb1e03700 1 -- 172.21.15.157:0/4267930976 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7bac0b2710 msgr2=0x7f7bac1f0da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:20.914 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.901+0000 7f7bb1e03700 1 --2- 172.21.15.157:0/4267930976 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7bac0b2710 0x7f7bac1f0da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:20.914 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.901+0000 7f7bb1e03700 1 -- 172.21.15.157:0/4267930976 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7bac143bd0 msgr2=0x7f7bac137140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:20.915 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.901+0000 7f7bb1e03700 1 --2- 172.21.15.157:0/4267930976 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7bac143bd0 0x7f7bac137140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:20.915 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.901+0000 7f7bb1e03700 1 -- 172.21.15.157:0/4267930976 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b9c0094a0 con 0x7f7bac071080 2023-10-16T19:57:20.915 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.901+0000 7f7bb1e03700 1 --2- 172.21.15.157:0/4267930976 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7bac071080 0x7f7bac0c85e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f7ba800c750 tx=0x7f7ba800ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:20.915 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.901+0000 7f7ba27fc700 1 -- 172.21.15.157:0/4267930976 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ba8004c80 con 0x7f7bac071080 2023-10-16T19:57:20.915 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.901+0000 7f7ba27fc700 1 -- 172.21.15.157:0/4267930976 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ba8004e00 con 0x7f7bac071080 2023-10-16T19:57:20.915 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.901+0000 7f7bb4067700 1 -- 172.21.15.157:0/4267930976 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bac137900 con 0x7f7bac071080 2023-10-16T19:57:20.916 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.901+0000 7f7ba27fc700 1 -- 172.21.15.157:0/4267930976 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ba8007310 con 0x7f7bac071080 2023-10-16T19:57:20.916 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.901+0000 7f7bb4067700 1 -- 172.21.15.157:0/4267930976 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bac137ec0 con 0x7f7bac071080 2023-10-16T19:57:20.916 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.902+0000 7f7bb4067700 1 -- 172.21.15.157:0/4267930976 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bac0c8c60 con 0x7f7bac071080 2023-10-16T19:57:20.916 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.903+0000 7f7ba27fc700 1 -- 172.21.15.157:0/4267930976 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f7ba8007470 con 0x7f7bac071080 2023-10-16T19:57:20.916 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.903+0000 7f7ba27fc700 1 --2- 172.21.15.157:0/4267930976 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f7b9006af00 0x7f7b9006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:20.917 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.903+0000 7f7ba27fc700 1 -- 172.21.15.157:0/4267930976 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7ba8089200 con 0x7f7bac071080 2023-10-16T19:57:20.917 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.903+0000 7f7bb1602700 1 --2- 172.21.15.157:0/4267930976 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f7b9006af00 0x7f7b9006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:20.917 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.904+0000 7f7bb1602700 1 --2- 172.21.15.157:0/4267930976 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f7b9006af00 0x7f7b9006d3c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f7b9c009fd0 tx=0x7f7b9c008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:20.917 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:20.908+0000 7f7ba27fc700 1 -- 172.21.15.157:0/4267930976 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7ba80542b0 con 0x7f7bac071080 2023-10-16T19:57:21.144 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.142+0000 7f7bb4067700 1 -- 172.21.15.157:0/4267930976 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f7bac04f400 con 0x7f7bac071080 2023-10-16T19:57:21.145 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.142+0000 7f7ba27fc700 1 -- 172.21.15.157:0/4267930976 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f7ba80578d0 con 0x7f7bac071080 2023-10-16T19:57:21.145 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-10-16T19:57:21.145 INFO:teuthology.orchestra.run.smithi157.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-10-16T19:57:21.147 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.144+0000 7f7bb4067700 1 -- 172.21.15.157:0/4267930976 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f7b9006af00 msgr2=0x7f7b9006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:21.147 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.144+0000 7f7bb4067700 1 --2- 172.21.15.157:0/4267930976 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f7b9006af00 0x7f7b9006d3c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f7b9c009fd0 tx=0x7f7b9c008030 comp rx=0 tx=0).stop 2023-10-16T19:57:21.147 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.144+0000 7f7bb4067700 1 -- 172.21.15.157:0/4267930976 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7bac071080 msgr2=0x7f7bac0c85e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:21.148 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.144+0000 7f7bb4067700 1 --2- 172.21.15.157:0/4267930976 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7bac071080 0x7f7bac0c85e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f7ba800c750 tx=0x7f7ba800ca60 comp rx=0 tx=0).stop 2023-10-16T19:57:21.148 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.144+0000 7f7bb4067700 1 -- 172.21.15.157:0/4267930976 shutdown_connections 2023-10-16T19:57:21.148 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.144+0000 7f7bb4067700 1 --2- 172.21.15.157:0/4267930976 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f7b9006af00 0x7f7b9006d3c0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:21.148 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.144+0000 7f7bb4067700 1 --2- 172.21.15.157:0/4267930976 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7bac143bd0 0x7f7bac137140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:21.148 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.144+0000 7f7bb4067700 1 --2- 172.21.15.157:0/4267930976 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7bac071080 0x7f7bac0c85e0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:21.149 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.144+0000 7f7bb4067700 1 --2- 172.21.15.157:0/4267930976 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7bac0b2710 0x7f7bac1f0da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:21.149 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.144+0000 7f7bb4067700 1 -- 172.21.15.157:0/4267930976 >> 172.21.15.157:0/4267930976 conn(0x7f7bac0d0b30 msgr2=0x7f7bac0b1460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:21.149 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.144+0000 7f7bb4067700 1 -- 172.21.15.157:0/4267930976 shutdown_connections 2023-10-16T19:57:21.149 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.144+0000 7f7bb4067700 1 -- 172.21.15.157:0/4267930976 wait complete. 2023-10-16T19:57:21.159 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-10-16T19:57:21.160 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T19:57:21.281 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.278+0000 7fc6a112a700 1 Processor -- start 2023-10-16T19:57:21.281 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.278+0000 7fc6a112a700 1 -- start start 2023-10-16T19:57:21.285 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.279+0000 7fc6a112a700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fc69c15bf50 0x7fc69c0cef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:21.285 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.279+0000 7fc6a112a700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc69c0cdf80 0x7fc69c0d0e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:21.285 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.279+0000 7fc6a112a700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc69c0cf920 con 0x7fc69c0b76e0 2023-10-16T19:57:21.285 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.279+0000 7fc6a112a700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc69c0cc4b0 con 0x7fc69c15bf50 2023-10-16T19:57:21.285 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.279+0000 7fc6a112a700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc69c0cfc00 con 0x7fc69c0cdf80 2023-10-16T19:57:21.286 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.279+0000 7fc69a59c700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7fc69c0b76e0 0x7fc69c0cd870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:55836/0 (socket says 172.21.15.157:55836) 2023-10-16T19:57:21.286 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.279+0000 7fc69a59c700 1 -- 172.21.15.157:0/2629300940 learned_addr learned my addr 172.21.15.157:0/2629300940 (peer_addr_for_me v1:172.21.15.157:0/0) 2023-10-16T19:57:21.286 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.279+0000 7fc69b59e700 1 --2- 172.21.15.157:0/2629300940 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc69c0cdf80 0x7fc69c0d0e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:21.286 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.279+0000 7fc69ad9d700 1 --2- 172.21.15.157:0/2629300940 >> v2:172.21.15.187:3300/0 conn(0x7fc69c15bf50 0x7fc69c0cef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:21.286 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.279+0000 7fc699d9b700 1 -- 172.21.15.157:0/2629300940 <== mon.0 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2317230347 0 0) 0x7fc69c0cf920 con 0x7fc69c0b76e0 2023-10-16T19:57:21.287 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.280+0000 7fc699d9b700 1 -- 172.21.15.157:0/2629300940 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc6840035b0 con 0x7fc69c0b76e0 2023-10-16T19:57:21.287 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.280+0000 7fc699d9b700 1 -- 172.21.15.157:0/2629300940 <== mon.0 v1:172.21.15.157:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3649178316 0 0) 0x7fc6840035b0 con 0x7fc69c0b76e0 2023-10-16T19:57:21.287 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.280+0000 7fc699d9b700 1 -- 172.21.15.157:0/2629300940 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc69c0cdf80 msgr2=0x7fc69c0d0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:57:21.287 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.280+0000 7fc699d9b700 1 --2- 172.21.15.157:0/2629300940 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc69c0cdf80 0x7fc69c0d0e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:21.287 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.280+0000 7fc699d9b700 1 -- 172.21.15.157:0/2629300940 >> v2:172.21.15.187:3300/0 conn(0x7fc69c15bf50 msgr2=0x7fc69c0cef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:57:21.288 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.280+0000 7fc699d9b700 1 --2- 172.21.15.157:0/2629300940 >> v2:172.21.15.187:3300/0 conn(0x7fc69c15bf50 0x7fc69c0cef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:21.288 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.280+0000 7fc699d9b700 1 -- 172.21.15.157:0/2629300940 --> v1:172.21.15.157:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc69c0cfee0 con 0x7fc69c0b76e0 2023-10-16T19:57:21.288 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.280+0000 7fc699d9b700 1 -- 172.21.15.157:0/2629300940 <== mon.0 v1:172.21.15.157:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4021145519 0 0) 0x7fc68c001670 con 0x7fc69c0b76e0 2023-10-16T19:57:21.288 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.280+0000 7fc699d9b700 1 -- 172.21.15.157:0/2629300940 >> v1:172.21.15.157:6789/0 conn(0x7fc69c0b76e0 legacy=0x7fc69c0cd870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:21.288 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.280+0000 7fc699d9b700 1 --2- 172.21.15.157:0/2629300940 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc69c0cdf80 0x7fc684003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:21.289 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.280+0000 7fc699d9b700 1 --2- 172.21.15.157:0/2629300940 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc684003f80 0x7fc684004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:21.289 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.280+0000 7fc699d9b700 1 --2- 172.21.15.157:0/2629300940 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc684004d90 0x7fc684005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:21.289 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.280+0000 7fc699d9b700 1 -- 172.21.15.157:0/2629300940 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc69c0cc4b0 con 0x7fc684004d90 2023-10-16T19:57:21.289 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.280+0000 7fc699d9b700 1 -- 172.21.15.157:0/2629300940 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc69c0cfc00 con 0x7fc684003f80 2023-10-16T19:57:21.289 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.280+0000 7fc699d9b700 1 -- 172.21.15.157:0/2629300940 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc68400ba10 con 0x7fc69c0cdf80 2023-10-16T19:57:21.290 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.280+0000 7fc69b59e700 1 --2- 172.21.15.157:0/2629300940 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc684004d90 0x7fc684005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:21.290 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.280+0000 7fc69ad9d700 1 --2- 172.21.15.157:0/2629300940 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc69c0cdf80 0x7fc684003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:21.290 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.280+0000 7fc69a59c700 1 --2- 172.21.15.157:0/2629300940 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc684003f80 0x7fc684004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:21.290 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.280+0000 7fc69b59e700 1 -- 172.21.15.157:0/2629300940 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc69c0cdf80 msgr2=0x7fc684003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:57:21.290 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.280+0000 7fc69b59e700 1 --2- 172.21.15.157:0/2629300940 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc69c0cdf80 0x7fc684003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:21.291 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.280+0000 7fc69b59e700 1 -- 172.21.15.157:0/2629300940 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc684003f80 msgr2=0x7fc684004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:57:21.291 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.280+0000 7fc69b59e700 1 --2- 172.21.15.157:0/2629300940 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc684003f80 0x7fc684004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:21.291 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.280+0000 7fc69b59e700 1 -- 172.21.15.157:0/2629300940 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6840035b0 con 0x7fc684004d90 2023-10-16T19:57:21.291 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.280+0000 7fc69b59e700 1 --2- 172.21.15.157:0/2629300940 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc684004d90 0x7fc684005210 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fc694009fc0 tx=0x7fc684005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=105bca0132e739b8 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:21.291 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.280+0000 7fc699d9b700 1 -- 172.21.15.157:0/2629300940 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc69400ebd0 con 0x7fc684004d90 2023-10-16T19:57:21.291 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.281+0000 7fc699d9b700 1 -- 172.21.15.157:0/2629300940 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc69400f040 con 0x7fc684004d90 2023-10-16T19:57:21.292 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.281+0000 7fc699d9b700 1 -- 172.21.15.157:0/2629300940 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc694014480 con 0x7fc684004d90 2023-10-16T19:57:21.292 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.281+0000 7fc6a112a700 1 -- 172.21.15.157:0/2629300940 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc684004d90 msgr2=0x7fc684005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:21.292 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.281+0000 7fc6a112a700 1 --2- 172.21.15.157:0/2629300940 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc684004d90 0x7fc684005210 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fc694009fc0 tx=0x7fc684005880 comp rx=0 tx=0).stop 2023-10-16T19:57:21.292 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.281+0000 7fc69b59e700 1 -- 172.21.15.157:0/2629300940 reap_dead start 2023-10-16T19:57:21.292 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.281+0000 7fc6a112a700 1 -- 172.21.15.157:0/2629300940 shutdown_connections 2023-10-16T19:57:21.293 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.281+0000 7fc6a112a700 1 -- 172.21.15.157:0/2629300940 >> 172.21.15.157:0/2629300940 conn(0x7fc69c06e300 msgr2=0x7fc69c06e6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:21.293 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.281+0000 7fc6a112a700 1 -- 172.21.15.157:0/2629300940 shutdown_connections 2023-10-16T19:57:21.293 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.281+0000 7fc6a112a700 1 -- 172.21.15.157:0/2629300940 wait complete. 2023-10-16T19:57:21.296 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.283+0000 7fc6a112a700 1 Processor -- start 2023-10-16T19:57:21.296 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.283+0000 7fc6a112a700 1 -- start start 2023-10-16T19:57:21.296 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.284+0000 7fc6a112a700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc69c157b50 0x7fc69c15d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:21.296 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.284+0000 7fc6a112a700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc69c0c80d0 0x7fc69c1560d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:21.296 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.284+0000 7fc6a112a700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc69c157f30 0x7fc69c156610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:21.297 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.284+0000 7fc6a112a700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc69c15e0e0 con 0x7fc69c157b50 2023-10-16T19:57:21.297 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.284+0000 7fc6a112a700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc69c15e3c0 con 0x7fc69c0c80d0 2023-10-16T19:57:21.297 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.284+0000 7fc6a112a700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc69c15e6a0 con 0x7fc69c157f30 2023-10-16T19:57:21.297 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.284+0000 7fc69ad9d700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc69c157b50 0x7fc69c15d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:21.297 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.284+0000 7fc69ad9d700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc69c157b50 0x7fc69c15d7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:46176/0 (socket says 172.21.15.157:46176) 2023-10-16T19:57:21.298 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.284+0000 7fc69ad9d700 1 -- 172.21.15.157:0/821996176 learned_addr learned my addr 172.21.15.157:0/821996176 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:57:21.298 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.284+0000 7fc69b59e700 1 --2- 172.21.15.157:0/821996176 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc69c157f30 0x7fc69c156610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:21.298 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.284+0000 7fc69a59c700 1 --2- 172.21.15.157:0/821996176 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc69c0c80d0 0x7fc69c1560d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:21.298 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.284+0000 7fc69ad9d700 1 -- 172.21.15.157:0/821996176 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc69c157f30 msgr2=0x7fc69c156610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:21.298 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.284+0000 7fc69ad9d700 1 --2- 172.21.15.157:0/821996176 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc69c157f30 0x7fc69c156610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:21.299 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.284+0000 7fc69ad9d700 1 -- 172.21.15.157:0/821996176 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc69c0c80d0 msgr2=0x7fc69c1560d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:21.299 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.284+0000 7fc69ad9d700 1 --2- 172.21.15.157:0/821996176 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc69c0c80d0 0x7fc69c1560d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:21.299 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.284+0000 7fc69ad9d700 1 -- 172.21.15.157:0/821996176 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc69c15e980 con 0x7fc69c157b50 2023-10-16T19:57:21.299 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.284+0000 7fc69b59e700 1 --2- 172.21.15.157:0/821996176 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc69c157f30 0x7fc69c156610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T19:57:21.299 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.284+0000 7fc69a59c700 1 --2- 172.21.15.157:0/821996176 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc69c0c80d0 0x7fc69c1560d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T19:57:21.300 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.284+0000 7fc69ad9d700 1 --2- 172.21.15.157:0/821996176 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc69c157b50 0x7fc69c15d7e0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fc690011aa0 tx=0x7fc690011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:21.300 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.285+0000 7fc6837fe700 1 -- 172.21.15.157:0/821996176 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc69000f9e0 con 0x7fc69c157b50 2023-10-16T19:57:21.300 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.285+0000 7fc6837fe700 1 -- 172.21.15.157:0/821996176 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc69000fb40 con 0x7fc69c157b50 2023-10-16T19:57:21.300 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.285+0000 7fc6837fe700 1 -- 172.21.15.157:0/821996176 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc690014440 con 0x7fc69c157b50 2023-10-16T19:57:21.300 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.285+0000 7fc6a112a700 1 -- 172.21.15.157:0/821996176 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc69c15ec60 con 0x7fc69c157b50 2023-10-16T19:57:21.301 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.285+0000 7fc6a112a700 1 -- 172.21.15.157:0/821996176 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc69c15c330 con 0x7fc69c157b50 2023-10-16T19:57:21.301 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.286+0000 7fc6a112a700 1 -- 172.21.15.157:0/821996176 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc69c04f400 con 0x7fc69c157b50 2023-10-16T19:57:21.301 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.286+0000 7fc6837fe700 1 -- 172.21.15.157:0/821996176 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fc6900145a0 con 0x7fc69c157b50 2023-10-16T19:57:21.301 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.286+0000 7fc6837fe700 1 --2- 172.21.15.157:0/821996176 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fc68806af00 0x7fc68806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:21.301 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.286+0000 7fc6837fe700 1 -- 172.21.15.157:0/821996176 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc690089dd0 con 0x7fc69c157b50 2023-10-16T19:57:21.301 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.287+0000 7fc69a59c700 1 --2- 172.21.15.157:0/821996176 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fc68806af00 0x7fc68806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:21.302 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.287+0000 7fc69a59c700 1 --2- 172.21.15.157:0/821996176 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fc68806af00 0x7fc68806d3c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fc69c0c8510 tx=0x7fc68c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:21.302 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.291+0000 7fc6837fe700 1 -- 172.21.15.157:0/821996176 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc690054e80 con 0x7fc69c157b50 2023-10-16T19:57:21.482 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.480+0000 7fc6a112a700 1 -- 172.21.15.157:0/821996176 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc69c158790 con 0x7fc69c157b50 2023-10-16T19:57:21.483 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.481+0000 7fc6837fe700 1 -- 172.21.15.157:0/821996176 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16517 (secure 0 0 0) 0x7fc6900584a0 con 0x7fc69c157b50 2023-10-16T19:57:21.484 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-10-16T19:57:21.484 INFO:teuthology.orchestra.run.smithi157.stdout:{"epoch":21,"fsid":"28199dc9-64d5-479e-83c6-21f097c33d39","created":"2023-10-16T19:56:49.201889+0000","modified":"2023-10-16T19:57:07.988567+0000","last_up_change":"2023-10-16T19:56:54.675673+0000","last_in_change":"2023-10-16T19:56:51.666728+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T19:56:56.932895+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-16T19:57:04.936105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-16T19:57:05.335279+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":335785898},{"type":"v1","addr":"172.21.15.157:6809","nonce":335785898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":335785898},{"type":"v1","addr":"172.21.15.157:6811","nonce":335785898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6815","nonce":335785898},{"type":"v1","addr":"172.21.15.157:6817","nonce":335785898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":335785898},{"type":"v1","addr":"172.21.15.157:6813","nonce":335785898}]},"public_addr":"172.21.15.157:6809/335785898","cluster_addr":"172.21.15.157:6811/335785898","heartbeat_back_addr":"172.21.15.157:6817/335785898","heartbeat_front_addr":"172.21.15.157:6813/335785898","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":3482825047},{"type":"v1","addr":"172.21.15.157:6801","nonce":3482825047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":3482825047},{"type":"v1","addr":"172.21.15.157:6803","nonce":3482825047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":3482825047},{"type":"v1","addr":"172.21.15.157:6807","nonce":3482825047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":3482825047},{"type":"v1","addr":"172.21.15.157:6805","nonce":3482825047}]},"public_addr":"172.21.15.157:6801/3482825047","cluster_addr":"172.21.15.157:6803/3482825047","heartbeat_back_addr":"172.21.15.157:6807/3482825047","heartbeat_front_addr":"172.21.15.157:6805/3482825047","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":1118292389},{"type":"v1","addr":"172.21.15.157:6825","nonce":1118292389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":1118292389},{"type":"v1","addr":"172.21.15.157:6827","nonce":1118292389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":1118292389},{"type":"v1","addr":"172.21.15.157:6831","nonce":1118292389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":1118292389},{"type":"v1","addr":"172.21.15.157:6829","nonce":1118292389}]},"public_addr":"172.21.15.157:6825/1118292389","cluster_addr":"172.21.15.157:6827/1118292389","heartbeat_back_addr":"172.21.15.157:6831/1118292389","heartbeat_front_addr":"172.21.15.157:6829/1118292389","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":989329821},{"type":"v1","addr":"172.21.15.157:6816","nonce":989329821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":989329821},{"type":"v1","addr":"172.21.15.157:6819","nonce":989329821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":989329821},{"type":"v1","addr":"172.21.15.157:6823","nonce":989329821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":989329821},{"type":"v1","addr":"172.21.15.157:6821","nonce":989329821}]},"public_addr":"172.21.15.157:6816/989329821","cluster_addr":"172.21.15.157:6819/989329821","heartbeat_back_addr":"172.21.15.157:6823/989329821","heartbeat_front_addr":"172.21.15.157:6821/989329821","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":3841016811},{"type":"v1","addr":"172.21.15.187:6801","nonce":3841016811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6803","nonce":3841016811},{"type":"v1","addr":"172.21.15.187:6804","nonce":3841016811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6809","nonce":3841016811},{"type":"v1","addr":"172.21.15.187:6811","nonce":3841016811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":3841016811},{"type":"v1","addr":"172.21.15.187:6808","nonce":3841016811}]},"public_addr":"172.21.15.187:6801/3841016811","cluster_addr":"172.21.15.187:6804/3841016811","heartbeat_back_addr":"172.21.15.187:6811/3841016811","heartbeat_front_addr":"172.21.15.187:6808/3841016811","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":915130263},{"type":"v1","addr":"172.21.15.187:6805","nonce":915130263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6807","nonce":915130263},{"type":"v1","addr":"172.21.15.187:6810","nonce":915130263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":915130263},{"type":"v1","addr":"172.21.15.187:6815","nonce":915130263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":915130263},{"type":"v1","addr":"172.21.15.187:6813","nonce":915130263}]},"public_addr":"172.21.15.187:6805/915130263","cluster_addr":"172.21.15.187:6810/915130263","heartbeat_back_addr":"172.21.15.187:6815/915130263","heartbeat_front_addr":"172.21.15.187:6813/915130263","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":654976824},{"type":"v1","addr":"172.21.15.187:6817","nonce":654976824}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":654976824},{"type":"v1","addr":"172.21.15.187:6819","nonce":654976824}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":654976824},{"type":"v1","addr":"172.21.15.187:6823","nonce":654976824}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":654976824},{"type":"v1","addr":"172.21.15.187:6821","nonce":654976824}]},"public_addr":"172.21.15.187:6817/654976824","cluster_addr":"172.21.15.187:6819/654976824","heartbeat_back_addr":"172.21.15.187:6823/654976824","heartbeat_front_addr":"172.21.15.187:6821/654976824","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":4284059445},{"type":"v1","addr":"172.21.15.187:6825","nonce":4284059445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":4284059445},{"type":"v1","addr":"172.21.15.187:6827","nonce":4284059445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":4284059445},{"type":"v1","addr":"172.21.15.187:6831","nonce":4284059445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":4284059445},{"type":"v1","addr":"172.21.15.187:6829","nonce":4284059445}]},"public_addr":"172.21.15.187:6825/4284059445","cluster_addr":"172.21.15.187:6827/4284059445","heartbeat_back_addr":"172.21.15.187:6831/4284059445","heartbeat_front_addr":"172.21.15.187:6829/4284059445","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.819780+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.824193+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.849575+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.824806+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.809540+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.805093+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.866109+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.807372+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T19:57:21.485 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.483+0000 7fc6a112a700 1 -- 172.21.15.157:0/821996176 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fc68806af00 msgr2=0x7fc68806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:21.486 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.483+0000 7fc6a112a700 1 --2- 172.21.15.157:0/821996176 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fc68806af00 0x7fc68806d3c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fc69c0c8510 tx=0x7fc68c009040 comp rx=0 tx=0).stop 2023-10-16T19:57:21.486 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.483+0000 7fc6a112a700 1 -- 172.21.15.157:0/821996176 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc69c157b50 msgr2=0x7fc69c15d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:21.486 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.483+0000 7fc6a112a700 1 --2- 172.21.15.157:0/821996176 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc69c157b50 0x7fc69c15d7e0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fc690011aa0 tx=0x7fc690011e60 comp rx=0 tx=0).stop 2023-10-16T19:57:21.486 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.483+0000 7fc6a112a700 1 -- 172.21.15.157:0/821996176 shutdown_connections 2023-10-16T19:57:21.487 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.483+0000 7fc6a112a700 1 --2- 172.21.15.157:0/821996176 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc69c157f30 0x7fc69c156610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:21.487 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.483+0000 7fc6a112a700 1 --2- 172.21.15.157:0/821996176 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc69c157b50 0x7fc69c15d7e0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:21.487 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.483+0000 7fc6a112a700 1 --2- 172.21.15.157:0/821996176 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fc68806af00 0x7fc68806d3c0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:21.487 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.483+0000 7fc6a112a700 1 --2- 172.21.15.157:0/821996176 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc69c0c80d0 0x7fc69c1560d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:21.487 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.483+0000 7fc6a112a700 1 -- 172.21.15.157:0/821996176 >> 172.21.15.157:0/821996176 conn(0x7fc69c06e300 msgr2=0x7fc69c0d1240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:21.488 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.483+0000 7fc6a112a700 1 -- 172.21.15.157:0/821996176 shutdown_connections 2023-10-16T19:57:21.488 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.483+0000 7fc6a112a700 1 -- 172.21.15.157:0/821996176 wait complete. 2023-10-16T19:57:21.498 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-16T19:56:56.932895+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-16T19:57:04.936105+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-16T19:57:05.335279+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-16T19:57:21.498 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-16T19:57:21.624 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.622+0000 7fb94cf3c700 1 Processor -- start 2023-10-16T19:57:21.625 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.622+0000 7fb94cf3c700 1 -- start start 2023-10-16T19:57:21.628 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.623+0000 7fb94cf3c700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb948143bd0 0x7fb9480cef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:21.629 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.623+0000 7fb94cf3c700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb94806e180 con 0x7fb9480cf4c0 2023-10-16T19:57:21.629 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.623+0000 7fb94cf3c700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb948144480 con 0x7fb9480b2e20 2023-10-16T19:57:21.629 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.623+0000 7fb94cf3c700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb948143fb0 con 0x7fb948143bd0 2023-10-16T19:57:21.629 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.623+0000 7fb945d9b700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7fb9480cf4c0 0x7fb9480b2710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:55856/0 (socket says 172.21.15.157:55856) 2023-10-16T19:57:21.629 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.623+0000 7fb945d9b700 1 -- 172.21.15.157:0/189621520 learned_addr learned my addr 172.21.15.157:0/189621520 (peer_addr_for_me v1:172.21.15.157:0/0) 2023-10-16T19:57:21.630 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.624+0000 7fb94659c700 1 --2- 172.21.15.157:0/189621520 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb948143bd0 0x7fb9480cef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:21.630 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.624+0000 7fb94559a700 1 -- 172.21.15.157:0/189621520 <== mon.0 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2634807730 0 0) 0x7fb94806e180 con 0x7fb9480cf4c0 2023-10-16T19:57:21.630 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.624+0000 7fb94559a700 1 -- 172.21.15.157:0/189621520 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb9300035b0 con 0x7fb9480cf4c0 2023-10-16T19:57:21.630 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.624+0000 7fb94559a700 1 -- 172.21.15.157:0/189621520 <== mon.0 v1:172.21.15.157:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2165117659 0 0) 0x7fb9300035b0 con 0x7fb9480cf4c0 2023-10-16T19:57:21.630 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.624+0000 7fb94559a700 1 -- 172.21.15.157:0/189621520 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb948143bd0 msgr2=0x7fb9480cef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:57:21.631 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.624+0000 7fb94559a700 1 --2- 172.21.15.157:0/189621520 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb948143bd0 0x7fb9480cef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:21.631 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.624+0000 7fb94559a700 1 -- 172.21.15.157:0/189621520 >> v1:172.21.15.187:6789/0 conn(0x7fb9480b2e20 legacy=0x7fb948071080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:21.631 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.624+0000 7fb94559a700 1 -- 172.21.15.157:0/189621520 --> v1:172.21.15.157:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb948071c60 con 0x7fb9480cf4c0 2023-10-16T19:57:21.632 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.624+0000 7fb94559a700 1 -- 172.21.15.157:0/189621520 <== mon.0 v1:172.21.15.157:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4021145519 0 0) 0x7fb938001670 con 0x7fb9480cf4c0 2023-10-16T19:57:21.632 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.624+0000 7fb94659c700 1 --2- 172.21.15.157:0/189621520 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb948143bd0 0x7fb9480cef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T19:57:21.632 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.624+0000 7fb94559a700 1 -- 172.21.15.157:0/189621520 >> v1:172.21.15.157:6789/0 conn(0x7fb9480cf4c0 legacy=0x7fb9480b2710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:21.632 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.624+0000 7fb94559a700 1 --2- 172.21.15.157:0/189621520 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb948143bd0 0x7fb930003a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:21.632 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.624+0000 7fb94559a700 1 --2- 172.21.15.157:0/189621520 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb930003f70 0x7fb930004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:21.633 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.624+0000 7fb94559a700 1 --2- 172.21.15.157:0/189621520 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb930004d90 0x7fb930005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:21.633 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.624+0000 7fb94559a700 1 -- 172.21.15.157:0/189621520 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb948143fb0 con 0x7fb930004d90 2023-10-16T19:57:21.633 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.624+0000 7fb94559a700 1 -- 172.21.15.157:0/189621520 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb93000dcd0 con 0x7fb930003f70 2023-10-16T19:57:21.633 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.624+0000 7fb94559a700 1 -- 172.21.15.157:0/189621520 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb93000de90 con 0x7fb948143bd0 2023-10-16T19:57:21.633 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.624+0000 7fb946d9d700 1 --2- 172.21.15.157:0/189621520 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb930004d90 0x7fb930005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:21.634 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.624+0000 7fb94659c700 1 --2- 172.21.15.157:0/189621520 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb948143bd0 0x7fb930003a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:21.634 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.624+0000 7fb945d9b700 1 --2- 172.21.15.157:0/189621520 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb930003f70 0x7fb930004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:21.634 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.624+0000 7fb946d9d700 1 -- 172.21.15.157:0/189621520 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb948143bd0 msgr2=0x7fb930003a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:57:21.634 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.624+0000 7fb946d9d700 1 --2- 172.21.15.157:0/189621520 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb948143bd0 0x7fb930003a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:21.634 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.624+0000 7fb946d9d700 1 -- 172.21.15.157:0/189621520 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb930003f70 msgr2=0x7fb930004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:57:21.635 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.624+0000 7fb946d9d700 1 --2- 172.21.15.157:0/189621520 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb930003f70 0x7fb930004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:21.635 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.624+0000 7fb946d9d700 1 -- 172.21.15.157:0/189621520 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb93c0094a0 con 0x7fb930004d90 2023-10-16T19:57:21.635 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.624+0000 7fb945d9b700 1 --2- 172.21.15.157:0/189621520 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb930003f70 0x7fb930004850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T19:57:21.635 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.625+0000 7fb946d9d700 1 --2- 172.21.15.157:0/189621520 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb930004d90 0x7fb930005210 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fb94000c190 tx=0x7fb930005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=529ae168a21efd09 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:21.635 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.625+0000 7fb94559a700 1 -- 172.21.15.157:0/189621520 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb940001db0 con 0x7fb930004d90 2023-10-16T19:57:21.635 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.625+0000 7fb94559a700 1 -- 172.21.15.157:0/189621520 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb94000ccd0 con 0x7fb930004d90 2023-10-16T19:57:21.636 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.625+0000 7fb94559a700 1 -- 172.21.15.157:0/189621520 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb940003c40 con 0x7fb930004d90 2023-10-16T19:57:21.636 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.625+0000 7fb94cf3c700 1 -- 172.21.15.157:0/189621520 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb930004d90 msgr2=0x7fb930005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:21.636 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.625+0000 7fb94cf3c700 1 --2- 172.21.15.157:0/189621520 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb930004d90 0x7fb930005210 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fb94000c190 tx=0x7fb930005880 comp rx=0 tx=0).stop 2023-10-16T19:57:21.636 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.625+0000 7fb946d9d700 1 -- 172.21.15.157:0/189621520 reap_dead start 2023-10-16T19:57:21.636 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.625+0000 7fb94cf3c700 1 -- 172.21.15.157:0/189621520 shutdown_connections 2023-10-16T19:57:21.637 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.625+0000 7fb94cf3c700 1 -- 172.21.15.157:0/189621520 >> 172.21.15.157:0/189621520 conn(0x7fb9480d0b30 msgr2=0x7fb9480d0f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:21.637 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.625+0000 7fb94cf3c700 1 -- 172.21.15.157:0/189621520 shutdown_connections 2023-10-16T19:57:21.637 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.625+0000 7fb94cf3c700 1 -- 172.21.15.157:0/189621520 wait complete. 2023-10-16T19:57:21.640 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.627+0000 7fb94cf3c700 1 Processor -- start 2023-10-16T19:57:21.640 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.627+0000 7fb94cf3c700 1 -- start start 2023-10-16T19:57:21.640 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.628+0000 7fb94cf3c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb930004d90 0x7fb948138fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:21.641 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.628+0000 7fb94cf3c700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb9481f2760 0x7fb948136c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:21.641 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.628+0000 7fb94cf3c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb948134be0 0x7fb9480cc0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:21.641 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.628+0000 7fb94cf3c700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb94813a580 con 0x7fb948134be0 2023-10-16T19:57:21.642 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.628+0000 7fb94cf3c700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9480b5480 con 0x7fb930004d90 2023-10-16T19:57:21.642 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.628+0000 7fb94cf3c700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb948137160 con 0x7fb9481f2760 2023-10-16T19:57:21.642 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.628+0000 7fb946d9d700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb948134be0 0x7fb9480cc0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:21.642 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.628+0000 7fb946d9d700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb948134be0 0x7fb9480cc0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:46200/0 (socket says 172.21.15.157:46200) 2023-10-16T19:57:21.642 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.628+0000 7fb946d9d700 1 -- 172.21.15.157:0/1963367079 learned_addr learned my addr 172.21.15.157:0/1963367079 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:57:21.643 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.628+0000 7fb945d9b700 1 --2- 172.21.15.157:0/1963367079 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb9481f2760 0x7fb948136c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:21.643 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.628+0000 7fb94659c700 1 --2- 172.21.15.157:0/1963367079 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb930004d90 0x7fb948138fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:21.643 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.628+0000 7fb946d9d700 1 -- 172.21.15.157:0/1963367079 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb9481f2760 msgr2=0x7fb948136c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:21.643 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.628+0000 7fb946d9d700 1 --2- 172.21.15.157:0/1963367079 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb9481f2760 0x7fb948136c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:21.643 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.628+0000 7fb946d9d700 1 -- 172.21.15.157:0/1963367079 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb930004d90 msgr2=0x7fb948138fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:21.644 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.628+0000 7fb946d9d700 1 --2- 172.21.15.157:0/1963367079 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb930004d90 0x7fb948138fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:21.644 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.628+0000 7fb946d9d700 1 -- 172.21.15.157:0/1963367079 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9481f2d00 con 0x7fb948134be0 2023-10-16T19:57:21.644 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.628+0000 7fb94659c700 1 --2- 172.21.15.157:0/1963367079 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb930004d90 0x7fb948138fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T19:57:21.644 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.628+0000 7fb946d9d700 1 --2- 172.21.15.157:0/1963367079 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb948134be0 0x7fb9480cc0e0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fb940005040 tx=0x7fb9400014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:21.644 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.628+0000 7fb936ffd700 1 -- 172.21.15.157:0/1963367079 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb94000cad0 con 0x7fb948134be0 2023-10-16T19:57:21.645 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.628+0000 7fb936ffd700 1 -- 172.21.15.157:0/1963367079 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb94000ce40 con 0x7fb948134be0 2023-10-16T19:57:21.645 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.628+0000 7fb94cf3c700 1 -- 172.21.15.157:0/1963367079 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9481f2fe0 con 0x7fb948134be0 2023-10-16T19:57:21.645 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.628+0000 7fb936ffd700 1 -- 172.21.15.157:0/1963367079 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb940005520 con 0x7fb948134be0 2023-10-16T19:57:21.645 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.628+0000 7fb94cf3c700 1 -- 172.21.15.157:0/1963367079 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9481f35a0 con 0x7fb948134be0 2023-10-16T19:57:21.645 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.629+0000 7fb94cf3c700 1 -- 172.21.15.157:0/1963367079 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb94804f400 con 0x7fb948134be0 2023-10-16T19:57:21.645 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.630+0000 7fb936ffd700 1 -- 172.21.15.157:0/1963367079 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fb940019070 con 0x7fb948134be0 2023-10-16T19:57:21.646 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.630+0000 7fb936ffd700 1 --2- 172.21.15.157:0/1963367079 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fb92806af00 0x7fb92806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:21.646 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.630+0000 7fb936ffd700 1 -- 172.21.15.157:0/1963367079 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb94008a230 con 0x7fb948134be0 2023-10-16T19:57:21.646 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.630+0000 7fb94659c700 1 --2- 172.21.15.157:0/1963367079 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fb92806af00 0x7fb92806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:21.646 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.631+0000 7fb94659c700 1 --2- 172.21.15.157:0/1963367079 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fb92806af00 0x7fb92806d3c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fb93c009df0 tx=0x7fb93c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:21.646 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.634+0000 7fb936ffd700 1 -- 172.21.15.157:0/1963367079 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb940055490 con 0x7fb948134be0 2023-10-16T19:57:21.826 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.823+0000 7fb94cf3c700 1 -- 172.21.15.157:0/1963367079 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb94806d430 con 0x7fb948134be0 2023-10-16T19:57:21.826 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.824+0000 7fb936ffd700 1 -- 172.21.15.157:0/1963367079 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb940058ab0 con 0x7fb948134be0 2023-10-16T19:57:21.827 INFO:teuthology.orchestra.run.smithi157.stdout:pg_num: 1 2023-10-16T19:57:21.829 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.826+0000 7fb94cf3c700 1 -- 172.21.15.157:0/1963367079 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fb92806af00 msgr2=0x7fb92806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:21.829 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.826+0000 7fb94cf3c700 1 --2- 172.21.15.157:0/1963367079 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fb92806af00 0x7fb92806d3c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fb93c009df0 tx=0x7fb93c008040 comp rx=0 tx=0).stop 2023-10-16T19:57:21.829 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.826+0000 7fb94cf3c700 1 -- 172.21.15.157:0/1963367079 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb948134be0 msgr2=0x7fb9480cc0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:21.830 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.826+0000 7fb94cf3c700 1 --2- 172.21.15.157:0/1963367079 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb948134be0 0x7fb9480cc0e0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fb940005040 tx=0x7fb9400014a0 comp rx=0 tx=0).stop 2023-10-16T19:57:21.830 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.826+0000 7fb94cf3c700 1 -- 172.21.15.157:0/1963367079 shutdown_connections 2023-10-16T19:57:21.830 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.826+0000 7fb94cf3c700 1 --2- 172.21.15.157:0/1963367079 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fb92806af00 0x7fb92806d3c0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:21.830 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.826+0000 7fb94cf3c700 1 --2- 172.21.15.157:0/1963367079 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb930004d90 0x7fb948138fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:21.830 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.826+0000 7fb94cf3c700 1 --2- 172.21.15.157:0/1963367079 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb948134be0 0x7fb9480cc0e0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:21.831 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.826+0000 7fb94cf3c700 1 --2- 172.21.15.157:0/1963367079 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb9481f2760 0x7fb948136c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:21.831 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.826+0000 7fb94cf3c700 1 -- 172.21.15.157:0/1963367079 >> 172.21.15.157:0/1963367079 conn(0x7fb9480d0b30 msgr2=0x7fb94806e510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:21.831 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.826+0000 7fb94cf3c700 1 -- 172.21.15.157:0/1963367079 shutdown_connections 2023-10-16T19:57:21.831 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.826+0000 7fb94cf3c700 1 -- 172.21.15.157:0/1963367079 wait complete. 2023-10-16T19:57:21.841 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-16T19:57:21.963 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.961+0000 7f16a3573700 1 Processor -- start 2023-10-16T19:57:21.964 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.961+0000 7f16a3573700 1 -- start start 2023-10-16T19:57:21.966 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.962+0000 7f16a3573700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f169c15bed0 0x7f169c0b36b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:21.966 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.962+0000 7f16a3573700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f169c0b3bf0 0x7f169c0d0f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:21.966 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.962+0000 7f16a3573700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f169c0d1440 0x7f169c0cf800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:21.966 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.962+0000 7f16a3573700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f169c0b4070 con 0x7f169c15bed0 2023-10-16T19:57:21.967 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.962+0000 7f16a3573700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f169c15c2b0 con 0x7f169c0b3bf0 2023-10-16T19:57:21.967 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.962+0000 7f16a3573700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f169c15f9e0 con 0x7f169c0d1440 2023-10-16T19:57:21.967 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.962+0000 7f16a130f700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f169c15bed0 0x7f169c0b36b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:21.967 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.962+0000 7f16a130f700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f169c15bed0 0x7f169c0b36b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:46204/0 (socket says 172.21.15.157:46204) 2023-10-16T19:57:21.967 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.962+0000 7f16a130f700 1 -- 172.21.15.157:0/1471686692 learned_addr learned my addr 172.21.15.157:0/1471686692 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:57:21.968 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.962+0000 7f16a1b10700 1 --2- 172.21.15.157:0/1471686692 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f169c0d1440 0x7f169c0cf800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:21.968 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.962+0000 7f16a130f700 1 -- 172.21.15.157:0/1471686692 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f169c0d1440 msgr2=0x7f169c0cf800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:57:21.968 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.962+0000 7f16a0b0e700 1 --2- 172.21.15.157:0/1471686692 >> v2:172.21.15.187:3300/0 conn(0x7f169c0b3bf0 0x7f169c0d0f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:21.968 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.962+0000 7f16a130f700 1 --2- 172.21.15.157:0/1471686692 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f169c0d1440 0x7f169c0cf800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:21.968 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.962+0000 7f16a130f700 1 -- 172.21.15.157:0/1471686692 >> v2:172.21.15.187:3300/0 conn(0x7f169c0b3bf0 msgr2=0x7f169c0d0f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:57:21.969 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.962+0000 7f16a130f700 1 --2- 172.21.15.157:0/1471686692 >> v2:172.21.15.187:3300/0 conn(0x7f169c0b3bf0 0x7f169c0d0f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:21.969 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.962+0000 7f16a130f700 1 -- 172.21.15.157:0/1471686692 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f169c15fcc0 con 0x7f169c15bed0 2023-10-16T19:57:21.969 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.962+0000 7f16a0b0e700 1 --2- 172.21.15.157:0/1471686692 >> v2:172.21.15.187:3300/0 conn(0x7f169c0b3bf0 0x7f169c0d0f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T19:57:21.969 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.962+0000 7f16a1b10700 1 --2- 172.21.15.157:0/1471686692 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f169c0d1440 0x7f169c0cf800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T19:57:21.969 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.962+0000 7f16a130f700 1 --2- 172.21.15.157:0/1471686692 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f169c15bed0 0x7f169c0b36b0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f169c067540 tx=0x7f1698009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eba04dbc2421702c server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:21.969 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.962+0000 7f1693fff700 1 -- 172.21.15.157:0/1471686692 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f169800b870 con 0x7f169c15bed0 2023-10-16T19:57:21.970 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.962+0000 7f1693fff700 1 -- 172.21.15.157:0/1471686692 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f169800b9d0 con 0x7f169c15bed0 2023-10-16T19:57:21.970 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.962+0000 7f1693fff700 1 -- 172.21.15.157:0/1471686692 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f169800bd60 con 0x7f169c15bed0 2023-10-16T19:57:21.970 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.963+0000 7f16a3573700 1 -- 172.21.15.157:0/1471686692 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f169c15bed0 msgr2=0x7f169c0b36b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:21.970 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.963+0000 7f16a3573700 1 --2- 172.21.15.157:0/1471686692 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f169c15bed0 0x7f169c0b36b0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f169c067540 tx=0x7f1698009bd0 comp rx=0 tx=0).stop 2023-10-16T19:57:21.970 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.963+0000 7f16a3573700 1 -- 172.21.15.157:0/1471686692 shutdown_connections 2023-10-16T19:57:21.971 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.963+0000 7f16a3573700 1 --2- 172.21.15.157:0/1471686692 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f169c0d1440 0x7f169c0cf800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:21.971 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.963+0000 7f16a3573700 1 --2- 172.21.15.157:0/1471686692 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f169c15bed0 0x7f169c0b36b0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:21.971 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.963+0000 7f16a3573700 1 --2- 172.21.15.157:0/1471686692 >> v2:172.21.15.187:3300/0 conn(0x7f169c0b3bf0 0x7f169c0d0f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:21.971 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.963+0000 7f16a3573700 1 -- 172.21.15.157:0/1471686692 >> 172.21.15.157:0/1471686692 conn(0x7f169c0ce6b0 msgr2=0x7f169c0ceac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:21.971 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.963+0000 7f16a3573700 1 -- 172.21.15.157:0/1471686692 shutdown_connections 2023-10-16T19:57:21.972 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.963+0000 7f16a3573700 1 -- 172.21.15.157:0/1471686692 wait complete. 2023-10-16T19:57:21.974 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.964+0000 7f16a3573700 1 Processor -- start 2023-10-16T19:57:21.974 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.964+0000 7f16a3573700 1 -- start start 2023-10-16T19:57:21.975 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.965+0000 7f16a3573700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f169c0b3bf0 0x7f169c149460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:21.975 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.965+0000 7f16a3573700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f169c0d1440 0x7f169c0cfe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:21.975 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.965+0000 7f16a3573700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f169c15bed0 0x7f169c0d03a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:21.975 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.965+0000 7f16a3573700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f169c155bf0 con 0x7f169c0b3bf0 2023-10-16T19:57:21.975 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.965+0000 7f16a3573700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f169c0cbc70 con 0x7f169c0d1440 2023-10-16T19:57:21.976 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.965+0000 7f16a3573700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f169c0cb990 con 0x7f169c15bed0 2023-10-16T19:57:21.976 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.965+0000 7f16a130f700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f169c0b3bf0 0x7f169c149460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:21.976 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.965+0000 7f16a130f700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f169c0b3bf0 0x7f169c149460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:46210/0 (socket says 172.21.15.157:46210) 2023-10-16T19:57:21.976 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.965+0000 7f16a130f700 1 -- 172.21.15.157:0/3210845555 learned_addr learned my addr 172.21.15.157:0/3210845555 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:57:21.976 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.965+0000 7f16a130f700 1 -- 172.21.15.157:0/3210845555 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f169c15bed0 msgr2=0x7f169c0d03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:21.977 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.965+0000 7f16a130f700 1 --2- 172.21.15.157:0/3210845555 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f169c15bed0 0x7f169c0d03a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:21.977 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.965+0000 7f16a130f700 1 -- 172.21.15.157:0/3210845555 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f169c0d1440 msgr2=0x7f169c0cfe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:21.977 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.965+0000 7f16a130f700 1 --2- 172.21.15.157:0/3210845555 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f169c0d1440 0x7f169c0cfe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:21.977 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.965+0000 7f16a130f700 1 -- 172.21.15.157:0/3210845555 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1698009550 con 0x7f169c0b3bf0 2023-10-16T19:57:21.977 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.965+0000 7f16a130f700 1 --2- 172.21.15.157:0/3210845555 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f169c0b3bf0 0x7f169c149460 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f1698014040 tx=0x7f1698004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:21.978 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.966+0000 7f1691ffb700 1 -- 172.21.15.157:0/3210845555 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1698004520 con 0x7f169c0b3bf0 2023-10-16T19:57:21.978 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.966+0000 7f1691ffb700 1 -- 172.21.15.157:0/3210845555 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f169801e070 con 0x7f169c0b3bf0 2023-10-16T19:57:21.978 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.966+0000 7f16a3573700 1 -- 172.21.15.157:0/3210845555 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f169c150620 con 0x7f169c0b3bf0 2023-10-16T19:57:21.978 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.966+0000 7f1691ffb700 1 -- 172.21.15.157:0/3210845555 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16980038e0 con 0x7f169c0b3bf0 2023-10-16T19:57:21.978 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.966+0000 7f16a3573700 1 -- 172.21.15.157:0/3210845555 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f169c150be0 con 0x7f169c0b3bf0 2023-10-16T19:57:21.978 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.967+0000 7f16a3573700 1 -- 172.21.15.157:0/3210845555 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f169c06b300 con 0x7f169c0b3bf0 2023-10-16T19:57:21.979 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.967+0000 7f1691ffb700 1 -- 172.21.15.157:0/3210845555 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f1698003a40 con 0x7f169c0b3bf0 2023-10-16T19:57:21.980 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.968+0000 7f1691ffb700 1 --2- 172.21.15.157:0/3210845555 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f168006af00 0x7f168006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:21.980 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.968+0000 7f1691ffb700 1 -- 172.21.15.157:0/3210845555 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1698020070 con 0x7f169c0b3bf0 2023-10-16T19:57:21.980 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.968+0000 7f16a0b0e700 1 --2- 172.21.15.157:0/3210845555 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f168006af00 0x7f168006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:21.981 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.968+0000 7f16a0b0e700 1 --2- 172.21.15.157:0/3210845555 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f168006af00 0x7f168006d3c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f168c006ba0 tx=0x7f168c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:21.981 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:21.972+0000 7f1691ffb700 1 -- 172.21.15.157:0/3210845555 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1698055d20 con 0x7f169c0b3bf0 2023-10-16T19:57:22.164 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:22.162+0000 7f16a3573700 1 -- 172.21.15.157:0/3210845555 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f169c04f400 con 0x7f169c0b3bf0 2023-10-16T19:57:22.165 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:22.162+0000 7f1691ffb700 1 -- 172.21.15.157:0/3210845555 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f16980150a0 con 0x7f169c0b3bf0 2023-10-16T19:57:22.165 INFO:teuthology.orchestra.run.smithi157.stdout:pg_num: 32 2023-10-16T19:57:22.167 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:22.164+0000 7f16a3573700 1 -- 172.21.15.157:0/3210845555 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f168006af00 msgr2=0x7f168006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:22.167 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:22.164+0000 7f16a3573700 1 --2- 172.21.15.157:0/3210845555 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f168006af00 0x7f168006d3c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f168c006ba0 tx=0x7f168c008040 comp rx=0 tx=0).stop 2023-10-16T19:57:22.167 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:22.164+0000 7f16a3573700 1 -- 172.21.15.157:0/3210845555 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f169c0b3bf0 msgr2=0x7f169c149460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:22.168 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:22.164+0000 7f16a3573700 1 --2- 172.21.15.157:0/3210845555 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f169c0b3bf0 0x7f169c149460 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f1698014040 tx=0x7f1698004750 comp rx=0 tx=0).stop 2023-10-16T19:57:22.168 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:22.164+0000 7f16a3573700 1 -- 172.21.15.157:0/3210845555 shutdown_connections 2023-10-16T19:57:22.168 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:22.164+0000 7f16a3573700 1 --2- 172.21.15.157:0/3210845555 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f169c15bed0 0x7f169c0d03a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:22.168 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:22.164+0000 7f16a3573700 1 --2- 172.21.15.157:0/3210845555 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f169c0b3bf0 0x7f169c149460 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:22.168 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:22.164+0000 7f16a3573700 1 --2- 172.21.15.157:0/3210845555 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f168006af00 0x7f168006d3c0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:22.169 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:22.164+0000 7f16a3573700 1 --2- 172.21.15.157:0/3210845555 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f169c0d1440 0x7f169c0cfe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:22.169 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:22.164+0000 7f16a3573700 1 -- 172.21.15.157:0/3210845555 >> 172.21.15.157:0/3210845555 conn(0x7f169c0ce6b0 msgr2=0x7f169c165e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:22.169 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:22.165+0000 7f16a3573700 1 -- 172.21.15.157:0/3210845555 shutdown_connections 2023-10-16T19:57:22.169 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:22.165+0000 7f16a3573700 1 -- 172.21.15.157:0/3210845555 wait complete. 2023-10-16T19:57:22.179 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-16T19:57:22.301 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:22.299+0000 7f18d7920700 1 Processor -- start 2023-10-16T19:57:22.302 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:22.299+0000 7f18d7920700 1 -- start start 2023-10-16T19:57:22.305 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:22.300+0000 7f18d7920700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f18d0143bd0 0x7f18d00cef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:22.306 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:22.300+0000 7f18d7920700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f18d00cf4c0 0x7f18d00b2710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:22.306 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:22.300+0000 7f18d7920700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18d006e180 con 0x7f18d00b2c50 2023-10-16T19:57:22.306 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:22.300+0000 7f18d7920700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18d00b3100 con 0x7f18d0143bd0 2023-10-16T19:57:22.306 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:22.300+0000 7f18d7920700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18d0143fb0 con 0x7f18d00cf4c0 2023-10-16T19:57:22.306 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:22.300+0000 7f18d5ebd700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f18d00b2c50 0x7f18d0071080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:55894/0 (socket says 172.21.15.157:55894) 2023-10-16T19:57:22.307 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:22.300+0000 7f18d5ebd700 1 -- 172.21.15.157:0/2806352994 learned_addr learned my addr 172.21.15.157:0/2806352994 (peer_addr_for_me v1:172.21.15.157:0/0) 2023-10-16T19:57:22.307 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:22.300+0000 7f18d4ebb700 1 --2- 172.21.15.157:0/2806352994 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f18d00cf4c0 0x7f18d00b2710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:22.307 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:22.300+0000 7f18d56bc700 1 --2- 172.21.15.157:0/2806352994 >> v2:172.21.15.187:3300/0 conn(0x7f18d0143bd0 0x7f18d00cef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:22.307 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:22.300+0000 7f18c7fff700 1 -- 172.21.15.157:0/2806352994 <== mon.0 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 432837024 0 0) 0x7f18d006e180 con 0x7f18d00b2c50 2023-10-16T19:57:22.307 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:22.300+0000 7f18c7fff700 1 -- 172.21.15.157:0/2806352994 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f18bc0035b0 con 0x7f18d00b2c50 2023-10-16T19:57:22.308 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:22.301+0000 7f18c7fff700 1 -- 172.21.15.157:0/2806352994 <== mon.0 v1:172.21.15.157:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3399992217 0 0) 0x7f18bc0035b0 con 0x7f18d00b2c50 2023-10-16T19:57:22.308 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:22.301+0000 7f18c7fff700 1 -- 172.21.15.157:0/2806352994 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f18d00cf4c0 msgr2=0x7f18d00b2710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:57:22.309 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:22.301+0000 7f18c7fff700 1 --2- 172.21.15.157:0/2806352994 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f18d00cf4c0 0x7f18d00b2710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:22.309 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:22.301+0000 7f18c7fff700 1 -- 172.21.15.157:0/2806352994 >> v2:172.21.15.187:3300/0 conn(0x7f18d0143bd0 msgr2=0x7f18d00cef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:57:22.309 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:22.301+0000 7f18c7fff700 1 --2- 172.21.15.157:0/2806352994 >> v2:172.21.15.187:3300/0 conn(0x7f18d0143bd0 0x7f18d00cef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:22.309 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:22.301+0000 7f18c7fff700 1 -- 172.21.15.157:0/2806352994 --> v1:172.21.15.157:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18d0144480 con 0x7f18d00b2c50 2023-10-16T19:57:22.309 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:22.301+0000 7f18c7fff700 1 -- 172.21.15.157:0/2806352994 <== mon.0 v1:172.21.15.157:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4021145519 0 0) 0x7f18c80019f0 con 0x7f18d00b2c50 2023-10-16T19:57:22.309 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:22.301+0000 7f18c7fff700 1 -- 172.21.15.157:0/2806352994 >> v1:172.21.15.157:6789/0 conn(0x7f18d00b2c50 legacy=0x7f18d0071080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:22.310 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:22.301+0000 7f18c7fff700 1 --2- 172.21.15.157:0/2806352994 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f18bc003a30 0x7f18bc003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:22.310 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:22.301+0000 7f18c7fff700 1 --2- 172.21.15.157:0/2806352994 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f18d00cf4c0 0x7f18bc004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:22.310 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:22.301+0000 7f18c7fff700 1 --2- 172.21.15.157:0/2806352994 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f18bc004d90 0x7f18bc005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:22.310 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:22.301+0000 7f18c7fff700 1 -- 172.21.15.157:0/2806352994 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18d00b3100 con 0x7f18bc003a30 2023-10-16T19:57:22.311 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:22.301+0000 7f18c7fff700 1 -- 172.21.15.157:0/2806352994 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18d0143fb0 con 0x7f18bc004d90 2023-10-16T19:57:22.311 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:22.301+0000 7f18c7fff700 1 -- 172.21.15.157:0/2806352994 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18bc00ba10 con 0x7f18d00cf4c0 2023-10-16T19:57:22.311 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:22.301+0000 7f18d56bc700 1 --2- 172.21.15.157:0/2806352994 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f18bc003a30 0x7f18bc003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:22.311 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:22.301+0000 7f18d4ebb700 1 --2- 172.21.15.157:0/2806352994 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f18d00cf4c0 0x7f18bc004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:22.311 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:22.301+0000 7f18d5ebd700 1 --2- 172.21.15.157:0/2806352994 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f18bc004d90 0x7f18bc005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:22.311 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:22.301+0000 7f18d56bc700 1 -- 172.21.15.157:0/2806352994 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f18d00cf4c0 msgr2=0x7f18bc004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:57:22.312 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:22.301+0000 7f18d56bc700 1 --2- 172.21.15.157:0/2806352994 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f18d00cf4c0 0x7f18bc004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:22.312 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:22.301+0000 7f18d56bc700 1 -- 172.21.15.157:0/2806352994 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f18bc004d90 msgr2=0x7f18bc005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:57:22.312 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:22.301+0000 7f18d56bc700 1 --2- 172.21.15.157:0/2806352994 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f18bc004d90 0x7f18bc005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:22.312 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:22.301+0000 7f18d56bc700 1 -- 172.21.15.157:0/2806352994 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18bc0035b0 con 0x7f18bc003a30 2023-10-16T19:57:22.312 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:22.301+0000 7f18d56bc700 1 --2- 172.21.15.157:0/2806352994 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f18bc003a30 0x7f18bc003e50 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f18c0009b90 tx=0x7f18bc005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c287eccc497a2eff server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:22.313 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:22.301+0000 7f18c7fff700 1 -- 172.21.15.157:0/2806352994 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18c000e6c0 con 0x7f18bc003a30 2023-10-16T19:57:22.313 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:22.301+0000 7f18c7fff700 1 -- 172.21.15.157:0/2806352994 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18c000e820 con 0x7f18bc003a30 2023-10-16T19:57:22.313 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:22.301+0000 7f18c7fff700 1 -- 172.21.15.157:0/2806352994 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18c000eb90 con 0x7f18bc003a30 2023-10-16T19:57:22.313 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:22.302+0000 7f18d7920700 1 -- 172.21.15.157:0/2806352994 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f18bc003a30 msgr2=0x7f18bc003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:22.313 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:22.302+0000 7f18d7920700 1 --2- 172.21.15.157:0/2806352994 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f18bc003a30 0x7f18bc003e50 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f18c0009b90 tx=0x7f18bc005880 comp rx=0 tx=0).stop 2023-10-16T19:57:22.314 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:22.302+0000 7f18d5ebd700 1 -- 172.21.15.157:0/2806352994 reap_dead start 2023-10-16T19:57:22.314 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:22.302+0000 7f18d7920700 1 -- 172.21.15.157:0/2806352994 shutdown_connections 2023-10-16T19:57:22.314 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:22.302+0000 7f18d7920700 1 -- 172.21.15.157:0/2806352994 >> 172.21.15.157:0/2806352994 conn(0x7f18d00d0b30 msgr2=0x7f18d00d0f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:22.314 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:22.302+0000 7f18d7920700 1 -- 172.21.15.157:0/2806352994 shutdown_connections 2023-10-16T19:57:22.314 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:22.302+0000 7f18d7920700 1 -- 172.21.15.157:0/2806352994 wait complete. 2023-10-16T19:57:22.317 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:22.304+0000 7f18d7920700 1 Processor -- start 2023-10-16T19:57:22.317 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:22.304+0000 7f18d7920700 1 -- start start 2023-10-16T19:57:22.318 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:22.305+0000 7f18d7920700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f18bc003a30 0x7f18d0149fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:22.318 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:22.305+0000 7f18d7920700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f18d01424e0 0x7f18d014c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:22.318 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:22.305+0000 7f18d7920700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f18d00b4fc0 0x7f18d00b5450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:22.318 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:22.305+0000 7f18d7920700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18d01f1580 con 0x7f18d01424e0 2023-10-16T19:57:22.318 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:22.305+0000 7f18d7920700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18d00b4290 con 0x7f18bc003a30 2023-10-16T19:57:22.319 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:22.305+0000 7f18d7920700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18d014a4e0 con 0x7f18d00b4fc0 2023-10-16T19:57:22.319 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:22.305+0000 7f18d4ebb700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f18d01424e0 0x7f18d014c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:22.319 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:22.305+0000 7f18d4ebb700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f18d01424e0 0x7f18d014c9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:46232/0 (socket says 172.21.15.157:46232) 2023-10-16T19:57:22.320 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:22.305+0000 7f18d4ebb700 1 -- 172.21.15.157:0/337374592 learned_addr learned my addr 172.21.15.157:0/337374592 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:57:22.320 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:22.305+0000 7f18d5ebd700 1 --2- 172.21.15.157:0/337374592 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f18d00b4fc0 0x7f18d00b5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:22.320 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:22.305+0000 7f18d56bc700 1 --2- 172.21.15.157:0/337374592 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f18bc003a30 0x7f18d0149fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:22.320 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:22.305+0000 7f18d4ebb700 1 -- 172.21.15.157:0/337374592 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f18d00b4fc0 msgr2=0x7f18d00b5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:22.320 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:22.305+0000 7f18d4ebb700 1 --2- 172.21.15.157:0/337374592 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f18d00b4fc0 0x7f18d00b5450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:22.321 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:22.305+0000 7f18d4ebb700 1 -- 172.21.15.157:0/337374592 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f18bc003a30 msgr2=0x7f18d0149fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:22.321 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:22.305+0000 7f18d4ebb700 1 --2- 172.21.15.157:0/337374592 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f18bc003a30 0x7f18d0149fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:22.321 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:22.305+0000 7f18d4ebb700 1 -- 172.21.15.157:0/337374592 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18d014cf30 con 0x7f18d01424e0 2023-10-16T19:57:22.321 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:22.305+0000 7f18d5ebd700 1 --2- 172.21.15.157:0/337374592 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f18d00b4fc0 0x7f18d00b5450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T19:57:22.322 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:22.305+0000 7f18d56bc700 1 --2- 172.21.15.157:0/337374592 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f18bc003a30 0x7f18d0149fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T19:57:22.322 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:22.305+0000 7f18d4ebb700 1 --2- 172.21.15.157:0/337374592 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f18d01424e0 0x7f18d014c9f0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f18cc011ad0 tx=0x7f18cc011e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:22.322 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:22.305+0000 7f18c5ffb700 1 -- 172.21.15.157:0/337374592 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18cc00fa00 con 0x7f18d01424e0 2023-10-16T19:57:22.322 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:22.305+0000 7f18c5ffb700 1 -- 172.21.15.157:0/337374592 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18cc00fb60 con 0x7f18d01424e0 2023-10-16T19:57:22.322 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:22.305+0000 7f18c5ffb700 1 -- 172.21.15.157:0/337374592 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18cc014440 con 0x7f18d01424e0 2023-10-16T19:57:22.323 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:22.305+0000 7f18d7920700 1 -- 172.21.15.157:0/337374592 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18d01429d0 con 0x7f18d01424e0 2023-10-16T19:57:22.323 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:22.306+0000 7f18d7920700 1 -- 172.21.15.157:0/337374592 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18d00b47c0 con 0x7f18d01424e0 2023-10-16T19:57:22.323 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:22.307+0000 7f18d7920700 1 -- 172.21.15.157:0/337374592 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18d00cf330 con 0x7f18d01424e0 2023-10-16T19:57:22.323 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:22.307+0000 7f18c5ffb700 1 -- 172.21.15.157:0/337374592 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f18cc0145a0 con 0x7f18d01424e0 2023-10-16T19:57:22.323 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:22.307+0000 7f18c5ffb700 1 --2- 172.21.15.157:0/337374592 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f18b406af30 0x7f18b406d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:22.324 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:22.307+0000 7f18c5ffb700 1 -- 172.21.15.157:0/337374592 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f18cc089d60 con 0x7f18d01424e0 2023-10-16T19:57:22.324 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:22.307+0000 7f18d56bc700 1 --2- 172.21.15.157:0/337374592 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f18b406af30 0x7f18b406d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:22.324 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:22.308+0000 7f18d56bc700 1 --2- 172.21.15.157:0/337374592 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f18b406af30 0x7f18b406d3f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f18c00090b0 tx=0x7f18c0008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:22.324 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:22.312+0000 7f18c5ffb700 1 -- 172.21.15.157:0/337374592 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f18cc054ed0 con 0x7f18d01424e0 2023-10-16T19:57:22.500 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:22.498+0000 7f18d7920700 1 -- 172.21.15.157:0/337374592 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f18d004f400 con 0x7f18d01424e0 2023-10-16T19:57:22.501 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:22.498+0000 7f18c5ffb700 1 -- 172.21.15.157:0/337374592 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f18cc022020 con 0x7f18d01424e0 2023-10-16T19:57:22.501 INFO:teuthology.orchestra.run.smithi157.stdout:pg_num: 64 2023-10-16T19:57:22.503 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:22.500+0000 7f18d7920700 1 -- 172.21.15.157:0/337374592 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f18b406af30 msgr2=0x7f18b406d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:22.503 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:22.500+0000 7f18d7920700 1 --2- 172.21.15.157:0/337374592 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f18b406af30 0x7f18b406d3f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f18c00090b0 tx=0x7f18c0008030 comp rx=0 tx=0).stop 2023-10-16T19:57:22.503 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:22.500+0000 7f18d7920700 1 -- 172.21.15.157:0/337374592 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f18d01424e0 msgr2=0x7f18d014c9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:22.504 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:22.500+0000 7f18d7920700 1 --2- 172.21.15.157:0/337374592 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f18d01424e0 0x7f18d014c9f0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f18cc011ad0 tx=0x7f18cc011e90 comp rx=0 tx=0).stop 2023-10-16T19:57:22.504 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:22.500+0000 7f18d7920700 1 -- 172.21.15.157:0/337374592 shutdown_connections 2023-10-16T19:57:22.504 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:22.500+0000 7f18d7920700 1 --2- 172.21.15.157:0/337374592 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f18b406af30 0x7f18b406d3f0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:22.504 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:22.500+0000 7f18d7920700 1 --2- 172.21.15.157:0/337374592 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f18bc003a30 0x7f18d0149fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:22.504 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:22.500+0000 7f18d7920700 1 --2- 172.21.15.157:0/337374592 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f18d00b4fc0 0x7f18d00b5450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:22.505 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:22.500+0000 7f18d7920700 1 --2- 172.21.15.157:0/337374592 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f18d01424e0 0x7f18d014c9f0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:22.505 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:22.500+0000 7f18d7920700 1 -- 172.21.15.157:0/337374592 >> 172.21.15.157:0/337374592 conn(0x7f18d00d0b30 msgr2=0x7f18d00cc240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:22.505 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:22.501+0000 7f18d7920700 1 -- 172.21.15.157:0/337374592 shutdown_connections 2023-10-16T19:57:22.505 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:22.501+0000 7f18d7920700 1 -- 172.21.15.157:0/337374592 wait complete. 2023-10-16T19:57:22.515 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-16T19:57:22.636 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:22.634+0000 7f2a063df700 1 Processor -- start 2023-10-16T19:57:22.636 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:22.634+0000 7f2a063df700 1 -- start start 2023-10-16T19:57:22.639 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:22.634+0000 7f2a063df700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f2a0015e2f0 0x7f2a0006d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:22.639 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:22.634+0000 7f2a063df700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f2a0006de00 0x7f2a000ce910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:22.639 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:22.634+0000 7f2a063df700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2a0006a850 0x7f2a0006ace0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:22.640 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:22.634+0000 7f2a063df700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a0006b220 con 0x7f2a0006de00 2023-10-16T19:57:22.640 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:22.634+0000 7f2a063df700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a000d08b0 con 0x7f2a0015e2f0 2023-10-16T19:57:22.640 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:22.634+0000 7f2a063df700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a001628f0 con 0x7f2a0006a850 2023-10-16T19:57:22.640 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:22.635+0000 7f29ff7fe700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f2a0006de00 0x7f2a000ce910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:22.640 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:22.635+0000 7f29ff7fe700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f2a0006de00 0x7f2a000ce910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:46240/0 (socket says 172.21.15.157:46240) 2023-10-16T19:57:22.641 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:22.635+0000 7f29ff7fe700 1 -- 172.21.15.157:0/3784669352 learned_addr learned my addr 172.21.15.157:0/3784669352 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:57:22.641 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:22.635+0000 7f2a0497c700 1 --2- 172.21.15.157:0/3784669352 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2a0006a850 0x7f2a0006ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:22.641 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:22.635+0000 7f29fffff700 1 --2- 172.21.15.157:0/3784669352 >> v2:172.21.15.187:3300/0 conn(0x7f2a0015e2f0 0x7f2a0006d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:22.641 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:22.635+0000 7f29ff7fe700 1 -- 172.21.15.157:0/3784669352 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2a0006a850 msgr2=0x7f2a0006ace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:57:22.641 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:22.635+0000 7f29ff7fe700 1 --2- 172.21.15.157:0/3784669352 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2a0006a850 0x7f2a0006ace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:22.641 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:22.635+0000 7f29ff7fe700 1 -- 172.21.15.157:0/3784669352 >> v2:172.21.15.187:3300/0 conn(0x7f2a0015e2f0 msgr2=0x7f2a0006d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:57:22.642 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:22.635+0000 7f29ff7fe700 1 --2- 172.21.15.157:0/3784669352 >> v2:172.21.15.187:3300/0 conn(0x7f2a0015e2f0 0x7f2a0006d0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:22.642 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:22.635+0000 7f29ff7fe700 1 -- 172.21.15.157:0/3784669352 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a00162bd0 con 0x7f2a0006de00 2023-10-16T19:57:22.642 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:22.635+0000 7f29fffff700 1 --2- 172.21.15.157:0/3784669352 >> v2:172.21.15.187:3300/0 conn(0x7f2a0015e2f0 0x7f2a0006d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T19:57:22.642 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:22.635+0000 7f29ff7fe700 1 --2- 172.21.15.157:0/3784669352 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2a0006de00 0x7f2a000ce910 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f2a000d1ad0 tx=0x7f29f4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e44738bf6ea3e080 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:22.642 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:22.635+0000 7f29feffd700 1 -- 172.21.15.157:0/3784669352 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29f400b870 con 0x7f2a0006de00 2023-10-16T19:57:22.643 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:22.635+0000 7f29feffd700 1 -- 172.21.15.157:0/3784669352 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29f400b9d0 con 0x7f2a0006de00 2023-10-16T19:57:22.643 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:22.635+0000 7f29feffd700 1 -- 172.21.15.157:0/3784669352 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29f400bd60 con 0x7f2a0006de00 2023-10-16T19:57:22.643 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:22.636+0000 7f2a063df700 1 -- 172.21.15.157:0/3784669352 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2a0006de00 msgr2=0x7f2a000ce910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:22.643 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:22.636+0000 7f2a063df700 1 --2- 172.21.15.157:0/3784669352 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2a0006de00 0x7f2a000ce910 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f2a000d1ad0 tx=0x7f29f4009bd0 comp rx=0 tx=0).stop 2023-10-16T19:57:22.643 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:22.636+0000 7f2a063df700 1 -- 172.21.15.157:0/3784669352 shutdown_connections 2023-10-16T19:57:22.644 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:22.636+0000 7f2a063df700 1 --2- 172.21.15.157:0/3784669352 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2a0006a850 0x7f2a0006ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:22.644 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:22.636+0000 7f2a063df700 1 --2- 172.21.15.157:0/3784669352 >> v2:172.21.15.187:3300/0 conn(0x7f2a0015e2f0 0x7f2a0006d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:22.644 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:22.636+0000 7f2a063df700 1 --2- 172.21.15.157:0/3784669352 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2a0006de00 0x7f2a000ce910 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:22.644 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:22.636+0000 7f2a063df700 1 -- 172.21.15.157:0/3784669352 >> 172.21.15.157:0/3784669352 conn(0x7f2a000cd4e0 msgr2=0x7f2a000cd8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:22.644 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:22.636+0000 7f2a063df700 1 -- 172.21.15.157:0/3784669352 shutdown_connections 2023-10-16T19:57:22.644 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:22.636+0000 7f2a063df700 1 -- 172.21.15.157:0/3784669352 wait complete. 2023-10-16T19:57:22.645 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:22.637+0000 7f2a063df700 1 Processor -- start 2023-10-16T19:57:22.648 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:22.637+0000 7f2a063df700 1 -- start start 2023-10-16T19:57:22.648 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:22.638+0000 7f2a063df700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2a0006a850 0x7f2a001f3320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:22.648 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:22.638+0000 7f2a063df700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2a0006de00 0x7f2a001f6f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:22.648 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:22.638+0000 7f2a063df700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2a0015e2f0 0x7f2a001f7450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:22.648 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:22.638+0000 7f2a063df700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a00149730 con 0x7f2a0015e2f0 2023-10-16T19:57:22.649 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:22.638+0000 7f2a063df700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a001f3860 con 0x7f2a0006a850 2023-10-16T19:57:22.649 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:22.638+0000 7f2a063df700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a000c62c0 con 0x7f2a0006de00 2023-10-16T19:57:22.649 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:22.638+0000 7f2a0497c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2a0015e2f0 0x7f2a001f7450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:22.649 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:22.638+0000 7f2a0497c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2a0015e2f0 0x7f2a001f7450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:46248/0 (socket says 172.21.15.157:46248) 2023-10-16T19:57:22.649 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:22.638+0000 7f2a0497c700 1 -- 172.21.15.157:0/2211784611 learned_addr learned my addr 172.21.15.157:0/2211784611 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:57:22.650 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:22.638+0000 7f29ff7fe700 1 --2- 172.21.15.157:0/2211784611 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2a0006de00 0x7f2a001f6f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:22.650 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:22.638+0000 7f29fffff700 1 --2- 172.21.15.157:0/2211784611 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2a0006a850 0x7f2a001f3320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:22.650 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:22.638+0000 7f2a0497c700 1 -- 172.21.15.157:0/2211784611 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2a0006de00 msgr2=0x7f2a001f6f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:22.650 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:22.638+0000 7f2a0497c700 1 --2- 172.21.15.157:0/2211784611 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2a0006de00 0x7f2a001f6f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:22.650 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:22.638+0000 7f2a0497c700 1 -- 172.21.15.157:0/2211784611 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2a0006a850 msgr2=0x7f2a001f3320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:22.651 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:22.638+0000 7f2a0497c700 1 --2- 172.21.15.157:0/2211784611 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2a0006a850 0x7f2a001f3320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:22.651 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:22.638+0000 7f2a0497c700 1 -- 172.21.15.157:0/2211784611 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29f4009550 con 0x7f2a0015e2f0 2023-10-16T19:57:22.651 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:22.638+0000 7f29fffff700 1 --2- 172.21.15.157:0/2211784611 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2a0006a850 0x7f2a001f3320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T19:57:22.651 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:22.639+0000 7f2a0497c700 1 --2- 172.21.15.157:0/2211784611 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2a0015e2f0 0x7f2a001f7450 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f29f8007d20 tx=0x7f29f800e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:22.651 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:22.639+0000 7f29fcff9700 1 -- 172.21.15.157:0/2211784611 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29f800ed80 con 0x7f2a0015e2f0 2023-10-16T19:57:22.651 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:22.639+0000 7f29fcff9700 1 -- 172.21.15.157:0/2211784611 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29f8007e70 con 0x7f2a0015e2f0 2023-10-16T19:57:22.652 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:22.639+0000 7f2a063df700 1 -- 172.21.15.157:0/2211784611 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a000c65a0 con 0x7f2a0015e2f0 2023-10-16T19:57:22.652 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:22.639+0000 7f29fcff9700 1 -- 172.21.15.157:0/2211784611 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29f8014640 con 0x7f2a0015e2f0 2023-10-16T19:57:22.652 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:22.639+0000 7f2a063df700 1 -- 172.21.15.157:0/2211784611 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a000c6b60 con 0x7f2a0015e2f0 2023-10-16T19:57:22.652 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:22.640+0000 7f2a063df700 1 -- 172.21.15.157:0/2211784611 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a0004f400 con 0x7f2a0015e2f0 2023-10-16T19:57:22.652 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:22.640+0000 7f29fcff9700 1 -- 172.21.15.157:0/2211784611 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f29f80147a0 con 0x7f2a0015e2f0 2023-10-16T19:57:22.653 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:22.640+0000 7f29fcff9700 1 --2- 172.21.15.157:0/2211784611 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f29ec06af00 0x7f29ec06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:22.653 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:22.641+0000 7f29fcff9700 1 -- 172.21.15.157:0/2211784611 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f29f8089b70 con 0x7f2a0015e2f0 2023-10-16T19:57:22.653 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:22.641+0000 7f29fffff700 1 --2- 172.21.15.157:0/2211784611 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f29ec06af00 0x7f29ec06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:22.653 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:22.641+0000 7f29fffff700 1 --2- 172.21.15.157:0/2211784611 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f29ec06af00 0x7f29ec06d3c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f29f000aa20 tx=0x7f29f0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:22.653 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:22.645+0000 7f29fcff9700 1 -- 172.21.15.157:0/2211784611 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f29f8054c20 con 0x7f2a0015e2f0 2023-10-16T19:57:22.878 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:22.876+0000 7f2a063df700 1 -- 172.21.15.157:0/2211784611 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2a00162230 con 0x7f2a0015e2f0 2023-10-16T19:57:22.879 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:22.877+0000 7f29fcff9700 1 -- 172.21.15.157:0/2211784611 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4913 (secure 0 0 0) 0x7f29f8058240 con 0x7f2a0015e2f0 2023-10-16T19:57:22.879 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-10-16T19:57:22.880 INFO:teuthology.orchestra.run.smithi157.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/1319816297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6834","nonce":1319816297},{"type":"v1","addr":"172.21.15.187:6835","nonce":1319816297}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4242,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6834/3219992837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6832","nonce":3219992837},{"type":"v1","addr":"172.21.15.157:6834","nonce":3219992837}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4245,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6835/1675699874","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6833","nonce":1675699874},{"type":"v1","addr":"172.21.15.157:6835","nonce":1675699874}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-16T19:57:06.364669+0000","modified":"2023-10-16T19:57:09.412706+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4282":{"gid":4282,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.187:6837/68705029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6836","nonce":68705029},{"type":"v1","addr":"172.21.15.187:6837","nonce":68705029}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-16T19:57:22.882 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:22.879+0000 7f2a063df700 1 -- 172.21.15.157:0/2211784611 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f29ec06af00 msgr2=0x7f29ec06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:22.882 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:22.879+0000 7f2a063df700 1 --2- 172.21.15.157:0/2211784611 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f29ec06af00 0x7f29ec06d3c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f29f000aa20 tx=0x7f29f0008040 comp rx=0 tx=0).stop 2023-10-16T19:57:22.883 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:22.879+0000 7f2a063df700 1 -- 172.21.15.157:0/2211784611 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2a0015e2f0 msgr2=0x7f2a001f7450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:22.883 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:22.879+0000 7f2a063df700 1 --2- 172.21.15.157:0/2211784611 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2a0015e2f0 0x7f2a001f7450 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f29f8007d20 tx=0x7f29f800e3c0 comp rx=0 tx=0).stop 2023-10-16T19:57:22.883 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:22.879+0000 7f2a063df700 1 -- 172.21.15.157:0/2211784611 shutdown_connections 2023-10-16T19:57:22.883 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:22.879+0000 7f2a063df700 1 --2- 172.21.15.157:0/2211784611 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f29ec06af00 0x7f29ec06d3c0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:22.884 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:22.879+0000 7f2a063df700 1 --2- 172.21.15.157:0/2211784611 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2a0006a850 0x7f2a001f3320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:22.884 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:22.879+0000 7f2a063df700 1 --2- 172.21.15.157:0/2211784611 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2a0015e2f0 0x7f2a001f7450 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:22.884 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:22.879+0000 7f2a063df700 1 --2- 172.21.15.157:0/2211784611 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2a0006de00 0x7f2a001f6f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:22.884 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:22.879+0000 7f2a063df700 1 -- 172.21.15.157:0/2211784611 >> 172.21.15.157:0/2211784611 conn(0x7f2a000cd4e0 msgr2=0x7f2a000afaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:22.884 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:22.879+0000 7f2a063df700 1 -- 172.21.15.157:0/2211784611 shutdown_connections 2023-10-16T19:57:22.885 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:22.879+0000 7f2a063df700 1 -- 172.21.15.157:0/2211784611 wait complete. 2023-10-16T19:57:22.885 INFO:teuthology.orchestra.run.smithi157.stderr:dumped fsmap epoch 8 2023-10-16T19:57:22.894 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T19:57:23.016 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.013+0000 7fc574a4c700 1 Processor -- start 2023-10-16T19:57:23.016 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.013+0000 7fc574a4c700 1 -- start start 2023-10-16T19:57:23.020 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.014+0000 7fc574a4c700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc5700cdf80 0x7fc5701669e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:23.020 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.014+0000 7fc574a4c700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5700cf920 con 0x7fc57015bf50 2023-10-16T19:57:23.020 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.014+0000 7fc574a4c700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5700cfc00 con 0x7fc5700b76e0 2023-10-16T19:57:23.020 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.014+0000 7fc574a4c700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5700cc4b0 con 0x7fc5700cdf80 2023-10-16T19:57:23.020 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.014+0000 7fc56e59c700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7fc57015bf50 0x7fc5700cef80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:55924/0 (socket says 172.21.15.157:55924) 2023-10-16T19:57:23.021 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.014+0000 7fc56e59c700 1 -- 172.21.15.157:0/1423488091 learned_addr learned my addr 172.21.15.157:0/1423488091 (peer_addr_for_me v1:172.21.15.157:0/0) 2023-10-16T19:57:23.021 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.015+0000 7fc56ed9d700 1 --2- 172.21.15.157:0/1423488091 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc5700cdf80 0x7fc5701669e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:23.021 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.015+0000 7fc56d59a700 1 -- 172.21.15.157:0/1423488091 <== mon.0 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 854138463 0 0) 0x7fc5700cf920 con 0x7fc57015bf50 2023-10-16T19:57:23.021 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.015+0000 7fc56d59a700 1 -- 172.21.15.157:0/1423488091 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc5580035b0 con 0x7fc57015bf50 2023-10-16T19:57:23.022 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.015+0000 7fc56d59a700 1 -- 172.21.15.157:0/1423488091 <== mon.0 v1:172.21.15.157:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4232765408 0 0) 0x7fc5580035b0 con 0x7fc57015bf50 2023-10-16T19:57:23.022 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.015+0000 7fc56d59a700 1 -- 172.21.15.157:0/1423488091 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc5700cdf80 msgr2=0x7fc5701669e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:57:23.022 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.015+0000 7fc56d59a700 1 --2- 172.21.15.157:0/1423488091 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc5700cdf80 0x7fc5701669e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:23.022 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.015+0000 7fc56d59a700 1 -- 172.21.15.157:0/1423488091 >> v1:172.21.15.187:6789/0 conn(0x7fc5700b76e0 legacy=0x7fc5700cd870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:23.022 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.015+0000 7fc56d59a700 1 -- 172.21.15.157:0/1423488091 --> v1:172.21.15.157:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5700cfee0 con 0x7fc57015bf50 2023-10-16T19:57:23.023 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.015+0000 7fc56d59a700 1 -- 172.21.15.157:0/1423488091 <== mon.0 v1:172.21.15.157:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4021145519 0 0) 0x7fc564001670 con 0x7fc57015bf50 2023-10-16T19:57:23.023 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.015+0000 7fc56d59a700 1 -- 172.21.15.157:0/1423488091 >> v1:172.21.15.157:6789/0 conn(0x7fc57015bf50 legacy=0x7fc5700cef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:23.023 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.015+0000 7fc56d59a700 1 --2- 172.21.15.157:0/1423488091 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc5700cdf80 0x7fc558003a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:23.023 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.015+0000 7fc56d59a700 1 --2- 172.21.15.157:0/1423488091 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc558004000 0x7fc558004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:23.023 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.015+0000 7fc56d59a700 1 --2- 172.21.15.157:0/1423488091 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc558004d90 0x7fc558005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:23.024 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.015+0000 7fc56d59a700 1 -- 172.21.15.157:0/1423488091 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5700cc4b0 con 0x7fc558004000 2023-10-16T19:57:23.024 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.015+0000 7fc56d59a700 1 -- 172.21.15.157:0/1423488091 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc55800bb50 con 0x7fc558004d90 2023-10-16T19:57:23.024 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.015+0000 7fc56d59a700 1 -- 172.21.15.157:0/1423488091 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc55800bd10 con 0x7fc5700cdf80 2023-10-16T19:57:23.024 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.015+0000 7fc56dd9b700 1 --2- 172.21.15.157:0/1423488091 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc558004000 0x7fc558004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:23.024 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.015+0000 7fc56e59c700 1 --2- 172.21.15.157:0/1423488091 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc5700cdf80 0x7fc558003a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:23.025 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.015+0000 7fc56ed9d700 1 --2- 172.21.15.157:0/1423488091 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc558004d90 0x7fc558005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:23.025 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.015+0000 7fc56dd9b700 1 -- 172.21.15.157:0/1423488091 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc5700cdf80 msgr2=0x7fc558003a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:57:23.025 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.015+0000 7fc56dd9b700 1 --2- 172.21.15.157:0/1423488091 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc5700cdf80 0x7fc558003a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:23.025 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.015+0000 7fc56dd9b700 1 -- 172.21.15.157:0/1423488091 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc558004d90 msgr2=0x7fc558005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:57:23.025 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.015+0000 7fc56dd9b700 1 --2- 172.21.15.157:0/1423488091 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc558004d90 0x7fc558005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:23.025 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.015+0000 7fc56dd9b700 1 -- 172.21.15.157:0/1423488091 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5580035b0 con 0x7fc558004000 2023-10-16T19:57:23.026 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.015+0000 7fc56ed9d700 1 --2- 172.21.15.157:0/1423488091 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc558004d90 0x7fc558005210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T19:57:23.026 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.015+0000 7fc56dd9b700 1 --2- 172.21.15.157:0/1423488091 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc558004000 0x7fc558004850 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fc5600017c0 tx=0x7fc558005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad1d46f805cc37b server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:23.026 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.016+0000 7fc56d59a700 1 -- 172.21.15.157:0/1423488091 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5600052d0 con 0x7fc558004000 2023-10-16T19:57:23.026 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.016+0000 7fc56d59a700 1 -- 172.21.15.157:0/1423488091 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc560005430 con 0x7fc558004000 2023-10-16T19:57:23.027 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.016+0000 7fc56d59a700 1 -- 172.21.15.157:0/1423488091 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5600038c0 con 0x7fc558004000 2023-10-16T19:57:23.027 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.016+0000 7fc574a4c700 1 -- 172.21.15.157:0/1423488091 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc558004000 msgr2=0x7fc558004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:23.027 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.016+0000 7fc574a4c700 1 --2- 172.21.15.157:0/1423488091 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc558004000 0x7fc558004850 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fc5600017c0 tx=0x7fc558005880 comp rx=0 tx=0).stop 2023-10-16T19:57:23.027 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.016+0000 7fc56ed9d700 1 -- 172.21.15.157:0/1423488091 reap_dead start 2023-10-16T19:57:23.027 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.016+0000 7fc574a4c700 1 -- 172.21.15.157:0/1423488091 shutdown_connections 2023-10-16T19:57:23.028 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.016+0000 7fc574a4c700 1 -- 172.21.15.157:0/1423488091 >> 172.21.15.157:0/1423488091 conn(0x7fc57006e300 msgr2=0x7fc57006e6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:23.028 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.016+0000 7fc574a4c700 1 -- 172.21.15.157:0/1423488091 shutdown_connections 2023-10-16T19:57:23.028 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.016+0000 7fc574a4c700 1 -- 172.21.15.157:0/1423488091 wait complete. 2023-10-16T19:57:23.033 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.018+0000 7fc574a4c700 1 Processor -- start 2023-10-16T19:57:23.033 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.018+0000 7fc574a4c700 1 -- start start 2023-10-16T19:57:23.033 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.019+0000 7fc574a4c700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc558004000 0x7fc5701f0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:23.033 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.019+0000 7fc574a4c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc57015d570 0x7fc5700c78d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:23.033 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.019+0000 7fc574a4c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc5700c7e10 0x7fc57015dc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:23.034 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.019+0000 7fc574a4c700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc57014f980 con 0x7fc5700c7e10 2023-10-16T19:57:23.034 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.019+0000 7fc574a4c700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc57015d9f0 con 0x7fc57015d570 2023-10-16T19:57:23.034 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.019+0000 7fc574a4c700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc57015d0e0 con 0x7fc558004000 2023-10-16T19:57:23.034 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.019+0000 7fc56ed9d700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc5700c7e10 0x7fc57015dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:23.034 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.019+0000 7fc56ed9d700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc5700c7e10 0x7fc57015dc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:46266/0 (socket says 172.21.15.157:46266) 2023-10-16T19:57:23.035 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.019+0000 7fc56ed9d700 1 -- 172.21.15.157:0/230244288 learned_addr learned my addr 172.21.15.157:0/230244288 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:57:23.035 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.019+0000 7fc56e59c700 1 --2- 172.21.15.157:0/230244288 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc558004000 0x7fc5701f0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:23.035 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.019+0000 7fc56dd9b700 1 --2- 172.21.15.157:0/230244288 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc57015d570 0x7fc5700c78d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:23.035 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.019+0000 7fc56ed9d700 1 -- 172.21.15.157:0/230244288 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc558004000 msgr2=0x7fc5701f0fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:23.035 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.019+0000 7fc56ed9d700 1 --2- 172.21.15.157:0/230244288 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc558004000 0x7fc5701f0fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:23.036 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.019+0000 7fc56ed9d700 1 -- 172.21.15.157:0/230244288 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc57015d570 msgr2=0x7fc5700c78d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:23.036 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.019+0000 7fc56ed9d700 1 --2- 172.21.15.157:0/230244288 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc57015d570 0x7fc5700c78d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:23.036 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.019+0000 7fc56ed9d700 1 -- 172.21.15.157:0/230244288 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc57014fd20 con 0x7fc5700c7e10 2023-10-16T19:57:23.036 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.019+0000 7fc56dd9b700 1 --2- 172.21.15.157:0/230244288 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc57015d570 0x7fc5700c78d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T19:57:23.036 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.020+0000 7fc56ed9d700 1 --2- 172.21.15.157:0/230244288 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc5700c7e10 0x7fc57015dc40 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fc568007cf0 tx=0x7fc5680104a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:23.037 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.020+0000 7fc55effd700 1 -- 172.21.15.157:0/230244288 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc56800e050 con 0x7fc5700c7e10 2023-10-16T19:57:23.037 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.020+0000 7fc55effd700 1 -- 172.21.15.157:0/230244288 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc56800f040 con 0x7fc5700c7e10 2023-10-16T19:57:23.037 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.020+0000 7fc55effd700 1 -- 172.21.15.157:0/230244288 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc568010e00 con 0x7fc5700c7e10 2023-10-16T19:57:23.037 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.020+0000 7fc574a4c700 1 -- 172.21.15.157:0/230244288 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc57015c4d0 con 0x7fc5700c7e10 2023-10-16T19:57:23.037 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.020+0000 7fc574a4c700 1 -- 172.21.15.157:0/230244288 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc57015ca90 con 0x7fc5700c7e10 2023-10-16T19:57:23.037 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.021+0000 7fc574a4c700 1 -- 172.21.15.157:0/230244288 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc57015f670 con 0x7fc5700c7e10 2023-10-16T19:57:23.038 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.021+0000 7fc55effd700 1 -- 172.21.15.157:0/230244288 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fc568003a20 con 0x7fc5700c7e10 2023-10-16T19:57:23.038 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.022+0000 7fc55effd700 1 --2- 172.21.15.157:0/230244288 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fc55006af00 0x7fc55006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:23.038 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.022+0000 7fc55effd700 1 -- 172.21.15.157:0/230244288 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc56808a3e0 con 0x7fc5700c7e10 2023-10-16T19:57:23.038 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.022+0000 7fc56e59c700 1 --2- 172.21.15.157:0/230244288 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fc55006af00 0x7fc55006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:23.038 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.022+0000 7fc56e59c700 1 --2- 172.21.15.157:0/230244288 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fc55006af00 0x7fc55006d3c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc564001eb0 tx=0x7fc564009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:23.039 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.026+0000 7fc55effd700 1 -- 172.21.15.157:0/230244288 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc568055600 con 0x7fc5700c7e10 2023-10-16T19:57:23.221 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.219+0000 7fc574a4c700 1 -- 172.21.15.157:0/230244288 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc57004f400 con 0x7fc5700c7e10 2023-10-16T19:57:23.222 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.220+0000 7fc55effd700 1 -- 172.21.15.157:0/230244288 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16517 (secure 0 0 0) 0x7fc568058c20 con 0x7fc5700c7e10 2023-10-16T19:57:23.223 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-10-16T19:57:23.223 INFO:teuthology.orchestra.run.smithi157.stdout:{"epoch":21,"fsid":"28199dc9-64d5-479e-83c6-21f097c33d39","created":"2023-10-16T19:56:49.201889+0000","modified":"2023-10-16T19:57:07.988567+0000","last_up_change":"2023-10-16T19:56:54.675673+0000","last_in_change":"2023-10-16T19:56:51.666728+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T19:56:56.932895+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-16T19:57:04.936105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-16T19:57:05.335279+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":335785898},{"type":"v1","addr":"172.21.15.157:6809","nonce":335785898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":335785898},{"type":"v1","addr":"172.21.15.157:6811","nonce":335785898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6815","nonce":335785898},{"type":"v1","addr":"172.21.15.157:6817","nonce":335785898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":335785898},{"type":"v1","addr":"172.21.15.157:6813","nonce":335785898}]},"public_addr":"172.21.15.157:6809/335785898","cluster_addr":"172.21.15.157:6811/335785898","heartbeat_back_addr":"172.21.15.157:6817/335785898","heartbeat_front_addr":"172.21.15.157:6813/335785898","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":3482825047},{"type":"v1","addr":"172.21.15.157:6801","nonce":3482825047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":3482825047},{"type":"v1","addr":"172.21.15.157:6803","nonce":3482825047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":3482825047},{"type":"v1","addr":"172.21.15.157:6807","nonce":3482825047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":3482825047},{"type":"v1","addr":"172.21.15.157:6805","nonce":3482825047}]},"public_addr":"172.21.15.157:6801/3482825047","cluster_addr":"172.21.15.157:6803/3482825047","heartbeat_back_addr":"172.21.15.157:6807/3482825047","heartbeat_front_addr":"172.21.15.157:6805/3482825047","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":1118292389},{"type":"v1","addr":"172.21.15.157:6825","nonce":1118292389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":1118292389},{"type":"v1","addr":"172.21.15.157:6827","nonce":1118292389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":1118292389},{"type":"v1","addr":"172.21.15.157:6831","nonce":1118292389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":1118292389},{"type":"v1","addr":"172.21.15.157:6829","nonce":1118292389}]},"public_addr":"172.21.15.157:6825/1118292389","cluster_addr":"172.21.15.157:6827/1118292389","heartbeat_back_addr":"172.21.15.157:6831/1118292389","heartbeat_front_addr":"172.21.15.157:6829/1118292389","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":989329821},{"type":"v1","addr":"172.21.15.157:6816","nonce":989329821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":989329821},{"type":"v1","addr":"172.21.15.157:6819","nonce":989329821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":989329821},{"type":"v1","addr":"172.21.15.157:6823","nonce":989329821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":989329821},{"type":"v1","addr":"172.21.15.157:6821","nonce":989329821}]},"public_addr":"172.21.15.157:6816/989329821","cluster_addr":"172.21.15.157:6819/989329821","heartbeat_back_addr":"172.21.15.157:6823/989329821","heartbeat_front_addr":"172.21.15.157:6821/989329821","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":3841016811},{"type":"v1","addr":"172.21.15.187:6801","nonce":3841016811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6803","nonce":3841016811},{"type":"v1","addr":"172.21.15.187:6804","nonce":3841016811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6809","nonce":3841016811},{"type":"v1","addr":"172.21.15.187:6811","nonce":3841016811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":3841016811},{"type":"v1","addr":"172.21.15.187:6808","nonce":3841016811}]},"public_addr":"172.21.15.187:6801/3841016811","cluster_addr":"172.21.15.187:6804/3841016811","heartbeat_back_addr":"172.21.15.187:6811/3841016811","heartbeat_front_addr":"172.21.15.187:6808/3841016811","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":915130263},{"type":"v1","addr":"172.21.15.187:6805","nonce":915130263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6807","nonce":915130263},{"type":"v1","addr":"172.21.15.187:6810","nonce":915130263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":915130263},{"type":"v1","addr":"172.21.15.187:6815","nonce":915130263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":915130263},{"type":"v1","addr":"172.21.15.187:6813","nonce":915130263}]},"public_addr":"172.21.15.187:6805/915130263","cluster_addr":"172.21.15.187:6810/915130263","heartbeat_back_addr":"172.21.15.187:6815/915130263","heartbeat_front_addr":"172.21.15.187:6813/915130263","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":654976824},{"type":"v1","addr":"172.21.15.187:6817","nonce":654976824}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":654976824},{"type":"v1","addr":"172.21.15.187:6819","nonce":654976824}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":654976824},{"type":"v1","addr":"172.21.15.187:6823","nonce":654976824}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":654976824},{"type":"v1","addr":"172.21.15.187:6821","nonce":654976824}]},"public_addr":"172.21.15.187:6817/654976824","cluster_addr":"172.21.15.187:6819/654976824","heartbeat_back_addr":"172.21.15.187:6823/654976824","heartbeat_front_addr":"172.21.15.187:6821/654976824","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":4284059445},{"type":"v1","addr":"172.21.15.187:6825","nonce":4284059445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":4284059445},{"type":"v1","addr":"172.21.15.187:6827","nonce":4284059445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":4284059445},{"type":"v1","addr":"172.21.15.187:6831","nonce":4284059445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":4284059445},{"type":"v1","addr":"172.21.15.187:6829","nonce":4284059445}]},"public_addr":"172.21.15.187:6825/4284059445","cluster_addr":"172.21.15.187:6827/4284059445","heartbeat_back_addr":"172.21.15.187:6831/4284059445","heartbeat_front_addr":"172.21.15.187:6829/4284059445","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.819780+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.824193+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.849575+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.824806+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.809540+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.805093+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.866109+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.807372+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T19:57:23.225 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.222+0000 7fc574a4c700 1 -- 172.21.15.157:0/230244288 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fc55006af00 msgr2=0x7fc55006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:23.225 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.222+0000 7fc574a4c700 1 --2- 172.21.15.157:0/230244288 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fc55006af00 0x7fc55006d3c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc564001eb0 tx=0x7fc564009040 comp rx=0 tx=0).stop 2023-10-16T19:57:23.225 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.222+0000 7fc574a4c700 1 -- 172.21.15.157:0/230244288 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc5700c7e10 msgr2=0x7fc57015dc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:23.225 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.222+0000 7fc574a4c700 1 --2- 172.21.15.157:0/230244288 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc5700c7e10 0x7fc57015dc40 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fc568007cf0 tx=0x7fc5680104a0 comp rx=0 tx=0).stop 2023-10-16T19:57:23.225 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.222+0000 7fc574a4c700 1 -- 172.21.15.157:0/230244288 shutdown_connections 2023-10-16T19:57:23.226 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.222+0000 7fc574a4c700 1 --2- 172.21.15.157:0/230244288 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc5700c7e10 0x7fc57015dc40 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:23.226 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.222+0000 7fc574a4c700 1 --2- 172.21.15.157:0/230244288 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc558004000 0x7fc5701f0fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:23.226 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.222+0000 7fc574a4c700 1 --2- 172.21.15.157:0/230244288 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fc55006af00 0x7fc55006d3c0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:23.226 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.222+0000 7fc574a4c700 1 --2- 172.21.15.157:0/230244288 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc57015d570 0x7fc5700c78d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:23.226 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.222+0000 7fc574a4c700 1 -- 172.21.15.157:0/230244288 >> 172.21.15.157:0/230244288 conn(0x7fc57006e300 msgr2=0x7fc570159900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:23.227 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.222+0000 7fc574a4c700 1 -- 172.21.15.157:0/230244288 shutdown_connections 2023-10-16T19:57:23.227 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.222+0000 7fc574a4c700 1 -- 172.21.15.157:0/230244288 wait complete. 2023-10-16T19:57:23.237 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-16T19:56:56.932895+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-16T19:57:04.936105+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-16T19:57:05.335279+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-16T19:57:23.238 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-16T19:57:23.361 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.359+0000 7fa55042b700 1 Processor -- start 2023-10-16T19:57:23.362 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.359+0000 7fa55042b700 1 -- start start 2023-10-16T19:57:23.363 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.360+0000 7fa55042b700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fa54815e090 0x7fa54806b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:23.364 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.360+0000 7fa55042b700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa54806b6a0 con 0x7fa5480b0190 2023-10-16T19:57:23.364 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.360+0000 7fa55042b700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa548072320 con 0x7fa54806ea10 2023-10-16T19:57:23.364 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.360+0000 7fa55042b700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa548071b50 con 0x7fa54815e090 2023-10-16T19:57:23.364 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.360+0000 7fa54e1c7700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fa54815e090 0x7fa54806b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:23.364 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.360+0000 7fa54e1c7700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fa54815e090 0x7fa54806b160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:46270/0 (socket says 172.21.15.157:46270) 2023-10-16T19:57:23.365 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.360+0000 7fa54e1c7700 1 -- 172.21.15.157:0/1876341116 learned_addr learned my addr 172.21.15.157:0/1876341116 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:57:23.365 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.360+0000 7fa54e1c7700 1 -- 172.21.15.157:0/1876341116 >> v1:172.21.15.187:6789/0 conn(0x7fa54806ea10 legacy=0x7fa5480afa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:57:23.365 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.360+0000 7fa54e1c7700 1 -- 172.21.15.157:0/1876341116 >> v1:172.21.15.157:6789/0 conn(0x7fa5480b0190 legacy=0x7fa54815e470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:23.365 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.360+0000 7fa54e1c7700 1 -- 172.21.15.157:0/1876341116 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa548071d60 con 0x7fa54815e090 2023-10-16T19:57:23.365 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.360+0000 7fa54e1c7700 1 --2- 172.21.15.157:0/1876341116 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa54815e090 0x7fa54806b160 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fa5380098f0 tx=0x7fa538009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=656b5f2ac2bdf20f server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:23.366 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.361+0000 7fa54d1c5700 1 -- 172.21.15.157:0/1876341116 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa538004230 con 0x7fa54815e090 2023-10-16T19:57:23.366 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.361+0000 7fa54d1c5700 1 -- 172.21.15.157:0/1876341116 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa538004390 con 0x7fa54815e090 2023-10-16T19:57:23.366 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.361+0000 7fa54d1c5700 1 -- 172.21.15.157:0/1876341116 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5380036a0 con 0x7fa54815e090 2023-10-16T19:57:23.366 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.361+0000 7fa55042b700 1 -- 172.21.15.157:0/1876341116 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa54815e090 msgr2=0x7fa54806b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:23.366 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.361+0000 7fa55042b700 1 --2- 172.21.15.157:0/1876341116 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa54815e090 0x7fa54806b160 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fa5380098f0 tx=0x7fa538009c00 comp rx=0 tx=0).stop 2023-10-16T19:57:23.367 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.361+0000 7fa55042b700 1 -- 172.21.15.157:0/1876341116 shutdown_connections 2023-10-16T19:57:23.367 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.361+0000 7fa55042b700 1 --2- 172.21.15.157:0/1876341116 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa54815e090 0x7fa54806b160 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:23.367 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.361+0000 7fa55042b700 1 -- 172.21.15.157:0/1876341116 >> 172.21.15.157:0/1876341116 conn(0x7fa5480d0b30 msgr2=0x7fa5480d0f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:23.367 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.361+0000 7fa55042b700 1 -- 172.21.15.157:0/1876341116 shutdown_connections 2023-10-16T19:57:23.367 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.361+0000 7fa55042b700 1 -- 172.21.15.157:0/1876341116 wait complete. 2023-10-16T19:57:23.370 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.363+0000 7fa55042b700 1 Processor -- start 2023-10-16T19:57:23.370 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.363+0000 7fa55042b700 1 -- start start 2023-10-16T19:57:23.371 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.364+0000 7fa55042b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa54806ea10 0x7fa548158cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:23.371 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.364+0000 7fa55042b700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa5480b0190 0x7fa5481f3080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:23.371 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.364+0000 7fa55042b700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa54815e090 0x7fa54815f620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:23.371 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.364+0000 7fa55042b700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa548149070 con 0x7fa5480b0190 2023-10-16T19:57:23.371 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.364+0000 7fa55042b700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa548158830 con 0x7fa54806ea10 2023-10-16T19:57:23.372 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.364+0000 7fa55042b700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa548148d90 con 0x7fa54815e090 2023-10-16T19:57:23.372 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.364+0000 7fa54d9c6700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa5480b0190 0x7fa5481f3080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:23.372 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.364+0000 7fa54d9c6700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa5480b0190 0x7fa5481f3080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:46278/0 (socket says 172.21.15.157:46278) 2023-10-16T19:57:23.372 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.364+0000 7fa54d9c6700 1 -- 172.21.15.157:0/2081633824 learned_addr learned my addr 172.21.15.157:0/2081633824 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:57:23.372 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.364+0000 7fa54e9c8700 1 --2- 172.21.15.157:0/2081633824 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa54815e090 0x7fa54815f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:23.373 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.364+0000 7fa54e1c7700 1 --2- 172.21.15.157:0/2081633824 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa54806ea10 0x7fa548158cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:23.373 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.364+0000 7fa54d9c6700 1 -- 172.21.15.157:0/2081633824 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa54815e090 msgr2=0x7fa54815f620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:23.373 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.364+0000 7fa54d9c6700 1 --2- 172.21.15.157:0/2081633824 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa54815e090 0x7fa54815f620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:23.373 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.364+0000 7fa54d9c6700 1 -- 172.21.15.157:0/2081633824 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa54806ea10 msgr2=0x7fa548158cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:23.373 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.364+0000 7fa54d9c6700 1 --2- 172.21.15.157:0/2081633824 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa54806ea10 0x7fa548158cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:23.373 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.364+0000 7fa54d9c6700 1 -- 172.21.15.157:0/2081633824 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa538009550 con 0x7fa5480b0190 2023-10-16T19:57:23.374 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.364+0000 7fa54e1c7700 1 --2- 172.21.15.157:0/2081633824 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa54806ea10 0x7fa548158cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T19:57:23.374 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.364+0000 7fa54e9c8700 1 --2- 172.21.15.157:0/2081633824 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa54815e090 0x7fa54815f620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T19:57:23.374 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.364+0000 7fa54d9c6700 1 --2- 172.21.15.157:0/2081633824 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa5480b0190 0x7fa5481f3080 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fa54400b4a0 tx=0x7fa54400b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:23.374 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.364+0000 7fa53effd700 1 -- 172.21.15.157:0/2081633824 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa544011830 con 0x7fa5480b0190 2023-10-16T19:57:23.374 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.364+0000 7fa53effd700 1 -- 172.21.15.157:0/2081633824 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa544011990 con 0x7fa5480b0190 2023-10-16T19:57:23.375 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.364+0000 7fa53effd700 1 -- 172.21.15.157:0/2081633824 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa544011d40 con 0x7fa5480b0190 2023-10-16T19:57:23.375 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.364+0000 7fa55042b700 1 -- 172.21.15.157:0/2081633824 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5481581e0 con 0x7fa5480b0190 2023-10-16T19:57:23.375 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.365+0000 7fa55042b700 1 -- 172.21.15.157:0/2081633824 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5481f35c0 con 0x7fa5480b0190 2023-10-16T19:57:23.375 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.365+0000 7fa55042b700 1 -- 172.21.15.157:0/2081633824 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa548158040 con 0x7fa5480b0190 2023-10-16T19:57:23.375 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.366+0000 7fa53effd700 1 -- 172.21.15.157:0/2081633824 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fa54401a400 con 0x7fa5480b0190 2023-10-16T19:57:23.376 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.366+0000 7fa53effd700 1 --2- 172.21.15.157:0/2081633824 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fa52c06af00 0x7fa52c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:23.376 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.366+0000 7fa53effd700 1 -- 172.21.15.157:0/2081633824 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa544089260 con 0x7fa5480b0190 2023-10-16T19:57:23.376 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.366+0000 7fa54e1c7700 1 --2- 172.21.15.157:0/2081633824 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fa52c06af00 0x7fa52c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:23.376 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.367+0000 7fa54e1c7700 1 --2- 172.21.15.157:0/2081633824 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fa52c06af00 0x7fa52c06d3c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fa538009130 tx=0x7fa538008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:23.377 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.370+0000 7fa53effd700 1 -- 172.21.15.157:0/2081633824 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa548158040 con 0x7fa5480b0190 2023-10-16T19:57:23.559 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.556+0000 7fa55042b700 1 -- 172.21.15.157:0/2081633824 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa548158040 con 0x7fa5480b0190 2023-10-16T19:57:23.559 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.557+0000 7fa53effd700 1 -- 172.21.15.157:0/2081633824 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa548158040 con 0x7fa5480b0190 2023-10-16T19:57:23.560 INFO:teuthology.orchestra.run.smithi157.stdout:pg_num: 1 2023-10-16T19:57:23.561 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.559+0000 7fa55042b700 1 -- 172.21.15.157:0/2081633824 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fa52c06af00 msgr2=0x7fa52c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:23.561 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.559+0000 7fa55042b700 1 --2- 172.21.15.157:0/2081633824 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fa52c06af00 0x7fa52c06d3c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fa538009130 tx=0x7fa538008030 comp rx=0 tx=0).stop 2023-10-16T19:57:23.562 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.559+0000 7fa55042b700 1 -- 172.21.15.157:0/2081633824 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa5480b0190 msgr2=0x7fa5481f3080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:23.562 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.559+0000 7fa55042b700 1 --2- 172.21.15.157:0/2081633824 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa5480b0190 0x7fa5481f3080 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fa54400b4a0 tx=0x7fa54400b860 comp rx=0 tx=0).stop 2023-10-16T19:57:23.562 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.559+0000 7fa55042b700 1 -- 172.21.15.157:0/2081633824 shutdown_connections 2023-10-16T19:57:23.562 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.559+0000 7fa55042b700 1 --2- 172.21.15.157:0/2081633824 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fa52c06af00 0x7fa52c06d3c0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:23.563 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.559+0000 7fa55042b700 1 --2- 172.21.15.157:0/2081633824 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa54806ea10 0x7fa548158cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:23.563 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.559+0000 7fa55042b700 1 --2- 172.21.15.157:0/2081633824 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa54815e090 0x7fa54815f620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:23.563 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.559+0000 7fa55042b700 1 --2- 172.21.15.157:0/2081633824 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa5480b0190 0x7fa5481f3080 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:23.563 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.559+0000 7fa55042b700 1 -- 172.21.15.157:0/2081633824 >> 172.21.15.157:0/2081633824 conn(0x7fa5480d0b30 msgr2=0x7fa54806da10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:23.563 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.559+0000 7fa55042b700 1 -- 172.21.15.157:0/2081633824 shutdown_connections 2023-10-16T19:57:23.564 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.559+0000 7fa55042b700 1 -- 172.21.15.157:0/2081633824 wait complete. 2023-10-16T19:57:23.573 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-16T19:57:23.697 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.695+0000 7f666339e700 1 Processor -- start 2023-10-16T19:57:23.697 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.695+0000 7f666339e700 1 -- start start 2023-10-16T19:57:23.700 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.696+0000 7f666339e700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f665c1456a0 0x7f665c0cb0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:23.700 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.696+0000 7f666339e700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f665c0b2710 0x7f665c0b2ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:23.700 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.696+0000 7f666339e700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f665c06e9b0 con 0x7f665c160450 2023-10-16T19:57:23.700 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.696+0000 7f666339e700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f665c0b30e0 con 0x7f665c0b2710 2023-10-16T19:57:23.701 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.696+0000 7f666339e700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f665c1608d0 con 0x7f665c1456a0 2023-10-16T19:57:23.701 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.696+0000 7f666193b700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f665c0b2710 0x7f665c0b2ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:23.701 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.696+0000 7f6660939700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f665c160450 0x7f665c0c7160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:55958/0 (socket says 172.21.15.157:55958) 2023-10-16T19:57:23.701 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.696+0000 7f6660939700 1 -- 172.21.15.157:0/3766330588 learned_addr learned my addr 172.21.15.157:0/3766330588 (peer_addr_for_me v1:172.21.15.157:0/0) 2023-10-16T19:57:23.701 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.696+0000 7f666113a700 1 --2- 172.21.15.157:0/3766330588 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f665c1456a0 0x7f665c0cb0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:23.702 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.696+0000 7f666193b700 1 -- 172.21.15.157:0/3766330588 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f665c1456a0 msgr2=0x7f665c0cb0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:57:23.702 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.696+0000 7f666193b700 1 --2- 172.21.15.157:0/3766330588 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f665c1456a0 0x7f665c0cb0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:23.702 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.696+0000 7f666193b700 1 -- 172.21.15.157:0/3766330588 >> v1:172.21.15.157:6789/0 conn(0x7f665c160450 legacy=0x7f665c0c7160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:23.702 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.696+0000 7f666193b700 1 -- 172.21.15.157:0/3766330588 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f665c145a80 con 0x7f665c0b2710 2023-10-16T19:57:23.702 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.696+0000 7f664ffff700 1 -- 172.21.15.157:0/3766330588 <== mon.0 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2723801818 0 0) 0x7f665c06e9b0 con 0x7f665c160450 2023-10-16T19:57:23.703 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.696+0000 7f666193b700 1 --2- 172.21.15.157:0/3766330588 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f665c0b2710 0x7f665c0b2ba0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f6654009d90 tx=0x7f665400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98bb1cade5c5bc81 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:23.703 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.696+0000 7f664ffff700 1 -- 172.21.15.157:0/3766330588 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f665400e070 con 0x7f665c0b2710 2023-10-16T19:57:23.703 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.696+0000 7f664ffff700 1 -- 172.21.15.157:0/3766330588 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f665400bbd0 con 0x7f665c0b2710 2023-10-16T19:57:23.703 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.696+0000 7f664ffff700 1 -- 172.21.15.157:0/3766330588 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6654012430 con 0x7f665c0b2710 2023-10-16T19:57:23.703 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.697+0000 7f666339e700 1 -- 172.21.15.157:0/3766330588 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f665c0b2710 msgr2=0x7f665c0b2ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:23.704 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.697+0000 7f666339e700 1 --2- 172.21.15.157:0/3766330588 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f665c0b2710 0x7f665c0b2ba0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f6654009d90 tx=0x7f665400b330 comp rx=0 tx=0).stop 2023-10-16T19:57:23.704 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.697+0000 7f666339e700 1 -- 172.21.15.157:0/3766330588 shutdown_connections 2023-10-16T19:57:23.704 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.697+0000 7f666339e700 1 --2- 172.21.15.157:0/3766330588 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f665c0b2710 0x7f665c0b2ba0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:23.704 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.697+0000 7f666339e700 1 --2- 172.21.15.157:0/3766330588 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f665c1456a0 0x7f665c0cb0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:23.704 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.697+0000 7f666339e700 1 -- 172.21.15.157:0/3766330588 >> 172.21.15.157:0/3766330588 conn(0x7f665c0d0b30 msgr2=0x7f665c0d0f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:23.705 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.697+0000 7f666339e700 1 -- 172.21.15.157:0/3766330588 shutdown_connections 2023-10-16T19:57:23.705 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.697+0000 7f666339e700 1 -- 172.21.15.157:0/3766330588 wait complete. 2023-10-16T19:57:23.708 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.699+0000 7f666339e700 1 Processor -- start 2023-10-16T19:57:23.708 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.699+0000 7f666339e700 1 -- start start 2023-10-16T19:57:23.709 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.699+0000 7f666339e700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f665c0b2710 0x7f665c1f3f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:23.709 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.700+0000 7f666339e700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f665c1456a0 0x7f665c0b5220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:23.709 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.700+0000 7f666339e700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f665c160450 0x7f665c15b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:23.709 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.700+0000 7f666339e700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f665c1f4440 con 0x7f665c160450 2023-10-16T19:57:23.709 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.700+0000 7f666339e700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f665c0b5760 con 0x7f665c1456a0 2023-10-16T19:57:23.710 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.700+0000 7f666339e700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f665c0b5a00 con 0x7f665c0b2710 2023-10-16T19:57:23.710 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.700+0000 7f666193b700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f665c160450 0x7f665c15b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:23.710 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.700+0000 7f666193b700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f665c160450 0x7f665c15b520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:46294/0 (socket says 172.21.15.157:46294) 2023-10-16T19:57:23.710 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.700+0000 7f666193b700 1 -- 172.21.15.157:0/2945241786 learned_addr learned my addr 172.21.15.157:0/2945241786 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:57:23.710 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.700+0000 7f666113a700 1 --2- 172.21.15.157:0/2945241786 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f665c0b2710 0x7f665c1f3f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:23.711 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.700+0000 7f6660939700 1 --2- 172.21.15.157:0/2945241786 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f665c1456a0 0x7f665c0b5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:23.711 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.700+0000 7f666193b700 1 -- 172.21.15.157:0/2945241786 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f665c0b2710 msgr2=0x7f665c1f3f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:23.711 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.700+0000 7f666193b700 1 --2- 172.21.15.157:0/2945241786 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f665c0b2710 0x7f665c1f3f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:23.711 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.700+0000 7f666193b700 1 -- 172.21.15.157:0/2945241786 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f665c1456a0 msgr2=0x7f665c0b5220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:23.711 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.700+0000 7f666193b700 1 --2- 172.21.15.157:0/2945241786 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f665c1456a0 0x7f665c0b5220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:23.711 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.700+0000 7f666193b700 1 -- 172.21.15.157:0/2945241786 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6654009a70 con 0x7f665c160450 2023-10-16T19:57:23.712 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.700+0000 7f6660939700 1 --2- 172.21.15.157:0/2945241786 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f665c1456a0 0x7f665c0b5220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T19:57:23.712 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.700+0000 7f666193b700 1 --2- 172.21.15.157:0/2945241786 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f665c160450 0x7f665c15b520 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f6654014040 tx=0x7f6654004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:23.712 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.700+0000 7f664dffb700 1 -- 172.21.15.157:0/2945241786 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6654012430 con 0x7f665c160450 2023-10-16T19:57:23.712 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.700+0000 7f664dffb700 1 -- 172.21.15.157:0/2945241786 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6654020070 con 0x7f665c160450 2023-10-16T19:57:23.713 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.700+0000 7f666339e700 1 -- 172.21.15.157:0/2945241786 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f665c0b5ce0 con 0x7f665c160450 2023-10-16T19:57:23.713 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.700+0000 7f664dffb700 1 -- 172.21.15.157:0/2945241786 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6654004280 con 0x7f665c160450 2023-10-16T19:57:23.713 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.701+0000 7f666339e700 1 -- 172.21.15.157:0/2945241786 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f665c0b62a0 con 0x7f665c160450 2023-10-16T19:57:23.713 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.701+0000 7f666339e700 1 -- 172.21.15.157:0/2945241786 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f665c0ad850 con 0x7f665c160450 2023-10-16T19:57:23.713 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.702+0000 7f664dffb700 1 -- 172.21.15.157:0/2945241786 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f66540043e0 con 0x7f665c160450 2023-10-16T19:57:23.714 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.702+0000 7f664dffb700 1 --2- 172.21.15.157:0/2945241786 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f664006af00 0x7f664006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:23.714 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.702+0000 7f664dffb700 1 -- 172.21.15.157:0/2945241786 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6654022070 con 0x7f665c160450 2023-10-16T19:57:23.714 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.702+0000 7f666113a700 1 --2- 172.21.15.157:0/2945241786 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f664006af00 0x7f664006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:23.714 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.703+0000 7f666113a700 1 --2- 172.21.15.157:0/2945241786 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f664006af00 0x7f664006d3c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f6658009930 tx=0x7f6658008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:23.715 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.707+0000 7f664dffb700 1 -- 172.21.15.157:0/2945241786 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6654056890 con 0x7f665c160450 2023-10-16T19:57:23.895 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.893+0000 7f666339e700 1 -- 172.21.15.157:0/2945241786 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f665c04f400 con 0x7f665c160450 2023-10-16T19:57:23.896 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.893+0000 7f664dffb700 1 -- 172.21.15.157:0/2945241786 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f665401ae60 con 0x7f665c160450 2023-10-16T19:57:23.896 INFO:teuthology.orchestra.run.smithi157.stdout:pg_num: 32 2023-10-16T19:57:23.898 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.895+0000 7f666339e700 1 -- 172.21.15.157:0/2945241786 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f664006af00 msgr2=0x7f664006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:23.898 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.895+0000 7f666339e700 1 --2- 172.21.15.157:0/2945241786 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f664006af00 0x7f664006d3c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f6658009930 tx=0x7f6658008040 comp rx=0 tx=0).stop 2023-10-16T19:57:23.899 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.895+0000 7f666339e700 1 -- 172.21.15.157:0/2945241786 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f665c160450 msgr2=0x7f665c15b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:23.899 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.895+0000 7f666339e700 1 --2- 172.21.15.157:0/2945241786 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f665c160450 0x7f665c15b520 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f6654014040 tx=0x7f6654004ad0 comp rx=0 tx=0).stop 2023-10-16T19:57:23.899 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.895+0000 7f666339e700 1 -- 172.21.15.157:0/2945241786 shutdown_connections 2023-10-16T19:57:23.899 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.895+0000 7f666339e700 1 --2- 172.21.15.157:0/2945241786 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f665c160450 0x7f665c15b520 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:23.900 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.895+0000 7f666339e700 1 --2- 172.21.15.157:0/2945241786 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f665c0b2710 0x7f665c1f3f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:23.900 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.895+0000 7f666339e700 1 --2- 172.21.15.157:0/2945241786 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f664006af00 0x7f664006d3c0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:23.900 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.895+0000 7f666339e700 1 --2- 172.21.15.157:0/2945241786 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f665c1456a0 0x7f665c0b5220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:23.900 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.895+0000 7f666339e700 1 -- 172.21.15.157:0/2945241786 >> 172.21.15.157:0/2945241786 conn(0x7f665c0d0b30 msgr2=0x7f665c0d0f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:23.900 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.895+0000 7f666339e700 1 -- 172.21.15.157:0/2945241786 shutdown_connections 2023-10-16T19:57:23.900 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:23.895+0000 7f666339e700 1 -- 172.21.15.157:0/2945241786 wait complete. 2023-10-16T19:57:23.910 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-16T19:57:24.034 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.031+0000 7f66e1c6f700 1 Processor -- start 2023-10-16T19:57:24.034 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.031+0000 7f66e1c6f700 1 -- start start 2023-10-16T19:57:24.036 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.032+0000 7f66e1c6f700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f66dc072980 0x7f66dc06d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:24.037 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.032+0000 7f66e1c6f700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f66dc0ca900 0x7f66dc0cbe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:24.037 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.032+0000 7f66e1c6f700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66dc06d8f0 con 0x7f66dc0cc370 2023-10-16T19:57:24.037 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.032+0000 7f66e1c6f700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66dc070bd0 con 0x7f66dc072980 2023-10-16T19:57:24.037 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.032+0000 7f66e1c6f700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66dc06b860 con 0x7f66dc0ca900 2023-10-16T19:57:24.037 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.032+0000 7f66db7fe700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f66dc072980 0x7f66dc06d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:24.038 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.032+0000 7f66dbfff700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f66dc0cc370 0x7f66dc15f8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:55974/0 (socket says 172.21.15.157:55974) 2023-10-16T19:57:24.038 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.032+0000 7f66dbfff700 1 -- 172.21.15.157:0/4206941320 learned_addr learned my addr 172.21.15.157:0/4206941320 (peer_addr_for_me v1:172.21.15.157:0/0) 2023-10-16T19:57:24.038 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.032+0000 7f66d2ffd700 1 --2- 172.21.15.157:0/4206941320 >> v2:172.21.15.187:3300/0 conn(0x7f66dc0ca900 0x7f66dc0cbe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:24.038 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.032+0000 7f66db7fe700 1 -- 172.21.15.157:0/4206941320 >> v2:172.21.15.187:3300/0 conn(0x7f66dc0ca900 msgr2=0x7f66dc0cbe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:57:24.039 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.032+0000 7f66db7fe700 1 --2- 172.21.15.157:0/4206941320 >> v2:172.21.15.187:3300/0 conn(0x7f66dc0ca900 0x7f66dc0cbe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:24.039 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.032+0000 7f66db7fe700 1 -- 172.21.15.157:0/4206941320 >> v1:172.21.15.157:6789/0 conn(0x7f66dc0cc370 legacy=0x7f66dc15f8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:24.039 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.032+0000 7f66db7fe700 1 -- 172.21.15.157:0/4206941320 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66dc0cad90 con 0x7f66dc072980 2023-10-16T19:57:24.039 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.032+0000 7f66daffd700 1 -- 172.21.15.157:0/4206941320 <== mon.0 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3931940928 0 0) 0x7f66d4001490 con 0x7f66dc0cc370 2023-10-16T19:57:24.039 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.033+0000 7f66db7fe700 1 --2- 172.21.15.157:0/4206941320 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f66dc072980 0x7f66dc06d3b0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f66dc0afcc0 tx=0x7f66cc009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec39f4cbf108eb6a server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:24.040 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.033+0000 7f66daffd700 1 -- 172.21.15.157:0/4206941320 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66cc011830 con 0x7f66dc072980 2023-10-16T19:57:24.040 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.033+0000 7f66daffd700 1 -- 172.21.15.157:0/4206941320 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66cc011990 con 0x7f66dc072980 2023-10-16T19:57:24.040 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.033+0000 7f66daffd700 1 -- 172.21.15.157:0/4206941320 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66cc011d20 con 0x7f66dc072980 2023-10-16T19:57:24.040 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.033+0000 7f66e1c6f700 1 -- 172.21.15.157:0/4206941320 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f66dc072980 msgr2=0x7f66dc06d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:24.040 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.033+0000 7f66e1c6f700 1 --2- 172.21.15.157:0/4206941320 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f66dc072980 0x7f66dc06d3b0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f66dc0afcc0 tx=0x7f66cc009b20 comp rx=0 tx=0).stop 2023-10-16T19:57:24.040 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.033+0000 7f66e1c6f700 1 -- 172.21.15.157:0/4206941320 shutdown_connections 2023-10-16T19:57:24.041 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.033+0000 7f66e1c6f700 1 --2- 172.21.15.157:0/4206941320 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f66dc072980 0x7f66dc06d3b0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:24.041 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.033+0000 7f66e1c6f700 1 --2- 172.21.15.157:0/4206941320 >> v2:172.21.15.187:3300/0 conn(0x7f66dc0ca900 0x7f66dc0cbe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:24.041 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.033+0000 7f66e1c6f700 1 -- 172.21.15.157:0/4206941320 >> 172.21.15.157:0/4206941320 conn(0x7f66dc06c7e0 msgr2=0x7f66dc06cbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:24.041 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.033+0000 7f66e1c6f700 1 -- 172.21.15.157:0/4206941320 shutdown_connections 2023-10-16T19:57:24.041 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.033+0000 7f66e1c6f700 1 -- 172.21.15.157:0/4206941320 wait complete. 2023-10-16T19:57:24.041 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.034+0000 7f66e1c6f700 1 Processor -- start 2023-10-16T19:57:24.044 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.035+0000 7f66e1c6f700 1 -- start start 2023-10-16T19:57:24.044 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.035+0000 7f66e1c6f700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f66dc072980 0x7f66dc15ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:24.044 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.035+0000 7f66e1c6f700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f66dc0cc370 0x7f66dc14e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:24.045 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.035+0000 7f66e1c6f700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f66dc1f30e0 0x7f66dc15c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:24.045 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.035+0000 7f66e1c6f700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66dc14f430 con 0x7f66dc0cc370 2023-10-16T19:57:24.045 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.035+0000 7f66e1c6f700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66dc1f3590 con 0x7f66dc072980 2023-10-16T19:57:24.045 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.035+0000 7f66e1c6f700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66dc14eb90 con 0x7f66dc1f30e0 2023-10-16T19:57:24.045 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.036+0000 7f66d2ffd700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f66dc0cc370 0x7f66dc14e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:24.046 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.036+0000 7f66d2ffd700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f66dc0cc370 0x7f66dc14e490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:46304/0 (socket says 172.21.15.157:46304) 2023-10-16T19:57:24.046 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.036+0000 7f66d2ffd700 1 -- 172.21.15.157:0/3193167568 learned_addr learned my addr 172.21.15.157:0/3193167568 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:57:24.046 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.036+0000 7f66dbfff700 1 --2- 172.21.15.157:0/3193167568 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f66dc1f30e0 0x7f66dc15c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:24.046 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.036+0000 7f66db7fe700 1 --2- 172.21.15.157:0/3193167568 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f66dc072980 0x7f66dc15ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:24.046 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.036+0000 7f66d2ffd700 1 -- 172.21.15.157:0/3193167568 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f66dc1f30e0 msgr2=0x7f66dc15c370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:24.047 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.036+0000 7f66d2ffd700 1 --2- 172.21.15.157:0/3193167568 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f66dc1f30e0 0x7f66dc15c370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:24.047 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.036+0000 7f66d2ffd700 1 -- 172.21.15.157:0/3193167568 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f66dc072980 msgr2=0x7f66dc15ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:24.047 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.036+0000 7f66d2ffd700 1 --2- 172.21.15.157:0/3193167568 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f66dc072980 0x7f66dc15ee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:24.047 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.036+0000 7f66d2ffd700 1 -- 172.21.15.157:0/3193167568 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66cc0094a0 con 0x7f66dc0cc370 2023-10-16T19:57:24.047 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.036+0000 7f66d2ffd700 1 --2- 172.21.15.157:0/3193167568 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f66dc0cc370 0x7f66dc14e490 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f66c400e810 tx=0x7f66c400eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:24.048 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.036+0000 7f66d8ff9700 1 -- 172.21.15.157:0/3193167568 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66c400c070 con 0x7f66dc0cc370 2023-10-16T19:57:24.048 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.036+0000 7f66d8ff9700 1 -- 172.21.15.157:0/3193167568 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66c4013610 con 0x7f66dc0cc370 2023-10-16T19:57:24.048 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.036+0000 7f66e1c6f700 1 -- 172.21.15.157:0/3193167568 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66dc14ee70 con 0x7f66dc0cc370 2023-10-16T19:57:24.048 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.036+0000 7f66d8ff9700 1 -- 172.21.15.157:0/3193167568 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66c40139a0 con 0x7f66dc0cc370 2023-10-16T19:57:24.048 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.036+0000 7f66e1c6f700 1 -- 172.21.15.157:0/3193167568 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66dc0ce020 con 0x7f66dc0cc370 2023-10-16T19:57:24.049 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.037+0000 7f66e1c6f700 1 -- 172.21.15.157:0/3193167568 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66dc0cde80 con 0x7f66dc0cc370 2023-10-16T19:57:24.049 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.037+0000 7f66d8ff9700 1 -- 172.21.15.157:0/3193167568 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f66c4013b00 con 0x7f66dc0cc370 2023-10-16T19:57:24.049 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.038+0000 7f66d8ff9700 1 --2- 172.21.15.157:0/3193167568 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f66bc06af00 0x7f66bc06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:24.049 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.038+0000 7f66d8ff9700 1 -- 172.21.15.157:0/3193167568 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f66c4088fb0 con 0x7f66dc0cc370 2023-10-16T19:57:24.049 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.038+0000 7f66db7fe700 1 --2- 172.21.15.157:0/3193167568 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f66bc06af00 0x7f66bc06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:24.050 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.038+0000 7f66db7fe700 1 --2- 172.21.15.157:0/3193167568 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f66bc06af00 0x7f66bc06d3c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f66cc0090b0 tx=0x7f66cc01c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:24.050 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.042+0000 7f66d8ff9700 1 -- 172.21.15.157:0/3193167568 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f66dc0cde80 con 0x7f66dc0cc370 2023-10-16T19:57:24.235 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.233+0000 7f66e1c6f700 1 -- 172.21.15.157:0/3193167568 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f66dc0cde80 con 0x7f66dc0cc370 2023-10-16T19:57:24.236 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.233+0000 7f66d8ff9700 1 -- 172.21.15.157:0/3193167568 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f66dc0cde80 con 0x7f66dc0cc370 2023-10-16T19:57:24.236 INFO:teuthology.orchestra.run.smithi157.stdout:pg_num: 64 2023-10-16T19:57:24.238 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.235+0000 7f66e1c6f700 1 -- 172.21.15.157:0/3193167568 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f66bc06af00 msgr2=0x7f66bc06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:24.238 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.235+0000 7f66e1c6f700 1 --2- 172.21.15.157:0/3193167568 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f66bc06af00 0x7f66bc06d3c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f66cc0090b0 tx=0x7f66cc01c040 comp rx=0 tx=0).stop 2023-10-16T19:57:24.238 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.235+0000 7f66e1c6f700 1 -- 172.21.15.157:0/3193167568 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f66dc0cc370 msgr2=0x7f66dc14e490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:24.239 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.235+0000 7f66e1c6f700 1 --2- 172.21.15.157:0/3193167568 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f66dc0cc370 0x7f66dc14e490 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f66c400e810 tx=0x7f66c400eb20 comp rx=0 tx=0).stop 2023-10-16T19:57:24.239 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.235+0000 7f66e1c6f700 1 -- 172.21.15.157:0/3193167568 shutdown_connections 2023-10-16T19:57:24.239 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.235+0000 7f66e1c6f700 1 --2- 172.21.15.157:0/3193167568 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f66bc06af00 0x7f66bc06d3c0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:24.239 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.235+0000 7f66e1c6f700 1 --2- 172.21.15.157:0/3193167568 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f66dc072980 0x7f66dc15ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:24.239 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.235+0000 7f66e1c6f700 1 --2- 172.21.15.157:0/3193167568 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f66dc1f30e0 0x7f66dc15c370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:24.240 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.235+0000 7f66e1c6f700 1 --2- 172.21.15.157:0/3193167568 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f66dc0cc370 0x7f66dc14e490 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:24.240 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.235+0000 7f66e1c6f700 1 -- 172.21.15.157:0/3193167568 >> 172.21.15.157:0/3193167568 conn(0x7f66dc06c7e0 msgr2=0x7f66dc0b5b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:24.240 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.235+0000 7f66e1c6f700 1 -- 172.21.15.157:0/3193167568 shutdown_connections 2023-10-16T19:57:24.240 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.235+0000 7f66e1c6f700 1 -- 172.21.15.157:0/3193167568 wait complete. 2023-10-16T19:57:24.250 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-16T19:57:24.371 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.368+0000 7f73fc799700 1 Processor -- start 2023-10-16T19:57:24.371 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.368+0000 7f73fc799700 1 -- start start 2023-10-16T19:57:24.373 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.369+0000 7f73fc799700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f73f415b130 0x7f73f4071f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:24.374 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.369+0000 7f73fc799700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f73f406eb20 0x7f73f406efb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:24.374 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.369+0000 7f73fc799700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73f40cefc0 con 0x7f73f406d0f0 2023-10-16T19:57:24.374 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.369+0000 7f73fc799700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73f40b0050 con 0x7f73f406eb20 2023-10-16T19:57:24.374 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.369+0000 7f73fc799700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73f406f4f0 con 0x7f73f415b130 2023-10-16T19:57:24.375 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.369+0000 7f73fad36700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f73f406eb20 0x7f73f406efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:24.375 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.369+0000 7f73fad36700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f73f406eb20 0x7f73f406efb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:46316/0 (socket says 172.21.15.157:46316) 2023-10-16T19:57:24.375 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.369+0000 7f73fad36700 1 -- 172.21.15.157:0/2265370053 learned_addr learned my addr 172.21.15.157:0/2265370053 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:57:24.375 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.370+0000 7f73fa535700 1 --2- 172.21.15.157:0/2265370053 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f73f415b130 0x7f73f4071f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:24.375 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.370+0000 7f73fad36700 1 -- 172.21.15.157:0/2265370053 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f73f415b130 msgr2=0x7f73f4071f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:57:24.376 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.370+0000 7f73fad36700 1 --2- 172.21.15.157:0/2265370053 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f73f415b130 0x7f73f4071f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:24.376 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.370+0000 7f73fad36700 1 -- 172.21.15.157:0/2265370053 >> v1:172.21.15.187:6789/0 conn(0x7f73f406d0f0 legacy=0x7f73f40cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:57:24.376 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.370+0000 7f73fad36700 1 -- 172.21.15.157:0/2265370053 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73f406e090 con 0x7f73f406eb20 2023-10-16T19:57:24.376 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.370+0000 7f73fad36700 1 --2- 172.21.15.157:0/2265370053 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f73f406eb20 0x7f73f406efb0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f73ec00d150 tx=0x7f73ec00d460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fe72d64e5102d59 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:24.376 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.370+0000 7f73f9533700 1 -- 172.21.15.157:0/2265370053 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73ec010070 con 0x7f73f406eb20 2023-10-16T19:57:24.376 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.370+0000 7f73f9533700 1 -- 172.21.15.157:0/2265370053 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73ec00dd80 con 0x7f73f406eb20 2023-10-16T19:57:24.377 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.370+0000 7f73f9533700 1 -- 172.21.15.157:0/2265370053 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73ec00b310 con 0x7f73f406eb20 2023-10-16T19:57:24.377 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.370+0000 7f73fc799700 1 -- 172.21.15.157:0/2265370053 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f73f406eb20 msgr2=0x7f73f406efb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:24.377 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.370+0000 7f73fc799700 1 --2- 172.21.15.157:0/2265370053 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f73f406eb20 0x7f73f406efb0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f73ec00d150 tx=0x7f73ec00d460 comp rx=0 tx=0).stop 2023-10-16T19:57:24.377 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.371+0000 7f73fc799700 1 -- 172.21.15.157:0/2265370053 shutdown_connections 2023-10-16T19:57:24.377 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.371+0000 7f73fc799700 1 --2- 172.21.15.157:0/2265370053 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f73f415b130 0x7f73f4071f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:24.378 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.371+0000 7f73fc799700 1 --2- 172.21.15.157:0/2265370053 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f73f406eb20 0x7f73f406efb0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:24.378 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.371+0000 7f73fc799700 1 -- 172.21.15.157:0/2265370053 >> 172.21.15.157:0/2265370053 conn(0x7f73f40cd4e0 msgr2=0x7f73f40cd8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:24.378 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.371+0000 7f73fc799700 1 -- 172.21.15.157:0/2265370053 shutdown_connections 2023-10-16T19:57:24.378 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.371+0000 7f73fc799700 1 -- 172.21.15.157:0/2265370053 wait complete. 2023-10-16T19:57:24.381 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.372+0000 7f73fc799700 1 Processor -- start 2023-10-16T19:57:24.382 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.372+0000 7f73fc799700 1 -- start start 2023-10-16T19:57:24.382 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.373+0000 7f73fc799700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f73f406d0f0 0x7f73f41f3ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:24.382 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.373+0000 7f73fc799700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f73f406eb20 0x7f73f40c6ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:24.382 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.373+0000 7f73fc799700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f73f415b130 0x7f73f4142630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:24.382 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.373+0000 7f73fc799700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73f4143a70 con 0x7f73f415b130 2023-10-16T19:57:24.383 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.373+0000 7f73fc799700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73f40c71e0 con 0x7f73f406d0f0 2023-10-16T19:57:24.383 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.373+0000 7f73fc799700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73f4142e60 con 0x7f73f406eb20 2023-10-16T19:57:24.383 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.373+0000 7f73fad36700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f73f415b130 0x7f73f4142630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:24.383 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.373+0000 7f73fad36700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f73f415b130 0x7f73f4142630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:46322/0 (socket says 172.21.15.157:46322) 2023-10-16T19:57:24.384 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.373+0000 7f73fad36700 1 -- 172.21.15.157:0/4279139832 learned_addr learned my addr 172.21.15.157:0/4279139832 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:57:24.384 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.373+0000 7f73f9d34700 1 --2- 172.21.15.157:0/4279139832 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f73f406eb20 0x7f73f40c6ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:24.384 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.373+0000 7f73fad36700 1 -- 172.21.15.157:0/4279139832 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f73f406eb20 msgr2=0x7f73f40c6ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:24.384 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.373+0000 7f73fad36700 1 --2- 172.21.15.157:0/4279139832 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f73f406eb20 0x7f73f40c6ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:24.385 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.373+0000 7f73fad36700 1 -- 172.21.15.157:0/4279139832 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f73f406d0f0 msgr2=0x7f73f41f3ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:24.385 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.373+0000 7f73fad36700 1 --2- 172.21.15.157:0/4279139832 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f73f406d0f0 0x7f73f41f3ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:24.385 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.373+0000 7f73fad36700 1 -- 172.21.15.157:0/4279139832 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73ec00bd40 con 0x7f73f415b130 2023-10-16T19:57:24.385 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.373+0000 7f73f9d34700 1 --2- 172.21.15.157:0/4279139832 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f73f406eb20 0x7f73f40c6ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T19:57:24.385 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.374+0000 7f73fad36700 1 --2- 172.21.15.157:0/4279139832 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f73f415b130 0x7f73f4142630 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f73ec017040 tx=0x7f73ec004b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:24.386 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.374+0000 7f73eaffd700 1 -- 172.21.15.157:0/4279139832 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73ec00abe0 con 0x7f73f415b130 2023-10-16T19:57:24.386 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.374+0000 7f73eaffd700 1 -- 172.21.15.157:0/4279139832 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73ec00ad40 con 0x7f73f415b130 2023-10-16T19:57:24.386 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.374+0000 7f73fc799700 1 -- 172.21.15.157:0/4279139832 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73f4143140 con 0x7f73f415b130 2023-10-16T19:57:24.386 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.374+0000 7f73eaffd700 1 -- 172.21.15.157:0/4279139832 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73ec004270 con 0x7f73f415b130 2023-10-16T19:57:24.386 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.374+0000 7f73fc799700 1 -- 172.21.15.157:0/4279139832 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73f4143700 con 0x7f73f415b130 2023-10-16T19:57:24.387 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.375+0000 7f73fc799700 1 -- 172.21.15.157:0/4279139832 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73f406d550 con 0x7f73f415b130 2023-10-16T19:57:24.387 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.375+0000 7f73eaffd700 1 -- 172.21.15.157:0/4279139832 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f73ec01b050 con 0x7f73f415b130 2023-10-16T19:57:24.387 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.376+0000 7f73eaffd700 1 --2- 172.21.15.157:0/4279139832 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f73d806af00 0x7f73d806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:24.387 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.376+0000 7f73eaffd700 1 -- 172.21.15.157:0/4279139832 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f73ec08cc50 con 0x7f73f415b130 2023-10-16T19:57:24.387 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.376+0000 7f73fa535700 1 --2- 172.21.15.157:0/4279139832 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f73d806af00 0x7f73d806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:24.388 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.376+0000 7f73fa535700 1 --2- 172.21.15.157:0/4279139832 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f73d806af00 0x7f73d806d3c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f73f41f2e90 tx=0x7f73e4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:24.388 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.380+0000 7f73eaffd700 1 -- 172.21.15.157:0/4279139832 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f73f406d550 con 0x7f73f415b130 2023-10-16T19:57:24.610 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.607+0000 7f73fc799700 1 -- 172.21.15.157:0/4279139832 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f73f406d550 con 0x7f73f415b130 2023-10-16T19:57:24.610 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.608+0000 7f73eaffd700 1 -- 172.21.15.157:0/4279139832 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4913 (secure 0 0 0) 0x7f73f406d550 con 0x7f73f415b130 2023-10-16T19:57:24.611 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-10-16T19:57:24.611 INFO:teuthology.orchestra.run.smithi157.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/1319816297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6834","nonce":1319816297},{"type":"v1","addr":"172.21.15.187:6835","nonce":1319816297}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4242,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6834/3219992837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6832","nonce":3219992837},{"type":"v1","addr":"172.21.15.157:6834","nonce":3219992837}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4245,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6835/1675699874","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6833","nonce":1675699874},{"type":"v1","addr":"172.21.15.157:6835","nonce":1675699874}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-16T19:57:06.364669+0000","modified":"2023-10-16T19:57:09.412706+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4282":{"gid":4282,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.187:6837/68705029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6836","nonce":68705029},{"type":"v1","addr":"172.21.15.187:6837","nonce":68705029}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-16T19:57:24.613 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.610+0000 7f73fc799700 1 -- 172.21.15.157:0/4279139832 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f73d806af00 msgr2=0x7f73d806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:24.613 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.610+0000 7f73fc799700 1 --2- 172.21.15.157:0/4279139832 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f73d806af00 0x7f73d806d3c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f73f41f2e90 tx=0x7f73e4008040 comp rx=0 tx=0).stop 2023-10-16T19:57:24.613 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.610+0000 7f73fc799700 1 -- 172.21.15.157:0/4279139832 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f73f415b130 msgr2=0x7f73f4142630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:24.613 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.610+0000 7f73fc799700 1 --2- 172.21.15.157:0/4279139832 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f73f415b130 0x7f73f4142630 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f73ec017040 tx=0x7f73ec004b20 comp rx=0 tx=0).stop 2023-10-16T19:57:24.613 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.610+0000 7f73fc799700 1 -- 172.21.15.157:0/4279139832 shutdown_connections 2023-10-16T19:57:24.614 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.610+0000 7f73fc799700 1 --2- 172.21.15.157:0/4279139832 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f73d806af00 0x7f73d806d3c0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:24.614 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.610+0000 7f73fc799700 1 --2- 172.21.15.157:0/4279139832 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f73f406d0f0 0x7f73f41f3ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:24.614 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.610+0000 7f73fc799700 1 --2- 172.21.15.157:0/4279139832 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f73f415b130 0x7f73f4142630 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:24.614 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.610+0000 7f73fc799700 1 --2- 172.21.15.157:0/4279139832 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f73f406eb20 0x7f73f40c6ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:24.615 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.610+0000 7f73fc799700 1 -- 172.21.15.157:0/4279139832 >> 172.21.15.157:0/4279139832 conn(0x7f73f40cd4e0 msgr2=0x7f73f40cf2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:24.615 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.610+0000 7f73fc799700 1 -- 172.21.15.157:0/4279139832 shutdown_connections 2023-10-16T19:57:24.615 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.610+0000 7f73fc799700 1 -- 172.21.15.157:0/4279139832 wait complete. 2023-10-16T19:57:24.615 INFO:teuthology.orchestra.run.smithi157.stderr:dumped fsmap epoch 8 2023-10-16T19:57:24.625 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T19:57:24.745 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.743+0000 7fcf5ed90700 1 Processor -- start 2023-10-16T19:57:24.745 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.743+0000 7fcf5ed90700 1 -- start start 2023-10-16T19:57:24.749 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.743+0000 7fcf5ed90700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fcf5815b130 0x7fcf58071f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:24.749 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.744+0000 7fcf5ed90700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf580cefc0 con 0x7fcf5806d0f0 2023-10-16T19:57:24.750 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.744+0000 7fcf5ed90700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf5806e090 con 0x7fcf5806eb20 2023-10-16T19:57:24.750 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.744+0000 7fcf5ed90700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf580b0050 con 0x7fcf5815b130 2023-10-16T19:57:24.750 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.744+0000 7fcf57fff700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7fcf5806d0f0 0x7fcf580cb970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:56002/0 (socket says 172.21.15.157:56002) 2023-10-16T19:57:24.750 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.744+0000 7fcf57fff700 1 -- 172.21.15.157:0/2111861899 learned_addr learned my addr 172.21.15.157:0/2111861899 (peer_addr_for_me v1:172.21.15.157:0/0) 2023-10-16T19:57:24.750 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.744+0000 7fcf5cb2c700 1 --2- 172.21.15.157:0/2111861899 >> v2:172.21.15.187:3300/0 conn(0x7fcf5815b130 0x7fcf58071f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:24.751 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.744+0000 7fcf577fe700 1 -- 172.21.15.157:0/2111861899 <== mon.0 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3329105065 0 0) 0x7fcf580cefc0 con 0x7fcf5806d0f0 2023-10-16T19:57:24.751 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.744+0000 7fcf577fe700 1 -- 172.21.15.157:0/2111861899 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcf480035b0 con 0x7fcf5806d0f0 2023-10-16T19:57:24.751 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.744+0000 7fcf577fe700 1 -- 172.21.15.157:0/2111861899 <== mon.0 v1:172.21.15.157:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3294867827 0 0) 0x7fcf480035b0 con 0x7fcf5806d0f0 2023-10-16T19:57:24.751 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.744+0000 7fcf577fe700 1 -- 172.21.15.157:0/2111861899 >> v2:172.21.15.187:3300/0 conn(0x7fcf5815b130 msgr2=0x7fcf58071f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:57:24.752 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.744+0000 7fcf577fe700 1 --2- 172.21.15.157:0/2111861899 >> v2:172.21.15.187:3300/0 conn(0x7fcf5815b130 0x7fcf58071f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:24.752 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.744+0000 7fcf577fe700 1 -- 172.21.15.157:0/2111861899 >> v1:172.21.15.187:6789/0 conn(0x7fcf5806eb20 legacy=0x7fcf580cf450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:24.752 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.744+0000 7fcf577fe700 1 -- 172.21.15.157:0/2111861899 --> v1:172.21.15.157:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf5806d570 con 0x7fcf5806d0f0 2023-10-16T19:57:24.752 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.744+0000 7fcf577fe700 1 -- 172.21.15.157:0/2111861899 <== mon.0 v1:172.21.15.157:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4021145519 0 0) 0x7fcf44001670 con 0x7fcf5806d0f0 2023-10-16T19:57:24.752 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.744+0000 7fcf577fe700 1 -- 172.21.15.157:0/2111861899 >> v1:172.21.15.157:6789/0 conn(0x7fcf5806d0f0 legacy=0x7fcf580cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:24.753 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.744+0000 7fcf577fe700 1 --2- 172.21.15.157:0/2111861899 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcf48003a00 0x7fcf48003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:24.753 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.744+0000 7fcf577fe700 1 --2- 172.21.15.157:0/2111861899 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcf48004850 0x7fcf48004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:24.753 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.744+0000 7fcf577fe700 1 --2- 172.21.15.157:0/2111861899 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcf48005330 0x7fcf4800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:24.753 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.744+0000 7fcf577fe700 1 -- 172.21.15.157:0/2111861899 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf4800c1d0 con 0x7fcf48005330 2023-10-16T19:57:24.753 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.744+0000 7fcf577fe700 1 -- 172.21.15.157:0/2111861899 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf4800c340 con 0x7fcf48004850 2023-10-16T19:57:24.753 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.744+0000 7fcf577fe700 1 -- 172.21.15.157:0/2111861899 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf4800c500 con 0x7fcf48003a00 2023-10-16T19:57:24.754 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.744+0000 7fcf5d32d700 1 --2- 172.21.15.157:0/2111861899 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcf48005330 0x7fcf4800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:24.754 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.744+0000 7fcf5cb2c700 1 --2- 172.21.15.157:0/2111861899 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcf48003a00 0x7fcf48003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:24.754 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.744+0000 7fcf57fff700 1 --2- 172.21.15.157:0/2111861899 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcf48004850 0x7fcf48004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:24.755 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.745+0000 7fcf5d32d700 1 -- 172.21.15.157:0/2111861899 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcf48003a00 msgr2=0x7fcf48003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:57:24.755 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.745+0000 7fcf5d32d700 1 --2- 172.21.15.157:0/2111861899 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcf48003a00 0x7fcf48003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:24.755 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.745+0000 7fcf5d32d700 1 -- 172.21.15.157:0/2111861899 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcf48004850 msgr2=0x7fcf48004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:57:24.755 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.745+0000 7fcf5d32d700 1 --2- 172.21.15.157:0/2111861899 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcf48004850 0x7fcf48004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:24.755 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.745+0000 7fcf5d32d700 1 -- 172.21.15.157:0/2111861899 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf480035b0 con 0x7fcf48005330 2023-10-16T19:57:24.756 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.745+0000 7fcf5d32d700 1 -- 172.21.15.157:0/2111861899 reap_dead start 2023-10-16T19:57:24.756 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.745+0000 7fcf5d32d700 1 --2- 172.21.15.157:0/2111861899 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcf48005330 0x7fcf4800ba10 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fcf5000c0e0 tx=0x7fcf48005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10d3b2f731c6734f server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:24.756 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.745+0000 7fcf577fe700 1 -- 172.21.15.157:0/2111861899 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf50001da0 con 0x7fcf48005330 2023-10-16T19:57:24.756 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.745+0000 7fcf577fe700 1 -- 172.21.15.157:0/2111861899 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf50003c50 con 0x7fcf48005330 2023-10-16T19:57:24.756 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.745+0000 7fcf577fe700 1 -- 172.21.15.157:0/2111861899 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf5000ca20 con 0x7fcf48005330 2023-10-16T19:57:24.757 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.745+0000 7fcf5ed90700 1 -- 172.21.15.157:0/2111861899 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcf48005330 msgr2=0x7fcf4800ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:24.757 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.745+0000 7fcf5ed90700 1 --2- 172.21.15.157:0/2111861899 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcf48005330 0x7fcf4800ba10 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fcf5000c0e0 tx=0x7fcf48005880 comp rx=0 tx=0).stop 2023-10-16T19:57:24.757 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.745+0000 7fcf5ed90700 1 -- 172.21.15.157:0/2111861899 shutdown_connections 2023-10-16T19:57:24.757 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.745+0000 7fcf5ed90700 1 --2- 172.21.15.157:0/2111861899 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcf48005330 0x7fcf4800ba10 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:24.757 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.745+0000 7fcf5ed90700 1 -- 172.21.15.157:0/2111861899 >> 172.21.15.157:0/2111861899 conn(0x7fcf580cd4e0 msgr2=0x7fcf580cd8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:24.758 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.745+0000 7fcf5ed90700 1 -- 172.21.15.157:0/2111861899 shutdown_connections 2023-10-16T19:57:24.758 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.746+0000 7fcf5ed90700 1 -- 172.21.15.157:0/2111861899 wait complete. 2023-10-16T19:57:24.758 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.747+0000 7fcf5ed90700 1 Processor -- start 2023-10-16T19:57:24.758 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.747+0000 7fcf5ed90700 1 -- start start 2023-10-16T19:57:24.761 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.748+0000 7fcf5ed90700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcf48005330 0x7fcf58153a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:24.761 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.748+0000 7fcf5ed90700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcf58159290 0x7fcf580ac900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:24.762 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.748+0000 7fcf5ed90700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcf581533e0 0x7fcf580ca210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:24.762 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.748+0000 7fcf5ed90700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf580ad550 con 0x7fcf48005330 2023-10-16T19:57:24.762 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.748+0000 7fcf5ed90700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf580aa930 con 0x7fcf58159290 2023-10-16T19:57:24.762 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.748+0000 7fcf5ed90700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf580ad270 con 0x7fcf581533e0 2023-10-16T19:57:24.762 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.748+0000 7fcf5cb2c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcf48005330 0x7fcf58153a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:24.763 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.748+0000 7fcf5cb2c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcf48005330 0x7fcf58153a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:46338/0 (socket says 172.21.15.157:46338) 2023-10-16T19:57:24.763 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.748+0000 7fcf5cb2c700 1 -- 172.21.15.157:0/1137402074 learned_addr learned my addr 172.21.15.157:0/1137402074 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:57:24.763 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.748+0000 7fcf5d32d700 1 --2- 172.21.15.157:0/1137402074 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcf581533e0 0x7fcf580ca210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:24.763 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.748+0000 7fcf57fff700 1 --2- 172.21.15.157:0/1137402074 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcf58159290 0x7fcf580ac900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:24.763 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.748+0000 7fcf5cb2c700 1 -- 172.21.15.157:0/1137402074 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcf581533e0 msgr2=0x7fcf580ca210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:24.763 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.748+0000 7fcf5cb2c700 1 --2- 172.21.15.157:0/1137402074 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcf581533e0 0x7fcf580ca210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:24.764 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.748+0000 7fcf5cb2c700 1 -- 172.21.15.157:0/1137402074 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcf58159290 msgr2=0x7fcf580ac900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:24.764 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.748+0000 7fcf5cb2c700 1 --2- 172.21.15.157:0/1137402074 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcf58159290 0x7fcf580ac900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:24.764 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.748+0000 7fcf5cb2c700 1 -- 172.21.15.157:0/1137402074 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf580aab40 con 0x7fcf48005330 2023-10-16T19:57:24.764 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.748+0000 7fcf57fff700 1 --2- 172.21.15.157:0/1137402074 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcf58159290 0x7fcf580ac900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T19:57:24.764 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.748+0000 7fcf5cb2c700 1 --2- 172.21.15.157:0/1137402074 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcf48005330 0x7fcf58153a70 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fcf4c0119a0 tx=0x7fcf4c011cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:24.765 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.748+0000 7fcf557fa700 1 -- 172.21.15.157:0/1137402074 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf4c00f940 con 0x7fcf48005330 2023-10-16T19:57:24.765 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.748+0000 7fcf557fa700 1 -- 172.21.15.157:0/1137402074 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf4c00faa0 con 0x7fcf48005330 2023-10-16T19:57:24.765 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.748+0000 7fcf5ed90700 1 -- 172.21.15.157:0/1137402074 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf580aae20 con 0x7fcf48005330 2023-10-16T19:57:24.765 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.748+0000 7fcf557fa700 1 -- 172.21.15.157:0/1137402074 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf4c00fe30 con 0x7fcf48005330 2023-10-16T19:57:24.765 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.748+0000 7fcf5ed90700 1 -- 172.21.15.157:0/1137402074 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf58153fb0 con 0x7fcf48005330 2023-10-16T19:57:24.766 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.749+0000 7fcf5ed90700 1 -- 172.21.15.157:0/1137402074 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf580ab470 con 0x7fcf48005330 2023-10-16T19:57:24.766 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.750+0000 7fcf557fa700 1 -- 172.21.15.157:0/1137402074 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fcf4c014440 con 0x7fcf48005330 2023-10-16T19:57:24.766 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.750+0000 7fcf557fa700 1 --2- 172.21.15.157:0/1137402074 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fcf3c06af00 0x7fcf3c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:24.766 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.750+0000 7fcf557fa700 1 -- 172.21.15.157:0/1137402074 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcf4c089cb0 con 0x7fcf48005330 2023-10-16T19:57:24.766 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.750+0000 7fcf57fff700 1 --2- 172.21.15.157:0/1137402074 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fcf3c06af00 0x7fcf3c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:24.767 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.751+0000 7fcf57fff700 1 --2- 172.21.15.157:0/1137402074 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fcf3c06af00 0x7fcf3c06d3c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fcf44000f60 tx=0x7fcf44009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:24.767 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.754+0000 7fcf557fa700 1 -- 172.21.15.157:0/1137402074 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fcf4c054d60 con 0x7fcf48005330 2023-10-16T19:57:24.945 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.943+0000 7fcf5ed90700 1 -- 172.21.15.157:0/1137402074 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcf5806dd80 con 0x7fcf48005330 2023-10-16T19:57:24.946 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.944+0000 7fcf557fa700 1 -- 172.21.15.157:0/1137402074 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16517 (secure 0 0 0) 0x7fcf4c058380 con 0x7fcf48005330 2023-10-16T19:57:24.947 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-10-16T19:57:24.947 INFO:teuthology.orchestra.run.smithi157.stdout:{"epoch":21,"fsid":"28199dc9-64d5-479e-83c6-21f097c33d39","created":"2023-10-16T19:56:49.201889+0000","modified":"2023-10-16T19:57:07.988567+0000","last_up_change":"2023-10-16T19:56:54.675673+0000","last_in_change":"2023-10-16T19:56:51.666728+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T19:56:56.932895+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-16T19:57:04.936105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-16T19:57:05.335279+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":335785898},{"type":"v1","addr":"172.21.15.157:6809","nonce":335785898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":335785898},{"type":"v1","addr":"172.21.15.157:6811","nonce":335785898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6815","nonce":335785898},{"type":"v1","addr":"172.21.15.157:6817","nonce":335785898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":335785898},{"type":"v1","addr":"172.21.15.157:6813","nonce":335785898}]},"public_addr":"172.21.15.157:6809/335785898","cluster_addr":"172.21.15.157:6811/335785898","heartbeat_back_addr":"172.21.15.157:6817/335785898","heartbeat_front_addr":"172.21.15.157:6813/335785898","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":3482825047},{"type":"v1","addr":"172.21.15.157:6801","nonce":3482825047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":3482825047},{"type":"v1","addr":"172.21.15.157:6803","nonce":3482825047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":3482825047},{"type":"v1","addr":"172.21.15.157:6807","nonce":3482825047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":3482825047},{"type":"v1","addr":"172.21.15.157:6805","nonce":3482825047}]},"public_addr":"172.21.15.157:6801/3482825047","cluster_addr":"172.21.15.157:6803/3482825047","heartbeat_back_addr":"172.21.15.157:6807/3482825047","heartbeat_front_addr":"172.21.15.157:6805/3482825047","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":1118292389},{"type":"v1","addr":"172.21.15.157:6825","nonce":1118292389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":1118292389},{"type":"v1","addr":"172.21.15.157:6827","nonce":1118292389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":1118292389},{"type":"v1","addr":"172.21.15.157:6831","nonce":1118292389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":1118292389},{"type":"v1","addr":"172.21.15.157:6829","nonce":1118292389}]},"public_addr":"172.21.15.157:6825/1118292389","cluster_addr":"172.21.15.157:6827/1118292389","heartbeat_back_addr":"172.21.15.157:6831/1118292389","heartbeat_front_addr":"172.21.15.157:6829/1118292389","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":989329821},{"type":"v1","addr":"172.21.15.157:6816","nonce":989329821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":989329821},{"type":"v1","addr":"172.21.15.157:6819","nonce":989329821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":989329821},{"type":"v1","addr":"172.21.15.157:6823","nonce":989329821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":989329821},{"type":"v1","addr":"172.21.15.157:6821","nonce":989329821}]},"public_addr":"172.21.15.157:6816/989329821","cluster_addr":"172.21.15.157:6819/989329821","heartbeat_back_addr":"172.21.15.157:6823/989329821","heartbeat_front_addr":"172.21.15.157:6821/989329821","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":3841016811},{"type":"v1","addr":"172.21.15.187:6801","nonce":3841016811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6803","nonce":3841016811},{"type":"v1","addr":"172.21.15.187:6804","nonce":3841016811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6809","nonce":3841016811},{"type":"v1","addr":"172.21.15.187:6811","nonce":3841016811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":3841016811},{"type":"v1","addr":"172.21.15.187:6808","nonce":3841016811}]},"public_addr":"172.21.15.187:6801/3841016811","cluster_addr":"172.21.15.187:6804/3841016811","heartbeat_back_addr":"172.21.15.187:6811/3841016811","heartbeat_front_addr":"172.21.15.187:6808/3841016811","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":915130263},{"type":"v1","addr":"172.21.15.187:6805","nonce":915130263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6807","nonce":915130263},{"type":"v1","addr":"172.21.15.187:6810","nonce":915130263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":915130263},{"type":"v1","addr":"172.21.15.187:6815","nonce":915130263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":915130263},{"type":"v1","addr":"172.21.15.187:6813","nonce":915130263}]},"public_addr":"172.21.15.187:6805/915130263","cluster_addr":"172.21.15.187:6810/915130263","heartbeat_back_addr":"172.21.15.187:6815/915130263","heartbeat_front_addr":"172.21.15.187:6813/915130263","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":654976824},{"type":"v1","addr":"172.21.15.187:6817","nonce":654976824}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":654976824},{"type":"v1","addr":"172.21.15.187:6819","nonce":654976824}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":654976824},{"type":"v1","addr":"172.21.15.187:6823","nonce":654976824}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":654976824},{"type":"v1","addr":"172.21.15.187:6821","nonce":654976824}]},"public_addr":"172.21.15.187:6817/654976824","cluster_addr":"172.21.15.187:6819/654976824","heartbeat_back_addr":"172.21.15.187:6823/654976824","heartbeat_front_addr":"172.21.15.187:6821/654976824","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":4284059445},{"type":"v1","addr":"172.21.15.187:6825","nonce":4284059445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":4284059445},{"type":"v1","addr":"172.21.15.187:6827","nonce":4284059445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":4284059445},{"type":"v1","addr":"172.21.15.187:6831","nonce":4284059445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":4284059445},{"type":"v1","addr":"172.21.15.187:6829","nonce":4284059445}]},"public_addr":"172.21.15.187:6825/4284059445","cluster_addr":"172.21.15.187:6827/4284059445","heartbeat_back_addr":"172.21.15.187:6831/4284059445","heartbeat_front_addr":"172.21.15.187:6829/4284059445","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.819780+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.824193+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.849575+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.824806+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.809540+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.805093+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.866109+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.807372+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T19:57:24.948 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.946+0000 7fcf5ed90700 1 -- 172.21.15.157:0/1137402074 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fcf3c06af00 msgr2=0x7fcf3c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:24.949 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.946+0000 7fcf5ed90700 1 --2- 172.21.15.157:0/1137402074 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fcf3c06af00 0x7fcf3c06d3c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fcf44000f60 tx=0x7fcf44009040 comp rx=0 tx=0).stop 2023-10-16T19:57:24.949 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.946+0000 7fcf5ed90700 1 -- 172.21.15.157:0/1137402074 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcf48005330 msgr2=0x7fcf58153a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:24.949 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.946+0000 7fcf5ed90700 1 --2- 172.21.15.157:0/1137402074 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcf48005330 0x7fcf58153a70 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fcf4c0119a0 tx=0x7fcf4c011cb0 comp rx=0 tx=0).stop 2023-10-16T19:57:24.949 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.946+0000 7fcf5ed90700 1 -- 172.21.15.157:0/1137402074 shutdown_connections 2023-10-16T19:57:24.949 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.946+0000 7fcf5ed90700 1 --2- 172.21.15.157:0/1137402074 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcf581533e0 0x7fcf580ca210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:24.950 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.946+0000 7fcf5ed90700 1 --2- 172.21.15.157:0/1137402074 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcf48005330 0x7fcf58153a70 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:24.950 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.946+0000 7fcf5ed90700 1 --2- 172.21.15.157:0/1137402074 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fcf3c06af00 0x7fcf3c06d3c0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:24.950 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.946+0000 7fcf5ed90700 1 --2- 172.21.15.157:0/1137402074 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcf58159290 0x7fcf580ac900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:24.950 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.946+0000 7fcf5ed90700 1 -- 172.21.15.157:0/1137402074 >> 172.21.15.157:0/1137402074 conn(0x7fcf580cd4e0 msgr2=0x7fcf580b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:24.950 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.946+0000 7fcf5ed90700 1 -- 172.21.15.157:0/1137402074 shutdown_connections 2023-10-16T19:57:24.951 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:24.946+0000 7fcf5ed90700 1 -- 172.21.15.157:0/1137402074 wait complete. 2023-10-16T19:57:24.961 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-16T19:57:25.081 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.079+0000 7f15ecf4b700 1 Processor -- start 2023-10-16T19:57:25.081 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.079+0000 7f15ecf4b700 1 -- start start 2023-10-16T19:57:25.084 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.080+0000 7f15ecf4b700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f15e815bf50 0x7f15e80cef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:25.084 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.080+0000 7f15ecf4b700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f15e80b76e0 0x7f15e80cd870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:25.084 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.080+0000 7f15ecf4b700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15e80cf920 con 0x7f15e80cddb0 2023-10-16T19:57:25.085 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.080+0000 7f15ecf4b700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15e80cc4b0 con 0x7f15e80b76e0 2023-10-16T19:57:25.085 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.080+0000 7f15ecf4b700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15e80cfc00 con 0x7f15e815bf50 2023-10-16T19:57:25.085 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.080+0000 7f15e5d9b700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f15e80b76e0 0x7f15e80cd870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:25.085 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.080+0000 7f15e5d9b700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f15e80b76e0 0x7f15e80cd870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:46346/0 (socket says 172.21.15.157:46346) 2023-10-16T19:57:25.085 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.080+0000 7f15e5d9b700 1 -- 172.21.15.157:0/321767698 learned_addr learned my addr 172.21.15.157:0/321767698 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:57:25.086 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.080+0000 7f15e659c700 1 --2- 172.21.15.157:0/321767698 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f15e815bf50 0x7f15e80cef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:25.086 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.080+0000 7f15e5d9b700 1 -- 172.21.15.157:0/321767698 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f15e815bf50 msgr2=0x7f15e80cef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:57:25.086 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.080+0000 7f15e5d9b700 1 --2- 172.21.15.157:0/321767698 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f15e815bf50 0x7f15e80cef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:25.086 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.080+0000 7f15e5d9b700 1 -- 172.21.15.157:0/321767698 >> v1:172.21.15.187:6789/0 conn(0x7f15e80cddb0 legacy=0x7f15e815f8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:57:25.087 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.080+0000 7f15e5d9b700 1 -- 172.21.15.157:0/321767698 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15e80cfee0 con 0x7f15e80b76e0 2023-10-16T19:57:25.087 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.081+0000 7f15e5d9b700 1 --2- 172.21.15.157:0/321767698 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f15e80b76e0 0x7f15e80cd870 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f15dc0098f0 tx=0x7f15dc009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d13355ad3db1f3bb server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:25.087 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.081+0000 7f15e559a700 1 -- 172.21.15.157:0/321767698 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15dc004230 con 0x7f15e80b76e0 2023-10-16T19:57:25.087 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.081+0000 7f15e559a700 1 -- 172.21.15.157:0/321767698 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15dc004390 con 0x7f15e80b76e0 2023-10-16T19:57:25.087 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.081+0000 7f15e559a700 1 -- 172.21.15.157:0/321767698 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15dc0036a0 con 0x7f15e80b76e0 2023-10-16T19:57:25.088 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.081+0000 7f15ecf4b700 1 -- 172.21.15.157:0/321767698 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f15e80b76e0 msgr2=0x7f15e80cd870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:25.088 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.081+0000 7f15ecf4b700 1 --2- 172.21.15.157:0/321767698 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f15e80b76e0 0x7f15e80cd870 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f15dc0098f0 tx=0x7f15dc009c00 comp rx=0 tx=0).stop 2023-10-16T19:57:25.088 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.081+0000 7f15ecf4b700 1 -- 172.21.15.157:0/321767698 shutdown_connections 2023-10-16T19:57:25.088 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.081+0000 7f15ecf4b700 1 --2- 172.21.15.157:0/321767698 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f15e815bf50 0x7f15e80cef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:25.088 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.081+0000 7f15ecf4b700 1 --2- 172.21.15.157:0/321767698 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f15e80b76e0 0x7f15e80cd870 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:25.089 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.081+0000 7f15ecf4b700 1 -- 172.21.15.157:0/321767698 >> 172.21.15.157:0/321767698 conn(0x7f15e806e300 msgr2=0x7f15e806e6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:25.089 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.081+0000 7f15ecf4b700 1 -- 172.21.15.157:0/321767698 shutdown_connections 2023-10-16T19:57:25.089 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.081+0000 7f15ecf4b700 1 -- 172.21.15.157:0/321767698 wait complete. 2023-10-16T19:57:25.092 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.083+0000 7f15ecf4b700 1 Processor -- start 2023-10-16T19:57:25.092 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.083+0000 7f15ecf4b700 1 -- start start 2023-10-16T19:57:25.092 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.084+0000 7f15ecf4b700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f15e80b76e0 0x7f15e8157d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:25.093 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.084+0000 7f15ecf4b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f15e80cddb0 0x7f15e80c5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:25.093 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.084+0000 7f15ecf4b700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f15e815bf50 0x7f15e80c5c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:25.093 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.084+0000 7f15ecf4b700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15e81f3ee0 con 0x7f15e80b76e0 2023-10-16T19:57:25.093 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.084+0000 7f15ecf4b700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15e806c570 con 0x7f15e80cddb0 2023-10-16T19:57:25.094 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.084+0000 7f15ecf4b700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15e806c850 con 0x7f15e815bf50 2023-10-16T19:57:25.094 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.084+0000 7f15e659c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f15e80b76e0 0x7f15e8157d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:25.094 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.084+0000 7f15e659c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f15e80b76e0 0x7f15e8157d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:46350/0 (socket says 172.21.15.157:46350) 2023-10-16T19:57:25.094 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.084+0000 7f15e659c700 1 -- 172.21.15.157:0/2783944042 learned_addr learned my addr 172.21.15.157:0/2783944042 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:57:25.094 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.084+0000 7f15e5d9b700 1 --2- 172.21.15.157:0/2783944042 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f15e80cddb0 0x7f15e80c5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:25.095 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.084+0000 7f15e6d9d700 1 --2- 172.21.15.157:0/2783944042 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f15e815bf50 0x7f15e80c5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:25.095 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.084+0000 7f15e659c700 1 -- 172.21.15.157:0/2783944042 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f15e815bf50 msgr2=0x7f15e80c5c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:25.095 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.084+0000 7f15e659c700 1 --2- 172.21.15.157:0/2783944042 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f15e815bf50 0x7f15e80c5c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:25.095 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.084+0000 7f15e659c700 1 -- 172.21.15.157:0/2783944042 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f15e80cddb0 msgr2=0x7f15e80c5700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:25.095 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.084+0000 7f15e659c700 1 --2- 172.21.15.157:0/2783944042 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f15e80cddb0 0x7f15e80c5700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:25.096 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.084+0000 7f15e659c700 1 -- 172.21.15.157:0/2783944042 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15dc009550 con 0x7f15e80b76e0 2023-10-16T19:57:25.096 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.085+0000 7f15e659c700 1 --2- 172.21.15.157:0/2783944042 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f15e80b76e0 0x7f15e8157d10 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f15d800c7f0 tx=0x7f15d800cb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:25.096 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.086+0000 7f15d6ffd700 1 -- 172.21.15.157:0/2783944042 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15d8011800 con 0x7f15e80b76e0 2023-10-16T19:57:25.096 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.086+0000 7f15d6ffd700 1 -- 172.21.15.157:0/2783944042 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15d8011960 con 0x7f15e80b76e0 2023-10-16T19:57:25.096 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.086+0000 7f15ecf4b700 1 -- 172.21.15.157:0/2783944042 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15e806cb30 con 0x7f15e80b76e0 2023-10-16T19:57:25.097 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.086+0000 7f15d6ffd700 1 -- 172.21.15.157:0/2783944042 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15d8011cd0 con 0x7f15e80b76e0 2023-10-16T19:57:25.097 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.086+0000 7f15ecf4b700 1 -- 172.21.15.157:0/2783944042 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15e806d0f0 con 0x7f15e80b76e0 2023-10-16T19:57:25.097 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.087+0000 7f15ecf4b700 1 -- 172.21.15.157:0/2783944042 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15e806d310 con 0x7f15e80b76e0 2023-10-16T19:57:25.097 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.088+0000 7f15d6ffd700 1 -- 172.21.15.157:0/2783944042 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f15d8004020 con 0x7f15e80b76e0 2023-10-16T19:57:25.097 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.088+0000 7f15d6ffd700 1 --2- 172.21.15.157:0/2783944042 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f15c806af00 0x7f15c806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:25.097 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.088+0000 7f15d6ffd700 1 -- 172.21.15.157:0/2783944042 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f15d80890d0 con 0x7f15e80b76e0 2023-10-16T19:57:25.098 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.088+0000 7f15e5d9b700 1 --2- 172.21.15.157:0/2783944042 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f15c806af00 0x7f15c806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:25.098 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.089+0000 7f15e5d9b700 1 --2- 172.21.15.157:0/2783944042 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f15c806af00 0x7f15c806d3c0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f15dc009130 tx=0x7f15dc008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:25.098 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.093+0000 7f15d6ffd700 1 -- 172.21.15.157:0/2783944042 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f15d8054180 con 0x7f15e80b76e0 2023-10-16T19:57:25.327 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.324+0000 7f15ecf4b700 1 -- 172.21.15.157:0/2783944042 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f15e804f400 con 0x7f15e80b76e0 2023-10-16T19:57:25.327 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.325+0000 7f15d6ffd700 1 -- 172.21.15.157:0/2783944042 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4913 (secure 0 0 0) 0x7f15d80577a0 con 0x7f15e80b76e0 2023-10-16T19:57:25.328 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-10-16T19:57:25.328 INFO:teuthology.orchestra.run.smithi157.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/1319816297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6834","nonce":1319816297},{"type":"v1","addr":"172.21.15.187:6835","nonce":1319816297}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4242,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6834/3219992837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6832","nonce":3219992837},{"type":"v1","addr":"172.21.15.157:6834","nonce":3219992837}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4245,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6835/1675699874","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6833","nonce":1675699874},{"type":"v1","addr":"172.21.15.157:6835","nonce":1675699874}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-16T19:57:06.364669+0000","modified":"2023-10-16T19:57:09.412706+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4282":{"gid":4282,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.187:6837/68705029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6836","nonce":68705029},{"type":"v1","addr":"172.21.15.187:6837","nonce":68705029}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-16T19:57:25.330 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.327+0000 7f15ecf4b700 1 -- 172.21.15.157:0/2783944042 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f15c806af00 msgr2=0x7f15c806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:25.330 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.327+0000 7f15ecf4b700 1 --2- 172.21.15.157:0/2783944042 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f15c806af00 0x7f15c806d3c0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f15dc009130 tx=0x7f15dc008030 comp rx=0 tx=0).stop 2023-10-16T19:57:25.330 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.327+0000 7f15ecf4b700 1 -- 172.21.15.157:0/2783944042 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f15e80b76e0 msgr2=0x7f15e8157d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:25.330 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.327+0000 7f15ecf4b700 1 --2- 172.21.15.157:0/2783944042 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f15e80b76e0 0x7f15e8157d10 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f15d800c7f0 tx=0x7f15d800cb00 comp rx=0 tx=0).stop 2023-10-16T19:57:25.331 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.327+0000 7f15ecf4b700 1 -- 172.21.15.157:0/2783944042 shutdown_connections 2023-10-16T19:57:25.331 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.327+0000 7f15ecf4b700 1 --2- 172.21.15.157:0/2783944042 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f15e815bf50 0x7f15e80c5c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:25.331 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.327+0000 7f15ecf4b700 1 --2- 172.21.15.157:0/2783944042 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f15e80b76e0 0x7f15e8157d10 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:25.331 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.327+0000 7f15ecf4b700 1 --2- 172.21.15.157:0/2783944042 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f15c806af00 0x7f15c806d3c0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:25.331 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.327+0000 7f15ecf4b700 1 --2- 172.21.15.157:0/2783944042 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f15e80cddb0 0x7f15e80c5700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:25.332 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.327+0000 7f15ecf4b700 1 -- 172.21.15.157:0/2783944042 >> 172.21.15.157:0/2783944042 conn(0x7f15e806e300 msgr2=0x7f15e815b040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:25.332 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.327+0000 7f15ecf4b700 1 -- 172.21.15.157:0/2783944042 shutdown_connections 2023-10-16T19:57:25.332 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.327+0000 7f15ecf4b700 1 -- 172.21.15.157:0/2783944042 wait complete. 2023-10-16T19:57:25.332 INFO:teuthology.orchestra.run.smithi157.stderr:dumped fsmap epoch 8 2023-10-16T19:57:25.744 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-16T19:57:06.364669+0000', 'modified': '2023-10-16T19:57:09.412706+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4282}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4282': {'gid': 4282, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.187:6837/68705029', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.187:6836', 'nonce': 68705029}, {'type': 'v1', 'addr': '172.21.15.187:6837', 'nonce': 68705029}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-10-16T19:57:25.744 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-16T19:57:25.745 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-10-16T19:57:25.869 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.867+0000 7fc95b65e700 1 Processor -- start 2023-10-16T19:57:25.870 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.867+0000 7fc95b65e700 1 -- start start 2023-10-16T19:57:25.873 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.868+0000 7fc95b65e700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc95415e260 0x7fc954162400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:25.873 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.868+0000 7fc95b65e700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9540cee50 con 0x7fc95415de80 2023-10-16T19:57:25.873 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.868+0000 7fc95b65e700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc954162a40 con 0x7fc9540b5f20 2023-10-16T19:57:25.873 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.868+0000 7fc95b65e700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9540ce5f0 con 0x7fc95415e260 2023-10-16T19:57:25.873 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.868+0000 7fc9593fa700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7fc95415de80 0x7fc9540b5810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:56030/0 (socket says 172.21.15.157:56030) 2023-10-16T19:57:25.874 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.868+0000 7fc9593fa700 1 -- 172.21.15.157:0/3317741879 learned_addr learned my addr 172.21.15.157:0/3317741879 (peer_addr_for_me v1:172.21.15.157:0/0) 2023-10-16T19:57:25.874 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.868+0000 7fc94bfff700 1 -- 172.21.15.157:0/3317741879 <== mon.0 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 966587298 0 0) 0x7fc9540cee50 con 0x7fc95415de80 2023-10-16T19:57:25.874 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.868+0000 7fc959bfb700 1 --2- 172.21.15.157:0/3317741879 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc95415e260 0x7fc954162400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:25.874 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.868+0000 7fc94bfff700 1 -- 172.21.15.157:0/3317741879 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc9400035b0 con 0x7fc95415de80 2023-10-16T19:57:25.874 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.868+0000 7fc94bfff700 1 -- 172.21.15.157:0/3317741879 <== mon.0 v1:172.21.15.157:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2926628707 0 0) 0x7fc9400035b0 con 0x7fc95415de80 2023-10-16T19:57:25.875 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.868+0000 7fc94bfff700 1 -- 172.21.15.157:0/3317741879 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc95415e260 msgr2=0x7fc954162400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:57:25.875 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.868+0000 7fc94bfff700 1 --2- 172.21.15.157:0/3317741879 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc95415e260 0x7fc954162400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:25.875 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.868+0000 7fc94bfff700 1 -- 172.21.15.157:0/3317741879 >> v1:172.21.15.187:6789/0 conn(0x7fc9540b5f20 legacy=0x7fc954161cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:25.875 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.868+0000 7fc94bfff700 1 -- 172.21.15.157:0/3317741879 --> v1:172.21.15.157:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9540ce800 con 0x7fc95415de80 2023-10-16T19:57:25.875 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.868+0000 7fc94bfff700 1 -- 172.21.15.157:0/3317741879 <== mon.0 v1:172.21.15.157:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4021145519 0 0) 0x7fc950001670 con 0x7fc95415de80 2023-10-16T19:57:25.876 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.868+0000 7fc94bfff700 1 -- 172.21.15.157:0/3317741879 >> v1:172.21.15.157:6789/0 conn(0x7fc95415de80 legacy=0x7fc9540b5810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:25.876 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.868+0000 7fc94bfff700 1 --2- 172.21.15.157:0/3317741879 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc95415e260 0x7fc940003a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:25.876 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.868+0000 7fc94bfff700 1 --2- 172.21.15.157:0/3317741879 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc940004020 0x7fc940004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:25.876 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.868+0000 7fc94bfff700 1 --2- 172.21.15.157:0/3317741879 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc940004d90 0x7fc940005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:25.876 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.868+0000 7fc94bfff700 1 -- 172.21.15.157:0/3317741879 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9540ce5f0 con 0x7fc940004d90 2023-10-16T19:57:25.876 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.868+0000 7fc94bfff700 1 -- 172.21.15.157:0/3317741879 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc94000bb20 con 0x7fc940004020 2023-10-16T19:57:25.877 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.868+0000 7fc94bfff700 1 -- 172.21.15.157:0/3317741879 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc94000bce0 con 0x7fc95415e260 2023-10-16T19:57:25.877 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.869+0000 7fc959bfb700 1 --2- 172.21.15.157:0/3317741879 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc940004d90 0x7fc940005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:25.877 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.869+0000 7fc9593fa700 1 --2- 172.21.15.157:0/3317741879 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc95415e260 0x7fc940003a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:25.877 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.869+0000 7fc958bf9700 1 --2- 172.21.15.157:0/3317741879 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc940004020 0x7fc940004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:25.878 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.869+0000 7fc959bfb700 1 -- 172.21.15.157:0/3317741879 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc95415e260 msgr2=0x7fc940003a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:57:25.878 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.869+0000 7fc959bfb700 1 --2- 172.21.15.157:0/3317741879 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc95415e260 0x7fc940003a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:25.878 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.869+0000 7fc959bfb700 1 -- 172.21.15.157:0/3317741879 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc940004020 msgr2=0x7fc940004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:57:25.878 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.869+0000 7fc959bfb700 1 --2- 172.21.15.157:0/3317741879 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc940004020 0x7fc940004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:25.878 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.869+0000 7fc959bfb700 1 -- 172.21.15.157:0/3317741879 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9400035b0 con 0x7fc940004d90 2023-10-16T19:57:25.879 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.869+0000 7fc959bfb700 1 --2- 172.21.15.157:0/3317741879 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc940004d90 0x7fc940005210 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fc94c007330 tx=0x7fc940005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55a6e7d1aae0d729 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:25.879 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.869+0000 7fc94bfff700 1 -- 172.21.15.157:0/3317741879 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc94c007e50 con 0x7fc940004d90 2023-10-16T19:57:25.879 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.869+0000 7fc94bfff700 1 -- 172.21.15.157:0/3317741879 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc94c014400 con 0x7fc940004d90 2023-10-16T19:57:25.879 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.869+0000 7fc94bfff700 1 -- 172.21.15.157:0/3317741879 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc94c014790 con 0x7fc940004d90 2023-10-16T19:57:25.879 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.870+0000 7fc95b65e700 1 -- 172.21.15.157:0/3317741879 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc940004d90 msgr2=0x7fc940005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:25.880 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.870+0000 7fc95b65e700 1 --2- 172.21.15.157:0/3317741879 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc940004d90 0x7fc940005210 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fc94c007330 tx=0x7fc940005880 comp rx=0 tx=0).stop 2023-10-16T19:57:25.880 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.870+0000 7fc959bfb700 1 -- 172.21.15.157:0/3317741879 reap_dead start 2023-10-16T19:57:25.880 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.870+0000 7fc95b65e700 1 -- 172.21.15.157:0/3317741879 shutdown_connections 2023-10-16T19:57:25.880 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.870+0000 7fc95b65e700 1 -- 172.21.15.157:0/3317741879 >> 172.21.15.157:0/3317741879 conn(0x7fc9540d0810 msgr2=0x7fc9540d0bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:25.880 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.870+0000 7fc95b65e700 1 -- 172.21.15.157:0/3317741879 shutdown_connections 2023-10-16T19:57:25.881 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.870+0000 7fc95b65e700 1 -- 172.21.15.157:0/3317741879 wait complete. 2023-10-16T19:57:25.889 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.871+0000 7fc95b65e700 1 Processor -- start 2023-10-16T19:57:25.889 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.871+0000 7fc95b65e700 1 -- start start 2023-10-16T19:57:25.889 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.872+0000 7fc95b65e700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc954154e80 0x7fc9540cd5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:25.889 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.872+0000 7fc95b65e700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc95415ee40 0x7fc9540d25e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:25.890 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.872+0000 7fc95b65e700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc954155610 0x7fc9540d2b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:25.890 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.872+0000 7fc95b65e700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9540cdae0 con 0x7fc954155610 2023-10-16T19:57:25.890 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.872+0000 7fc95b65e700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9540cc500 con 0x7fc95415ee40 2023-10-16T19:57:25.890 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.872+0000 7fc95b65e700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9540cc7e0 con 0x7fc954154e80 2023-10-16T19:57:25.890 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.872+0000 7fc959bfb700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc954155610 0x7fc9540d2b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:25.890 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.872+0000 7fc959bfb700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc954155610 0x7fc9540d2b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:46374/0 (socket says 172.21.15.157:46374) 2023-10-16T19:57:25.891 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.872+0000 7fc959bfb700 1 -- 172.21.15.157:0/2274940051 learned_addr learned my addr 172.21.15.157:0/2274940051 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:57:25.891 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.872+0000 7fc9593fa700 1 --2- 172.21.15.157:0/2274940051 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc954154e80 0x7fc9540cd5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:25.891 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.872+0000 7fc958bf9700 1 --2- 172.21.15.157:0/2274940051 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc95415ee40 0x7fc9540d25e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:25.891 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.872+0000 7fc959bfb700 1 -- 172.21.15.157:0/2274940051 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc954154e80 msgr2=0x7fc9540cd5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:25.891 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.872+0000 7fc959bfb700 1 --2- 172.21.15.157:0/2274940051 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc954154e80 0x7fc9540cd5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:25.892 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.872+0000 7fc959bfb700 1 -- 172.21.15.157:0/2274940051 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc95415ee40 msgr2=0x7fc9540d25e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:25.892 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.872+0000 7fc959bfb700 1 --2- 172.21.15.157:0/2274940051 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc95415ee40 0x7fc9540d25e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:25.892 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.872+0000 7fc959bfb700 1 -- 172.21.15.157:0/2274940051 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9540ccac0 con 0x7fc954155610 2023-10-16T19:57:25.892 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.872+0000 7fc959bfb700 1 --2- 172.21.15.157:0/2274940051 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc954155610 0x7fc9540d2b20 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fc94c014000 tx=0x7fc94c004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:25.892 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.872+0000 7fc949ffb700 1 -- 172.21.15.157:0/2274940051 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc94c007000 con 0x7fc954155610 2023-10-16T19:57:25.893 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.872+0000 7fc949ffb700 1 -- 172.21.15.157:0/2274940051 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc94c014980 con 0x7fc954155610 2023-10-16T19:57:25.893 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.872+0000 7fc95b65e700 1 -- 172.21.15.157:0/2274940051 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9540ccda0 con 0x7fc954155610 2023-10-16T19:57:25.893 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.872+0000 7fc949ffb700 1 -- 172.21.15.157:0/2274940051 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc94c014d30 con 0x7fc954155610 2023-10-16T19:57:25.893 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.873+0000 7fc95b65e700 1 -- 172.21.15.157:0/2274940051 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9540cc140 con 0x7fc954155610 2023-10-16T19:57:25.893 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.875+0000 7fc949ffb700 1 -- 172.21.15.157:0/2274940051 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fc94c004040 con 0x7fc954155610 2023-10-16T19:57:25.893 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.876+0000 7fc949ffb700 1 --2- 172.21.15.157:0/2274940051 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fc93806af00 0x7fc93806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:25.894 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.876+0000 7fc949ffb700 1 -- 172.21.15.157:0/2274940051 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc94c08a710 con 0x7fc954155610 2023-10-16T19:57:25.894 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.876+0000 7fc9593fa700 1 --2- 172.21.15.157:0/2274940051 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fc93806af00 0x7fc93806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:25.894 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.877+0000 7fc967848b80 1 Processor -- start 2023-10-16T19:57:25.894 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.877+0000 7fc967848b80 1 -- start start 2023-10-16T19:57:25.894 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.877+0000 7fc9593fa700 1 --2- 172.21.15.157:0/2274940051 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fc93806af00 0x7fc93806d3c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fc950001aa0 tx=0x7fc950000ed0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:25.895 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.877+0000 7fc967848b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e388c82220 0x55e388c89a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:25.895 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.877+0000 7fc967848b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55e388c87630 0x55e388c89fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:25.895 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.877+0000 7fc967848b80 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55e388c5d010 0x55e388c5d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:25.895 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.877+0000 7fc967848b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e388bd3c20 con 0x55e388c87630 2023-10-16T19:57:25.895 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.877+0000 7fc967848b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e388bb8c10 con 0x55e388c82220 2023-10-16T19:57:25.896 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.877+0000 7fc967848b80 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e388bb6530 con 0x55e388c5d010 2023-10-16T19:57:25.896 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.877+0000 7fc958bf9700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55e388c87630 0x55e388c89fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:25.896 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.877+0000 7fc958bf9700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55e388c87630 0x55e388c89fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:46380/0 (socket says 172.21.15.157:46380) 2023-10-16T19:57:25.896 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.877+0000 7fc958bf9700 1 -- 172.21.15.157:0/2032699360 learned_addr learned my addr 172.21.15.157:0/2032699360 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:57:25.896 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.878+0000 7fc9593fa700 1 --2- 172.21.15.157:0/2032699360 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e388c82220 0x55e388c89a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:25.896 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.878+0000 7fc959bfb700 1 --2- 172.21.15.157:0/2032699360 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55e388c5d010 0x55e388c5d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:25.897 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.878+0000 7fc958bf9700 1 -- 172.21.15.157:0/2032699360 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55e388c5d010 msgr2=0x55e388c5d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:57:25.897 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.878+0000 7fc958bf9700 1 --2- 172.21.15.157:0/2032699360 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55e388c5d010 0x55e388c5d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:25.897 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.878+0000 7fc958bf9700 1 -- 172.21.15.157:0/2032699360 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e388c82220 msgr2=0x55e388c89a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:57:25.897 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.878+0000 7fc958bf9700 1 --2- 172.21.15.157:0/2032699360 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e388c82220 0x55e388c89a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:25.897 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.878+0000 7fc958bf9700 1 -- 172.21.15.157:0/2032699360 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e388b6f3a0 con 0x55e388c87630 2023-10-16T19:57:25.898 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.878+0000 7fc9593fa700 1 --2- 172.21.15.157:0/2032699360 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e388c82220 0x55e388c89a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T19:57:25.898 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.878+0000 7fc958bf9700 1 --2- 172.21.15.157:0/2032699360 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55e388c87630 0x55e388c89fb0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fc944001760 tx=0x7fc944007d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77cf1e8b9e81f9f6 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:25.898 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.878+0000 7fc93effd700 1 -- 172.21.15.157:0/2032699360 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc94401a030 con 0x55e388c87630 2023-10-16T19:57:25.898 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.878+0000 7fc93effd700 1 -- 172.21.15.157:0/2032699360 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9440053e0 con 0x55e388c87630 2023-10-16T19:57:25.898 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.878+0000 7fc93effd700 1 -- 172.21.15.157:0/2032699360 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc944006a80 con 0x55e388c87630 2023-10-16T19:57:25.899 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.878+0000 7fc967848b80 1 -- 172.21.15.157:0/2032699360 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55e388c87630 msgr2=0x55e388c89fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:25.899 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.879+0000 7fc967848b80 1 --2- 172.21.15.157:0/2032699360 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55e388c87630 0x55e388c89fb0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fc944001760 tx=0x7fc944007d10 comp rx=0 tx=0).stop 2023-10-16T19:57:25.899 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.879+0000 7fc967848b80 1 -- 172.21.15.157:0/2032699360 shutdown_connections 2023-10-16T19:57:25.899 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.879+0000 7fc967848b80 1 --2- 172.21.15.157:0/2032699360 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e388c82220 0x55e388c89a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:25.899 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.879+0000 7fc967848b80 1 --2- 172.21.15.157:0/2032699360 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55e388c5d010 0x55e388c5d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:25.899 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.879+0000 7fc967848b80 1 --2- 172.21.15.157:0/2032699360 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55e388c87630 0x55e388c89fb0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:25.900 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.879+0000 7fc967848b80 1 -- 172.21.15.157:0/2032699360 >> 172.21.15.157:0/2032699360 conn(0x55e388b8cd80 msgr2=0x55e388ca7ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:25.900 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.879+0000 7fc967848b80 1 -- 172.21.15.157:0/2032699360 shutdown_connections 2023-10-16T19:57:25.900 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.879+0000 7fc967848b80 1 -- 172.21.15.157:0/2032699360 wait complete. 2023-10-16T19:57:25.900 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.879+0000 7fc967848b80 1 -- start start 2023-10-16T19:57:25.900 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.879+0000 7fc967848b80 1 Processor -- start 2023-10-16T19:57:25.901 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.880+0000 7fc967848b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e388c5d010 0x55e388c84a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:25.901 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.880+0000 7fc967848b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55e388c82220 0x55e388ca4a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:25.901 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.880+0000 7fc967848b80 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55e388c87630 0x55e388ca4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:25.901 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.880+0000 7fc967848b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e388bb1e20 con 0x55e388c82220 2023-10-16T19:57:25.901 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.880+0000 7fc967848b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e388b4e6c0 con 0x55e388c5d010 2023-10-16T19:57:25.901 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.880+0000 7fc967848b80 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e388b4e360 con 0x55e388c87630 2023-10-16T19:57:25.902 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.880+0000 7fc967848b80 10 client.0 _ll_register_callbacks cb 0x55e3889ab7b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-16T19:57:25.902 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.880+0000 7fc958bf9700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55e388c82220 0x55e388ca4a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:25.902 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.880+0000 7fc958bf9700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55e388c82220 0x55e388ca4a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:46386/0 (socket says 172.21.15.157:46386) 2023-10-16T19:57:25.902 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.880+0000 7fc958bf9700 1 -- 172.21.15.157:0/702715053 learned_addr learned my addr 172.21.15.157:0/702715053 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:57:25.902 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.880+0000 7fc9593fa700 1 --2- 172.21.15.157:0/702715053 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e388c5d010 0x55e388c84a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:25.903 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.880+0000 7fc959bfb700 1 --2- 172.21.15.157:0/702715053 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55e388c87630 0x55e388ca4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:25.903 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.880+0000 7fc958bf9700 1 -- 172.21.15.157:0/702715053 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55e388c87630 msgr2=0x55e388ca4fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:57:25.903 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.880+0000 7fc958bf9700 1 --2- 172.21.15.157:0/702715053 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55e388c87630 0x55e388ca4fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:25.903 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.880+0000 7fc958bf9700 1 -- 172.21.15.157:0/702715053 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e388c5d010 msgr2=0x55e388c84a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:57:25.903 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.880+0000 7fc958bf9700 1 --2- 172.21.15.157:0/702715053 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e388c5d010 0x55e388c84a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:25.904 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.880+0000 7fc958bf9700 1 -- 172.21.15.157:0/702715053 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc954162a40 con 0x55e388c82220 2023-10-16T19:57:25.904 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.880+0000 7fc9593fa700 1 --2- 172.21.15.157:0/702715053 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e388c5d010 0x55e388c84a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T19:57:25.904 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.881+0000 7fc958bf9700 1 --2- 172.21.15.157:0/702715053 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55e388c82220 0x55e388ca4a70 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fc944016000 tx=0x7fc944001190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1eed94cc8404d07 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:25.904 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.881+0000 7fc933fff700 10 client.0 ms_handle_connect on v2:172.21.15.157:3300/0 2023-10-16T19:57:25.904 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.881+0000 7fc933fff700 1 -- 172.21.15.157:0/702715053 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc944003a90 con 0x55e388c82220 2023-10-16T19:57:25.905 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.881+0000 7fc933fff700 1 -- 172.21.15.157:0/702715053 <== mon.0 v2:172.21.15.157:3300/0 2 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc94401b070 con 0x55e388c82220 2023-10-16T19:57:25.905 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.881+0000 7fc967848b80 1 -- 172.21.15.157:0/702715053 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e388c525b0 con 0x55e388c82220 2023-10-16T19:57:25.905 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.881+0000 7fc933fff700 1 -- 172.21.15.157:0/702715053 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc944005550 con 0x55e388c82220 2023-10-16T19:57:25.905 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.881+0000 7fc967848b80 10 client.4641 fetch_fsmap learned FSMap version 8 2023-10-16T19:57:25.905 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.881+0000 7fc967848b80 1 -- 172.21.15.157:0/702715053 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x55e3889dcd90 con 0x55e388c82220 2023-10-16T19:57:25.905 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.881+0000 7fc933fff700 1 -- 172.21.15.157:0/702715053 <== mon.0 v2:172.21.15.157:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55e388c525b0 con 0x55e388c82220 2023-10-16T19:57:25.906 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.881+0000 7fc933fff700 1 -- 172.21.15.157:0/702715053 <== mon.0 v2:172.21.15.157:3300/0 5 ==== fsmap(e 8) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fc944003bf0 con 0x55e388c82220 2023-10-16T19:57:25.906 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.881+0000 7fc967848b80 10 client.4641 fetch_fsmap finished waiting for FSMap version 8 2023-10-16T19:57:25.906 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.881+0000 7fc967848b80 10 client.4641 resolve_mds: resolved name 'd' to daemon mds.d 2023-10-16T19:57:25.906 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.881+0000 7fc967848b80 20 client.4641 populate_metadata read hostname 'smithi157' 2023-10-16T19:57:25.906 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.881+0000 7fc967848b80 1 --2- 172.21.15.157:0/702715053 >> [v2:172.21.15.187:6836/68705029,v1:172.21.15.187:6837/68705029] conn(0x55e388ca7920 0x55e388c8b780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:25.907 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.881+0000 7fc967848b80 4 client.4641 mds_command: new command op to 4282 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-16T19:57:25.907 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.881+0000 7fc967848b80 1 -- 172.21.15.157:0/702715053 --> [v2:172.21.15.187:6836/68705029,v1:172.21.15.187:6837/68705029] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e388baae00 con 0x55e388ca7920 2023-10-16T19:57:25.907 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.881+0000 7fc9593fa700 1 --2- 172.21.15.157:0/702715053 >> [v2:172.21.15.187:6836/68705029,v1:172.21.15.187:6837/68705029] conn(0x55e388ca7920 0x55e388c8b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:25.907 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.882+0000 7fc933fff700 10 client.4641 ms_handle_connect on v2:172.21.15.187:6836/68705029 2023-10-16T19:57:25.907 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.882+0000 7fc9593fa700 1 --2- 172.21.15.157:0/702715053 >> [v2:172.21.15.187:6836/68705029,v1:172.21.15.187:6837/68705029] conn(0x55e388ca7920 0x55e388c8b780 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e1524bb63e8e0cc server_cookie=a4aa8aa0de3ee9fd in_seq=0 out_seq=0 2023-10-16T19:57:25.908 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.882+0000 7fc933fff700 1 -- 172.21.15.157:0/702715053 <== mds.0 v2:172.21.15.187:6836/68705029 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55e388baae00 con 0x55e388ca7920 2023-10-16T19:57:25.908 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.882+0000 7fc933fff700 10 client.4641 handle_command_reply: tid=0 2023-10-16T19:57:25.908 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.882+0000 7fc967848b80 1 client.4641 shutdown 2023-10-16T19:57:25.908 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.883+0000 7fc967848b80 1 -- 172.21.15.157:0/702715053 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55e388c82220 msgr2=0x55e388ca4a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:25.908 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.883+0000 7fc967848b80 1 --2- 172.21.15.157:0/702715053 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55e388c82220 0x55e388ca4a70 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fc944016000 tx=0x7fc944001190 comp rx=0 tx=0).stop 2023-10-16T19:57:25.908 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.883+0000 7fc967848b80 1 -- 172.21.15.157:0/702715053 shutdown_connections 2023-10-16T19:57:25.909 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.883+0000 7fc967848b80 1 --2- 172.21.15.157:0/702715053 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e388c5d010 0x55e388c84a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:25.909 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.883+0000 7fc967848b80 1 --2- 172.21.15.157:0/702715053 >> [v2:172.21.15.187:6836/68705029,v1:172.21.15.187:6837/68705029] conn(0x55e388ca7920 0x55e388c8b780 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:25.909 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.883+0000 7fc967848b80 1 --2- 172.21.15.157:0/702715053 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55e388c87630 0x55e388ca4fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:25.909 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.883+0000 7fc933fff700 0 client.4641 ms_handle_reset on v2:172.21.15.187:6836/68705029 2023-10-16T19:57:25.909 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.883+0000 7fc967848b80 1 --2- 172.21.15.157:0/702715053 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55e388c82220 0x55e388ca4a70 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:25.910 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.883+0000 7fc967848b80 1 -- 172.21.15.157:0/702715053 >> 172.21.15.157:0/702715053 conn(0x55e388b8cd80 msgr2=0x55e388c9e860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:25.910 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.883+0000 7fc967848b80 1 -- 172.21.15.157:0/702715053 shutdown_connections 2023-10-16T19:57:25.910 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.883+0000 7fc967848b80 1 -- 172.21.15.157:0/702715053 wait complete. 2023-10-16T19:57:25.910 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.883+0000 7fc967848b80 20 client.4641 trim_cache size 0 max 16384 2023-10-16T19:57:25.916 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.901+0000 7fc967848b80 1 Processor -- start 2023-10-16T19:57:25.916 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.901+0000 7fc967848b80 1 -- start start 2023-10-16T19:57:25.917 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.901+0000 7fc967848b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e388c5d010 0x55e388c60a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:25.917 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.901+0000 7fc967848b80 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55e388c82220 0x55e388c811f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:25.917 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.902+0000 7fc967848b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55e388c87630 0x55e388ca7d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:25.917 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.902+0000 7fc967848b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e388a328d0 con 0x55e388c87630 2023-10-16T19:57:25.917 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.902+0000 7fc967848b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e388c5d3f0 con 0x55e388c5d010 2023-10-16T19:57:25.918 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.902+0000 7fc967848b80 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e388c82850 con 0x55e388c82220 2023-10-16T19:57:25.918 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.902+0000 7fc959bfb700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55e388c87630 0x55e388ca7d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:25.918 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.902+0000 7fc959bfb700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55e388c87630 0x55e388ca7d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:46396/0 (socket says 172.21.15.157:46396) 2023-10-16T19:57:25.918 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.902+0000 7fc959bfb700 1 -- 172.21.15.157:0/1025018927 learned_addr learned my addr 172.21.15.157:0/1025018927 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:57:25.918 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.902+0000 7fc9593fa700 1 --2- 172.21.15.157:0/1025018927 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e388c5d010 0x55e388c60a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:25.919 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.902+0000 7fc958bf9700 1 --2- 172.21.15.157:0/1025018927 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55e388c82220 0x55e388c811f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:25.919 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.902+0000 7fc959bfb700 1 -- 172.21.15.157:0/1025018927 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55e388c82220 msgr2=0x55e388c811f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:57:25.919 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.902+0000 7fc959bfb700 1 --2- 172.21.15.157:0/1025018927 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55e388c82220 0x55e388c811f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:25.919 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.902+0000 7fc959bfb700 1 -- 172.21.15.157:0/1025018927 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e388c5d010 msgr2=0x55e388c60a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:57:25.919 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.902+0000 7fc959bfb700 1 --2- 172.21.15.157:0/1025018927 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e388c5d010 0x55e388c60a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:25.920 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.902+0000 7fc959bfb700 1 -- 172.21.15.157:0/1025018927 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e388c5b430 con 0x55e388c87630 2023-10-16T19:57:25.920 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.902+0000 7fc958bf9700 1 --2- 172.21.15.157:0/1025018927 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55e388c82220 0x55e388c811f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T19:57:25.920 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.902+0000 7fc959bfb700 1 --2- 172.21.15.157:0/1025018927 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55e388c87630 0x55e388ca7d00 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fc94c017040 tx=0x7fc94c014eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6deddaf9fdd0f345 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:25.920 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.902+0000 7fc93f7fe700 1 -- 172.21.15.157:0/1025018927 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc94c059050 con 0x55e388c87630 2023-10-16T19:57:25.920 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.902+0000 7fc93f7fe700 1 -- 172.21.15.157:0/1025018927 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc94c059df0 con 0x55e388c87630 2023-10-16T19:57:25.921 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.902+0000 7fc93f7fe700 1 -- 172.21.15.157:0/1025018927 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc94c0596f0 con 0x55e388c87630 2023-10-16T19:57:25.921 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.903+0000 7fc967848b80 1 -- 172.21.15.157:0/1025018927 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55e388c87630 msgr2=0x55e388ca7d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:25.921 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.903+0000 7fc967848b80 1 --2- 172.21.15.157:0/1025018927 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55e388c87630 0x55e388ca7d00 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fc94c017040 tx=0x7fc94c014eb0 comp rx=0 tx=0).stop 2023-10-16T19:57:25.921 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.903+0000 7fc967848b80 1 -- 172.21.15.157:0/1025018927 shutdown_connections 2023-10-16T19:57:25.921 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.903+0000 7fc967848b80 1 --2- 172.21.15.157:0/1025018927 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e388c5d010 0x55e388c60a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:25.922 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.903+0000 7fc967848b80 1 --2- 172.21.15.157:0/1025018927 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55e388c87630 0x55e388ca7d00 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:25.922 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.903+0000 7fc967848b80 1 --2- 172.21.15.157:0/1025018927 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55e388c82220 0x55e388c811f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:25.922 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.903+0000 7fc967848b80 1 -- 172.21.15.157:0/1025018927 >> 172.21.15.157:0/1025018927 conn(0x55e388b8cd80 msgr2=0x55e388c9e860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:25.922 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.903+0000 7fc967848b80 1 -- 172.21.15.157:0/1025018927 shutdown_connections 2023-10-16T19:57:25.922 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.903+0000 7fc967848b80 1 -- 172.21.15.157:0/1025018927 wait complete. 2023-10-16T19:57:25.923 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.903+0000 7fc967848b80 1 -- start start 2023-10-16T19:57:25.923 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.903+0000 7fc967848b80 1 Processor -- start 2023-10-16T19:57:25.923 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.904+0000 7fc967848b80 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55e388c5d010 0x55e388cbdb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:25.923 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.904+0000 7fc967848b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55e388c82220 0x55e388c53fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:25.923 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.904+0000 7fc967848b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e388c87630 0x55e388c5ef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:25.923 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.904+0000 7fc967848b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e388c5fb40 con 0x55e388c82220 2023-10-16T19:57:25.924 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.904+0000 7fc967848b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e388c5d510 con 0x55e388c87630 2023-10-16T19:57:25.924 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.904+0000 7fc967848b80 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e388c5b850 con 0x55e388c5d010 2023-10-16T19:57:25.924 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.904+0000 7fc967848b80 10 client.0 _ll_register_callbacks cb 0x7fc94c0093b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-16T19:57:25.924 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.904+0000 7fc958bf9700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55e388c82220 0x55e388c53fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:25.924 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.904+0000 7fc958bf9700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55e388c82220 0x55e388c53fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:46400/0 (socket says 172.21.15.157:46400) 2023-10-16T19:57:25.925 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.904+0000 7fc958bf9700 1 -- 172.21.15.157:0/76856344 learned_addr learned my addr 172.21.15.157:0/76856344 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:57:25.925 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.904+0000 7fc9593fa700 1 --2- 172.21.15.157:0/76856344 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55e388c5d010 0x55e388cbdb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:25.925 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.904+0000 7fc959bfb700 1 --2- 172.21.15.157:0/76856344 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e388c87630 0x55e388c5ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:25.925 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.905+0000 7fc958bf9700 1 -- 172.21.15.157:0/76856344 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55e388c5d010 msgr2=0x55e388cbdb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:57:25.925 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.905+0000 7fc958bf9700 1 --2- 172.21.15.157:0/76856344 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55e388c5d010 0x55e388cbdb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:25.926 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.905+0000 7fc958bf9700 1 -- 172.21.15.157:0/76856344 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e388c87630 msgr2=0x55e388c5ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:57:25.926 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.905+0000 7fc958bf9700 1 --2- 172.21.15.157:0/76856344 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e388c87630 0x55e388c5ef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:25.926 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.905+0000 7fc958bf9700 1 -- 172.21.15.157:0/76856344 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9540cc140 con 0x55e388c82220 2023-10-16T19:57:25.926 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.905+0000 7fc958bf9700 1 --2- 172.21.15.157:0/76856344 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55e388c82220 0x55e388c53fb0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fc944016000 tx=0x7fc944009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9408d0dd4d701beb server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:25.926 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.905+0000 7fc933fff700 10 client.0 ms_handle_connect on v2:172.21.15.157:3300/0 2023-10-16T19:57:25.927 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.905+0000 7fc933fff700 1 -- 172.21.15.157:0/76856344 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc94401a040 con 0x55e388c82220 2023-10-16T19:57:25.927 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.905+0000 7fc933fff700 1 -- 172.21.15.157:0/76856344 <== mon.0 v2:172.21.15.157:3300/0 2 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc944007300 con 0x55e388c82220 2023-10-16T19:57:25.927 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.905+0000 7fc967848b80 1 -- 172.21.15.157:0/76856344 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc9440053e0 con 0x55e388c82220 2023-10-16T19:57:25.927 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.905+0000 7fc933fff700 1 -- 172.21.15.157:0/76856344 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc944005550 con 0x55e388c82220 2023-10-16T19:57:25.927 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.905+0000 7fc967848b80 10 client.4647 fetch_fsmap learned FSMap version 8 2023-10-16T19:57:25.927 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.905+0000 7fc967848b80 1 -- 172.21.15.157:0/76856344 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x55e3889c5c10 con 0x55e388c82220 2023-10-16T19:57:25.928 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.905+0000 7fc933fff700 1 -- 172.21.15.157:0/76856344 <== mon.0 v2:172.21.15.157:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9440053e0 con 0x55e388c82220 2023-10-16T19:57:25.928 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.905+0000 7fc933fff700 1 -- 172.21.15.157:0/76856344 <== mon.0 v2:172.21.15.157:3300/0 5 ==== fsmap(e 8) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fc944001a70 con 0x55e388c82220 2023-10-16T19:57:25.928 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.905+0000 7fc967848b80 10 client.4647 fetch_fsmap finished waiting for FSMap version 8 2023-10-16T19:57:25.928 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.905+0000 7fc967848b80 10 client.4647 resolve_mds: resolved name 'd' to daemon mds.d 2023-10-16T19:57:25.928 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.905+0000 7fc967848b80 20 client.4647 populate_metadata read hostname 'smithi157' 2023-10-16T19:57:25.929 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.905+0000 7fc967848b80 1 --2- 172.21.15.157:0/76856344 >> [v2:172.21.15.187:6836/68705029,v1:172.21.15.187:6837/68705029] conn(0x55e388c60cc0 0x55e388c59a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:25.929 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.905+0000 7fc967848b80 4 client.4647 mds_command: new command op to 4282 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-16T19:57:25.929 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.905+0000 7fc967848b80 1 -- 172.21.15.157:0/76856344 --> [v2:172.21.15.187:6836/68705029,v1:172.21.15.187:6837/68705029] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55e388baab20 con 0x55e388c60cc0 2023-10-16T19:57:25.929 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.906+0000 7fc9593fa700 1 --2- 172.21.15.157:0/76856344 >> [v2:172.21.15.187:6836/68705029,v1:172.21.15.187:6837/68705029] conn(0x55e388c60cc0 0x55e388c59a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:25.929 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.906+0000 7fc9593fa700 1 --2- 172.21.15.157:0/76856344 >> [v2:172.21.15.187:6836/68705029,v1:172.21.15.187:6837/68705029] conn(0x55e388c60cc0 0x55e388c59a90 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=214c17380fe103a4 server_cookie=f1b9bd93ebb752de in_seq=0 out_seq=0 2023-10-16T19:57:25.929 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.906+0000 7fc933fff700 10 client.4647 ms_handle_connect on v2:172.21.15.187:6836/68705029 2023-10-16T19:57:25.930 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.906+0000 7fc933fff700 1 -- 172.21.15.157:0/76856344 <== mds.0 v2:172.21.15.187:6836/68705029 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x55e388baab20 con 0x55e388c60cc0 2023-10-16T19:57:25.930 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.906+0000 7fc933fff700 10 client.4647 handle_command_reply: tid=0 2023-10-16T19:57:25.930 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.906+0000 7fc967848b80 1 client.4647 shutdown 2023-10-16T19:57:25.930 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.906+0000 7fc967848b80 1 -- 172.21.15.157:0/76856344 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55e388c82220 msgr2=0x55e388c53fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:25.930 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.906+0000 7fc967848b80 1 --2- 172.21.15.157:0/76856344 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55e388c82220 0x55e388c53fb0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fc944016000 tx=0x7fc944009040 comp rx=0 tx=0).stop 2023-10-16T19:57:25.931 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.906+0000 7fc967848b80 1 -- 172.21.15.157:0/76856344 shutdown_connections 2023-10-16T19:57:25.931 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.906+0000 7fc967848b80 1 --2- 172.21.15.157:0/76856344 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e388c87630 0x55e388c5ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:25.931 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.906+0000 7fc967848b80 1 --2- 172.21.15.157:0/76856344 >> [v2:172.21.15.187:6836/68705029,v1:172.21.15.187:6837/68705029] conn(0x55e388c60cc0 0x55e388c59a90 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:25.931 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.906+0000 7fc967848b80 1 --2- 172.21.15.157:0/76856344 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55e388c5d010 0x55e388cbdb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:25.931 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.906+0000 7fc933fff700 0 client.4647 ms_handle_reset on v2:172.21.15.187:6836/68705029 2023-10-16T19:57:25.932 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.906+0000 7fc967848b80 1 --2- 172.21.15.157:0/76856344 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55e388c82220 0x55e388c53fb0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:25.932 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.906+0000 7fc967848b80 1 -- 172.21.15.157:0/76856344 >> 172.21.15.157:0/76856344 conn(0x55e388b8cd80 msgr2=0x55e388ca7d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:25.932 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.906+0000 7fc967848b80 1 -- 172.21.15.157:0/76856344 shutdown_connections 2023-10-16T19:57:25.932 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.906+0000 7fc967848b80 1 -- 172.21.15.157:0/76856344 wait complete. 2023-10-16T19:57:25.932 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.906+0000 7fc967848b80 20 client.4647 trim_cache size 0 max 16384 2023-10-16T19:57:25.933 INFO:teuthology.orchestra.run.smithi157.stdout:{ 2023-10-16T19:57:25.933 INFO:teuthology.orchestra.run.smithi157.stdout: "cluster_fsid": "28199dc9-64d5-479e-83c6-21f097c33d39", 2023-10-16T19:57:25.933 INFO:teuthology.orchestra.run.smithi157.stdout: "whoami": 0, 2023-10-16T19:57:25.933 INFO:teuthology.orchestra.run.smithi157.stdout: "id": 4282, 2023-10-16T19:57:25.933 INFO:teuthology.orchestra.run.smithi157.stdout: "want_state": "up:active", 2023-10-16T19:57:25.934 INFO:teuthology.orchestra.run.smithi157.stdout: "state": "up:active", 2023-10-16T19:57:25.934 INFO:teuthology.orchestra.run.smithi157.stdout: "fs_name": "cephfs", 2023-10-16T19:57:25.934 INFO:teuthology.orchestra.run.smithi157.stdout: "rank_uptime": 18.899262243999999, 2023-10-16T19:57:25.934 INFO:teuthology.orchestra.run.smithi157.stdout: "mdsmap_epoch": 8, 2023-10-16T19:57:25.934 INFO:teuthology.orchestra.run.smithi157.stdout: "osdmap_epoch": 21, 2023-10-16T19:57:25.935 INFO:teuthology.orchestra.run.smithi157.stdout: "osdmap_epoch_barrier": 21, 2023-10-16T19:57:25.935 INFO:teuthology.orchestra.run.smithi157.stdout: "uptime": 25.699643551000001 2023-10-16T19:57:25.935 INFO:teuthology.orchestra.run.smithi157.stdout:} 2023-10-16T19:57:25.936 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.907+0000 7fc95b65e700 1 -- 172.21.15.157:0/2274940051 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fc93806af00 msgr2=0x7fc93806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:25.937 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.907+0000 7fc95b65e700 1 --2- 172.21.15.157:0/2274940051 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fc93806af00 0x7fc93806d3c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fc950001aa0 tx=0x7fc950000ed0 comp rx=0 tx=0).stop 2023-10-16T19:57:25.937 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.907+0000 7fc95b65e700 1 -- 172.21.15.157:0/2274940051 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc954155610 msgr2=0x7fc9540d2b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:25.937 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.907+0000 7fc95b65e700 1 --2- 172.21.15.157:0/2274940051 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc954155610 0x7fc9540d2b20 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fc94c014000 tx=0x7fc94c004b40 comp rx=0 tx=0).stop 2023-10-16T19:57:25.937 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.907+0000 7fc95b65e700 1 -- 172.21.15.157:0/2274940051 shutdown_connections 2023-10-16T19:57:25.937 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.907+0000 7fc95b65e700 1 --2- 172.21.15.157:0/2274940051 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc954155610 0x7fc9540d2b20 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:25.938 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.907+0000 7fc95b65e700 1 --2- 172.21.15.157:0/2274940051 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc954154e80 0x7fc9540cd5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:25.938 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.907+0000 7fc95b65e700 1 --2- 172.21.15.157:0/2274940051 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fc93806af00 0x7fc93806d3c0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:25.938 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.907+0000 7fc95b65e700 1 --2- 172.21.15.157:0/2274940051 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc95415ee40 0x7fc9540d25e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:25.938 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.907+0000 7fc95b65e700 1 -- 172.21.15.157:0/2274940051 >> 172.21.15.157:0/2274940051 conn(0x7fc9540d0810 msgr2=0x7fc95415d400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:25.938 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.907+0000 7fc95b65e700 1 -- 172.21.15.157:0/2274940051 shutdown_connections 2023-10-16T19:57:25.939 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:25.907+0000 7fc95b65e700 1 -- 172.21.15.157:0/2274940051 wait complete. 2023-10-16T19:57:25.939 INFO:teuthology.run_tasks:Running task kclient... 2023-10-16T19:57:25.964 INFO:tasks.kclient:Mounting kernel clients... 2023-10-16T19:57:25.965 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2023-10-16T19:57:25.966 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T19:57:25.966 DEBUG:teuthology.orchestra.run.smithi157:> ip netns list 2023-10-16T19:57:25.985 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T19:57:25.985 DEBUG:teuthology.orchestra.run.smithi157:> sudo ip link delete ceph-brx 2023-10-16T19:57:26.054 INFO:teuthology.orchestra.run.smithi157.stderr:Cannot find device "ceph-brx" 2023-10-16T19:57:26.055 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-16T19:57:26.055 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T19:57:26.056 DEBUG:teuthology.orchestra.run.smithi157:> ip netns list 2023-10-16T19:57:26.114 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T19:57:26.114 DEBUG:teuthology.orchestra.run.smithi157:> sudo ip link delete ceph-brx 2023-10-16T19:57:26.181 INFO:teuthology.orchestra.run.smithi157.stderr:Cannot find device "ceph-brx" 2023-10-16T19:57:26.181 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-16T19:57:26.182 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T19:57:26.183 DEBUG:teuthology.orchestra.run.smithi187:> ip netns list 2023-10-16T19:57:26.204 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T19:57:26.204 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip link delete ceph-brx 2023-10-16T19:57:26.277 INFO:teuthology.orchestra.run.smithi187.stderr:Cannot find device "ceph-brx" 2023-10-16T19:57:26.279 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-16T19:57:26.280 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T19:57:26.280 DEBUG:teuthology.orchestra.run.smithi187:> ip netns list 2023-10-16T19:57:26.339 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T19:57:26.340 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip link delete ceph-brx 2023-10-16T19:57:26.409 INFO:teuthology.orchestra.run.smithi187.stderr:Cannot find device "ceph-brx" 2023-10-16T19:57:26.410 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-16T19:57:26.411 INFO:tasks.kclient:client.0 config is {'syntax': 'v2'} 2023-10-16T19:57:26.411 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-10-16T19:57:26.412 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-16T19:57:26.412 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-16T19:57:26.533 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:26.531+0000 7fa59761e700 1 Processor -- start 2023-10-16T19:57:26.534 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:26.531+0000 7fa59761e700 1 -- start start 2023-10-16T19:57:26.536 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:26.532+0000 7fa59761e700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fa59015e2f0 0x7fa59006d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:26.536 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:26.532+0000 7fa59761e700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa59006af60 0x7fa5900ce910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:26.537 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:26.532+0000 7fa59761e700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5900d08b0 con 0x7fa59006de00 2023-10-16T19:57:26.537 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:26.532+0000 7fa59761e700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5901628f0 con 0x7fa59015e2f0 2023-10-16T19:57:26.537 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:26.532+0000 7fa59761e700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa590162bd0 con 0x7fa59006af60 2023-10-16T19:57:26.537 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:26.532+0000 7fa595bbb700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa59006af60 0x7fa5900ce910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:26.537 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:26.532+0000 7fa595bbb700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa59006af60 0x7fa5900ce910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.157:55714/0 (socket says 172.21.15.157:55714) 2023-10-16T19:57:26.538 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:26.532+0000 7fa595bbb700 1 -- 172.21.15.157:0/1760179014 learned_addr learned my addr 172.21.15.157:0/1760179014 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:57:26.538 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:26.532+0000 7fa5953ba700 1 --2- 172.21.15.157:0/1760179014 >> v2:172.21.15.187:3300/0 conn(0x7fa59015e2f0 0x7fa59006d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:26.538 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:26.533+0000 7fa595bbb700 1 -- 172.21.15.157:0/1760179014 >> v2:172.21.15.187:3300/0 conn(0x7fa59015e2f0 msgr2=0x7fa59006d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:57:26.538 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:26.533+0000 7fa595bbb700 1 --2- 172.21.15.157:0/1760179014 >> v2:172.21.15.187:3300/0 conn(0x7fa59015e2f0 0x7fa59006d0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:26.538 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:26.533+0000 7fa595bbb700 1 -- 172.21.15.157:0/1760179014 >> v1:172.21.15.187:6789/0 conn(0x7fa59006de00 legacy=0x7fa59006a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:26.539 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:26.533+0000 7fa595bbb700 1 -- 172.21.15.157:0/1760179014 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5900d05d0 con 0x7fa59006af60 2023-10-16T19:57:26.539 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:26.533+0000 7fa595bbb700 1 --2- 172.21.15.157:0/1760179014 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa59006af60 0x7fa5900ce910 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fa588009e50 tx=0x7fa58800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b6c351e5c7612725 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:26.539 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:26.533+0000 7fa587fff700 1 -- 172.21.15.157:0/1760179014 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa58800e070 con 0x7fa59006af60 2023-10-16T19:57:26.540 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:26.533+0000 7fa587fff700 1 -- 172.21.15.157:0/1760179014 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa58800b910 con 0x7fa59006af60 2023-10-16T19:57:26.540 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:26.533+0000 7fa587fff700 1 -- 172.21.15.157:0/1760179014 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa58800bcc0 con 0x7fa59006af60 2023-10-16T19:57:26.540 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:26.534+0000 7fa59761e700 1 -- 172.21.15.157:0/1760179014 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa59006af60 msgr2=0x7fa5900ce910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:26.540 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:26.534+0000 7fa59761e700 1 --2- 172.21.15.157:0/1760179014 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa59006af60 0x7fa5900ce910 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fa588009e50 tx=0x7fa58800b330 comp rx=0 tx=0).stop 2023-10-16T19:57:26.540 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:26.534+0000 7fa59761e700 1 -- 172.21.15.157:0/1760179014 shutdown_connections 2023-10-16T19:57:26.541 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:26.534+0000 7fa59761e700 1 --2- 172.21.15.157:0/1760179014 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa59006af60 0x7fa5900ce910 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:26.541 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:26.534+0000 7fa59761e700 1 --2- 172.21.15.157:0/1760179014 >> v2:172.21.15.187:3300/0 conn(0x7fa59015e2f0 0x7fa59006d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:26.541 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:26.534+0000 7fa59761e700 1 -- 172.21.15.157:0/1760179014 >> 172.21.15.157:0/1760179014 conn(0x7fa5900cd4e0 msgr2=0x7fa5900cd8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:26.541 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:26.534+0000 7fa59761e700 1 -- 172.21.15.157:0/1760179014 shutdown_connections 2023-10-16T19:57:26.541 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:26.534+0000 7fa59761e700 1 -- 172.21.15.157:0/1760179014 wait complete. 2023-10-16T19:57:26.545 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:26.535+0000 7fa59761e700 1 Processor -- start 2023-10-16T19:57:26.546 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:26.535+0000 7fa59761e700 1 -- start start 2023-10-16T19:57:26.546 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:26.536+0000 7fa59761e700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa59006af60 0x7fa5900c4340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:26.546 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:26.536+0000 7fa59761e700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa59006de00 0x7fa59015b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:26.546 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:26.536+0000 7fa59761e700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa59015e2f0 0x7fa590158870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:26.546 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:26.536+0000 7fa59761e700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa590159f80 con 0x7fa59006af60 2023-10-16T19:57:26.547 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:26.536+0000 7fa59761e700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5901f7730 con 0x7fa59015e2f0 2023-10-16T19:57:26.547 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:26.536+0000 7fa59761e700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5901f7a10 con 0x7fa59006de00 2023-10-16T19:57:26.547 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:26.536+0000 7fa5953ba700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa59006af60 0x7fa5900c4340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:26.547 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:26.536+0000 7fa5953ba700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa59006af60 0x7fa5900c4340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:46410/0 (socket says 172.21.15.157:46410) 2023-10-16T19:57:26.547 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:26.536+0000 7fa5953ba700 1 -- 172.21.15.157:0/368372296 learned_addr learned my addr 172.21.15.157:0/368372296 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:57:26.548 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:26.536+0000 7fa595bbb700 1 --2- 172.21.15.157:0/368372296 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa59015e2f0 0x7fa590158870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:26.548 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:26.536+0000 7fa594bb9700 1 --2- 172.21.15.157:0/368372296 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa59006de00 0x7fa59015b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:26.548 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:26.536+0000 7fa5953ba700 1 -- 172.21.15.157:0/368372296 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa59006de00 msgr2=0x7fa59015b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:26.548 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:26.536+0000 7fa5953ba700 1 --2- 172.21.15.157:0/368372296 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa59006de00 0x7fa59015b1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:26.548 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:26.536+0000 7fa5953ba700 1 -- 172.21.15.157:0/368372296 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa59015e2f0 msgr2=0x7fa590158870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:26.549 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:26.536+0000 7fa5953ba700 1 --2- 172.21.15.157:0/368372296 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa59015e2f0 0x7fa590158870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:26.549 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:26.536+0000 7fa5953ba700 1 -- 172.21.15.157:0/368372296 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa588009b30 con 0x7fa59006af60 2023-10-16T19:57:26.549 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:26.536+0000 7fa5953ba700 1 --2- 172.21.15.157:0/368372296 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa59006af60 0x7fa5900c4340 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fa58000e9b0 tx=0x7fa58000ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:26.549 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:26.536+0000 7fa585ffb700 1 -- 172.21.15.157:0/368372296 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa580009710 con 0x7fa59006af60 2023-10-16T19:57:26.549 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:26.536+0000 7fa585ffb700 1 -- 172.21.15.157:0/368372296 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa58000ee50 con 0x7fa59006af60 2023-10-16T19:57:26.550 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:26.536+0000 7fa59761e700 1 -- 172.21.15.157:0/368372296 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5901f7cf0 con 0x7fa59006af60 2023-10-16T19:57:26.550 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:26.536+0000 7fa585ffb700 1 -- 172.21.15.157:0/368372296 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa58000ca50 con 0x7fa59006af60 2023-10-16T19:57:26.550 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:26.537+0000 7fa59761e700 1 -- 172.21.15.157:0/368372296 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5900c4880 con 0x7fa59006af60 2023-10-16T19:57:26.550 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:26.537+0000 7fa59761e700 1 -- 172.21.15.157:0/368372296 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa590067b30 con 0x7fa59006af60 2023-10-16T19:57:26.550 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:26.538+0000 7fa585ffb700 1 -- 172.21.15.157:0/368372296 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fa58000cbb0 con 0x7fa59006af60 2023-10-16T19:57:26.551 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:26.538+0000 7fa585ffb700 1 --2- 172.21.15.157:0/368372296 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fa57406af00 0x7fa57406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:26.551 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:26.539+0000 7fa585ffb700 1 -- 172.21.15.157:0/368372296 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa5800896c0 con 0x7fa59006af60 2023-10-16T19:57:26.551 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:26.539+0000 7fa594bb9700 1 --2- 172.21.15.157:0/368372296 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fa57406af00 0x7fa57406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:26.551 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:26.539+0000 7fa594bb9700 1 --2- 172.21.15.157:0/368372296 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fa57406af00 0x7fa57406d3c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fa590160cd0 tx=0x7fa58c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:26.551 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:26.543+0000 7fa585ffb700 1 -- 172.21.15.157:0/368372296 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa5800546f0 con 0x7fa59006af60 2023-10-16T19:57:26.775 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:26.773+0000 7fa59761e700 1 -- 172.21.15.157:0/368372296 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fa59004f400 con 0x7fa59006af60 2023-10-16T19:57:26.776 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:26.773+0000 7fa585ffb700 1 -- 172.21.15.157:0/368372296 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7fa58000ce60 con 0x7fa59006af60 2023-10-16T19:57:26.776 INFO:teuthology.orchestra.run.smithi157.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-16T19:57:26.778 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:26.775+0000 7fa59761e700 1 -- 172.21.15.157:0/368372296 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fa57406af00 msgr2=0x7fa57406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:26.779 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:26.775+0000 7fa59761e700 1 --2- 172.21.15.157:0/368372296 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fa57406af00 0x7fa57406d3c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fa590160cd0 tx=0x7fa58c009040 comp rx=0 tx=0).stop 2023-10-16T19:57:26.779 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:26.775+0000 7fa59761e700 1 -- 172.21.15.157:0/368372296 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa59006af60 msgr2=0x7fa5900c4340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:26.779 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:26.775+0000 7fa59761e700 1 --2- 172.21.15.157:0/368372296 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa59006af60 0x7fa5900c4340 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fa58000e9b0 tx=0x7fa58000ecc0 comp rx=0 tx=0).stop 2023-10-16T19:57:26.779 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:26.775+0000 7fa59761e700 1 -- 172.21.15.157:0/368372296 shutdown_connections 2023-10-16T19:57:26.779 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:26.775+0000 7fa59761e700 1 --2- 172.21.15.157:0/368372296 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fa57406af00 0x7fa57406d3c0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:26.780 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:26.775+0000 7fa59761e700 1 --2- 172.21.15.157:0/368372296 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa59015e2f0 0x7fa590158870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:26.780 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:26.775+0000 7fa59761e700 1 --2- 172.21.15.157:0/368372296 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa59006af60 0x7fa5900c4340 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:26.780 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:26.775+0000 7fa59761e700 1 --2- 172.21.15.157:0/368372296 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa59006de00 0x7fa59015b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:26.780 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:26.775+0000 7fa59761e700 1 -- 172.21.15.157:0/368372296 >> 172.21.15.157:0/368372296 conn(0x7fa5900cd4e0 msgr2=0x7fa59015d140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:26.780 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:26.775+0000 7fa59761e700 1 -- 172.21.15.157:0/368372296 shutdown_connections 2023-10-16T19:57:26.781 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:26.775+0000 7fa59761e700 1 -- 172.21.15.157:0/368372296 wait complete. 2023-10-16T19:57:26.790 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-16T19:57:26.790 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-16T19:57:26.790 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi157.front.sepia.ceph.com 2023-10-16T19:57:26.791 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-16T19:57:26.791 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-16T19:57:26.791 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-16T19:57:26.791 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-16T19:57:26.792 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-16T19:57:26.792 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-16T19:57:26.792 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T19:57:26.793 DEBUG:teuthology.orchestra.run.smithi157:> ip addr 2023-10-16T19:57:26.810 INFO:teuthology.orchestra.run.smithi157.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-16T19:57:26.810 INFO:teuthology.orchestra.run.smithi157.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-16T19:57:26.811 INFO:teuthology.orchestra.run.smithi157.stdout: inet 127.0.0.1/8 scope host lo 2023-10-16T19:57:26.811 INFO:teuthology.orchestra.run.smithi157.stdout: valid_lft forever preferred_lft forever 2023-10-16T19:57:26.811 INFO:teuthology.orchestra.run.smithi157.stdout: inet6 ::1/128 scope host 2023-10-16T19:57:26.812 INFO:teuthology.orchestra.run.smithi157.stdout: valid_lft forever preferred_lft forever 2023-10-16T19:57:26.812 INFO:teuthology.orchestra.run.smithi157.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-16T19:57:26.812 INFO:teuthology.orchestra.run.smithi157.stdout: link/ether 0c:c4:7a:d9:37:98 brd ff:ff:ff:ff:ff:ff 2023-10-16T19:57:26.812 INFO:teuthology.orchestra.run.smithi157.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-16T19:57:26.813 INFO:teuthology.orchestra.run.smithi157.stdout: link/ether 0c:c4:7a:d9:37:99 brd ff:ff:ff:ff:ff:ff 2023-10-16T19:57:26.813 INFO:teuthology.orchestra.run.smithi157.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-16T19:57:26.813 INFO:teuthology.orchestra.run.smithi157.stdout: link/ether 0c:c4:7a:88:7e:a0 brd ff:ff:ff:ff:ff:ff 2023-10-16T19:57:26.813 INFO:teuthology.orchestra.run.smithi157.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-16T19:57:26.813 INFO:teuthology.orchestra.run.smithi157.stdout: link/ether 0c:c4:7a:88:7e:a1 brd ff:ff:ff:ff:ff:ff 2023-10-16T19:57:26.814 INFO:teuthology.orchestra.run.smithi157.stdout: inet 172.21.15.157/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-16T19:57:26.814 INFO:teuthology.orchestra.run.smithi157.stdout: valid_lft 42471sec preferred_lft 42471sec 2023-10-16T19:57:26.814 INFO:teuthology.orchestra.run.smithi157.stdout: inet6 fe80::7dc:e005:a3f1:bd3a/64 scope link noprefixroute 2023-10-16T19:57:26.814 INFO:teuthology.orchestra.run.smithi157.stdout: valid_lft forever preferred_lft forever 2023-10-16T19:57:26.815 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-10-16T19:57:26.815 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T19:57:26.816 DEBUG:teuthology.orchestra.run.smithi157:> (cd / && exec bash -c ' 2023-10-16T19:57:26.816 DEBUG:teuthology.orchestra.run.smithi157:> set -e 2023-10-16T19:57:26.816 DEBUG:teuthology.orchestra.run.smithi157:> sudo ip link add name ceph-brx type bridge 2023-10-16T19:57:26.816 DEBUG:teuthology.orchestra.run.smithi157:> sudo ip addr flush dev ceph-brx 2023-10-16T19:57:26.817 DEBUG:teuthology.orchestra.run.smithi157:> sudo ip link set ceph-brx up 2023-10-16T19:57:26.817 DEBUG:teuthology.orchestra.run.smithi157:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-10-16T19:57:26.817 DEBUG:teuthology.orchestra.run.smithi157:> ') 2023-10-16T19:57:26.975 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T19:57:26.975 DEBUG:teuthology.orchestra.run.smithi157:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-16T19:57:27.004 INFO:teuthology.orchestra.run.smithi157.stdout:1 2023-10-16T19:57:27.005 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T19:57:27.006 DEBUG:teuthology.orchestra.run.smithi157:> route 2023-10-16T19:57:27.074 INFO:teuthology.orchestra.run.smithi157.stdout:Kernel IP routing table 2023-10-16T19:57:27.074 INFO:teuthology.orchestra.run.smithi157.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-16T19:57:27.074 INFO:teuthology.orchestra.run.smithi157.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-16T19:57:27.074 INFO:teuthology.orchestra.run.smithi157.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-16T19:57:27.075 INFO:teuthology.orchestra.run.smithi157.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-16T19:57:27.075 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T19:57:27.076 DEBUG:teuthology.orchestra.run.smithi157:> (cd / && exec bash -c ' 2023-10-16T19:57:27.076 DEBUG:teuthology.orchestra.run.smithi157:> set -e 2023-10-16T19:57:27.076 DEBUG:teuthology.orchestra.run.smithi157:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-16T19:57:27.076 DEBUG:teuthology.orchestra.run.smithi157:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-16T19:57:27.077 DEBUG:teuthology.orchestra.run.smithi157:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-16T19:57:27.077 DEBUG:teuthology.orchestra.run.smithi157:> ') 2023-10-16T19:57:27.340 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T19:57:27.340 DEBUG:teuthology.orchestra.run.smithi157:> ip netns list 2023-10-16T19:57:27.358 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T19:57:27.358 DEBUG:teuthology.orchestra.run.smithi157:> ip netns list-id 2023-10-16T19:57:27.415 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T19:57:27.416 DEBUG:teuthology.orchestra.run.smithi157:> (cd / && exec bash -c ' 2023-10-16T19:57:27.416 DEBUG:teuthology.orchestra.run.smithi157:> set -e 2023-10-16T19:57:27.416 DEBUG:teuthology.orchestra.run.smithi157:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-16T19:57:27.417 DEBUG:teuthology.orchestra.run.smithi157:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-10-16T19:57:27.417 DEBUG:teuthology.orchestra.run.smithi157:> ') 2023-10-16T19:57:27.510 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-10-16T19:57:27.510 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T19:57:27.511 DEBUG:teuthology.orchestra.run.smithi157:> (cd / && exec bash -c ' 2023-10-16T19:57:27.511 DEBUG:teuthology.orchestra.run.smithi157:> set -e 2023-10-16T19:57:27.511 DEBUG:teuthology.orchestra.run.smithi157:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-10-16T19:57:27.512 DEBUG:teuthology.orchestra.run.smithi157:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-10-16T19:57:27.512 DEBUG:teuthology.orchestra.run.smithi157:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-10-16T19:57:27.512 DEBUG:teuthology.orchestra.run.smithi157:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-10-16T19:57:27.512 DEBUG:teuthology.orchestra.run.smithi157:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-10-16T19:57:27.513 DEBUG:teuthology.orchestra.run.smithi157:> ') 2023-10-16T19:57:27.741 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T19:57:27.742 DEBUG:teuthology.orchestra.run.smithi157:> (cd / && exec bash -c ' 2023-10-16T19:57:27.743 DEBUG:teuthology.orchestra.run.smithi157:> set -e 2023-10-16T19:57:27.743 DEBUG:teuthology.orchestra.run.smithi157:> sudo ip link set brx.0 up 2023-10-16T19:57:27.743 DEBUG:teuthology.orchestra.run.smithi157:> sudo ip link set dev brx.0 master ceph-brx 2023-10-16T19:57:27.744 DEBUG:teuthology.orchestra.run.smithi157:> ') 2023-10-16T19:57:27.846 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-16T19:57:27.846 DEBUG:teuthology.orchestra.run.smithi157:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-16T19:57:27.865 INFO:teuthology.orchestra.run.smithi157.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-16T19:57:27.866 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-16T19:57:27.866 DEBUG:teuthology.orchestra.run.smithi157:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-16T19:57:27.922 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-10-16T19:57:27.923 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T19:57:27.923 DEBUG:teuthology.orchestra.run.smithi157:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-16T19:57:28.023 INFO:teuthology.orchestra.run.smithi157.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-16T19:57:28.023 INFO:teuthology.orchestra.run.smithi157.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-16T19:57:28.125 INFO:teuthology.orchestra.run.smithi157.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-16T19:57:28.125 INFO:teuthology.orchestra.run.smithi157.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-16T19:57:28.125 INFO:teuthology.orchestra.run.smithi157.stdout:mount.ceph: resolved to: "172.21.15.157:3300,172.21.15.187:3300,172.21.15.187:3301" 2023-10-16T19:57:28.126 INFO:teuthology.orchestra.run.smithi157.stdout:mount.ceph: trying mount with new device syntax: 0@28199dc9-64d5-479e-83c6-21f097c33d39.cephfs=/ 2023-10-16T19:57:28.126 INFO:teuthology.orchestra.run.smithi157.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.157:3300/172.21.15.187:3300/172.21.15.187:3301" will pass to kernel 2023-10-16T19:57:28.126 INFO:teuthology.orchestra.run.smithi157.stdout:mount.ceph: v2 mount support check returned 2 2023-10-16T19:57:28.127 INFO:teuthology.orchestra.run.smithi157.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-16T19:57:28.127 INFO:teuthology.orchestra.run.smithi157.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-16T19:57:28.154 INFO:teuthology.orchestra.run.smithi157.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-16T19:57:28.155 INFO:teuthology.orchestra.run.smithi157.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-16T19:57:28.155 INFO:teuthology.orchestra.run.smithi157.stdout:mount.ceph: resolved to: "172.21.15.157:3300,172.21.15.187:3300,172.21.15.187:3301" 2023-10-16T19:57:28.155 INFO:teuthology.orchestra.run.smithi157.stdout:mount.ceph: trying mount with new device syntax: 0@28199dc9-64d5-479e-83c6-21f097c33d39.cephfs=/ 2023-10-16T19:57:28.155 INFO:teuthology.orchestra.run.smithi157.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.157:3300/172.21.15.187:3300/172.21.15.187:3301" will pass to kernel 2023-10-16T19:57:28.156 INFO:teuthology.orchestra.run.smithi157.stdout:mount.ceph: v2 mount support check returned 2 2023-10-16T19:57:28.156 INFO:teuthology.orchestra.run.smithi157.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-16T19:57:28.156 INFO:teuthology.orchestra.run.smithi157.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-16T19:57:28.156 INFO:teuthology.orchestra.run.smithi157.stdout:mount.ceph: resolved to: "172.21.15.157:6789,172.21.15.187:6789,172.21.15.187:6790" 2023-10-16T19:57:28.156 INFO:teuthology.orchestra.run.smithi157.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.157:6789,172.21.15.187:6789,172.21.15.187:6790:/ 2023-10-16T19:57:28.157 INFO:teuthology.orchestra.run.smithi157.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,key=0,mds_namespace=cephfs,fsid=28199dc9-64d5-479e-83c6-21f097c33d39" will pass to kernel 2023-10-16T19:57:28.158 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-16T19:57:28.159 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T19:57:28.159 DEBUG:teuthology.orchestra.run.smithi157:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-16T19:57:28.190 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T19:57:28.190 DEBUG:teuthology.orchestra.run.smithi157:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-16T19:57:28.278 INFO:teuthology.orchestra.run.smithi157.stdout:client4523 2023-10-16T19:57:28.278 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2023-10-16T19:57:28.279 DEBUG:teuthology.orchestra.run.smithi157:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T19:57:28.299 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T19:57:28.300 DEBUG:teuthology.orchestra.run.smithi157:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-16T19:57:28.385 INFO:teuthology.orchestra.run.smithi157.stdout:client4523 2023-10-16T19:57:28.385 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T19:57:28.386 DEBUG:teuthology.orchestra.run.smithi157:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-16T19:57:28.431 INFO:teuthology.orchestra.run.smithi157.stdout:client4523 2023-10-16T19:57:28.432 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T19:57:28.432 DEBUG:teuthology.orchestra.run.smithi157:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/28199dc9-64d5-479e-83c6-21f097c33d39.client4523/status') 2023-10-16T19:57:28.484 INFO:teuthology.orchestra.run.smithi157.stdout:instance: client.4523 (3)172.21.15.157:0/615621466 2023-10-16T19:57:28.484 INFO:teuthology.orchestra.run.smithi157.stdout:blocklisted: false 2023-10-16T19:57:28.485 INFO:teuthology.orchestra.run.smithi157.stderr:0+1 records in 2023-10-16T19:57:28.486 INFO:teuthology.orchestra.run.smithi157.stderr:0+1 records out 2023-10-16T19:57:28.486 INFO:teuthology.orchestra.run.smithi157.stderr:70 bytes copied, 2.3629e-05 s, 3.0 MB/s 2023-10-16T19:57:28.487 INFO:tasks.kclient:client.2 config is {'syntax': 'v2'} 2023-10-16T19:57:28.487 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-10-16T19:57:28.487 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-10-16T19:57:28.488 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-16T19:57:28.608 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:28.606+0000 7f55facc2700 1 Processor -- start 2023-10-16T19:57:28.609 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:28.606+0000 7f55facc2700 1 -- start start 2023-10-16T19:57:28.611 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:28.607+0000 7f55facc2700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f55f41560d0 0x7f55f40ca810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:28.611 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:28.607+0000 7f55facc2700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f55f41564b0 0x7f55f4070780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:28.611 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:28.607+0000 7f55facc2700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55f415c5e0 con 0x7f55f406c670 2023-10-16T19:57:28.612 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:28.607+0000 7f55facc2700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55f415d260 con 0x7f55f41564b0 2023-10-16T19:57:28.612 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:28.607+0000 7f55facc2700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55f415c8c0 con 0x7f55f41560d0 2023-10-16T19:57:28.612 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:28.607+0000 7f55f3fff700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f55f41564b0 0x7f55f4070780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:28.612 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:28.607+0000 7f55f3fff700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f55f41564b0 0x7f55f4070780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:46422/0 (socket says 172.21.15.157:46422) 2023-10-16T19:57:28.612 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:28.607+0000 7f55f3fff700 1 -- 172.21.15.157:0/1865341516 learned_addr learned my addr 172.21.15.157:0/1865341516 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:57:28.613 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:28.607+0000 7f55f8a5e700 1 --2- 172.21.15.157:0/1865341516 >> v2:172.21.15.187:3300/0 conn(0x7f55f41560d0 0x7f55f40ca810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:28.613 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:28.607+0000 7f55f3fff700 1 -- 172.21.15.157:0/1865341516 >> v2:172.21.15.187:3300/0 conn(0x7f55f41560d0 msgr2=0x7f55f40ca810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:57:28.613 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:28.607+0000 7f55f3fff700 1 --2- 172.21.15.157:0/1865341516 >> v2:172.21.15.187:3300/0 conn(0x7f55f41560d0 0x7f55f40ca810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:28.613 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:28.607+0000 7f55f3fff700 1 -- 172.21.15.157:0/1865341516 >> v1:172.21.15.187:6789/0 conn(0x7f55f406c670 legacy=0x7f55f4072210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:57:28.613 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:28.607+0000 7f55f3fff700 1 -- 172.21.15.157:0/1865341516 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55f415cba0 con 0x7f55f41564b0 2023-10-16T19:57:28.614 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:28.607+0000 7f55f3fff700 1 --2- 172.21.15.157:0/1865341516 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f55f41564b0 0x7f55f4070780 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f55f406d260 tx=0x7f55e0009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2c2fe68548f7634 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:28.614 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:28.608+0000 7f55f37fe700 1 -- 172.21.15.157:0/1865341516 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55e0004230 con 0x7f55f41564b0 2023-10-16T19:57:28.614 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:28.608+0000 7f55f37fe700 1 -- 172.21.15.157:0/1865341516 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55e0004390 con 0x7f55f41564b0 2023-10-16T19:57:28.614 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:28.608+0000 7f55f37fe700 1 -- 172.21.15.157:0/1865341516 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55e00036a0 con 0x7f55f41564b0 2023-10-16T19:57:28.614 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:28.608+0000 7f55facc2700 1 -- 172.21.15.157:0/1865341516 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f55f41564b0 msgr2=0x7f55f4070780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:28.615 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:28.608+0000 7f55facc2700 1 --2- 172.21.15.157:0/1865341516 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f55f41564b0 0x7f55f4070780 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f55f406d260 tx=0x7f55e0009bd0 comp rx=0 tx=0).stop 2023-10-16T19:57:28.615 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:28.608+0000 7f55facc2700 1 -- 172.21.15.157:0/1865341516 shutdown_connections 2023-10-16T19:57:28.615 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:28.608+0000 7f55facc2700 1 --2- 172.21.15.157:0/1865341516 >> v2:172.21.15.187:3300/0 conn(0x7f55f41560d0 0x7f55f40ca810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:28.615 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:28.608+0000 7f55facc2700 1 --2- 172.21.15.157:0/1865341516 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f55f41564b0 0x7f55f4070780 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:28.615 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:28.608+0000 7f55facc2700 1 -- 172.21.15.157:0/1865341516 >> 172.21.15.157:0/1865341516 conn(0x7f55f40cceb0 msgr2=0x7f55f40cd290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:28.616 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:28.608+0000 7f55facc2700 1 -- 172.21.15.157:0/1865341516 shutdown_connections 2023-10-16T19:57:28.616 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:28.608+0000 7f55facc2700 1 -- 172.21.15.157:0/1865341516 wait complete. 2023-10-16T19:57:28.619 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:28.609+0000 7f55facc2700 1 Processor -- start 2023-10-16T19:57:28.619 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:28.609+0000 7f55facc2700 1 -- start start 2023-10-16T19:57:28.619 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:28.610+0000 7f55facc2700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f55f406c670 0x7f55f40afd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:28.619 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:28.610+0000 7f55facc2700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f55f41560d0 0x7f55f413f640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:28.620 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:28.610+0000 7f55facc2700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f55f41564b0 0x7f55f413fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:28.620 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:28.610+0000 7f55facc2700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55f40b3c60 con 0x7f55f41560d0 2023-10-16T19:57:28.620 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:28.610+0000 7f55facc2700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55f40b3f40 con 0x7f55f41564b0 2023-10-16T19:57:28.620 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:28.610+0000 7f55facc2700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55f40b4220 con 0x7f55f406c670 2023-10-16T19:57:28.620 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:28.610+0000 7f55f3fff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f55f41560d0 0x7f55f413f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:28.621 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:28.611+0000 7f55f3fff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f55f41560d0 0x7f55f413f640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:46428/0 (socket says 172.21.15.157:46428) 2023-10-16T19:57:28.621 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:28.611+0000 7f55f3fff700 1 -- 172.21.15.157:0/2108561106 learned_addr learned my addr 172.21.15.157:0/2108561106 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:57:28.621 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:28.611+0000 7f55f925f700 1 --2- 172.21.15.157:0/2108561106 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f55f41564b0 0x7f55f413fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:28.621 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:28.611+0000 7f55f8a5e700 1 --2- 172.21.15.157:0/2108561106 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f55f406c670 0x7f55f40afd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:28.621 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:28.611+0000 7f55f3fff700 1 -- 172.21.15.157:0/2108561106 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f55f406c670 msgr2=0x7f55f40afd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:28.621 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:28.611+0000 7f55f3fff700 1 --2- 172.21.15.157:0/2108561106 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f55f406c670 0x7f55f40afd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:28.622 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:28.611+0000 7f55f3fff700 1 -- 172.21.15.157:0/2108561106 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f55f41564b0 msgr2=0x7f55f413fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:28.622 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:28.611+0000 7f55f3fff700 1 --2- 172.21.15.157:0/2108561106 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f55f41564b0 0x7f55f413fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:28.622 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:28.611+0000 7f55f3fff700 1 -- 172.21.15.157:0/2108561106 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55e0009550 con 0x7f55f41560d0 2023-10-16T19:57:28.622 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:28.611+0000 7f55f3fff700 1 --2- 172.21.15.157:0/2108561106 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f55f41560d0 0x7f55f413f640 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f55e0009130 tx=0x7f55e0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:28.622 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:28.611+0000 7f55f17fa700 1 -- 172.21.15.157:0/2108561106 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55e0003cc0 con 0x7f55f41560d0 2023-10-16T19:57:28.623 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:28.611+0000 7f55f17fa700 1 -- 172.21.15.157:0/2108561106 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55e001f070 con 0x7f55f41560d0 2023-10-16T19:57:28.623 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:28.611+0000 7f55f17fa700 1 -- 172.21.15.157:0/2108561106 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55e0011870 con 0x7f55f41560d0 2023-10-16T19:57:28.623 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:28.611+0000 7f55facc2700 1 -- 172.21.15.157:0/2108561106 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55f40b4500 con 0x7f55f41560d0 2023-10-16T19:57:28.623 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:28.611+0000 7f55facc2700 1 -- 172.21.15.157:0/2108561106 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55f40b0260 con 0x7f55f41560d0 2023-10-16T19:57:28.623 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:28.612+0000 7f55facc2700 1 -- 172.21.15.157:0/2108561106 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55f40b4870 con 0x7f55f41560d0 2023-10-16T19:57:28.624 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:28.613+0000 7f55f17fa700 1 -- 172.21.15.157:0/2108561106 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f55e0021030 con 0x7f55f41560d0 2023-10-16T19:57:28.624 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:28.613+0000 7f55f17fa700 1 --2- 172.21.15.157:0/2108561106 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f55d806af00 0x7f55d806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:28.624 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:28.613+0000 7f55f17fa700 1 -- 172.21.15.157:0/2108561106 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f55e008aa90 con 0x7f55f41560d0 2023-10-16T19:57:28.624 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:28.613+0000 7f55f8a5e700 1 --2- 172.21.15.157:0/2108561106 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f55d806af00 0x7f55d806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:28.624 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:28.614+0000 7f55f8a5e700 1 --2- 172.21.15.157:0/2108561106 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f55d806af00 0x7f55d806d3c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f55e800b9b0 tx=0x7f55e8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:28.625 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:28.617+0000 7f55f17fa700 1 -- 172.21.15.157:0/2108561106 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f55e0055b50 con 0x7f55f41560d0 2023-10-16T19:57:28.855 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:28.852+0000 7f55facc2700 1 -- 172.21.15.157:0/2108561106 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f55f404f400 con 0x7f55f41560d0 2023-10-16T19:57:28.855 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:28.853+0000 7f55f17fa700 1 -- 172.21.15.157:0/2108561106 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f55e0059170 con 0x7f55f41560d0 2023-10-16T19:57:28.856 INFO:teuthology.orchestra.run.smithi157.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-16T19:57:28.857 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:28.855+0000 7f55facc2700 1 -- 172.21.15.157:0/2108561106 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f55d806af00 msgr2=0x7f55d806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:28.857 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:28.855+0000 7f55facc2700 1 --2- 172.21.15.157:0/2108561106 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f55d806af00 0x7f55d806d3c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f55e800b9b0 tx=0x7f55e8008040 comp rx=0 tx=0).stop 2023-10-16T19:57:28.858 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:28.855+0000 7f55facc2700 1 -- 172.21.15.157:0/2108561106 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f55f41560d0 msgr2=0x7f55f413f640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:28.858 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:28.855+0000 7f55facc2700 1 --2- 172.21.15.157:0/2108561106 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f55f41560d0 0x7f55f413f640 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f55e0009130 tx=0x7f55e0004750 comp rx=0 tx=0).stop 2023-10-16T19:57:28.858 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:28.855+0000 7f55facc2700 1 -- 172.21.15.157:0/2108561106 shutdown_connections 2023-10-16T19:57:28.858 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:28.855+0000 7f55facc2700 1 --2- 172.21.15.157:0/2108561106 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f55d806af00 0x7f55d806d3c0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:28.859 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:28.855+0000 7f55facc2700 1 --2- 172.21.15.157:0/2108561106 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f55f41564b0 0x7f55f413fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:28.859 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:28.855+0000 7f55facc2700 1 --2- 172.21.15.157:0/2108561106 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f55f406c670 0x7f55f40afd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:28.859 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:28.855+0000 7f55facc2700 1 --2- 172.21.15.157:0/2108561106 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f55f41560d0 0x7f55f413f640 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:28.859 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:28.855+0000 7f55facc2700 1 -- 172.21.15.157:0/2108561106 >> 172.21.15.157:0/2108561106 conn(0x7f55f40cceb0 msgr2=0x7f55f4154250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:28.859 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:28.855+0000 7f55facc2700 1 -- 172.21.15.157:0/2108561106 shutdown_connections 2023-10-16T19:57:28.860 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:28.855+0000 7f55facc2700 1 -- 172.21.15.157:0/2108561106 wait complete. 2023-10-16T19:57:28.869 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-16T19:57:28.870 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-16T19:57:28.870 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi157.front.sepia.ceph.com 2023-10-16T19:57:28.870 INFO:tasks.cephfs.mount:self.client.name = client.2 2023-10-16T19:57:28.871 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-10-16T19:57:28.871 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-16T19:57:28.871 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-16T19:57:28.872 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-16T19:57:28.872 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2023-10-16T19:57:28.872 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T19:57:28.873 DEBUG:teuthology.orchestra.run.smithi157:> ip addr 2023-10-16T19:57:28.891 INFO:teuthology.orchestra.run.smithi157.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-16T19:57:28.891 INFO:teuthology.orchestra.run.smithi157.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-16T19:57:28.891 INFO:teuthology.orchestra.run.smithi157.stdout: inet 127.0.0.1/8 scope host lo 2023-10-16T19:57:28.891 INFO:teuthology.orchestra.run.smithi157.stdout: valid_lft forever preferred_lft forever 2023-10-16T19:57:28.892 INFO:teuthology.orchestra.run.smithi157.stdout: inet6 ::1/128 scope host 2023-10-16T19:57:28.892 INFO:teuthology.orchestra.run.smithi157.stdout: valid_lft forever preferred_lft forever 2023-10-16T19:57:28.892 INFO:teuthology.orchestra.run.smithi157.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-16T19:57:28.892 INFO:teuthology.orchestra.run.smithi157.stdout: link/ether 0c:c4:7a:d9:37:98 brd ff:ff:ff:ff:ff:ff 2023-10-16T19:57:28.892 INFO:teuthology.orchestra.run.smithi157.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-16T19:57:28.893 INFO:teuthology.orchestra.run.smithi157.stdout: link/ether 0c:c4:7a:d9:37:99 brd ff:ff:ff:ff:ff:ff 2023-10-16T19:57:28.893 INFO:teuthology.orchestra.run.smithi157.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-16T19:57:28.893 INFO:teuthology.orchestra.run.smithi157.stdout: link/ether 0c:c4:7a:88:7e:a0 brd ff:ff:ff:ff:ff:ff 2023-10-16T19:57:28.893 INFO:teuthology.orchestra.run.smithi157.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-16T19:57:28.894 INFO:teuthology.orchestra.run.smithi157.stdout: link/ether 0c:c4:7a:88:7e:a1 brd ff:ff:ff:ff:ff:ff 2023-10-16T19:57:28.894 INFO:teuthology.orchestra.run.smithi157.stdout: inet 172.21.15.157/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-16T19:57:28.894 INFO:teuthology.orchestra.run.smithi157.stdout: valid_lft 42469sec preferred_lft 42469sec 2023-10-16T19:57:28.894 INFO:teuthology.orchestra.run.smithi157.stdout: inet6 fe80::7dc:e005:a3f1:bd3a/64 scope link noprefixroute 2023-10-16T19:57:28.895 INFO:teuthology.orchestra.run.smithi157.stdout: valid_lft forever preferred_lft forever 2023-10-16T19:57:28.895 INFO:teuthology.orchestra.run.smithi157.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-16T19:57:28.895 INFO:teuthology.orchestra.run.smithi157.stdout: link/ether 5a:6d:a2:1e:d1:b2 brd ff:ff:ff:ff:ff:ff 2023-10-16T19:57:28.896 INFO:teuthology.orchestra.run.smithi157.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-16T19:57:28.896 INFO:teuthology.orchestra.run.smithi157.stdout: valid_lft forever preferred_lft forever 2023-10-16T19:57:28.896 INFO:teuthology.orchestra.run.smithi157.stdout: inet6 fe80::5ca8:fff:fec3:4d85/64 scope link tentative 2023-10-16T19:57:28.897 INFO:teuthology.orchestra.run.smithi157.stdout: valid_lft forever preferred_lft forever 2023-10-16T19:57:28.897 INFO:teuthology.orchestra.run.smithi157.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-16T19:57:28.898 INFO:teuthology.orchestra.run.smithi157.stdout: link/ether 5a:6d:a2:1e:d1:b2 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-16T19:57:28.898 INFO:teuthology.orchestra.run.smithi157.stdout: inet6 fe80::586d:a2ff:fe1e:d1b2/64 scope link tentative 2023-10-16T19:57:28.899 INFO:teuthology.orchestra.run.smithi157.stdout: valid_lft forever preferred_lft forever 2023-10-16T19:57:28.899 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T19:57:28.900 DEBUG:teuthology.orchestra.run.smithi157:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-16T19:57:28.957 INFO:teuthology.orchestra.run.smithi157.stdout:1 2023-10-16T19:57:28.958 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T19:57:28.958 DEBUG:teuthology.orchestra.run.smithi157:> route 2023-10-16T19:57:29.019 INFO:teuthology.orchestra.run.smithi157.stdout:Kernel IP routing table 2023-10-16T19:57:29.019 INFO:teuthology.orchestra.run.smithi157.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-16T19:57:29.020 INFO:teuthology.orchestra.run.smithi157.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-16T19:57:29.020 INFO:teuthology.orchestra.run.smithi157.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-16T19:57:29.020 INFO:teuthology.orchestra.run.smithi157.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-16T19:57:29.020 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T19:57:29.021 DEBUG:teuthology.orchestra.run.smithi157:> (cd / && exec bash -c ' 2023-10-16T19:57:29.021 DEBUG:teuthology.orchestra.run.smithi157:> set -e 2023-10-16T19:57:29.021 DEBUG:teuthology.orchestra.run.smithi157:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-16T19:57:29.022 DEBUG:teuthology.orchestra.run.smithi157:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-16T19:57:29.022 DEBUG:teuthology.orchestra.run.smithi157:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-16T19:57:29.022 DEBUG:teuthology.orchestra.run.smithi157:> ') 2023-10-16T19:57:29.124 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T19:57:29.125 DEBUG:teuthology.orchestra.run.smithi157:> ip netns list 2023-10-16T19:57:29.142 INFO:teuthology.orchestra.run.smithi157.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-16T19:57:29.142 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T19:57:29.143 DEBUG:teuthology.orchestra.run.smithi157:> ip netns list-id 2023-10-16T19:57:29.198 INFO:teuthology.orchestra.run.smithi157.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2023-10-16T19:57:29.199 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T19:57:29.199 DEBUG:teuthology.orchestra.run.smithi157:> (cd / && exec bash -c ' 2023-10-16T19:57:29.200 DEBUG:teuthology.orchestra.run.smithi157:> set -e 2023-10-16T19:57:29.200 DEBUG:teuthology.orchestra.run.smithi157:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-16T19:57:29.200 DEBUG:teuthology.orchestra.run.smithi157:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2023-10-16T19:57:29.201 DEBUG:teuthology.orchestra.run.smithi157:> ') 2023-10-16T19:57:29.294 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T19:57:29.295 DEBUG:teuthology.orchestra.run.smithi157:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-10-16T19:57:29.328 INFO:teuthology.orchestra.run.smithi157.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-16T19:57:29.328 INFO:teuthology.orchestra.run.smithi157.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-16T19:57:29.329 INFO:teuthology.orchestra.run.smithi157.stdout: inet 127.0.0.1/8 scope host lo 2023-10-16T19:57:29.329 INFO:teuthology.orchestra.run.smithi157.stdout: valid_lft forever preferred_lft forever 2023-10-16T19:57:29.329 INFO:teuthology.orchestra.run.smithi157.stdout: inet6 ::1/128 scope host 2023-10-16T19:57:29.329 INFO:teuthology.orchestra.run.smithi157.stdout: valid_lft forever preferred_lft forever 2023-10-16T19:57:29.329 INFO:teuthology.orchestra.run.smithi157.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-16T19:57:29.330 INFO:teuthology.orchestra.run.smithi157.stdout: link/ether 66:51:cb:f9:13:82 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-16T19:57:29.330 INFO:teuthology.orchestra.run.smithi157.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-16T19:57:29.330 INFO:teuthology.orchestra.run.smithi157.stdout: valid_lft forever preferred_lft forever 2023-10-16T19:57:29.330 INFO:teuthology.orchestra.run.smithi157.stdout: inet6 fe80::6451:cbff:fef9:1382/64 scope link 2023-10-16T19:57:29.330 INFO:teuthology.orchestra.run.smithi157.stdout: valid_lft forever preferred_lft forever 2023-10-16T19:57:29.340 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T19:57:29.340 DEBUG:teuthology.orchestra.run.smithi157:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-10-16T19:57:29.421 INFO:teuthology.orchestra.run.smithi157.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-16T19:57:29.421 INFO:teuthology.orchestra.run.smithi157.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-16T19:57:29.422 INFO:teuthology.orchestra.run.smithi157.stdout: inet 127.0.0.1/8 scope host lo 2023-10-16T19:57:29.422 INFO:teuthology.orchestra.run.smithi157.stdout: valid_lft forever preferred_lft forever 2023-10-16T19:57:29.422 INFO:teuthology.orchestra.run.smithi157.stdout: inet6 ::1/128 scope host 2023-10-16T19:57:29.422 INFO:teuthology.orchestra.run.smithi157.stdout: valid_lft forever preferred_lft forever 2023-10-16T19:57:29.422 INFO:teuthology.orchestra.run.smithi157.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-16T19:57:29.423 INFO:teuthology.orchestra.run.smithi157.stdout: link/ether 66:51:cb:f9:13:82 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-16T19:57:29.423 INFO:teuthology.orchestra.run.smithi157.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-16T19:57:29.423 INFO:teuthology.orchestra.run.smithi157.stdout: valid_lft forever preferred_lft forever 2023-10-16T19:57:29.423 INFO:teuthology.orchestra.run.smithi157.stdout: inet6 fe80::6451:cbff:fef9:1382/64 scope link 2023-10-16T19:57:29.424 INFO:teuthology.orchestra.run.smithi157.stdout: valid_lft forever preferred_lft forever 2023-10-16T19:57:29.436 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2023-10-16T19:57:29.437 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T19:57:29.437 DEBUG:teuthology.orchestra.run.smithi157:> (cd / && exec bash -c ' 2023-10-16T19:57:29.438 DEBUG:teuthology.orchestra.run.smithi157:> set -e 2023-10-16T19:57:29.438 DEBUG:teuthology.orchestra.run.smithi157:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2023-10-16T19:57:29.438 DEBUG:teuthology.orchestra.run.smithi157:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-10-16T19:57:29.439 DEBUG:teuthology.orchestra.run.smithi157:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2023-10-16T19:57:29.439 DEBUG:teuthology.orchestra.run.smithi157:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2023-10-16T19:57:29.439 DEBUG:teuthology.orchestra.run.smithi157:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2023-10-16T19:57:29.440 DEBUG:teuthology.orchestra.run.smithi157:> ') 2023-10-16T19:57:29.688 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T19:57:29.688 DEBUG:teuthology.orchestra.run.smithi157:> (cd / && exec bash -c ' 2023-10-16T19:57:29.688 DEBUG:teuthology.orchestra.run.smithi157:> set -e 2023-10-16T19:57:29.689 DEBUG:teuthology.orchestra.run.smithi157:> sudo ip link set brx.1 up 2023-10-16T19:57:29.689 DEBUG:teuthology.orchestra.run.smithi157:> sudo ip link set dev brx.1 master ceph-brx 2023-10-16T19:57:29.689 DEBUG:teuthology.orchestra.run.smithi157:> ') 2023-10-16T19:57:29.802 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-16T19:57:29.802 DEBUG:teuthology.orchestra.run.smithi157:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2023-10-16T19:57:29.822 INFO:teuthology.orchestra.run.smithi157.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2023-10-16T19:57:29.823 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-16T19:57:29.823 DEBUG:teuthology.orchestra.run.smithi157:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2023-10-16T19:57:29.880 INFO:tasks.cephfs.kernel_mount:mounting using device: 2@.cephfs=/ 2023-10-16T19:57:29.880 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T19:57:29.880 DEBUG:teuthology.orchestra.run.smithi157:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 2@.cephfs=/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-16T19:57:29.967 INFO:teuthology.orchestra.run.smithi157.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-16T19:57:29.967 INFO:teuthology.orchestra.run.smithi157.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-16T19:57:29.991 INFO:teuthology.orchestra.run.smithi157.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-16T19:57:29.991 INFO:teuthology.orchestra.run.smithi157.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-16T19:57:29.991 INFO:teuthology.orchestra.run.smithi157.stdout:mount.ceph: resolved to: "172.21.15.157:3300,172.21.15.187:3300,172.21.15.187:3301" 2023-10-16T19:57:29.992 INFO:teuthology.orchestra.run.smithi157.stdout:mount.ceph: trying mount with new device syntax: 2@28199dc9-64d5-479e-83c6-21f097c33d39.cephfs=/ 2023-10-16T19:57:29.992 INFO:teuthology.orchestra.run.smithi157.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,ms_mode=prefer-crc,key=2,mon_addr=172.21.15.157:3300/172.21.15.187:3300/172.21.15.187:3301" will pass to kernel 2023-10-16T19:57:29.992 INFO:teuthology.orchestra.run.smithi157.stdout:mount.ceph: v2 mount support check returned 2 2023-10-16T19:57:29.992 INFO:teuthology.orchestra.run.smithi157.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-16T19:57:29.992 INFO:teuthology.orchestra.run.smithi157.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-16T19:57:30.066 INFO:teuthology.orchestra.run.smithi157.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-16T19:57:30.066 INFO:teuthology.orchestra.run.smithi157.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-16T19:57:30.066 INFO:teuthology.orchestra.run.smithi157.stdout:mount.ceph: resolved to: "172.21.15.157:3300,172.21.15.187:3300,172.21.15.187:3301" 2023-10-16T19:57:30.066 INFO:teuthology.orchestra.run.smithi157.stdout:mount.ceph: trying mount with new device syntax: 2@28199dc9-64d5-479e-83c6-21f097c33d39.cephfs=/ 2023-10-16T19:57:30.067 INFO:teuthology.orchestra.run.smithi157.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,ms_mode=prefer-crc,key=2,mon_addr=172.21.15.157:3300/172.21.15.187:3300/172.21.15.187:3301" will pass to kernel 2023-10-16T19:57:30.067 INFO:teuthology.orchestra.run.smithi157.stdout:mount.ceph: v2 mount support check returned 2 2023-10-16T19:57:30.067 INFO:teuthology.orchestra.run.smithi157.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-16T19:57:30.067 INFO:teuthology.orchestra.run.smithi157.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-16T19:57:30.067 INFO:teuthology.orchestra.run.smithi157.stdout:mount.ceph: resolved to: "172.21.15.157:6789,172.21.15.187:6789,172.21.15.187:6790" 2023-10-16T19:57:30.068 INFO:teuthology.orchestra.run.smithi157.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.157:6789,172.21.15.187:6789,172.21.15.187:6790:/ 2023-10-16T19:57:30.068 INFO:teuthology.orchestra.run.smithi157.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,key=2,mds_namespace=cephfs,fsid=28199dc9-64d5-479e-83c6-21f097c33d39" will pass to kernel 2023-10-16T19:57:30.069 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-16T19:57:30.069 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T19:57:30.069 DEBUG:teuthology.orchestra.run.smithi157:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2023-10-16T19:57:30.096 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T19:57:30.096 DEBUG:teuthology.orchestra.run.smithi157:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-16T19:57:30.169 INFO:teuthology.orchestra.run.smithi157.stdout:client4529 2023-10-16T19:57:30.169 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2023-10-16T19:57:30.169 DEBUG:teuthology.orchestra.run.smithi157:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T19:57:30.226 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T19:57:30.227 DEBUG:teuthology.orchestra.run.smithi157:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-16T19:57:30.300 INFO:teuthology.orchestra.run.smithi157.stdout:client4529 2023-10-16T19:57:30.300 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T19:57:30.301 DEBUG:teuthology.orchestra.run.smithi157:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-16T19:57:30.373 INFO:teuthology.orchestra.run.smithi157.stdout:client4529 2023-10-16T19:57:30.374 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T19:57:30.374 DEBUG:teuthology.orchestra.run.smithi157:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/28199dc9-64d5-479e-83c6-21f097c33d39.client4529/status') 2023-10-16T19:57:30.454 INFO:teuthology.orchestra.run.smithi157.stdout:instance: client.4529 (3)172.21.15.157:0/1154279333 2023-10-16T19:57:30.455 INFO:teuthology.orchestra.run.smithi157.stdout:blocklisted: false 2023-10-16T19:57:30.456 INFO:teuthology.orchestra.run.smithi157.stderr:0+1 records in 2023-10-16T19:57:30.456 INFO:teuthology.orchestra.run.smithi157.stderr:0+1 records out 2023-10-16T19:57:30.456 INFO:teuthology.orchestra.run.smithi157.stderr:71 bytes copied, 3.3875e-05 s, 2.1 MB/s 2023-10-16T19:57:30.456 INFO:tasks.kclient:client.1 config is {'syntax': 'v2'} 2023-10-16T19:57:30.457 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-10-16T19:57:30.457 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-16T19:57:30.458 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-16T19:57:30.616 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:30.614+0000 7f93d409e700 1 Processor -- start 2023-10-16T19:57:30.616 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:30.614+0000 7f93d409e700 1 -- start start 2023-10-16T19:57:30.619 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:30.615+0000 7f93d409e700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f93cc15e2f0 0x7f93cc06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:30.619 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:30.615+0000 7f93d409e700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f93cc06af60 0x7f93cc0ce910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:30.619 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:30.615+0000 7f93d409e700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93cc0d08b0 con 0x7f93cc06de00 2023-10-16T19:57:30.620 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:30.615+0000 7f93d409e700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93cc1628f0 con 0x7f93cc06af60 2023-10-16T19:57:30.620 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:30.615+0000 7f93d409e700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93cc162bd0 con 0x7f93cc15e2f0 2023-10-16T19:57:30.620 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:30.615+0000 7f93d263b700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f93cc06af60 0x7f93cc0ce910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:30.620 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:30.615+0000 7f93d1639700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f93cc06de00 0x7f93cc06a850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:56112/0 (socket says 172.21.15.157:56112) 2023-10-16T19:57:30.620 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:30.615+0000 7f93d1639700 1 -- 172.21.15.157:0/3257064945 learned_addr learned my addr 172.21.15.157:0/3257064945 (peer_addr_for_me v1:172.21.15.157:0/0) 2023-10-16T19:57:30.621 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:30.615+0000 7f93d1e3a700 1 --2- 172.21.15.157:0/3257064945 >> v2:172.21.15.187:3300/0 conn(0x7f93cc15e2f0 0x7f93cc06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:30.621 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:30.615+0000 7f93d263b700 1 -- 172.21.15.157:0/3257064945 >> v2:172.21.15.187:3300/0 conn(0x7f93cc15e2f0 msgr2=0x7f93cc06d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:57:30.621 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:30.615+0000 7f93d263b700 1 --2- 172.21.15.157:0/3257064945 >> v2:172.21.15.187:3300/0 conn(0x7f93cc15e2f0 0x7f93cc06d0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:30.621 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:30.615+0000 7f93d263b700 1 -- 172.21.15.157:0/3257064945 >> v1:172.21.15.157:6789/0 conn(0x7f93cc06de00 legacy=0x7f93cc06a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:30.621 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:30.615+0000 7f93d0e38700 1 -- 172.21.15.157:0/3257064945 <== mon.0 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2150369793 0 0) 0x7f93cc0d08b0 con 0x7f93cc06de00 2023-10-16T19:57:30.622 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:30.615+0000 7f93d263b700 1 -- 172.21.15.157:0/3257064945 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93cc0d05d0 con 0x7f93cc06af60 2023-10-16T19:57:30.622 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:30.615+0000 7f93d263b700 1 --2- 172.21.15.157:0/3257064945 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f93cc06af60 0x7f93cc0ce910 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f93cc0d1ad0 tx=0x7f93c400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e625a6a44b2bd59d server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:30.622 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:30.615+0000 7f93d0e38700 1 -- 172.21.15.157:0/3257064945 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93c400e070 con 0x7f93cc06af60 2023-10-16T19:57:30.622 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:30.616+0000 7f93d0e38700 1 -- 172.21.15.157:0/3257064945 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93c400bbd0 con 0x7f93cc06af60 2023-10-16T19:57:30.623 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:30.616+0000 7f93d0e38700 1 -- 172.21.15.157:0/3257064945 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93c4012430 con 0x7f93cc06af60 2023-10-16T19:57:30.623 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:30.616+0000 7f93d409e700 1 -- 172.21.15.157:0/3257064945 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f93cc06af60 msgr2=0x7f93cc0ce910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:30.623 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:30.616+0000 7f93d409e700 1 --2- 172.21.15.157:0/3257064945 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f93cc06af60 0x7f93cc0ce910 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f93cc0d1ad0 tx=0x7f93c400b330 comp rx=0 tx=0).stop 2023-10-16T19:57:30.623 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:30.616+0000 7f93d409e700 1 -- 172.21.15.157:0/3257064945 shutdown_connections 2023-10-16T19:57:30.623 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:30.616+0000 7f93d409e700 1 --2- 172.21.15.157:0/3257064945 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f93cc06af60 0x7f93cc0ce910 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:30.623 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:30.616+0000 7f93d409e700 1 --2- 172.21.15.157:0/3257064945 >> v2:172.21.15.187:3300/0 conn(0x7f93cc15e2f0 0x7f93cc06d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:30.624 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:30.616+0000 7f93d409e700 1 -- 172.21.15.157:0/3257064945 >> 172.21.15.157:0/3257064945 conn(0x7f93cc0cd4e0 msgr2=0x7f93cc0cd8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:30.624 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:30.616+0000 7f93d409e700 1 -- 172.21.15.157:0/3257064945 shutdown_connections 2023-10-16T19:57:30.624 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:30.616+0000 7f93d409e700 1 -- 172.21.15.157:0/3257064945 wait complete. 2023-10-16T19:57:30.627 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:30.617+0000 7f93d409e700 1 Processor -- start 2023-10-16T19:57:30.627 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:30.617+0000 7f93d409e700 1 -- start start 2023-10-16T19:57:30.627 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:30.618+0000 7f93d409e700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f93cc06af60 0x7f93cc158170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:30.627 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:30.618+0000 7f93d409e700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f93cc06de00 0x7f93cc15c930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:30.628 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:30.618+0000 7f93d409e700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f93cc15e2f0 0x7f93cc15ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:30.628 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:30.618+0000 7f93d409e700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93cc0c6a20 con 0x7f93cc06af60 2023-10-16T19:57:30.628 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:30.618+0000 7f93d409e700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93cc0c5da0 con 0x7f93cc15e2f0 2023-10-16T19:57:30.628 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:30.618+0000 7f93d409e700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93cc0c6080 con 0x7f93cc06de00 2023-10-16T19:57:30.629 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:30.618+0000 7f93d1e3a700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f93cc06af60 0x7f93cc158170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:30.629 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:30.618+0000 7f93d1e3a700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f93cc06af60 0x7f93cc158170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:46444/0 (socket says 172.21.15.157:46444) 2023-10-16T19:57:30.629 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:30.618+0000 7f93d1e3a700 1 -- 172.21.15.157:0/3957368576 learned_addr learned my addr 172.21.15.157:0/3957368576 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:57:30.629 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:30.618+0000 7f93d1639700 1 --2- 172.21.15.157:0/3957368576 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f93cc06de00 0x7f93cc15c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:30.629 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:30.618+0000 7f93d1e3a700 1 -- 172.21.15.157:0/3957368576 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f93cc06de00 msgr2=0x7f93cc15c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:30.630 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:30.618+0000 7f93d1e3a700 1 --2- 172.21.15.157:0/3957368576 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f93cc06de00 0x7f93cc15c930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:30.630 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:30.618+0000 7f93d1e3a700 1 -- 172.21.15.157:0/3957368576 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f93cc15e2f0 msgr2=0x7f93cc15ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:30.630 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:30.618+0000 7f93d1e3a700 1 --2- 172.21.15.157:0/3957368576 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f93cc15e2f0 0x7f93cc15ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:30.630 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:30.618+0000 7f93d1e3a700 1 -- 172.21.15.157:0/3957368576 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93c4009a70 con 0x7f93cc06af60 2023-10-16T19:57:30.630 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:30.619+0000 7f93d1e3a700 1 --2- 172.21.15.157:0/3957368576 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f93cc06af60 0x7f93cc158170 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f93c800d800 tx=0x7f93c800dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:30.631 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:30.619+0000 7f93c27fc700 1 -- 172.21.15.157:0/3957368576 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93c80125f0 con 0x7f93cc06af60 2023-10-16T19:57:30.631 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:30.619+0000 7f93c27fc700 1 -- 172.21.15.157:0/3957368576 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93c8012750 con 0x7f93cc06af60 2023-10-16T19:57:30.631 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:30.619+0000 7f93d409e700 1 -- 172.21.15.157:0/3957368576 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93cc0c6360 con 0x7f93cc06af60 2023-10-16T19:57:30.631 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:30.619+0000 7f93c27fc700 1 -- 172.21.15.157:0/3957368576 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93c8012b00 con 0x7f93cc06af60 2023-10-16T19:57:30.631 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:30.619+0000 7f93d409e700 1 -- 172.21.15.157:0/3957368576 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93cc0b6230 con 0x7f93cc06af60 2023-10-16T19:57:30.632 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:30.620+0000 7f93d409e700 1 -- 172.21.15.157:0/3957368576 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93cc0c6b60 con 0x7f93cc06af60 2023-10-16T19:57:30.632 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:30.620+0000 7f93c27fc700 1 -- 172.21.15.157:0/3957368576 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f93c8012c60 con 0x7f93cc06af60 2023-10-16T19:57:30.632 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:30.621+0000 7f93c27fc700 1 --2- 172.21.15.157:0/3957368576 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f93b006af00 0x7f93b006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:30.632 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:30.621+0000 7f93c27fc700 1 -- 172.21.15.157:0/3957368576 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f93c8089990 con 0x7f93cc06af60 2023-10-16T19:57:30.632 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:30.621+0000 7f93d1639700 1 --2- 172.21.15.157:0/3957368576 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f93b006af00 0x7f93b006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:30.633 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:30.621+0000 7f93d1639700 1 --2- 172.21.15.157:0/3957368576 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f93b006af00 0x7f93b006d3c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f93cc15b5c0 tx=0x7f93bc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:30.633 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:30.625+0000 7f93c27fc700 1 -- 172.21.15.157:0/3957368576 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f93cc0c6b60 con 0x7f93cc06af60 2023-10-16T19:57:30.861 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:30.859+0000 7f93d409e700 1 -- 172.21.15.157:0/3957368576 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f93cc0c6b60 con 0x7f93cc06af60 2023-10-16T19:57:30.862 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:30.859+0000 7f93c27fc700 1 -- 172.21.15.157:0/3957368576 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f93cc0c6b60 con 0x7f93cc06af60 2023-10-16T19:57:30.862 INFO:teuthology.orchestra.run.smithi157.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-16T19:57:30.864 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:30.861+0000 7f93d409e700 1 -- 172.21.15.157:0/3957368576 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f93b006af00 msgr2=0x7f93b006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:30.864 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:30.861+0000 7f93d409e700 1 --2- 172.21.15.157:0/3957368576 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f93b006af00 0x7f93b006d3c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f93cc15b5c0 tx=0x7f93bc009040 comp rx=0 tx=0).stop 2023-10-16T19:57:30.865 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:30.861+0000 7f93d409e700 1 -- 172.21.15.157:0/3957368576 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f93cc06af60 msgr2=0x7f93cc158170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:30.865 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:30.861+0000 7f93d409e700 1 --2- 172.21.15.157:0/3957368576 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f93cc06af60 0x7f93cc158170 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f93c800d800 tx=0x7f93c800dbc0 comp rx=0 tx=0).stop 2023-10-16T19:57:30.865 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:30.862+0000 7f93d409e700 1 -- 172.21.15.157:0/3957368576 shutdown_connections 2023-10-16T19:57:30.865 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:30.862+0000 7f93d409e700 1 --2- 172.21.15.157:0/3957368576 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f93b006af00 0x7f93b006d3c0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:30.865 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:30.862+0000 7f93d409e700 1 --2- 172.21.15.157:0/3957368576 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f93cc15e2f0 0x7f93cc15ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:30.866 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:30.862+0000 7f93d409e700 1 --2- 172.21.15.157:0/3957368576 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f93cc06af60 0x7f93cc158170 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:30.866 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:30.862+0000 7f93d409e700 1 --2- 172.21.15.157:0/3957368576 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f93cc06de00 0x7f93cc15c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:30.866 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:30.862+0000 7f93d409e700 1 -- 172.21.15.157:0/3957368576 >> 172.21.15.157:0/3957368576 conn(0x7f93cc0cd4e0 msgr2=0x7f93cc0b0f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:30.866 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:30.862+0000 7f93d409e700 1 -- 172.21.15.157:0/3957368576 shutdown_connections 2023-10-16T19:57:30.866 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:30.862+0000 7f93d409e700 1 -- 172.21.15.157:0/3957368576 wait complete. 2023-10-16T19:57:30.876 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-16T19:57:30.877 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-16T19:57:30.877 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi187.front.sepia.ceph.com 2023-10-16T19:57:30.877 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-16T19:57:30.877 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-16T19:57:30.878 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-16T19:57:30.878 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-16T19:57:30.879 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-16T19:57:30.879 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-16T19:57:30.879 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T19:57:30.880 DEBUG:teuthology.orchestra.run.smithi187:> ip addr 2023-10-16T19:57:30.901 INFO:teuthology.orchestra.run.smithi187.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-16T19:57:30.902 INFO:teuthology.orchestra.run.smithi187.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-16T19:57:30.902 INFO:teuthology.orchestra.run.smithi187.stdout: inet 127.0.0.1/8 scope host lo 2023-10-16T19:57:30.903 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2023-10-16T19:57:30.903 INFO:teuthology.orchestra.run.smithi187.stdout: inet6 ::1/128 scope host 2023-10-16T19:57:30.903 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2023-10-16T19:57:30.904 INFO:teuthology.orchestra.run.smithi187.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-16T19:57:30.904 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether 0c:c4:7a:d9:36:78 brd ff:ff:ff:ff:ff:ff 2023-10-16T19:57:30.904 INFO:teuthology.orchestra.run.smithi187.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-16T19:57:30.905 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether 0c:c4:7a:d9:36:79 brd ff:ff:ff:ff:ff:ff 2023-10-16T19:57:30.905 INFO:teuthology.orchestra.run.smithi187.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-16T19:57:30.906 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether 0c:c4:7a:88:77:b0 brd ff:ff:ff:ff:ff:ff 2023-10-16T19:57:30.906 INFO:teuthology.orchestra.run.smithi187.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-16T19:57:30.906 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether 0c:c4:7a:88:77:b1 brd ff:ff:ff:ff:ff:ff 2023-10-16T19:57:30.907 INFO:teuthology.orchestra.run.smithi187.stdout: inet 172.21.15.187/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-16T19:57:30.907 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft 42432sec preferred_lft 42432sec 2023-10-16T19:57:30.907 INFO:teuthology.orchestra.run.smithi187.stdout: inet6 fe80::ecf0:c039:b76a:e727/64 scope link noprefixroute 2023-10-16T19:57:30.908 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2023-10-16T19:57:30.908 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-10-16T19:57:30.909 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T19:57:30.909 DEBUG:teuthology.orchestra.run.smithi187:> (cd / && exec bash -c ' 2023-10-16T19:57:30.910 DEBUG:teuthology.orchestra.run.smithi187:> set -e 2023-10-16T19:57:30.910 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip link add name ceph-brx type bridge 2023-10-16T19:57:30.910 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip addr flush dev ceph-brx 2023-10-16T19:57:30.911 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip link set ceph-brx up 2023-10-16T19:57:30.911 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-10-16T19:57:30.912 DEBUG:teuthology.orchestra.run.smithi187:> ') 2023-10-16T19:57:31.085 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T19:57:31.086 DEBUG:teuthology.orchestra.run.smithi187:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-16T19:57:31.115 INFO:teuthology.orchestra.run.smithi187.stdout:1 2023-10-16T19:57:31.116 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T19:57:31.117 DEBUG:teuthology.orchestra.run.smithi187:> route 2023-10-16T19:57:31.188 INFO:teuthology.orchestra.run.smithi187.stdout:Kernel IP routing table 2023-10-16T19:57:31.188 INFO:teuthology.orchestra.run.smithi187.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-16T19:57:31.189 INFO:teuthology.orchestra.run.smithi187.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-16T19:57:31.189 INFO:teuthology.orchestra.run.smithi187.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-16T19:57:31.189 INFO:teuthology.orchestra.run.smithi187.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-16T19:57:31.189 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T19:57:31.190 DEBUG:teuthology.orchestra.run.smithi187:> (cd / && exec bash -c ' 2023-10-16T19:57:31.190 DEBUG:teuthology.orchestra.run.smithi187:> set -e 2023-10-16T19:57:31.190 DEBUG:teuthology.orchestra.run.smithi187:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-16T19:57:31.191 DEBUG:teuthology.orchestra.run.smithi187:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-16T19:57:31.191 DEBUG:teuthology.orchestra.run.smithi187:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-16T19:57:31.191 DEBUG:teuthology.orchestra.run.smithi187:> ') 2023-10-16T19:57:31.426 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T19:57:31.426 DEBUG:teuthology.orchestra.run.smithi187:> ip netns list 2023-10-16T19:57:31.443 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T19:57:31.444 DEBUG:teuthology.orchestra.run.smithi187:> ip netns list-id 2023-10-16T19:57:31.500 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T19:57:31.500 DEBUG:teuthology.orchestra.run.smithi187:> (cd / && exec bash -c ' 2023-10-16T19:57:31.500 DEBUG:teuthology.orchestra.run.smithi187:> set -e 2023-10-16T19:57:31.501 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-16T19:57:31.501 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-10-16T19:57:31.501 DEBUG:teuthology.orchestra.run.smithi187:> ') 2023-10-16T19:57:31.594 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-10-16T19:57:31.595 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T19:57:31.596 DEBUG:teuthology.orchestra.run.smithi187:> (cd / && exec bash -c ' 2023-10-16T19:57:31.596 DEBUG:teuthology.orchestra.run.smithi187:> set -e 2023-10-16T19:57:31.596 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-10-16T19:57:31.596 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-10-16T19:57:31.597 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-10-16T19:57:31.597 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-10-16T19:57:31.597 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-10-16T19:57:31.598 DEBUG:teuthology.orchestra.run.smithi187:> ') 2023-10-16T19:57:31.791 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T19:57:31.791 DEBUG:teuthology.orchestra.run.smithi187:> (cd / && exec bash -c ' 2023-10-16T19:57:31.792 DEBUG:teuthology.orchestra.run.smithi187:> set -e 2023-10-16T19:57:31.792 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip link set brx.0 up 2023-10-16T19:57:31.792 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip link set dev brx.0 master ceph-brx 2023-10-16T19:57:31.792 DEBUG:teuthology.orchestra.run.smithi187:> ') 2023-10-16T19:57:31.896 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-16T19:57:31.896 DEBUG:teuthology.orchestra.run.smithi187:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-16T19:57:31.919 INFO:teuthology.orchestra.run.smithi187.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-16T19:57:31.920 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-16T19:57:31.920 DEBUG:teuthology.orchestra.run.smithi187:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-16T19:57:31.975 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-10-16T19:57:31.976 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T19:57:31.976 DEBUG:teuthology.orchestra.run.smithi187:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-16T19:57:32.072 INFO:teuthology.orchestra.run.smithi187.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-16T19:57:32.073 INFO:teuthology.orchestra.run.smithi187.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-16T19:57:32.189 INFO:teuthology.orchestra.run.smithi187.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-16T19:57:32.190 INFO:teuthology.orchestra.run.smithi187.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-16T19:57:32.190 INFO:teuthology.orchestra.run.smithi187.stdout:mount.ceph: resolved to: "172.21.15.157:3300,172.21.15.187:3300,172.21.15.187:3301" 2023-10-16T19:57:32.190 INFO:teuthology.orchestra.run.smithi187.stdout:mount.ceph: trying mount with new device syntax: 1@28199dc9-64d5-479e-83c6-21f097c33d39.cephfs=/ 2023-10-16T19:57:32.190 INFO:teuthology.orchestra.run.smithi187.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.157:3300/172.21.15.187:3300/172.21.15.187:3301" will pass to kernel 2023-10-16T19:57:32.191 INFO:teuthology.orchestra.run.smithi187.stdout:mount.ceph: v2 mount support check returned 2 2023-10-16T19:57:32.191 INFO:teuthology.orchestra.run.smithi187.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-16T19:57:32.191 INFO:teuthology.orchestra.run.smithi187.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-16T19:57:32.235 INFO:teuthology.orchestra.run.smithi187.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-16T19:57:32.235 INFO:teuthology.orchestra.run.smithi187.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-16T19:57:32.235 INFO:teuthology.orchestra.run.smithi187.stdout:mount.ceph: resolved to: "172.21.15.157:3300,172.21.15.187:3300,172.21.15.187:3301" 2023-10-16T19:57:32.235 INFO:teuthology.orchestra.run.smithi187.stdout:mount.ceph: trying mount with new device syntax: 1@28199dc9-64d5-479e-83c6-21f097c33d39.cephfs=/ 2023-10-16T19:57:32.236 INFO:teuthology.orchestra.run.smithi187.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.157:3300/172.21.15.187:3300/172.21.15.187:3301" will pass to kernel 2023-10-16T19:57:32.236 INFO:teuthology.orchestra.run.smithi187.stdout:mount.ceph: v2 mount support check returned 2 2023-10-16T19:57:32.236 INFO:teuthology.orchestra.run.smithi187.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-16T19:57:32.236 INFO:teuthology.orchestra.run.smithi187.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-16T19:57:32.236 INFO:teuthology.orchestra.run.smithi187.stdout:mount.ceph: resolved to: "172.21.15.157:6789,172.21.15.187:6789,172.21.15.187:6790" 2023-10-16T19:57:32.237 INFO:teuthology.orchestra.run.smithi187.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.157:6789,172.21.15.187:6789,172.21.15.187:6790:/ 2023-10-16T19:57:32.237 INFO:teuthology.orchestra.run.smithi187.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,key=1,mds_namespace=cephfs,fsid=28199dc9-64d5-479e-83c6-21f097c33d39" will pass to kernel 2023-10-16T19:57:32.238 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-16T19:57:32.238 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T19:57:32.239 DEBUG:teuthology.orchestra.run.smithi187:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-16T19:57:32.269 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T19:57:32.270 DEBUG:teuthology.orchestra.run.smithi187:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-16T19:57:32.341 INFO:teuthology.orchestra.run.smithi187.stdout:client4532 2023-10-16T19:57:32.341 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-10-16T19:57:32.342 DEBUG:teuthology.orchestra.run.smithi187:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T19:57:32.399 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T19:57:32.399 DEBUG:teuthology.orchestra.run.smithi187:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-16T19:57:32.470 INFO:teuthology.orchestra.run.smithi187.stdout:client4532 2023-10-16T19:57:32.471 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T19:57:32.471 DEBUG:teuthology.orchestra.run.smithi187:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-16T19:57:32.543 INFO:teuthology.orchestra.run.smithi187.stdout:client4532 2023-10-16T19:57:32.543 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T19:57:32.544 DEBUG:teuthology.orchestra.run.smithi187:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/28199dc9-64d5-479e-83c6-21f097c33d39.client4532/status') 2023-10-16T19:57:32.623 INFO:teuthology.orchestra.run.smithi187.stdout:instance: client.4532 (3)192.168.0.1:0/2745446200 2023-10-16T19:57:32.624 INFO:teuthology.orchestra.run.smithi187.stdout:blocklisted: false 2023-10-16T19:57:32.625 INFO:teuthology.orchestra.run.smithi187.stderr:0+1 records in 2023-10-16T19:57:32.625 INFO:teuthology.orchestra.run.smithi187.stderr:0+1 records out 2023-10-16T19:57:32.625 INFO:teuthology.orchestra.run.smithi187.stderr:69 bytes copied, 2.4421e-05 s, 2.8 MB/s 2023-10-16T19:57:32.625 INFO:tasks.kclient:client.3 config is {'syntax': 'v2'} 2023-10-16T19:57:32.626 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-10-16T19:57:32.626 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-10-16T19:57:32.626 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-16T19:57:32.760 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:32.758+0000 7fa84d2b3700 1 Processor -- start 2023-10-16T19:57:32.761 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:32.758+0000 7fa84d2b3700 1 -- start start 2023-10-16T19:57:32.764 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:32.759+0000 7fa84d2b3700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa84815de00 0x7fa848161a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:32.764 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:32.759+0000 7fa84d2b3700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fa848161f50 0x7fa8480d2200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:32.764 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:32.759+0000 7fa84d2b3700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8480ce870 con 0x7fa8480d2740 2023-10-16T19:57:32.764 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:32.759+0000 7fa84d2b3700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa848162990 con 0x7fa848161f50 2023-10-16T19:57:32.765 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:32.759+0000 7fa84d2b3700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8481623d0 con 0x7fa84815de00 2023-10-16T19:57:32.765 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:32.759+0000 7fa8477fe700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7fa8480d2740 0x7fa8480ced00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:56130/0 (socket says 172.21.15.157:56130) 2023-10-16T19:57:32.765 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:32.759+0000 7fa8477fe700 1 -- 172.21.15.157:0/2184144082 learned_addr learned my addr 172.21.15.157:0/2184144082 (peer_addr_for_me v1:172.21.15.157:0/0) 2023-10-16T19:57:32.765 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:32.759+0000 7fa846ffd700 1 --2- 172.21.15.157:0/2184144082 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa84815de00 0x7fa848161a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:32.765 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:32.759+0000 7fa8467fc700 1 --2- 172.21.15.157:0/2184144082 >> v2:172.21.15.187:3300/0 conn(0x7fa848161f50 0x7fa8480d2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:32.766 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:32.759+0000 7fa845ffb700 1 -- 172.21.15.157:0/2184144082 <== mon.0 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 629654188 0 0) 0x7fa8480ce870 con 0x7fa8480d2740 2023-10-16T19:57:32.766 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:32.759+0000 7fa845ffb700 1 -- 172.21.15.157:0/2184144082 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa8300035b0 con 0x7fa8480d2740 2023-10-16T19:57:32.766 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:32.759+0000 7fa8467fc700 1 -- 172.21.15.157:0/2184144082 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa84815de00 msgr2=0x7fa848161a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:57:32.766 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:32.759+0000 7fa8467fc700 1 --2- 172.21.15.157:0/2184144082 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa84815de00 0x7fa848161a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:32.767 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:32.759+0000 7fa8467fc700 1 -- 172.21.15.157:0/2184144082 >> v1:172.21.15.157:6789/0 conn(0x7fa8480d2740 legacy=0x7fa8480ced00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:32.767 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:32.759+0000 7fa8467fc700 1 -- 172.21.15.157:0/2184144082 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8481626b0 con 0x7fa848161f50 2023-10-16T19:57:32.767 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:32.759+0000 7fa846ffd700 1 --2- 172.21.15.157:0/2184144082 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa84815de00 0x7fa848161a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T19:57:32.767 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:32.760+0000 7fa8467fc700 1 --2- 172.21.15.157:0/2184144082 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa848161f50 0x7fa8480d2200 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fa838009840 tx=0x7fa838009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=47b091b09398bea7 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:32.768 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:32.760+0000 7fa845ffb700 1 -- 172.21.15.157:0/2184144082 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa838011830 con 0x7fa848161f50 2023-10-16T19:57:32.768 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:32.760+0000 7fa845ffb700 1 -- 172.21.15.157:0/2184144082 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa838011990 con 0x7fa848161f50 2023-10-16T19:57:32.768 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:32.760+0000 7fa845ffb700 1 -- 172.21.15.157:0/2184144082 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa838011d00 con 0x7fa848161f50 2023-10-16T19:57:32.768 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:32.760+0000 7fa84d2b3700 1 -- 172.21.15.157:0/2184144082 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa848161f50 msgr2=0x7fa8480d2200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:32.768 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:32.760+0000 7fa84d2b3700 1 --2- 172.21.15.157:0/2184144082 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa848161f50 0x7fa8480d2200 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fa838009840 tx=0x7fa838009b50 comp rx=0 tx=0).stop 2023-10-16T19:57:32.769 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:32.760+0000 7fa84d2b3700 1 -- 172.21.15.157:0/2184144082 shutdown_connections 2023-10-16T19:57:32.769 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:32.760+0000 7fa84d2b3700 1 --2- 172.21.15.157:0/2184144082 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa84815de00 0x7fa848161a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:32.769 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:32.760+0000 7fa84d2b3700 1 --2- 172.21.15.157:0/2184144082 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa848161f50 0x7fa8480d2200 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:32.769 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:32.760+0000 7fa84d2b3700 1 -- 172.21.15.157:0/2184144082 >> 172.21.15.157:0/2184144082 conn(0x7fa8480665a0 msgr2=0x7fa848066980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:32.769 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:32.760+0000 7fa84d2b3700 1 -- 172.21.15.157:0/2184144082 shutdown_connections 2023-10-16T19:57:32.770 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:32.760+0000 7fa84d2b3700 1 -- 172.21.15.157:0/2184144082 wait complete. 2023-10-16T19:57:32.770 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:32.762+0000 7fa84d2b3700 1 Processor -- start 2023-10-16T19:57:32.770 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:32.762+0000 7fa84d2b3700 1 -- start start 2023-10-16T19:57:32.773 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:32.762+0000 7fa84d2b3700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa8480d2740 0x7fa8481f4380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:32.773 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:32.762+0000 7fa84d2b3700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa84815de00 0x7fa8481f31a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:32.774 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:32.762+0000 7fa84d2b3700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa848161f50 0x7fa8480ab360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:32.774 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:32.762+0000 7fa84d2b3700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8480b8610 con 0x7fa848161f50 2023-10-16T19:57:32.774 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:32.762+0000 7fa84d2b3700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8481f48c0 con 0x7fa8480d2740 2023-10-16T19:57:32.774 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:32.762+0000 7fa84d2b3700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8480ca920 con 0x7fa84815de00 2023-10-16T19:57:32.775 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:32.762+0000 7fa8477fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa848161f50 0x7fa8480ab360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:32.775 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:32.763+0000 7fa8477fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa848161f50 0x7fa8480ab360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:46464/0 (socket says 172.21.15.157:46464) 2023-10-16T19:57:32.775 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:32.763+0000 7fa8477fe700 1 -- 172.21.15.157:0/475690320 learned_addr learned my addr 172.21.15.157:0/475690320 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:57:32.775 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:32.763+0000 7fa8467fc700 1 --2- 172.21.15.157:0/475690320 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa84815de00 0x7fa8481f31a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:32.776 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:32.763+0000 7fa846ffd700 1 --2- 172.21.15.157:0/475690320 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa8480d2740 0x7fa8481f4380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:32.776 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:32.763+0000 7fa8477fe700 1 -- 172.21.15.157:0/475690320 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa84815de00 msgr2=0x7fa8481f31a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:32.776 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:32.763+0000 7fa8477fe700 1 --2- 172.21.15.157:0/475690320 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa84815de00 0x7fa8481f31a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:32.776 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:32.763+0000 7fa8477fe700 1 -- 172.21.15.157:0/475690320 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa8480d2740 msgr2=0x7fa8481f4380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:32.776 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:32.763+0000 7fa8477fe700 1 --2- 172.21.15.157:0/475690320 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa8480d2740 0x7fa8481f4380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:32.777 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:32.763+0000 7fa8477fe700 1 -- 172.21.15.157:0/475690320 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa83c0094a0 con 0x7fa848161f50 2023-10-16T19:57:32.777 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:32.763+0000 7fa846ffd700 1 --2- 172.21.15.157:0/475690320 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa8480d2740 0x7fa8481f4380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T19:57:32.777 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:32.763+0000 7fa8467fc700 1 --2- 172.21.15.157:0/475690320 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa84815de00 0x7fa8481f31a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T19:57:32.777 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:32.763+0000 7fa8477fe700 1 --2- 172.21.15.157:0/475690320 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa848161f50 0x7fa8480ab360 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fa84000cb40 tx=0x7fa84000cf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:32.777 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:32.763+0000 7fa82f7fe700 1 -- 172.21.15.157:0/475690320 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa84000ab50 con 0x7fa848161f50 2023-10-16T19:57:32.778 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:32.763+0000 7fa82f7fe700 1 -- 172.21.15.157:0/475690320 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa84000acb0 con 0x7fa848161f50 2023-10-16T19:57:32.778 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:32.763+0000 7fa82f7fe700 1 -- 172.21.15.157:0/475690320 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa840012620 con 0x7fa848161f50 2023-10-16T19:57:32.778 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:32.763+0000 7fa84d2b3700 1 -- 172.21.15.157:0/475690320 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8380094a0 con 0x7fa848161f50 2023-10-16T19:57:32.778 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:32.763+0000 7fa84d2b3700 1 -- 172.21.15.157:0/475690320 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8480c9da0 con 0x7fa848161f50 2023-10-16T19:57:32.778 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:32.764+0000 7fa84d2b3700 1 -- 172.21.15.157:0/475690320 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8480c7940 con 0x7fa848161f50 2023-10-16T19:57:32.779 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:32.765+0000 7fa82f7fe700 1 -- 172.21.15.157:0/475690320 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fa84001b3b0 con 0x7fa848161f50 2023-10-16T19:57:32.779 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:32.765+0000 7fa82f7fe700 1 --2- 172.21.15.157:0/475690320 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fa83406af00 0x7fa83406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:32.779 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:32.765+0000 7fa82f7fe700 1 -- 172.21.15.157:0/475690320 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa8400896e0 con 0x7fa848161f50 2023-10-16T19:57:32.779 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:32.766+0000 7fa846ffd700 1 --2- 172.21.15.157:0/475690320 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fa83406af00 0x7fa83406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:32.779 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:32.766+0000 7fa846ffd700 1 --2- 172.21.15.157:0/475690320 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fa83406af00 0x7fa83406d3c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fa83c009dc0 tx=0x7fa83c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:32.780 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:32.769+0000 7fa82f7fe700 1 -- 172.21.15.157:0/475690320 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa840054780 con 0x7fa848161f50 2023-10-16T19:57:33.005 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:33.000+0000 7fa84d2b3700 1 -- 172.21.15.157:0/475690320 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fa8480c7940 con 0x7fa848161f50 2023-10-16T19:57:33.006 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:33.001+0000 7fa82f7fe700 1 -- 172.21.15.157:0/475690320 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7fa8480c7940 con 0x7fa848161f50 2023-10-16T19:57:33.006 INFO:teuthology.orchestra.run.smithi157.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-16T19:57:33.007 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:33.003+0000 7fa84d2b3700 1 -- 172.21.15.157:0/475690320 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fa83406af00 msgr2=0x7fa83406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:33.007 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:33.003+0000 7fa84d2b3700 1 --2- 172.21.15.157:0/475690320 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fa83406af00 0x7fa83406d3c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fa83c009dc0 tx=0x7fa83c008040 comp rx=0 tx=0).stop 2023-10-16T19:57:33.008 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:33.003+0000 7fa84d2b3700 1 -- 172.21.15.157:0/475690320 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa848161f50 msgr2=0x7fa8480ab360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:33.008 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:33.003+0000 7fa84d2b3700 1 --2- 172.21.15.157:0/475690320 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa848161f50 0x7fa8480ab360 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fa84000cb40 tx=0x7fa84000cf00 comp rx=0 tx=0).stop 2023-10-16T19:57:33.008 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:33.003+0000 7fa84d2b3700 1 -- 172.21.15.157:0/475690320 shutdown_connections 2023-10-16T19:57:33.008 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:33.003+0000 7fa84d2b3700 1 --2- 172.21.15.157:0/475690320 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fa83406af00 0x7fa83406d3c0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:33.009 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:33.003+0000 7fa84d2b3700 1 --2- 172.21.15.157:0/475690320 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa8480d2740 0x7fa8481f4380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:33.009 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:33.003+0000 7fa84d2b3700 1 --2- 172.21.15.157:0/475690320 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa848161f50 0x7fa8480ab360 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:33.009 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:33.003+0000 7fa84d2b3700 1 --2- 172.21.15.157:0/475690320 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa84815de00 0x7fa8481f31a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:33.009 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:33.003+0000 7fa84d2b3700 1 -- 172.21.15.157:0/475690320 >> 172.21.15.157:0/475690320 conn(0x7fa8480665a0 msgr2=0x7fa8480d2bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:33.009 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:33.003+0000 7fa84d2b3700 1 -- 172.21.15.157:0/475690320 shutdown_connections 2023-10-16T19:57:33.010 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:33.003+0000 7fa84d2b3700 1 -- 172.21.15.157:0/475690320 wait complete. 2023-10-16T19:57:33.017 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-16T19:57:33.018 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-16T19:57:33.018 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi187.front.sepia.ceph.com 2023-10-16T19:57:33.018 INFO:tasks.cephfs.mount:self.client.name = client.3 2023-10-16T19:57:33.018 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-10-16T19:57:33.019 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-16T19:57:33.019 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-16T19:57:33.019 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-16T19:57:33.019 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2023-10-16T19:57:33.020 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T19:57:33.020 DEBUG:teuthology.orchestra.run.smithi187:> ip addr 2023-10-16T19:57:33.039 INFO:teuthology.orchestra.run.smithi187.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-16T19:57:33.040 INFO:teuthology.orchestra.run.smithi187.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-16T19:57:33.040 INFO:teuthology.orchestra.run.smithi187.stdout: inet 127.0.0.1/8 scope host lo 2023-10-16T19:57:33.040 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2023-10-16T19:57:33.040 INFO:teuthology.orchestra.run.smithi187.stdout: inet6 ::1/128 scope host 2023-10-16T19:57:33.041 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2023-10-16T19:57:33.041 INFO:teuthology.orchestra.run.smithi187.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-16T19:57:33.041 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether 0c:c4:7a:d9:36:78 brd ff:ff:ff:ff:ff:ff 2023-10-16T19:57:33.041 INFO:teuthology.orchestra.run.smithi187.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-16T19:57:33.041 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether 0c:c4:7a:d9:36:79 brd ff:ff:ff:ff:ff:ff 2023-10-16T19:57:33.042 INFO:teuthology.orchestra.run.smithi187.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-16T19:57:33.042 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether 0c:c4:7a:88:77:b0 brd ff:ff:ff:ff:ff:ff 2023-10-16T19:57:33.042 INFO:teuthology.orchestra.run.smithi187.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-16T19:57:33.042 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether 0c:c4:7a:88:77:b1 brd ff:ff:ff:ff:ff:ff 2023-10-16T19:57:33.042 INFO:teuthology.orchestra.run.smithi187.stdout: inet 172.21.15.187/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-16T19:57:33.043 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft 42430sec preferred_lft 42430sec 2023-10-16T19:57:33.043 INFO:teuthology.orchestra.run.smithi187.stdout: inet6 fe80::ecf0:c039:b76a:e727/64 scope link noprefixroute 2023-10-16T19:57:33.043 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2023-10-16T19:57:33.043 INFO:teuthology.orchestra.run.smithi187.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-16T19:57:33.043 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether da:de:55:e7:41:a6 brd ff:ff:ff:ff:ff:ff 2023-10-16T19:57:33.044 INFO:teuthology.orchestra.run.smithi187.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-16T19:57:33.044 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2023-10-16T19:57:33.044 INFO:teuthology.orchestra.run.smithi187.stdout: inet6 fe80::c89e:f4ff:fec0:730d/64 scope link 2023-10-16T19:57:33.044 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2023-10-16T19:57:33.044 INFO:teuthology.orchestra.run.smithi187.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-16T19:57:33.045 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether da:de:55:e7:41:a6 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-16T19:57:33.045 INFO:teuthology.orchestra.run.smithi187.stdout: inet6 fe80::d8de:55ff:fee7:41a6/64 scope link tentative 2023-10-16T19:57:33.045 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2023-10-16T19:57:33.045 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T19:57:33.046 DEBUG:teuthology.orchestra.run.smithi187:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-16T19:57:33.107 INFO:teuthology.orchestra.run.smithi187.stdout:1 2023-10-16T19:57:33.109 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T19:57:33.109 DEBUG:teuthology.orchestra.run.smithi187:> route 2023-10-16T19:57:33.170 INFO:teuthology.orchestra.run.smithi187.stdout:Kernel IP routing table 2023-10-16T19:57:33.170 INFO:teuthology.orchestra.run.smithi187.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-16T19:57:33.170 INFO:teuthology.orchestra.run.smithi187.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-16T19:57:33.171 INFO:teuthology.orchestra.run.smithi187.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-16T19:57:33.171 INFO:teuthology.orchestra.run.smithi187.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-16T19:57:33.171 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T19:57:33.171 DEBUG:teuthology.orchestra.run.smithi187:> (cd / && exec bash -c ' 2023-10-16T19:57:33.172 DEBUG:teuthology.orchestra.run.smithi187:> set -e 2023-10-16T19:57:33.172 DEBUG:teuthology.orchestra.run.smithi187:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-16T19:57:33.172 DEBUG:teuthology.orchestra.run.smithi187:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-16T19:57:33.173 DEBUG:teuthology.orchestra.run.smithi187:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-16T19:57:33.173 DEBUG:teuthology.orchestra.run.smithi187:> ') 2023-10-16T19:57:33.276 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T19:57:33.277 DEBUG:teuthology.orchestra.run.smithi187:> ip netns list 2023-10-16T19:57:33.293 INFO:teuthology.orchestra.run.smithi187.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-16T19:57:33.294 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T19:57:33.294 DEBUG:teuthology.orchestra.run.smithi187:> ip netns list-id 2023-10-16T19:57:33.351 INFO:teuthology.orchestra.run.smithi187.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2023-10-16T19:57:33.352 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T19:57:33.352 DEBUG:teuthology.orchestra.run.smithi187:> (cd / && exec bash -c ' 2023-10-16T19:57:33.353 DEBUG:teuthology.orchestra.run.smithi187:> set -e 2023-10-16T19:57:33.353 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-16T19:57:33.353 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2023-10-16T19:57:33.353 DEBUG:teuthology.orchestra.run.smithi187:> ') 2023-10-16T19:57:33.444 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T19:57:33.444 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-10-16T19:57:33.485 INFO:teuthology.orchestra.run.smithi187.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-16T19:57:33.486 INFO:teuthology.orchestra.run.smithi187.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-16T19:57:33.486 INFO:teuthology.orchestra.run.smithi187.stdout: inet 127.0.0.1/8 scope host lo 2023-10-16T19:57:33.486 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2023-10-16T19:57:33.486 INFO:teuthology.orchestra.run.smithi187.stdout: inet6 ::1/128 scope host 2023-10-16T19:57:33.487 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2023-10-16T19:57:33.487 INFO:teuthology.orchestra.run.smithi187.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-16T19:57:33.487 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether 76:eb:9d:ff:d7:ef brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-16T19:57:33.487 INFO:teuthology.orchestra.run.smithi187.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-16T19:57:33.488 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2023-10-16T19:57:33.488 INFO:teuthology.orchestra.run.smithi187.stdout: inet6 fe80::74eb:9dff:feff:d7ef/64 scope link 2023-10-16T19:57:33.488 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2023-10-16T19:57:33.497 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T19:57:33.498 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-10-16T19:57:33.577 INFO:teuthology.orchestra.run.smithi187.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-16T19:57:33.578 INFO:teuthology.orchestra.run.smithi187.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-16T19:57:33.578 INFO:teuthology.orchestra.run.smithi187.stdout: inet 127.0.0.1/8 scope host lo 2023-10-16T19:57:33.578 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2023-10-16T19:57:33.578 INFO:teuthology.orchestra.run.smithi187.stdout: inet6 ::1/128 scope host 2023-10-16T19:57:33.578 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2023-10-16T19:57:33.579 INFO:teuthology.orchestra.run.smithi187.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-16T19:57:33.579 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether 76:eb:9d:ff:d7:ef brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-16T19:57:33.579 INFO:teuthology.orchestra.run.smithi187.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-16T19:57:33.579 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2023-10-16T19:57:33.579 INFO:teuthology.orchestra.run.smithi187.stdout: inet6 fe80::74eb:9dff:feff:d7ef/64 scope link 2023-10-16T19:57:33.580 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2023-10-16T19:57:33.587 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2023-10-16T19:57:33.588 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T19:57:33.588 DEBUG:teuthology.orchestra.run.smithi187:> (cd / && exec bash -c ' 2023-10-16T19:57:33.588 DEBUG:teuthology.orchestra.run.smithi187:> set -e 2023-10-16T19:57:33.589 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2023-10-16T19:57:33.589 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-10-16T19:57:33.589 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2023-10-16T19:57:33.590 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2023-10-16T19:57:33.590 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2023-10-16T19:57:33.590 DEBUG:teuthology.orchestra.run.smithi187:> ') 2023-10-16T19:57:33.840 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T19:57:33.841 DEBUG:teuthology.orchestra.run.smithi187:> (cd / && exec bash -c ' 2023-10-16T19:57:33.841 DEBUG:teuthology.orchestra.run.smithi187:> set -e 2023-10-16T19:57:33.841 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip link set brx.1 up 2023-10-16T19:57:33.841 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip link set dev brx.1 master ceph-brx 2023-10-16T19:57:33.842 DEBUG:teuthology.orchestra.run.smithi187:> ') 2023-10-16T19:57:33.969 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-16T19:57:33.969 DEBUG:teuthology.orchestra.run.smithi187:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2023-10-16T19:57:33.990 INFO:teuthology.orchestra.run.smithi187.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2023-10-16T19:57:33.990 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-16T19:57:33.991 DEBUG:teuthology.orchestra.run.smithi187:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2023-10-16T19:57:34.046 INFO:tasks.cephfs.kernel_mount:mounting using device: 3@.cephfs=/ 2023-10-16T19:57:34.047 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T19:57:34.048 DEBUG:teuthology.orchestra.run.smithi187:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 3@.cephfs=/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-16T19:57:34.132 INFO:teuthology.orchestra.run.smithi187.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-16T19:57:34.133 INFO:teuthology.orchestra.run.smithi187.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-16T19:57:34.155 INFO:teuthology.orchestra.run.smithi187.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-16T19:57:34.155 INFO:teuthology.orchestra.run.smithi187.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-16T19:57:34.155 INFO:teuthology.orchestra.run.smithi187.stdout:mount.ceph: resolved to: "172.21.15.157:3300,172.21.15.187:3300,172.21.15.187:3301" 2023-10-16T19:57:34.156 INFO:teuthology.orchestra.run.smithi187.stdout:mount.ceph: trying mount with new device syntax: 3@28199dc9-64d5-479e-83c6-21f097c33d39.cephfs=/ 2023-10-16T19:57:34.156 INFO:teuthology.orchestra.run.smithi187.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,ms_mode=prefer-crc,key=3,mon_addr=172.21.15.157:3300/172.21.15.187:3300/172.21.15.187:3301" will pass to kernel 2023-10-16T19:57:34.156 INFO:teuthology.orchestra.run.smithi187.stdout:mount.ceph: v2 mount support check returned 2 2023-10-16T19:57:34.156 INFO:teuthology.orchestra.run.smithi187.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-16T19:57:34.156 INFO:teuthology.orchestra.run.smithi187.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-16T19:57:34.194 INFO:teuthology.orchestra.run.smithi187.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-16T19:57:34.194 INFO:teuthology.orchestra.run.smithi187.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-16T19:57:34.194 INFO:teuthology.orchestra.run.smithi187.stdout:mount.ceph: resolved to: "172.21.15.157:3300,172.21.15.187:3300,172.21.15.187:3301" 2023-10-16T19:57:34.194 INFO:teuthology.orchestra.run.smithi187.stdout:mount.ceph: trying mount with new device syntax: 3@28199dc9-64d5-479e-83c6-21f097c33d39.cephfs=/ 2023-10-16T19:57:34.195 INFO:teuthology.orchestra.run.smithi187.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,ms_mode=prefer-crc,key=3,mon_addr=172.21.15.157:3300/172.21.15.187:3300/172.21.15.187:3301" will pass to kernel 2023-10-16T19:57:34.195 INFO:teuthology.orchestra.run.smithi187.stdout:mount.ceph: v2 mount support check returned 2 2023-10-16T19:57:34.195 INFO:teuthology.orchestra.run.smithi187.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-16T19:57:34.195 INFO:teuthology.orchestra.run.smithi187.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-16T19:57:34.195 INFO:teuthology.orchestra.run.smithi187.stdout:mount.ceph: resolved to: "172.21.15.157:6789,172.21.15.187:6789,172.21.15.187:6790" 2023-10-16T19:57:34.195 INFO:teuthology.orchestra.run.smithi187.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.157:6789,172.21.15.187:6789,172.21.15.187:6790:/ 2023-10-16T19:57:34.196 INFO:teuthology.orchestra.run.smithi187.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,key=3,mds_namespace=cephfs,fsid=28199dc9-64d5-479e-83c6-21f097c33d39" will pass to kernel 2023-10-16T19:57:34.203 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-16T19:57:34.204 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T19:57:34.204 DEBUG:teuthology.orchestra.run.smithi187:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2023-10-16T19:57:34.235 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T19:57:34.235 DEBUG:teuthology.orchestra.run.smithi187:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-16T19:57:34.307 INFO:teuthology.orchestra.run.smithi187.stdout:client4618 2023-10-16T19:57:34.307 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-10-16T19:57:34.307 DEBUG:teuthology.orchestra.run.smithi187:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T19:57:34.364 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T19:57:34.365 DEBUG:teuthology.orchestra.run.smithi187:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-16T19:57:34.435 INFO:teuthology.orchestra.run.smithi187.stdout:client4618 2023-10-16T19:57:34.436 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T19:57:34.436 DEBUG:teuthology.orchestra.run.smithi187:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-16T19:57:34.507 INFO:teuthology.orchestra.run.smithi187.stdout:client4618 2023-10-16T19:57:34.508 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T19:57:34.508 DEBUG:teuthology.orchestra.run.smithi187:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/28199dc9-64d5-479e-83c6-21f097c33d39.client4618/status') 2023-10-16T19:57:34.587 INFO:teuthology.orchestra.run.smithi187.stdout:instance: client.4618 (3)192.168.0.2:0/136879861 2023-10-16T19:57:34.587 INFO:teuthology.orchestra.run.smithi187.stdout:blocklisted: false 2023-10-16T19:57:34.588 INFO:teuthology.orchestra.run.smithi187.stderr:0+1 records in 2023-10-16T19:57:34.588 INFO:teuthology.orchestra.run.smithi187.stderr:0+1 records out 2023-10-16T19:57:34.589 INFO:teuthology.orchestra.run.smithi187.stderr:68 bytes copied, 2.3114e-05 s, 2.9 MB/s 2023-10-16T19:57:34.589 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-10-16T19:57:34.605 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T19:57:34.740 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:34.738+0000 7fe74dfc0700 1 Processor -- start 2023-10-16T19:57:34.740 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:34.738+0000 7fe74dfc0700 1 -- start start 2023-10-16T19:57:34.743 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:34.738+0000 7fe74dfc0700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fe74806af60 0x7fe74806d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:34.743 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:34.738+0000 7fe74dfc0700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fe74806de00 0x7fe7480ce910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:34.743 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:34.738+0000 7fe74dfc0700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7480d08b0 con 0x7fe74815e2f0 2023-10-16T19:57:34.743 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:34.738+0000 7fe74dfc0700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7481628f0 con 0x7fe74806de00 2023-10-16T19:57:34.744 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:34.738+0000 7fe74dfc0700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe748162bd0 con 0x7fe74806af60 2023-10-16T19:57:34.744 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:34.739+0000 7fe747fff700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fe74806de00 0x7fe7480ce910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:34.744 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:34.739+0000 7fe7477fe700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7fe74815e2f0 0x7fe74806a850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:56140/0 (socket says 172.21.15.157:56140) 2023-10-16T19:57:34.744 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:34.739+0000 7fe7477fe700 1 -- 172.21.15.157:0/3474212476 learned_addr learned my addr 172.21.15.157:0/3474212476 (peer_addr_for_me v1:172.21.15.157:0/0) 2023-10-16T19:57:34.744 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:34.739+0000 7fe746ffd700 1 --2- 172.21.15.157:0/3474212476 >> v2:172.21.15.187:3300/0 conn(0x7fe74806af60 0x7fe74806d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:34.745 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:34.739+0000 7fe747fff700 1 -- 172.21.15.157:0/3474212476 >> v2:172.21.15.187:3300/0 conn(0x7fe74806af60 msgr2=0x7fe74806d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:57:34.745 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:34.739+0000 7fe747fff700 1 --2- 172.21.15.157:0/3474212476 >> v2:172.21.15.187:3300/0 conn(0x7fe74806af60 0x7fe74806d0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:34.745 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:34.739+0000 7fe747fff700 1 -- 172.21.15.157:0/3474212476 >> v1:172.21.15.157:6789/0 conn(0x7fe74815e2f0 legacy=0x7fe74806a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:34.745 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:34.739+0000 7fe747fff700 1 -- 172.21.15.157:0/3474212476 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7480d05d0 con 0x7fe74806de00 2023-10-16T19:57:34.745 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:34.739+0000 7fe747fff700 1 --2- 172.21.15.157:0/3474212476 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe74806de00 0x7fe7480ce910 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fe7480678b0 tx=0x7fe74000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88ec9191a2e1e08d server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:34.746 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:34.739+0000 7fe7467fc700 1 -- 172.21.15.157:0/3474212476 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe74000e070 con 0x7fe74806de00 2023-10-16T19:57:34.746 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:34.739+0000 7fe7467fc700 1 -- 172.21.15.157:0/3474212476 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe74000bbd0 con 0x7fe74806de00 2023-10-16T19:57:34.746 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:34.739+0000 7fe7467fc700 1 -- 172.21.15.157:0/3474212476 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe740012430 con 0x7fe74806de00 2023-10-16T19:57:34.746 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:34.740+0000 7fe74dfc0700 1 -- 172.21.15.157:0/3474212476 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe74806de00 msgr2=0x7fe7480ce910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:34.746 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:34.740+0000 7fe74dfc0700 1 --2- 172.21.15.157:0/3474212476 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe74806de00 0x7fe7480ce910 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fe7480678b0 tx=0x7fe74000b330 comp rx=0 tx=0).stop 2023-10-16T19:57:34.747 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:34.740+0000 7fe74dfc0700 1 -- 172.21.15.157:0/3474212476 shutdown_connections 2023-10-16T19:57:34.747 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:34.740+0000 7fe74dfc0700 1 --2- 172.21.15.157:0/3474212476 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe74806de00 0x7fe7480ce910 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:34.747 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:34.740+0000 7fe74dfc0700 1 --2- 172.21.15.157:0/3474212476 >> v2:172.21.15.187:3300/0 conn(0x7fe74806af60 0x7fe74806d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:34.747 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:34.740+0000 7fe74dfc0700 1 -- 172.21.15.157:0/3474212476 >> 172.21.15.157:0/3474212476 conn(0x7fe7480cd4e0 msgr2=0x7fe7480cd8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:34.747 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:34.740+0000 7fe74dfc0700 1 -- 172.21.15.157:0/3474212476 shutdown_connections 2023-10-16T19:57:34.748 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:34.740+0000 7fe74dfc0700 1 -- 172.21.15.157:0/3474212476 wait complete. 2023-10-16T19:57:34.750 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:34.741+0000 7fe74dfc0700 1 Processor -- start 2023-10-16T19:57:34.751 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:34.741+0000 7fe74dfc0700 1 -- start start 2023-10-16T19:57:34.751 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:34.742+0000 7fe74dfc0700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe74806af60 0x7fe7481f3290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:34.751 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:34.742+0000 7fe74dfc0700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe74806de00 0x7fe748158a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:34.751 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:34.742+0000 7fe74dfc0700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe74815e2f0 0x7fe748158f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:34.751 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:34.742+0000 7fe74dfc0700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7481595a0 con 0x7fe74806de00 2023-10-16T19:57:34.752 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:34.742+0000 7fe74dfc0700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe74815f990 con 0x7fe74806af60 2023-10-16T19:57:34.752 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:34.742+0000 7fe74dfc0700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7480b2f60 con 0x7fe74815e2f0 2023-10-16T19:57:34.752 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:34.742+0000 7fe746ffd700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe74806de00 0x7fe748158a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:34.752 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:34.742+0000 7fe746ffd700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe74806de00 0x7fe748158a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:46474/0 (socket says 172.21.15.157:46474) 2023-10-16T19:57:34.752 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:34.742+0000 7fe746ffd700 1 -- 172.21.15.157:0/552207320 learned_addr learned my addr 172.21.15.157:0/552207320 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:57:34.753 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:34.742+0000 7fe746ffd700 1 -- 172.21.15.157:0/552207320 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe74815e2f0 msgr2=0x7fe748158f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:34.753 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:34.742+0000 7fe746ffd700 1 --2- 172.21.15.157:0/552207320 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe74815e2f0 0x7fe748158f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:34.753 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:34.742+0000 7fe746ffd700 1 -- 172.21.15.157:0/552207320 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe74806af60 msgr2=0x7fe7481f3290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:34.753 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:34.742+0000 7fe746ffd700 1 --2- 172.21.15.157:0/552207320 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe74806af60 0x7fe7481f3290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:34.753 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:34.742+0000 7fe746ffd700 1 -- 172.21.15.157:0/552207320 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe740009a70 con 0x7fe74806de00 2023-10-16T19:57:34.754 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:34.742+0000 7fe746ffd700 1 --2- 172.21.15.157:0/552207320 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe74806de00 0x7fe748158a30 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fe73800d800 tx=0x7fe73800dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:34.754 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:34.743+0000 7fe73ffff700 1 -- 172.21.15.157:0/552207320 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7380125f0 con 0x7fe74806de00 2023-10-16T19:57:34.754 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:34.743+0000 7fe73ffff700 1 -- 172.21.15.157:0/552207320 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe738012750 con 0x7fe74806de00 2023-10-16T19:57:34.754 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:34.743+0000 7fe74dfc0700 1 -- 172.21.15.157:0/552207320 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe74815fc30 con 0x7fe74806de00 2023-10-16T19:57:34.754 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:34.743+0000 7fe73ffff700 1 -- 172.21.15.157:0/552207320 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe738012b00 con 0x7fe74806de00 2023-10-16T19:57:34.755 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:34.743+0000 7fe74dfc0700 1 -- 172.21.15.157:0/552207320 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7481601f0 con 0x7fe74806de00 2023-10-16T19:57:34.755 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:34.744+0000 7fe74dfc0700 1 -- 172.21.15.157:0/552207320 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe748160380 con 0x7fe74806de00 2023-10-16T19:57:34.755 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:34.744+0000 7fe73ffff700 1 -- 172.21.15.157:0/552207320 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fe738012c60 con 0x7fe74806de00 2023-10-16T19:57:34.755 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:34.744+0000 7fe73ffff700 1 --2- 172.21.15.157:0/552207320 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fe72806af00 0x7fe72806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:34.755 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:34.744+0000 7fe73ffff700 1 -- 172.21.15.157:0/552207320 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe738089980 con 0x7fe74806de00 2023-10-16T19:57:34.756 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:34.745+0000 7fe7477fe700 1 --2- 172.21.15.157:0/552207320 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fe72806af00 0x7fe72806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:34.756 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:34.745+0000 7fe7477fe700 1 --2- 172.21.15.157:0/552207320 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fe72806af00 0x7fe72806d3c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fe730000f60 tx=0x7fe730007b10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:34.756 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:34.749+0000 7fe73ffff700 1 -- 172.21.15.157:0/552207320 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe738054a30 con 0x7fe74806de00 2023-10-16T19:57:34.942 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:34.940+0000 7fe74dfc0700 1 -- 172.21.15.157:0/552207320 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe74804f400 con 0x7fe74806de00 2023-10-16T19:57:34.943 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:34.941+0000 7fe73ffff700 1 -- 172.21.15.157:0/552207320 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16517 (secure 0 0 0) 0x7fe738058050 con 0x7fe74806de00 2023-10-16T19:57:34.944 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-10-16T19:57:34.944 INFO:teuthology.orchestra.run.smithi157.stdout:{"epoch":21,"fsid":"28199dc9-64d5-479e-83c6-21f097c33d39","created":"2023-10-16T19:56:49.201889+0000","modified":"2023-10-16T19:57:07.988567+0000","last_up_change":"2023-10-16T19:56:54.675673+0000","last_in_change":"2023-10-16T19:56:51.666728+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T19:56:56.932895+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-16T19:57:04.936105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-16T19:57:05.335279+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":335785898},{"type":"v1","addr":"172.21.15.157:6809","nonce":335785898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":335785898},{"type":"v1","addr":"172.21.15.157:6811","nonce":335785898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6815","nonce":335785898},{"type":"v1","addr":"172.21.15.157:6817","nonce":335785898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":335785898},{"type":"v1","addr":"172.21.15.157:6813","nonce":335785898}]},"public_addr":"172.21.15.157:6809/335785898","cluster_addr":"172.21.15.157:6811/335785898","heartbeat_back_addr":"172.21.15.157:6817/335785898","heartbeat_front_addr":"172.21.15.157:6813/335785898","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":3482825047},{"type":"v1","addr":"172.21.15.157:6801","nonce":3482825047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":3482825047},{"type":"v1","addr":"172.21.15.157:6803","nonce":3482825047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":3482825047},{"type":"v1","addr":"172.21.15.157:6807","nonce":3482825047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":3482825047},{"type":"v1","addr":"172.21.15.157:6805","nonce":3482825047}]},"public_addr":"172.21.15.157:6801/3482825047","cluster_addr":"172.21.15.157:6803/3482825047","heartbeat_back_addr":"172.21.15.157:6807/3482825047","heartbeat_front_addr":"172.21.15.157:6805/3482825047","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":1118292389},{"type":"v1","addr":"172.21.15.157:6825","nonce":1118292389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":1118292389},{"type":"v1","addr":"172.21.15.157:6827","nonce":1118292389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":1118292389},{"type":"v1","addr":"172.21.15.157:6831","nonce":1118292389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":1118292389},{"type":"v1","addr":"172.21.15.157:6829","nonce":1118292389}]},"public_addr":"172.21.15.157:6825/1118292389","cluster_addr":"172.21.15.157:6827/1118292389","heartbeat_back_addr":"172.21.15.157:6831/1118292389","heartbeat_front_addr":"172.21.15.157:6829/1118292389","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":989329821},{"type":"v1","addr":"172.21.15.157:6816","nonce":989329821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":989329821},{"type":"v1","addr":"172.21.15.157:6819","nonce":989329821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":989329821},{"type":"v1","addr":"172.21.15.157:6823","nonce":989329821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":989329821},{"type":"v1","addr":"172.21.15.157:6821","nonce":989329821}]},"public_addr":"172.21.15.157:6816/989329821","cluster_addr":"172.21.15.157:6819/989329821","heartbeat_back_addr":"172.21.15.157:6823/989329821","heartbeat_front_addr":"172.21.15.157:6821/989329821","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":3841016811},{"type":"v1","addr":"172.21.15.187:6801","nonce":3841016811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6803","nonce":3841016811},{"type":"v1","addr":"172.21.15.187:6804","nonce":3841016811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6809","nonce":3841016811},{"type":"v1","addr":"172.21.15.187:6811","nonce":3841016811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":3841016811},{"type":"v1","addr":"172.21.15.187:6808","nonce":3841016811}]},"public_addr":"172.21.15.187:6801/3841016811","cluster_addr":"172.21.15.187:6804/3841016811","heartbeat_back_addr":"172.21.15.187:6811/3841016811","heartbeat_front_addr":"172.21.15.187:6808/3841016811","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":915130263},{"type":"v1","addr":"172.21.15.187:6805","nonce":915130263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6807","nonce":915130263},{"type":"v1","addr":"172.21.15.187:6810","nonce":915130263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":915130263},{"type":"v1","addr":"172.21.15.187:6815","nonce":915130263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":915130263},{"type":"v1","addr":"172.21.15.187:6813","nonce":915130263}]},"public_addr":"172.21.15.187:6805/915130263","cluster_addr":"172.21.15.187:6810/915130263","heartbeat_back_addr":"172.21.15.187:6815/915130263","heartbeat_front_addr":"172.21.15.187:6813/915130263","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":654976824},{"type":"v1","addr":"172.21.15.187:6817","nonce":654976824}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":654976824},{"type":"v1","addr":"172.21.15.187:6819","nonce":654976824}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":654976824},{"type":"v1","addr":"172.21.15.187:6823","nonce":654976824}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":654976824},{"type":"v1","addr":"172.21.15.187:6821","nonce":654976824}]},"public_addr":"172.21.15.187:6817/654976824","cluster_addr":"172.21.15.187:6819/654976824","heartbeat_back_addr":"172.21.15.187:6823/654976824","heartbeat_front_addr":"172.21.15.187:6821/654976824","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":4284059445},{"type":"v1","addr":"172.21.15.187:6825","nonce":4284059445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":4284059445},{"type":"v1","addr":"172.21.15.187:6827","nonce":4284059445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":4284059445},{"type":"v1","addr":"172.21.15.187:6831","nonce":4284059445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":4284059445},{"type":"v1","addr":"172.21.15.187:6829","nonce":4284059445}]},"public_addr":"172.21.15.187:6825/4284059445","cluster_addr":"172.21.15.187:6827/4284059445","heartbeat_back_addr":"172.21.15.187:6831/4284059445","heartbeat_front_addr":"172.21.15.187:6829/4284059445","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.819780+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.824193+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.849575+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.824806+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.809540+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.805093+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.866109+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.807372+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T19:57:34.946 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:34.943+0000 7fe74dfc0700 1 -- 172.21.15.157:0/552207320 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fe72806af00 msgr2=0x7fe72806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:34.946 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:34.943+0000 7fe74dfc0700 1 --2- 172.21.15.157:0/552207320 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fe72806af00 0x7fe72806d3c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fe730000f60 tx=0x7fe730007b10 comp rx=0 tx=0).stop 2023-10-16T19:57:34.946 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:34.943+0000 7fe74dfc0700 1 -- 172.21.15.157:0/552207320 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe74806de00 msgr2=0x7fe748158a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:34.947 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:34.943+0000 7fe74dfc0700 1 --2- 172.21.15.157:0/552207320 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe74806de00 0x7fe748158a30 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fe73800d800 tx=0x7fe73800dbc0 comp rx=0 tx=0).stop 2023-10-16T19:57:34.947 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:34.943+0000 7fe74dfc0700 1 -- 172.21.15.157:0/552207320 shutdown_connections 2023-10-16T19:57:34.947 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:34.943+0000 7fe74dfc0700 1 --2- 172.21.15.157:0/552207320 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fe72806af00 0x7fe72806d3c0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:34.947 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:34.943+0000 7fe74dfc0700 1 --2- 172.21.15.157:0/552207320 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe74806af60 0x7fe7481f3290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:34.948 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:34.943+0000 7fe74dfc0700 1 --2- 172.21.15.157:0/552207320 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe74815e2f0 0x7fe748158f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:34.948 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:34.943+0000 7fe74dfc0700 1 --2- 172.21.15.157:0/552207320 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe74806de00 0x7fe748158a30 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:34.948 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:34.943+0000 7fe74dfc0700 1 -- 172.21.15.157:0/552207320 >> 172.21.15.157:0/552207320 conn(0x7fe7480cd4e0 msgr2=0x7fe7480ad860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:34.948 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:34.943+0000 7fe74dfc0700 1 -- 172.21.15.157:0/552207320 shutdown_connections 2023-10-16T19:57:34.949 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:34.943+0000 7fe74dfc0700 1 -- 172.21.15.157:0/552207320 wait complete. 2023-10-16T19:57:34.958 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-16T19:56:56.932895+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-16T19:57:04.936105+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-16T19:57:05.335279+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-16T19:57:34.959 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-16T19:57:35.082 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.080+0000 7f9823c1c700 1 Processor -- start 2023-10-16T19:57:35.083 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.080+0000 7f9823c1c700 1 -- start start 2023-10-16T19:57:35.085 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.081+0000 7f9823c1c700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f981c15e090 0x7f981c06b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:35.085 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.081+0000 7f9823c1c700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f981c06ea10 0x7f981c0afa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:35.085 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.081+0000 7f9823c1c700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f981c0affc0 0x7f981c15e470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:35.086 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.081+0000 7f9823c1c700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f981c071b50 con 0x7f981c0affc0 2023-10-16T19:57:35.086 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.081+0000 7f9823c1c700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f981c0b0430 con 0x7f981c06ea10 2023-10-16T19:57:35.086 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.081+0000 7f9823c1c700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f981c06b6a0 con 0x7f981c15e090 2023-10-16T19:57:35.086 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.081+0000 7f98221b9700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f981c0affc0 0x7f981c15e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:35.086 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.081+0000 7f98221b9700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f981c0affc0 0x7f981c15e470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:46486/0 (socket says 172.21.15.157:46486) 2023-10-16T19:57:35.087 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.081+0000 7f98221b9700 1 -- 172.21.15.157:0/512807102 learned_addr learned my addr 172.21.15.157:0/512807102 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:57:35.087 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.081+0000 7f98219b8700 1 --2- 172.21.15.157:0/512807102 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f981c15e090 0x7f981c06b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:35.087 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.081+0000 7f98211b7700 1 --2- 172.21.15.157:0/512807102 >> v2:172.21.15.187:3300/0 conn(0x7f981c06ea10 0x7f981c0afa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:35.087 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.081+0000 7f98221b9700 1 -- 172.21.15.157:0/512807102 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f981c15e090 msgr2=0x7f981c06b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:57:35.087 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.081+0000 7f98221b9700 1 --2- 172.21.15.157:0/512807102 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f981c15e090 0x7f981c06b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:35.088 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.081+0000 7f98221b9700 1 -- 172.21.15.157:0/512807102 >> v2:172.21.15.187:3300/0 conn(0x7f981c06ea10 msgr2=0x7f981c0afa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:57:35.088 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.081+0000 7f98221b9700 1 --2- 172.21.15.157:0/512807102 >> v2:172.21.15.187:3300/0 conn(0x7f981c06ea10 0x7f981c0afa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:35.088 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.081+0000 7f98221b9700 1 -- 172.21.15.157:0/512807102 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f981c072320 con 0x7f981c0affc0 2023-10-16T19:57:35.088 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.081+0000 7f98219b8700 1 --2- 172.21.15.157:0/512807102 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f981c15e090 0x7f981c06b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T19:57:35.088 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.081+0000 7f98221b9700 1 --2- 172.21.15.157:0/512807102 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f981c0affc0 0x7f981c15e470 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f981c067460 tx=0x7f981400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5e52daebaa33de4 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:35.089 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.081+0000 7f98209b6700 1 -- 172.21.15.157:0/512807102 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f981400e070 con 0x7f981c0affc0 2023-10-16T19:57:35.089 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.082+0000 7f98209b6700 1 -- 172.21.15.157:0/512807102 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f981400b9c0 con 0x7f981c0affc0 2023-10-16T19:57:35.089 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.082+0000 7f98209b6700 1 -- 172.21.15.157:0/512807102 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f981400bd70 con 0x7f981c0affc0 2023-10-16T19:57:35.089 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.082+0000 7f9823c1c700 1 -- 172.21.15.157:0/512807102 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f981c0affc0 msgr2=0x7f981c15e470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:35.089 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.082+0000 7f9823c1c700 1 --2- 172.21.15.157:0/512807102 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f981c0affc0 0x7f981c15e470 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f981c067460 tx=0x7f981400b330 comp rx=0 tx=0).stop 2023-10-16T19:57:35.090 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.082+0000 7f9823c1c700 1 -- 172.21.15.157:0/512807102 shutdown_connections 2023-10-16T19:57:35.090 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.082+0000 7f9823c1c700 1 --2- 172.21.15.157:0/512807102 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f981c0affc0 0x7f981c15e470 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:35.090 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.082+0000 7f9823c1c700 1 --2- 172.21.15.157:0/512807102 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f981c15e090 0x7f981c06b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:35.090 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.082+0000 7f9823c1c700 1 --2- 172.21.15.157:0/512807102 >> v2:172.21.15.187:3300/0 conn(0x7f981c06ea10 0x7f981c0afa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:35.091 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.082+0000 7f9823c1c700 1 -- 172.21.15.157:0/512807102 >> 172.21.15.157:0/512807102 conn(0x7f981c0d0b30 msgr2=0x7f981c0d0f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:35.091 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.082+0000 7f9823c1c700 1 -- 172.21.15.157:0/512807102 shutdown_connections 2023-10-16T19:57:35.091 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.082+0000 7f9823c1c700 1 -- 172.21.15.157:0/512807102 wait complete. 2023-10-16T19:57:35.094 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.083+0000 7f9823c1c700 1 Processor -- start 2023-10-16T19:57:35.094 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.083+0000 7f9823c1c700 1 -- start start 2023-10-16T19:57:35.095 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.084+0000 7f9823c1c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f981c06ea10 0x7f981c1f43a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:35.095 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.084+0000 7f9823c1c700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f981c0affc0 0x7f981c1f3230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:35.095 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.084+0000 7f9823c1c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f981c15e090 0x7f981c1f4ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:35.095 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.084+0000 7f9823c1c700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f981c1f48e0 con 0x7f981c15e090 2023-10-16T19:57:35.095 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.084+0000 7f9823c1c700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f981c1f3770 con 0x7f981c06ea10 2023-10-16T19:57:35.096 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.084+0000 7f9823c1c700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f981c158470 con 0x7f981c0affc0 2023-10-16T19:57:35.096 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.084+0000 7f98221b9700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f981c15e090 0x7f981c1f4ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:35.096 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.084+0000 7f98221b9700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f981c15e090 0x7f981c1f4ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:46492/0 (socket says 172.21.15.157:46492) 2023-10-16T19:57:35.096 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.084+0000 7f98221b9700 1 -- 172.21.15.157:0/1490510053 learned_addr learned my addr 172.21.15.157:0/1490510053 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:57:35.096 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.084+0000 7f98211b7700 1 --2- 172.21.15.157:0/1490510053 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f981c0affc0 0x7f981c1f3230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:35.097 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.084+0000 7f98219b8700 1 --2- 172.21.15.157:0/1490510053 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f981c06ea10 0x7f981c1f43a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:35.097 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.084+0000 7f98221b9700 1 -- 172.21.15.157:0/1490510053 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f981c0affc0 msgr2=0x7f981c1f3230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:35.097 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.084+0000 7f98221b9700 1 --2- 172.21.15.157:0/1490510053 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f981c0affc0 0x7f981c1f3230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:35.097 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.084+0000 7f98221b9700 1 -- 172.21.15.157:0/1490510053 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f981c06ea10 msgr2=0x7f981c1f43a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:35.098 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.084+0000 7f98221b9700 1 --2- 172.21.15.157:0/1490510053 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f981c06ea10 0x7f981c1f43a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:35.098 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.085+0000 7f98221b9700 1 -- 172.21.15.157:0/1490510053 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9814009b30 con 0x7f981c15e090 2023-10-16T19:57:35.098 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.085+0000 7f98221b9700 1 --2- 172.21.15.157:0/1490510053 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f981c15e090 0x7f981c1f4ae0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f981c0d1850 tx=0x7f9814004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:35.098 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.085+0000 7f98127fc700 1 -- 172.21.15.157:0/1490510053 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98140099b0 con 0x7f981c15e090 2023-10-16T19:57:35.098 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.085+0000 7f98127fc700 1 -- 172.21.15.157:0/1490510053 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9814004250 con 0x7f981c15e090 2023-10-16T19:57:35.099 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.085+0000 7f9823c1c700 1 -- 172.21.15.157:0/1490510053 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f981c158750 con 0x7f981c15e090 2023-10-16T19:57:35.099 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.085+0000 7f98127fc700 1 -- 172.21.15.157:0/1490510053 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9814004600 con 0x7f981c15e090 2023-10-16T19:57:35.099 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.085+0000 7f9823c1c700 1 -- 172.21.15.157:0/1490510053 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f981c158d10 con 0x7f981c15e090 2023-10-16T19:57:35.099 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.086+0000 7f9823c1c700 1 -- 172.21.15.157:0/1490510053 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f981c04f400 con 0x7f981c15e090 2023-10-16T19:57:35.099 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.086+0000 7f98127fc700 1 -- 172.21.15.157:0/1490510053 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f9814004760 con 0x7f981c15e090 2023-10-16T19:57:35.100 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.087+0000 7f98127fc700 1 --2- 172.21.15.157:0/1490510053 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f980006af00 0x7f980006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:35.100 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.087+0000 7f98127fc700 1 -- 172.21.15.157:0/1490510053 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f981408a9c0 con 0x7f981c15e090 2023-10-16T19:57:35.100 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.087+0000 7f98219b8700 1 --2- 172.21.15.157:0/1490510053 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f980006af00 0x7f980006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:35.100 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.087+0000 7f98219b8700 1 --2- 172.21.15.157:0/1490510053 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f980006af00 0x7f980006d3c0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f981c06e5c0 tx=0x7f9818008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:35.100 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.091+0000 7f98127fc700 1 -- 172.21.15.157:0/1490510053 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9814055bb0 con 0x7f981c15e090 2023-10-16T19:57:35.283 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.281+0000 7f9823c1c700 1 -- 172.21.15.157:0/1490510053 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f981c06ac30 con 0x7f981c15e090 2023-10-16T19:57:35.284 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.281+0000 7f98127fc700 1 -- 172.21.15.157:0/1490510053 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9814020020 con 0x7f981c15e090 2023-10-16T19:57:35.284 INFO:teuthology.orchestra.run.smithi157.stdout:pg_num: 1 2023-10-16T19:57:35.286 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.283+0000 7f9823c1c700 1 -- 172.21.15.157:0/1490510053 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f980006af00 msgr2=0x7f980006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:35.286 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.283+0000 7f9823c1c700 1 --2- 172.21.15.157:0/1490510053 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f980006af00 0x7f980006d3c0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f981c06e5c0 tx=0x7f9818008040 comp rx=0 tx=0).stop 2023-10-16T19:57:35.286 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.283+0000 7f9823c1c700 1 -- 172.21.15.157:0/1490510053 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f981c15e090 msgr2=0x7f981c1f4ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:35.286 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.283+0000 7f9823c1c700 1 --2- 172.21.15.157:0/1490510053 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f981c15e090 0x7f981c1f4ae0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f981c0d1850 tx=0x7f9814004ad0 comp rx=0 tx=0).stop 2023-10-16T19:57:35.287 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.283+0000 7f9823c1c700 1 -- 172.21.15.157:0/1490510053 shutdown_connections 2023-10-16T19:57:35.287 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.283+0000 7f9823c1c700 1 --2- 172.21.15.157:0/1490510053 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f980006af00 0x7f980006d3c0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:35.287 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.283+0000 7f9823c1c700 1 --2- 172.21.15.157:0/1490510053 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f981c06ea10 0x7f981c1f43a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:35.287 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.283+0000 7f9823c1c700 1 --2- 172.21.15.157:0/1490510053 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f981c15e090 0x7f981c1f4ae0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:35.287 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.283+0000 7f9823c1c700 1 --2- 172.21.15.157:0/1490510053 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f981c0affc0 0x7f981c1f3230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:35.288 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.283+0000 7f9823c1c700 1 -- 172.21.15.157:0/1490510053 >> 172.21.15.157:0/1490510053 conn(0x7f981c0d0b30 msgr2=0x7f981c0b20b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:35.288 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.283+0000 7f9823c1c700 1 -- 172.21.15.157:0/1490510053 shutdown_connections 2023-10-16T19:57:35.288 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.283+0000 7f9823c1c700 1 -- 172.21.15.157:0/1490510053 wait complete. 2023-10-16T19:57:35.297 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-16T19:57:35.421 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.419+0000 7f0a52334700 1 Processor -- start 2023-10-16T19:57:35.422 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.419+0000 7f0a52334700 1 -- start start 2023-10-16T19:57:35.424 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.420+0000 7f0a52334700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f0a4c1456a0 0x7f0a4c0cb0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:35.424 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.420+0000 7f0a52334700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f0a4c160450 0x7f0a4c0c7160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:35.425 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.420+0000 7f0a52334700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a4c06e9b0 con 0x7f0a4c0b2710 2023-10-16T19:57:35.425 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.420+0000 7f0a52334700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a4c1608d0 con 0x7f0a4c1456a0 2023-10-16T19:57:35.425 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.420+0000 7f0a52334700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a4c0c79d0 con 0x7f0a4c160450 2023-10-16T19:57:35.425 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.420+0000 7f0a4bfff700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f0a4c1456a0 0x7f0a4c0cb0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:35.425 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.420+0000 7f0a4bfff700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f0a4c1456a0 0x7f0a4c0cb0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:46496/0 (socket says 172.21.15.157:46496) 2023-10-16T19:57:35.426 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.420+0000 7f0a4bfff700 1 -- 172.21.15.157:0/2178155572 learned_addr learned my addr 172.21.15.157:0/2178155572 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:57:35.426 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.420+0000 7f0a4b7fe700 1 --2- 172.21.15.157:0/2178155572 >> v2:172.21.15.187:3300/0 conn(0x7f0a4c160450 0x7f0a4c0c7160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:35.426 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.420+0000 7f0a4bfff700 1 -- 172.21.15.157:0/2178155572 >> v2:172.21.15.187:3300/0 conn(0x7f0a4c160450 msgr2=0x7f0a4c0c7160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:57:35.426 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.420+0000 7f0a4bfff700 1 --2- 172.21.15.157:0/2178155572 >> v2:172.21.15.187:3300/0 conn(0x7f0a4c160450 0x7f0a4c0c7160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:35.426 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.420+0000 7f0a4bfff700 1 -- 172.21.15.157:0/2178155572 >> v1:172.21.15.187:6789/0 conn(0x7f0a4c0b2710 legacy=0x7f0a4c06d730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:35.427 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.420+0000 7f0a4bfff700 1 -- 172.21.15.157:0/2178155572 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a4c145a80 con 0x7f0a4c1456a0 2023-10-16T19:57:35.427 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.420+0000 7f0a4bfff700 1 --2- 172.21.15.157:0/2178155572 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0a4c1456a0 0x7f0a4c0cb0f0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f0a4c0714b0 tx=0x7f0a3c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9d5215047aa9e94 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:35.427 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.420+0000 7f0a4affd700 1 -- 172.21.15.157:0/2178155572 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a3c00b870 con 0x7f0a4c1456a0 2023-10-16T19:57:35.427 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.420+0000 7f0a4affd700 1 -- 172.21.15.157:0/2178155572 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a3c00b9d0 con 0x7f0a4c1456a0 2023-10-16T19:57:35.428 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.420+0000 7f0a4affd700 1 -- 172.21.15.157:0/2178155572 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a3c00bd60 con 0x7f0a4c1456a0 2023-10-16T19:57:35.428 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.421+0000 7f0a52334700 1 -- 172.21.15.157:0/2178155572 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0a4c1456a0 msgr2=0x7f0a4c0cb0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:35.428 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.421+0000 7f0a52334700 1 --2- 172.21.15.157:0/2178155572 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0a4c1456a0 0x7f0a4c0cb0f0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f0a4c0714b0 tx=0x7f0a3c009bd0 comp rx=0 tx=0).stop 2023-10-16T19:57:35.428 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.421+0000 7f0a52334700 1 -- 172.21.15.157:0/2178155572 shutdown_connections 2023-10-16T19:57:35.428 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.421+0000 7f0a52334700 1 --2- 172.21.15.157:0/2178155572 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0a4c1456a0 0x7f0a4c0cb0f0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:35.429 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.421+0000 7f0a52334700 1 --2- 172.21.15.157:0/2178155572 >> v2:172.21.15.187:3300/0 conn(0x7f0a4c160450 0x7f0a4c0c7160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:35.429 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.421+0000 7f0a52334700 1 -- 172.21.15.157:0/2178155572 >> 172.21.15.157:0/2178155572 conn(0x7f0a4c0d0b30 msgr2=0x7f0a4c0d0f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:35.429 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.421+0000 7f0a52334700 1 -- 172.21.15.157:0/2178155572 shutdown_connections 2023-10-16T19:57:35.429 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.421+0000 7f0a52334700 1 -- 172.21.15.157:0/2178155572 wait complete. 2023-10-16T19:57:35.432 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.422+0000 7f0a52334700 1 Processor -- start 2023-10-16T19:57:35.432 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.422+0000 7f0a52334700 1 -- start start 2023-10-16T19:57:35.432 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.423+0000 7f0a52334700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0a4c0b2710 0x7f0a4c15b590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:35.433 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.423+0000 7f0a52334700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0a4c1456a0 0x7f0a4c0adba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:35.433 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.423+0000 7f0a52334700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0a4c160450 0x7f0a4c0c8560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:35.433 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.423+0000 7f0a52334700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a4c15bad0 con 0x7f0a4c0b2710 2023-10-16T19:57:35.433 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.423+0000 7f0a52334700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a4c13ec00 con 0x7f0a4c160450 2023-10-16T19:57:35.433 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.423+0000 7f0a52334700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a4c13eee0 con 0x7f0a4c1456a0 2023-10-16T19:57:35.434 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.423+0000 7f0a4bfff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0a4c0b2710 0x7f0a4c15b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:35.434 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.423+0000 7f0a4bfff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0a4c0b2710 0x7f0a4c15b590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:46504/0 (socket says 172.21.15.157:46504) 2023-10-16T19:57:35.434 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.423+0000 7f0a4bfff700 1 -- 172.21.15.157:0/2611154739 learned_addr learned my addr 172.21.15.157:0/2611154739 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:57:35.434 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.423+0000 7f0a4b7fe700 1 --2- 172.21.15.157:0/2611154739 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0a4c1456a0 0x7f0a4c0adba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:35.434 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.423+0000 7f0a508d1700 1 --2- 172.21.15.157:0/2611154739 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0a4c160450 0x7f0a4c0c8560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:35.435 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.423+0000 7f0a4bfff700 1 -- 172.21.15.157:0/2611154739 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0a4c1456a0 msgr2=0x7f0a4c0adba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:35.435 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.423+0000 7f0a4bfff700 1 --2- 172.21.15.157:0/2611154739 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0a4c1456a0 0x7f0a4c0adba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:35.435 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.423+0000 7f0a4bfff700 1 -- 172.21.15.157:0/2611154739 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0a4c160450 msgr2=0x7f0a4c0c8560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:35.436 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.423+0000 7f0a4bfff700 1 --2- 172.21.15.157:0/2611154739 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0a4c160450 0x7f0a4c0c8560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:35.436 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.423+0000 7f0a4bfff700 1 -- 172.21.15.157:0/2611154739 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a3c009550 con 0x7f0a4c0b2710 2023-10-16T19:57:35.436 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.423+0000 7f0a508d1700 1 --2- 172.21.15.157:0/2611154739 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0a4c160450 0x7f0a4c0c8560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T19:57:35.436 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.424+0000 7f0a4bfff700 1 --2- 172.21.15.157:0/2611154739 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0a4c0b2710 0x7f0a4c15b590 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f0a3c000c00 tx=0x7f0a3c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:35.436 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.424+0000 7f0a48ff9700 1 -- 172.21.15.157:0/2611154739 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a3c004540 con 0x7f0a4c0b2710 2023-10-16T19:57:35.437 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.424+0000 7f0a48ff9700 1 -- 172.21.15.157:0/2611154739 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a3c0036a0 con 0x7f0a4c0b2710 2023-10-16T19:57:35.437 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.424+0000 7f0a52334700 1 -- 172.21.15.157:0/2611154739 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a4c13f1c0 con 0x7f0a4c0b2710 2023-10-16T19:57:35.437 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.424+0000 7f0a48ff9700 1 -- 172.21.15.157:0/2611154739 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a3c003a10 con 0x7f0a4c0b2710 2023-10-16T19:57:35.437 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.424+0000 7f0a52334700 1 -- 172.21.15.157:0/2611154739 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a4c13f780 con 0x7f0a4c0b2710 2023-10-16T19:57:35.437 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.425+0000 7f0a52334700 1 -- 172.21.15.157:0/2611154739 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a4c13f970 con 0x7f0a4c0b2710 2023-10-16T19:57:35.438 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.425+0000 7f0a48ff9700 1 -- 172.21.15.157:0/2611154739 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f0a3c021070 con 0x7f0a4c0b2710 2023-10-16T19:57:35.438 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.425+0000 7f0a48ff9700 1 --2- 172.21.15.157:0/2611154739 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f0a3806af00 0x7f0a3806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:35.438 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.426+0000 7f0a48ff9700 1 -- 172.21.15.157:0/2611154739 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0a3c08ad20 con 0x7f0a4c0b2710 2023-10-16T19:57:35.438 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.426+0000 7f0a4b7fe700 1 --2- 172.21.15.157:0/2611154739 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f0a3806af00 0x7f0a3806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:35.439 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.426+0000 7f0a4b7fe700 1 --2- 172.21.15.157:0/2611154739 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f0a3806af00 0x7f0a3806d3c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f0a4c0ca410 tx=0x7f0a40008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:35.439 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.430+0000 7f0a48ff9700 1 -- 172.21.15.157:0/2611154739 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0a3c055dc0 con 0x7f0a4c0b2710 2023-10-16T19:57:35.620 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.618+0000 7f0a52334700 1 -- 172.21.15.157:0/2611154739 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0a4c04f400 con 0x7f0a4c0b2710 2023-10-16T19:57:35.621 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.619+0000 7f0a48ff9700 1 -- 172.21.15.157:0/2611154739 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0a3c029020 con 0x7f0a4c0b2710 2023-10-16T19:57:35.621 INFO:teuthology.orchestra.run.smithi157.stdout:pg_num: 32 2023-10-16T19:57:35.623 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.621+0000 7f0a52334700 1 -- 172.21.15.157:0/2611154739 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f0a3806af00 msgr2=0x7f0a3806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:35.623 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.621+0000 7f0a52334700 1 --2- 172.21.15.157:0/2611154739 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f0a3806af00 0x7f0a3806d3c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f0a4c0ca410 tx=0x7f0a40008040 comp rx=0 tx=0).stop 2023-10-16T19:57:35.624 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.621+0000 7f0a52334700 1 -- 172.21.15.157:0/2611154739 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0a4c0b2710 msgr2=0x7f0a4c15b590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:35.624 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.621+0000 7f0a52334700 1 --2- 172.21.15.157:0/2611154739 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0a4c0b2710 0x7f0a4c15b590 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f0a3c000c00 tx=0x7f0a3c004750 comp rx=0 tx=0).stop 2023-10-16T19:57:35.624 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.621+0000 7f0a52334700 1 -- 172.21.15.157:0/2611154739 shutdown_connections 2023-10-16T19:57:35.624 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.621+0000 7f0a52334700 1 --2- 172.21.15.157:0/2611154739 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f0a3806af00 0x7f0a3806d3c0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:35.625 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.621+0000 7f0a52334700 1 --2- 172.21.15.157:0/2611154739 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0a4c160450 0x7f0a4c0c8560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:35.625 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.621+0000 7f0a52334700 1 --2- 172.21.15.157:0/2611154739 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0a4c0b2710 0x7f0a4c15b590 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:35.625 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.621+0000 7f0a52334700 1 --2- 172.21.15.157:0/2611154739 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0a4c1456a0 0x7f0a4c0adba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:35.625 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.621+0000 7f0a52334700 1 -- 172.21.15.157:0/2611154739 >> 172.21.15.157:0/2611154739 conn(0x7f0a4c0d0b30 msgr2=0x7f0a4c1433e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:35.625 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.621+0000 7f0a52334700 1 -- 172.21.15.157:0/2611154739 shutdown_connections 2023-10-16T19:57:35.625 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.621+0000 7f0a52334700 1 -- 172.21.15.157:0/2611154739 wait complete. 2023-10-16T19:57:35.635 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-16T19:57:35.758 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.756+0000 7fcbe05a0700 1 Processor -- start 2023-10-16T19:57:35.759 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.756+0000 7fcbe05a0700 1 -- start start 2023-10-16T19:57:35.761 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.757+0000 7fcbe05a0700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcbd815e090 0x7fcbd806b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:35.761 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.757+0000 7fcbe05a0700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fcbd80b0190 0x7fcbd815e470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:35.761 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.757+0000 7fcbe05a0700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbd806b6a0 con 0x7fcbd806ea10 2023-10-16T19:57:35.761 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.757+0000 7fcbe05a0700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbd8071b50 con 0x7fcbd80b0190 2023-10-16T19:57:35.762 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.757+0000 7fcbe05a0700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbd8072320 con 0x7fcbd815e090 2023-10-16T19:57:35.762 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.757+0000 7fcbde33c700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcbd815e090 0x7fcbd806b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:35.762 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.757+0000 7fcbdeb3d700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fcbd80b0190 0x7fcbd815e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:35.762 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.757+0000 7fcbdeb3d700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fcbd80b0190 0x7fcbd815e470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.157:41622/0 (socket says 172.21.15.157:41622) 2023-10-16T19:57:35.763 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.757+0000 7fcbddb3b700 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7fcbd806ea10 0x7fcbd80afa80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.157:39880/0 (socket says 172.21.15.157:39880) 2023-10-16T19:57:35.763 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.757+0000 7fcbdeb3d700 1 -- 172.21.15.157:0/2499723352 learned_addr learned my addr 172.21.15.157:0/2499723352 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:57:35.763 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.757+0000 7fcbde33c700 1 --2- 172.21.15.157:0/2499723352 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcbd815e090 0x7fcbd806b160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.157:55816/0 (socket says 172.21.15.157:55816) 2023-10-16T19:57:35.763 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.757+0000 7fcbdeb3d700 1 -- 172.21.15.157:0/2499723352 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcbd815e090 msgr2=0x7fcbd806b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:57:35.763 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.757+0000 7fcbdeb3d700 1 --2- 172.21.15.157:0/2499723352 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcbd815e090 0x7fcbd806b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:35.764 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.757+0000 7fcbdeb3d700 1 -- 172.21.15.157:0/2499723352 >> v1:172.21.15.187:6789/0 conn(0x7fcbd806ea10 legacy=0x7fcbd80afa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:35.764 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.757+0000 7fcbdeb3d700 1 -- 172.21.15.157:0/2499723352 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbd8071d60 con 0x7fcbd80b0190 2023-10-16T19:57:35.764 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.757+0000 7fcbdeb3d700 1 --2- 172.21.15.157:0/2499723352 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcbd80b0190 0x7fcbd815e470 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fcbd0009e50 tx=0x7fcbd000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=878507aebf64da7e server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:35.764 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.758+0000 7fcbdd33a700 1 -- 172.21.15.157:0/2499723352 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbd000e070 con 0x7fcbd80b0190 2023-10-16T19:57:35.765 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.758+0000 7fcbdd33a700 1 -- 172.21.15.157:0/2499723352 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbd0003a20 con 0x7fcbd80b0190 2023-10-16T19:57:35.765 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.758+0000 7fcbdd33a700 1 -- 172.21.15.157:0/2499723352 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbd0003dd0 con 0x7fcbd80b0190 2023-10-16T19:57:35.765 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.758+0000 7fcbe05a0700 1 -- 172.21.15.157:0/2499723352 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcbd80b0190 msgr2=0x7fcbd815e470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:35.765 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.758+0000 7fcbe05a0700 1 --2- 172.21.15.157:0/2499723352 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcbd80b0190 0x7fcbd815e470 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fcbd0009e50 tx=0x7fcbd000b330 comp rx=0 tx=0).stop 2023-10-16T19:57:35.766 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.758+0000 7fcbe05a0700 1 -- 172.21.15.157:0/2499723352 shutdown_connections 2023-10-16T19:57:35.766 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.758+0000 7fcbe05a0700 1 --2- 172.21.15.157:0/2499723352 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcbd80b0190 0x7fcbd815e470 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:35.766 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.758+0000 7fcbe05a0700 1 --2- 172.21.15.157:0/2499723352 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcbd815e090 0x7fcbd806b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:35.766 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.758+0000 7fcbe05a0700 1 -- 172.21.15.157:0/2499723352 >> 172.21.15.157:0/2499723352 conn(0x7fcbd80d0b30 msgr2=0x7fcbd80d0f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:35.767 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.758+0000 7fcbe05a0700 1 -- 172.21.15.157:0/2499723352 shutdown_connections 2023-10-16T19:57:35.767 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.758+0000 7fcbe05a0700 1 -- 172.21.15.157:0/2499723352 wait complete. 2023-10-16T19:57:35.770 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.759+0000 7fcbe05a0700 1 Processor -- start 2023-10-16T19:57:35.770 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.760+0000 7fcbe05a0700 1 -- start start 2023-10-16T19:57:35.770 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.760+0000 7fcbe05a0700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcbd806ea10 0x7fcbd8157590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:35.771 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.760+0000 7fcbe05a0700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcbd80b0190 0x7fcbd806d210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:35.771 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.760+0000 7fcbe05a0700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcbd815e090 0x7fcbd806d750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:35.771 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.760+0000 7fcbe05a0700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbd8158db0 con 0x7fcbd80b0190 2023-10-16T19:57:35.771 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.760+0000 7fcbe05a0700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbd81581a0 con 0x7fcbd806ea10 2023-10-16T19:57:35.772 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.760+0000 7fcbe05a0700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbd8158480 con 0x7fcbd815e090 2023-10-16T19:57:35.772 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.760+0000 7fcbddb3b700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcbd80b0190 0x7fcbd806d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:35.772 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.760+0000 7fcbddb3b700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcbd80b0190 0x7fcbd806d210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:46518/0 (socket says 172.21.15.157:46518) 2023-10-16T19:57:35.772 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.760+0000 7fcbddb3b700 1 -- 172.21.15.157:0/2922450124 learned_addr learned my addr 172.21.15.157:0/2922450124 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:57:35.772 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.761+0000 7fcbdeb3d700 1 --2- 172.21.15.157:0/2922450124 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcbd815e090 0x7fcbd806d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:35.773 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.761+0000 7fcbde33c700 1 --2- 172.21.15.157:0/2922450124 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcbd806ea10 0x7fcbd8157590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:35.773 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.761+0000 7fcbddb3b700 1 -- 172.21.15.157:0/2922450124 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcbd815e090 msgr2=0x7fcbd806d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:35.773 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.761+0000 7fcbddb3b700 1 --2- 172.21.15.157:0/2922450124 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcbd815e090 0x7fcbd806d750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:35.773 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.761+0000 7fcbddb3b700 1 -- 172.21.15.157:0/2922450124 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcbd806ea10 msgr2=0x7fcbd8157590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:35.773 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.761+0000 7fcbddb3b700 1 --2- 172.21.15.157:0/2922450124 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcbd806ea10 0x7fcbd8157590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:35.774 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.761+0000 7fcbddb3b700 1 -- 172.21.15.157:0/2922450124 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbd0009b30 con 0x7fcbd80b0190 2023-10-16T19:57:35.774 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.761+0000 7fcbddb3b700 1 --2- 172.21.15.157:0/2922450124 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcbd80b0190 0x7fcbd806d210 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fcbc800c780 tx=0x7fcbc800ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:35.774 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.761+0000 7fcbceffd700 1 -- 172.21.15.157:0/2922450124 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbc8004c80 con 0x7fcbd80b0190 2023-10-16T19:57:35.774 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.761+0000 7fcbceffd700 1 -- 172.21.15.157:0/2922450124 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbc8004de0 con 0x7fcbd80b0190 2023-10-16T19:57:35.774 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.761+0000 7fcbe05a0700 1 -- 172.21.15.157:0/2922450124 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbd8158760 con 0x7fcbd80b0190 2023-10-16T19:57:35.775 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.761+0000 7fcbceffd700 1 -- 172.21.15.157:0/2922450124 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbc80072f0 con 0x7fcbd80b0190 2023-10-16T19:57:35.775 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.761+0000 7fcbe05a0700 1 -- 172.21.15.157:0/2922450124 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbd8157ad0 con 0x7fcbd80b0190 2023-10-16T19:57:35.775 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.762+0000 7fcbe05a0700 1 -- 172.21.15.157:0/2922450124 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbd8158f20 con 0x7fcbd80b0190 2023-10-16T19:57:35.775 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.763+0000 7fcbceffd700 1 -- 172.21.15.157:0/2922450124 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fcbc8007450 con 0x7fcbd80b0190 2023-10-16T19:57:35.775 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.763+0000 7fcbceffd700 1 --2- 172.21.15.157:0/2922450124 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fcbbc06af00 0x7fcbbc06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:35.776 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.763+0000 7fcbceffd700 1 -- 172.21.15.157:0/2922450124 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcbc80892e0 con 0x7fcbd80b0190 2023-10-16T19:57:35.776 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.763+0000 7fcbde33c700 1 --2- 172.21.15.157:0/2922450124 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fcbbc06af00 0x7fcbbc06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:35.776 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.764+0000 7fcbde33c700 1 --2- 172.21.15.157:0/2922450124 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fcbbc06af00 0x7fcbbc06d3c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fcbd4009be0 tx=0x7fcbd4009210 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:35.776 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.767+0000 7fcbceffd700 1 -- 172.21.15.157:0/2922450124 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fcbc8054390 con 0x7fcbd80b0190 2023-10-16T19:57:35.961 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.958+0000 7fcbe05a0700 1 -- 172.21.15.157:0/2922450124 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fcbd804f400 con 0x7fcbd80b0190 2023-10-16T19:57:35.961 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.959+0000 7fcbceffd700 1 -- 172.21.15.157:0/2922450124 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7fcbc80579b0 con 0x7fcbd80b0190 2023-10-16T19:57:35.961 INFO:teuthology.orchestra.run.smithi157.stdout:pg_num: 64 2023-10-16T19:57:35.963 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.961+0000 7fcbe05a0700 1 -- 172.21.15.157:0/2922450124 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fcbbc06af00 msgr2=0x7fcbbc06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:35.963 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.961+0000 7fcbe05a0700 1 --2- 172.21.15.157:0/2922450124 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fcbbc06af00 0x7fcbbc06d3c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fcbd4009be0 tx=0x7fcbd4009210 comp rx=0 tx=0).stop 2023-10-16T19:57:35.964 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.961+0000 7fcbe05a0700 1 -- 172.21.15.157:0/2922450124 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcbd80b0190 msgr2=0x7fcbd806d210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:35.964 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.961+0000 7fcbe05a0700 1 --2- 172.21.15.157:0/2922450124 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcbd80b0190 0x7fcbd806d210 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fcbc800c780 tx=0x7fcbc800ca90 comp rx=0 tx=0).stop 2023-10-16T19:57:35.964 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.961+0000 7fcbe05a0700 1 -- 172.21.15.157:0/2922450124 shutdown_connections 2023-10-16T19:57:35.964 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.961+0000 7fcbe05a0700 1 --2- 172.21.15.157:0/2922450124 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fcbbc06af00 0x7fcbbc06d3c0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:35.964 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.961+0000 7fcbe05a0700 1 --2- 172.21.15.157:0/2922450124 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcbd806ea10 0x7fcbd8157590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:35.965 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.961+0000 7fcbe05a0700 1 --2- 172.21.15.157:0/2922450124 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcbd815e090 0x7fcbd806d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:35.965 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.961+0000 7fcbe05a0700 1 --2- 172.21.15.157:0/2922450124 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcbd80b0190 0x7fcbd806d210 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:35.965 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.961+0000 7fcbe05a0700 1 -- 172.21.15.157:0/2922450124 >> 172.21.15.157:0/2922450124 conn(0x7fcbd80d0b30 msgr2=0x7fcbd815d2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:35.965 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.961+0000 7fcbe05a0700 1 -- 172.21.15.157:0/2922450124 shutdown_connections 2023-10-16T19:57:35.965 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:35.961+0000 7fcbe05a0700 1 -- 172.21.15.157:0/2922450124 wait complete. 2023-10-16T19:57:35.975 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T19:57:36.095 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.092+0000 7f668451d700 1 Processor -- start 2023-10-16T19:57:36.095 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.092+0000 7f668451d700 1 -- start start 2023-10-16T19:57:36.098 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.093+0000 7f668451d700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f667c15b130 0x7f667c071f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:36.098 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.093+0000 7f668451d700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f667c06d0f0 0x7f667c0cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:36.098 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.093+0000 7f668451d700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f667c0cefc0 con 0x7f667c0cbeb0 2023-10-16T19:57:36.098 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.093+0000 7f668451d700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f667c0b0050 con 0x7f667c15b130 2023-10-16T19:57:36.099 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.093+0000 7f668451d700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f667c06e090 con 0x7f667c06d0f0 2023-10-16T19:57:36.099 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.094+0000 7f66822b9700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f667c15b130 0x7f667c071f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:36.099 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.094+0000 7f66822b9700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f667c15b130 0x7f667c071f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:46526/0 (socket says 172.21.15.157:46526) 2023-10-16T19:57:36.099 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.094+0000 7f66822b9700 1 -- 172.21.15.157:0/2612082524 learned_addr learned my addr 172.21.15.157:0/2612082524 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:57:36.099 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.094+0000 7f6681ab8700 1 --2- 172.21.15.157:0/2612082524 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f667c06d0f0 0x7f667c0cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:36.100 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.094+0000 7f66822b9700 1 -- 172.21.15.157:0/2612082524 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f667c06d0f0 msgr2=0x7f667c0cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:57:36.100 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.094+0000 7f66822b9700 1 --2- 172.21.15.157:0/2612082524 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f667c06d0f0 0x7f667c0cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:36.100 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.094+0000 7f66822b9700 1 -- 172.21.15.157:0/2612082524 >> v1:172.21.15.187:6789/0 conn(0x7f667c0cbeb0 legacy=0x7f667c06eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:36.100 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.094+0000 7f66822b9700 1 -- 172.21.15.157:0/2612082524 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f667c06d570 con 0x7f667c15b130 2023-10-16T19:57:36.100 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.094+0000 7f6681ab8700 1 --2- 172.21.15.157:0/2612082524 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f667c06d0f0 0x7f667c0cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T19:57:36.101 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.094+0000 7f66822b9700 1 --2- 172.21.15.157:0/2612082524 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f667c15b130 0x7f667c071f60 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f666c0098f0 tx=0x7f666c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b367a8dfe76d715 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:36.101 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.094+0000 7f66812b7700 1 -- 172.21.15.157:0/2612082524 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f666c00b8a0 con 0x7f667c15b130 2023-10-16T19:57:36.101 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.094+0000 7f66812b7700 1 -- 172.21.15.157:0/2612082524 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f666c00ba00 con 0x7f667c15b130 2023-10-16T19:57:36.101 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.094+0000 7f66812b7700 1 -- 172.21.15.157:0/2612082524 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f666c00bd90 con 0x7f667c15b130 2023-10-16T19:57:36.101 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.095+0000 7f668451d700 1 -- 172.21.15.157:0/2612082524 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f667c15b130 msgr2=0x7f667c071f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:36.102 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.095+0000 7f668451d700 1 --2- 172.21.15.157:0/2612082524 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f667c15b130 0x7f667c071f60 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f666c0098f0 tx=0x7f666c009c00 comp rx=0 tx=0).stop 2023-10-16T19:57:36.102 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.095+0000 7f668451d700 1 -- 172.21.15.157:0/2612082524 shutdown_connections 2023-10-16T19:57:36.102 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.095+0000 7f668451d700 1 --2- 172.21.15.157:0/2612082524 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f667c15b130 0x7f667c071f60 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:36.102 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.095+0000 7f668451d700 1 --2- 172.21.15.157:0/2612082524 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f667c06d0f0 0x7f667c0cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:36.102 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.095+0000 7f668451d700 1 -- 172.21.15.157:0/2612082524 >> 172.21.15.157:0/2612082524 conn(0x7f667c0cd4e0 msgr2=0x7f667c0cd8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:36.103 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.095+0000 7f668451d700 1 -- 172.21.15.157:0/2612082524 shutdown_connections 2023-10-16T19:57:36.103 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.095+0000 7f668451d700 1 -- 172.21.15.157:0/2612082524 wait complete. 2023-10-16T19:57:36.106 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.096+0000 7f668451d700 1 Processor -- start 2023-10-16T19:57:36.106 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.096+0000 7f668451d700 1 -- start start 2023-10-16T19:57:36.106 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.097+0000 7f668451d700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f667c06d0f0 0x7f667c1f4770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:36.106 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.097+0000 7f668451d700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f667c0cbeb0 0x7f667c0b20b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:36.106 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.097+0000 7f668451d700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f667c15b130 0x7f667c15ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:36.107 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.097+0000 7f668451d700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f667c0b25f0 con 0x7f667c0cbeb0 2023-10-16T19:57:36.107 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.097+0000 7f668451d700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f667c0b2820 con 0x7f667c15b130 2023-10-16T19:57:36.107 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.097+0000 7f668451d700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f667c0b2b00 con 0x7f667c06d0f0 2023-10-16T19:57:36.107 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.097+0000 7f6681ab8700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f667c0cbeb0 0x7f667c0b20b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:36.108 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.097+0000 7f6681ab8700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f667c0cbeb0 0x7f667c0b20b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:46532/0 (socket says 172.21.15.157:46532) 2023-10-16T19:57:36.108 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.097+0000 7f6681ab8700 1 -- 172.21.15.157:0/3416608681 learned_addr learned my addr 172.21.15.157:0/3416608681 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:57:36.108 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.097+0000 7f66822b9700 1 --2- 172.21.15.157:0/3416608681 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f667c06d0f0 0x7f667c1f4770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:36.108 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.097+0000 7f6682aba700 1 --2- 172.21.15.157:0/3416608681 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f667c15b130 0x7f667c15ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:36.108 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.097+0000 7f6681ab8700 1 -- 172.21.15.157:0/3416608681 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f667c06d0f0 msgr2=0x7f667c1f4770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:36.109 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.097+0000 7f6681ab8700 1 --2- 172.21.15.157:0/3416608681 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f667c06d0f0 0x7f667c1f4770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:36.109 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.097+0000 7f6681ab8700 1 -- 172.21.15.157:0/3416608681 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f667c15b130 msgr2=0x7f667c15ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:36.109 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.097+0000 7f6681ab8700 1 --2- 172.21.15.157:0/3416608681 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f667c15b130 0x7f667c15ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:36.109 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.097+0000 7f6681ab8700 1 -- 172.21.15.157:0/3416608681 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f666c009550 con 0x7f667c0cbeb0 2023-10-16T19:57:36.109 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.097+0000 7f6682aba700 1 --2- 172.21.15.157:0/3416608681 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f667c15b130 0x7f667c15ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T19:57:36.110 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.097+0000 7f6681ab8700 1 --2- 172.21.15.157:0/3416608681 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f667c0cbeb0 0x7f667c0b20b0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f667800e810 tx=0x7f667800eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:36.110 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.097+0000 7f6672ffd700 1 -- 172.21.15.157:0/3416608681 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f667800c020 con 0x7f667c0cbeb0 2023-10-16T19:57:36.110 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.097+0000 7f6672ffd700 1 -- 172.21.15.157:0/3416608681 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6678004250 con 0x7f667c0cbeb0 2023-10-16T19:57:36.110 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.097+0000 7f668451d700 1 -- 172.21.15.157:0/3416608681 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f667c0b2de0 con 0x7f667c0cbeb0 2023-10-16T19:57:36.110 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.097+0000 7f6672ffd700 1 -- 172.21.15.157:0/3416608681 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66780036a0 con 0x7f667c0cbeb0 2023-10-16T19:57:36.111 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.097+0000 7f668451d700 1 -- 172.21.15.157:0/3416608681 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f667c0b33a0 con 0x7f667c0cbeb0 2023-10-16T19:57:36.111 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.098+0000 7f668451d700 1 -- 172.21.15.157:0/3416608681 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f667c04f400 con 0x7f667c0cbeb0 2023-10-16T19:57:36.111 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.099+0000 7f6672ffd700 1 -- 172.21.15.157:0/3416608681 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f6678003800 con 0x7f667c0cbeb0 2023-10-16T19:57:36.111 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.099+0000 7f6672ffd700 1 --2- 172.21.15.157:0/3416608681 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f666006af00 0x7f666006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:36.111 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.099+0000 7f6672ffd700 1 -- 172.21.15.157:0/3416608681 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f66780892c0 con 0x7f667c0cbeb0 2023-10-16T19:57:36.111 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.099+0000 7f66822b9700 1 --2- 172.21.15.157:0/3416608681 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f666006af00 0x7f666006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:36.112 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.100+0000 7f66822b9700 1 --2- 172.21.15.157:0/3416608681 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f666006af00 0x7f666006d3c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f666c000c00 tx=0x7f666c008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:36.112 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.103+0000 7f6672ffd700 1 -- 172.21.15.157:0/3416608681 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6678054370 con 0x7f667c0cbeb0 2023-10-16T19:57:36.297 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.294+0000 7f668451d700 1 -- 172.21.15.157:0/3416608681 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f667c06f720 con 0x7f667c0cbeb0 2023-10-16T19:57:36.297 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.295+0000 7f6672ffd700 1 -- 172.21.15.157:0/3416608681 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16517 (secure 0 0 0) 0x7f6678057990 con 0x7f667c0cbeb0 2023-10-16T19:57:36.298 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-10-16T19:57:36.298 INFO:teuthology.orchestra.run.smithi157.stdout:{"epoch":21,"fsid":"28199dc9-64d5-479e-83c6-21f097c33d39","created":"2023-10-16T19:56:49.201889+0000","modified":"2023-10-16T19:57:07.988567+0000","last_up_change":"2023-10-16T19:56:54.675673+0000","last_in_change":"2023-10-16T19:56:51.666728+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T19:56:56.932895+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-16T19:57:04.936105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-16T19:57:05.335279+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":335785898},{"type":"v1","addr":"172.21.15.157:6809","nonce":335785898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":335785898},{"type":"v1","addr":"172.21.15.157:6811","nonce":335785898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6815","nonce":335785898},{"type":"v1","addr":"172.21.15.157:6817","nonce":335785898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":335785898},{"type":"v1","addr":"172.21.15.157:6813","nonce":335785898}]},"public_addr":"172.21.15.157:6809/335785898","cluster_addr":"172.21.15.157:6811/335785898","heartbeat_back_addr":"172.21.15.157:6817/335785898","heartbeat_front_addr":"172.21.15.157:6813/335785898","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":3482825047},{"type":"v1","addr":"172.21.15.157:6801","nonce":3482825047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":3482825047},{"type":"v1","addr":"172.21.15.157:6803","nonce":3482825047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":3482825047},{"type":"v1","addr":"172.21.15.157:6807","nonce":3482825047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":3482825047},{"type":"v1","addr":"172.21.15.157:6805","nonce":3482825047}]},"public_addr":"172.21.15.157:6801/3482825047","cluster_addr":"172.21.15.157:6803/3482825047","heartbeat_back_addr":"172.21.15.157:6807/3482825047","heartbeat_front_addr":"172.21.15.157:6805/3482825047","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":1118292389},{"type":"v1","addr":"172.21.15.157:6825","nonce":1118292389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":1118292389},{"type":"v1","addr":"172.21.15.157:6827","nonce":1118292389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":1118292389},{"type":"v1","addr":"172.21.15.157:6831","nonce":1118292389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":1118292389},{"type":"v1","addr":"172.21.15.157:6829","nonce":1118292389}]},"public_addr":"172.21.15.157:6825/1118292389","cluster_addr":"172.21.15.157:6827/1118292389","heartbeat_back_addr":"172.21.15.157:6831/1118292389","heartbeat_front_addr":"172.21.15.157:6829/1118292389","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":989329821},{"type":"v1","addr":"172.21.15.157:6816","nonce":989329821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":989329821},{"type":"v1","addr":"172.21.15.157:6819","nonce":989329821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":989329821},{"type":"v1","addr":"172.21.15.157:6823","nonce":989329821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":989329821},{"type":"v1","addr":"172.21.15.157:6821","nonce":989329821}]},"public_addr":"172.21.15.157:6816/989329821","cluster_addr":"172.21.15.157:6819/989329821","heartbeat_back_addr":"172.21.15.157:6823/989329821","heartbeat_front_addr":"172.21.15.157:6821/989329821","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":3841016811},{"type":"v1","addr":"172.21.15.187:6801","nonce":3841016811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6803","nonce":3841016811},{"type":"v1","addr":"172.21.15.187:6804","nonce":3841016811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6809","nonce":3841016811},{"type":"v1","addr":"172.21.15.187:6811","nonce":3841016811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":3841016811},{"type":"v1","addr":"172.21.15.187:6808","nonce":3841016811}]},"public_addr":"172.21.15.187:6801/3841016811","cluster_addr":"172.21.15.187:6804/3841016811","heartbeat_back_addr":"172.21.15.187:6811/3841016811","heartbeat_front_addr":"172.21.15.187:6808/3841016811","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":915130263},{"type":"v1","addr":"172.21.15.187:6805","nonce":915130263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6807","nonce":915130263},{"type":"v1","addr":"172.21.15.187:6810","nonce":915130263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":915130263},{"type":"v1","addr":"172.21.15.187:6815","nonce":915130263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":915130263},{"type":"v1","addr":"172.21.15.187:6813","nonce":915130263}]},"public_addr":"172.21.15.187:6805/915130263","cluster_addr":"172.21.15.187:6810/915130263","heartbeat_back_addr":"172.21.15.187:6815/915130263","heartbeat_front_addr":"172.21.15.187:6813/915130263","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":654976824},{"type":"v1","addr":"172.21.15.187:6817","nonce":654976824}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":654976824},{"type":"v1","addr":"172.21.15.187:6819","nonce":654976824}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":654976824},{"type":"v1","addr":"172.21.15.187:6823","nonce":654976824}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":654976824},{"type":"v1","addr":"172.21.15.187:6821","nonce":654976824}]},"public_addr":"172.21.15.187:6817/654976824","cluster_addr":"172.21.15.187:6819/654976824","heartbeat_back_addr":"172.21.15.187:6823/654976824","heartbeat_front_addr":"172.21.15.187:6821/654976824","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":4284059445},{"type":"v1","addr":"172.21.15.187:6825","nonce":4284059445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":4284059445},{"type":"v1","addr":"172.21.15.187:6827","nonce":4284059445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":4284059445},{"type":"v1","addr":"172.21.15.187:6831","nonce":4284059445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":4284059445},{"type":"v1","addr":"172.21.15.187:6829","nonce":4284059445}]},"public_addr":"172.21.15.187:6825/4284059445","cluster_addr":"172.21.15.187:6827/4284059445","heartbeat_back_addr":"172.21.15.187:6831/4284059445","heartbeat_front_addr":"172.21.15.187:6829/4284059445","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.819780+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.824193+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.849575+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.824806+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.809540+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.805093+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.866109+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.807372+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T19:57:36.300 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.297+0000 7f668451d700 1 -- 172.21.15.157:0/3416608681 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f666006af00 msgr2=0x7f666006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:36.300 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.297+0000 7f668451d700 1 --2- 172.21.15.157:0/3416608681 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f666006af00 0x7f666006d3c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f666c000c00 tx=0x7f666c008030 comp rx=0 tx=0).stop 2023-10-16T19:57:36.300 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.297+0000 7f668451d700 1 -- 172.21.15.157:0/3416608681 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f667c0cbeb0 msgr2=0x7f667c0b20b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:36.301 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.297+0000 7f668451d700 1 --2- 172.21.15.157:0/3416608681 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f667c0cbeb0 0x7f667c0b20b0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f667800e810 tx=0x7f667800eb20 comp rx=0 tx=0).stop 2023-10-16T19:57:36.301 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.297+0000 7f668451d700 1 -- 172.21.15.157:0/3416608681 shutdown_connections 2023-10-16T19:57:36.301 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.297+0000 7f668451d700 1 --2- 172.21.15.157:0/3416608681 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f666006af00 0x7f666006d3c0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:36.301 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.297+0000 7f668451d700 1 --2- 172.21.15.157:0/3416608681 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f667c15b130 0x7f667c15ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:36.301 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.297+0000 7f668451d700 1 --2- 172.21.15.157:0/3416608681 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f667c06d0f0 0x7f667c1f4770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:36.302 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.297+0000 7f668451d700 1 --2- 172.21.15.157:0/3416608681 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f667c0cbeb0 0x7f667c0b20b0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:36.302 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.297+0000 7f668451d700 1 -- 172.21.15.157:0/3416608681 >> 172.21.15.157:0/3416608681 conn(0x7f667c0cd4e0 msgr2=0x7f667c0c6f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:36.302 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.297+0000 7f668451d700 1 -- 172.21.15.157:0/3416608681 shutdown_connections 2023-10-16T19:57:36.302 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.297+0000 7f668451d700 1 -- 172.21.15.157:0/3416608681 wait complete. 2023-10-16T19:57:36.312 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-16T19:56:56.932895+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-16T19:57:04.936105+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-16T19:57:05.335279+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-16T19:57:36.313 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-16T19:57:36.436 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.433+0000 7fdb0be48700 1 Processor -- start 2023-10-16T19:57:36.436 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.434+0000 7fdb0be48700 1 -- start start 2023-10-16T19:57:36.438 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.435+0000 7fdb0be48700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fdb041456a0 0x7fdb040cb0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:36.438 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.435+0000 7fdb0be48700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb0406e9b0 con 0x7fdb04160450 2023-10-16T19:57:36.438 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.435+0000 7fdb0be48700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb04145a80 con 0x7fdb040b2710 2023-10-16T19:57:36.438 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.435+0000 7fdb0be48700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb041608d0 con 0x7fdb041456a0 2023-10-16T19:57:36.439 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.435+0000 7fdb09be4700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fdb041456a0 0x7fdb040cb0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:36.439 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.435+0000 7fdb093e3700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7fdb04160450 0x7fdb040c7160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:56212/0 (socket says 172.21.15.157:56212) 2023-10-16T19:57:36.439 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.435+0000 7fdb093e3700 1 -- 172.21.15.157:0/1032530910 learned_addr learned my addr 172.21.15.157:0/1032530910 (peer_addr_for_me v1:172.21.15.157:0/0) 2023-10-16T19:57:36.439 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.435+0000 7fdb09be4700 1 -- 172.21.15.157:0/1032530910 >> v1:172.21.15.187:6789/0 conn(0x7fdb040b2710 legacy=0x7fdb0406d730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:36.439 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.435+0000 7fdb09be4700 1 -- 172.21.15.157:0/1032530910 >> v1:172.21.15.157:6789/0 conn(0x7fdb04160450 legacy=0x7fdb040c7160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:36.440 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.435+0000 7fdb09be4700 1 -- 172.21.15.157:0/1032530910 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb0406ec50 con 0x7fdb041456a0 2023-10-16T19:57:36.440 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.435+0000 7fdb08be2700 1 -- 172.21.15.157:0/1032530910 <== mon.0 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 834093303 0 0) 0x7fdb0406e9b0 con 0x7fdb04160450 2023-10-16T19:57:36.440 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.435+0000 7fdb09be4700 1 --2- 172.21.15.157:0/1032530910 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdb041456a0 0x7fdb040cb0f0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fdaf4009840 tx=0x7fdaf4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4f85233e1dc2c72 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:36.440 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.436+0000 7fdb08be2700 1 -- 172.21.15.157:0/1032530910 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaf4011830 con 0x7fdb041456a0 2023-10-16T19:57:36.440 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.436+0000 7fdb08be2700 1 -- 172.21.15.157:0/1032530910 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdaf4011990 con 0x7fdb041456a0 2023-10-16T19:57:36.441 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.436+0000 7fdb08be2700 1 -- 172.21.15.157:0/1032530910 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaf4011d20 con 0x7fdb041456a0 2023-10-16T19:57:36.444 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.436+0000 7fdb0be48700 1 -- 172.21.15.157:0/1032530910 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdb041456a0 msgr2=0x7fdb040cb0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:36.444 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.436+0000 7fdb0be48700 1 --2- 172.21.15.157:0/1032530910 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdb041456a0 0x7fdb040cb0f0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fdaf4009840 tx=0x7fdaf4009b50 comp rx=0 tx=0).stop 2023-10-16T19:57:36.444 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.436+0000 7fdb0be48700 1 -- 172.21.15.157:0/1032530910 shutdown_connections 2023-10-16T19:57:36.444 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.436+0000 7fdb0be48700 1 --2- 172.21.15.157:0/1032530910 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdb041456a0 0x7fdb040cb0f0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:36.445 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.436+0000 7fdb0be48700 1 -- 172.21.15.157:0/1032530910 >> 172.21.15.157:0/1032530910 conn(0x7fdb040d0b30 msgr2=0x7fdb040d0f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:36.445 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.436+0000 7fdb0be48700 1 -- 172.21.15.157:0/1032530910 shutdown_connections 2023-10-16T19:57:36.445 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.436+0000 7fdb0be48700 1 -- 172.21.15.157:0/1032530910 wait complete. 2023-10-16T19:57:36.445 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.437+0000 7fdb0be48700 1 Processor -- start 2023-10-16T19:57:36.445 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.437+0000 7fdb0be48700 1 -- start start 2023-10-16T19:57:36.446 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.438+0000 7fdb0be48700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdb040b2710 0x7fdb041502e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:36.446 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.438+0000 7fdb0be48700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdb041456a0 0x7fdb040b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:36.446 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.438+0000 7fdb0be48700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdb04160450 0x7fdb040cd610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:36.446 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.438+0000 7fdb0be48700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb040c8d10 con 0x7fdb040b2710 2023-10-16T19:57:36.446 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.438+0000 7fdb0be48700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb040c9d10 con 0x7fdb041456a0 2023-10-16T19:57:36.447 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.438+0000 7fdb0be48700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb040c9f90 con 0x7fdb04160450 2023-10-16T19:57:36.447 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.438+0000 7fdb09be4700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdb040b2710 0x7fdb041502e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:36.447 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.438+0000 7fdb09be4700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdb040b2710 0x7fdb041502e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:46544/0 (socket says 172.21.15.157:46544) 2023-10-16T19:57:36.447 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.438+0000 7fdb09be4700 1 -- 172.21.15.157:0/796346280 learned_addr learned my addr 172.21.15.157:0/796346280 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:57:36.447 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.439+0000 7fdb093e3700 1 --2- 172.21.15.157:0/796346280 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdb041456a0 0x7fdb040b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:36.448 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.439+0000 7fdb09be4700 1 -- 172.21.15.157:0/796346280 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdb04160450 msgr2=0x7fdb040cd610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:36.448 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.439+0000 7fdb0a3e5700 1 --2- 172.21.15.157:0/796346280 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdb04160450 0x7fdb040cd610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:36.448 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.439+0000 7fdb09be4700 1 --2- 172.21.15.157:0/796346280 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdb04160450 0x7fdb040cd610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:36.448 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.439+0000 7fdb09be4700 1 -- 172.21.15.157:0/796346280 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdb041456a0 msgr2=0x7fdb040b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:36.448 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.439+0000 7fdb09be4700 1 --2- 172.21.15.157:0/796346280 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdb041456a0 0x7fdb040b5f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:36.449 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.439+0000 7fdb09be4700 1 -- 172.21.15.157:0/796346280 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdaf40094a0 con 0x7fdb040b2710 2023-10-16T19:57:36.449 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.439+0000 7fdb09be4700 1 --2- 172.21.15.157:0/796346280 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdb040b2710 0x7fdb041502e0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fdaf40090b0 tx=0x7fdaf4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:36.449 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.439+0000 7fdafa7fc700 1 -- 172.21.15.157:0/796346280 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaf401a900 con 0x7fdb040b2710 2023-10-16T19:57:36.449 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.439+0000 7fdafa7fc700 1 -- 172.21.15.157:0/796346280 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdaf401aa60 con 0x7fdb040b2710 2023-10-16T19:57:36.449 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.439+0000 7fdb0be48700 1 -- 172.21.15.157:0/796346280 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb040ca270 con 0x7fdb040b2710 2023-10-16T19:57:36.449 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.439+0000 7fdafa7fc700 1 -- 172.21.15.157:0/796346280 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaf401add0 con 0x7fdb040b2710 2023-10-16T19:57:36.450 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.439+0000 7fdb0be48700 1 -- 172.21.15.157:0/796346280 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb040ca830 con 0x7fdb040b2710 2023-10-16T19:57:36.450 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.440+0000 7fdb0be48700 1 -- 172.21.15.157:0/796346280 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb0404f400 con 0x7fdb040b2710 2023-10-16T19:57:36.450 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.440+0000 7fdafa7fc700 1 -- 172.21.15.157:0/796346280 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fdaf4022070 con 0x7fdb040b2710 2023-10-16T19:57:36.450 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.441+0000 7fdafa7fc700 1 --2- 172.21.15.157:0/796346280 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fdae806af00 0x7fdae806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:36.451 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.441+0000 7fdafa7fc700 1 -- 172.21.15.157:0/796346280 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdaf408a820 con 0x7fdb040b2710 2023-10-16T19:57:36.451 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.441+0000 7fdb093e3700 1 --2- 172.21.15.157:0/796346280 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fdae806af00 0x7fdae806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:36.451 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.441+0000 7fdb093e3700 1 --2- 172.21.15.157:0/796346280 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fdae806af00 0x7fdae806d3c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fdb00007fd0 tx=0x7fdb00009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:36.452 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.445+0000 7fdafa7fc700 1 -- 172.21.15.157:0/796346280 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fdaf4055a10 con 0x7fdb040b2710 2023-10-16T19:57:36.632 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.630+0000 7fdb0be48700 1 -- 172.21.15.157:0/796346280 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fdb040c5c20 con 0x7fdb040b2710 2023-10-16T19:57:36.633 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.630+0000 7fdafa7fc700 1 -- 172.21.15.157:0/796346280 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7fdaf40290a0 con 0x7fdb040b2710 2023-10-16T19:57:36.633 INFO:teuthology.orchestra.run.smithi157.stdout:pg_num: 1 2023-10-16T19:57:36.635 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.632+0000 7fdb0be48700 1 -- 172.21.15.157:0/796346280 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fdae806af00 msgr2=0x7fdae806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:36.635 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.632+0000 7fdb0be48700 1 --2- 172.21.15.157:0/796346280 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fdae806af00 0x7fdae806d3c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fdb00007fd0 tx=0x7fdb00009040 comp rx=0 tx=0).stop 2023-10-16T19:57:36.635 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.632+0000 7fdb0be48700 1 -- 172.21.15.157:0/796346280 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdb040b2710 msgr2=0x7fdb041502e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:36.636 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.632+0000 7fdb0be48700 1 --2- 172.21.15.157:0/796346280 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdb040b2710 0x7fdb041502e0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fdaf40090b0 tx=0x7fdaf4004750 comp rx=0 tx=0).stop 2023-10-16T19:57:36.636 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.632+0000 7fdb0be48700 1 -- 172.21.15.157:0/796346280 shutdown_connections 2023-10-16T19:57:36.636 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.632+0000 7fdb0be48700 1 --2- 172.21.15.157:0/796346280 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdb04160450 0x7fdb040cd610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:36.636 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.632+0000 7fdb0be48700 1 --2- 172.21.15.157:0/796346280 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdb040b2710 0x7fdb041502e0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:36.636 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.632+0000 7fdb0be48700 1 --2- 172.21.15.157:0/796346280 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fdae806af00 0x7fdae806d3c0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:36.637 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.632+0000 7fdb0be48700 1 --2- 172.21.15.157:0/796346280 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdb041456a0 0x7fdb040b5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:36.637 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.632+0000 7fdb0be48700 1 -- 172.21.15.157:0/796346280 >> 172.21.15.157:0/796346280 conn(0x7fdb040d0b30 msgr2=0x7fdb04143290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:36.637 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.633+0000 7fdb0be48700 1 -- 172.21.15.157:0/796346280 shutdown_connections 2023-10-16T19:57:36.637 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.633+0000 7fdb0be48700 1 -- 172.21.15.157:0/796346280 wait complete. 2023-10-16T19:57:36.647 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-16T19:57:36.770 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.768+0000 7f2ae2156700 1 Processor -- start 2023-10-16T19:57:36.771 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.768+0000 7f2ae2156700 1 -- start start 2023-10-16T19:57:36.774 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.769+0000 7f2ae2156700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2adc143bd0 0x7f2adc0cef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:36.774 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.769+0000 7f2ae2156700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f2adc0cf4c0 0x7f2adc0b2710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:36.774 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.769+0000 7f2ae2156700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f2adc0b2c50 0x7f2adc071080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:36.774 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.769+0000 7f2ae2156700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2adc0b3100 con 0x7f2adc0cf4c0 2023-10-16T19:57:36.775 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.769+0000 7f2ae2156700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2adc143fb0 con 0x7f2adc0b2c50 2023-10-16T19:57:36.775 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.769+0000 7f2ae2156700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2adc06e180 con 0x7f2adc143bd0 2023-10-16T19:57:36.775 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.769+0000 7f2adaffd700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f2adc0cf4c0 0x7f2adc0b2710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:36.775 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.769+0000 7f2adaffd700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f2adc0cf4c0 0x7f2adc0b2710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:46554/0 (socket says 172.21.15.157:46554) 2023-10-16T19:57:36.775 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.769+0000 7f2adaffd700 1 -- 172.21.15.157:0/662737282 learned_addr learned my addr 172.21.15.157:0/662737282 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:57:36.776 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.769+0000 7f2adb7fe700 1 --2- 172.21.15.157:0/662737282 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2adc143bd0 0x7f2adc0cef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:36.776 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.769+0000 7f2adaffd700 1 -- 172.21.15.157:0/662737282 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2adc143bd0 msgr2=0x7f2adc0cef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:57:36.776 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.769+0000 7f2adaffd700 1 --2- 172.21.15.157:0/662737282 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2adc143bd0 0x7f2adc0cef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:36.776 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.769+0000 7f2adbfff700 1 --2- 172.21.15.157:0/662737282 >> v2:172.21.15.187:3300/0 conn(0x7f2adc0b2c50 0x7f2adc071080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:36.776 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.769+0000 7f2adaffd700 1 -- 172.21.15.157:0/662737282 >> v2:172.21.15.187:3300/0 conn(0x7f2adc0b2c50 msgr2=0x7f2adc071080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:57:36.777 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.769+0000 7f2adaffd700 1 --2- 172.21.15.157:0/662737282 >> v2:172.21.15.187:3300/0 conn(0x7f2adc0b2c50 0x7f2adc071080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:36.777 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.769+0000 7f2adaffd700 1 -- 172.21.15.157:0/662737282 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2adc144480 con 0x7f2adc0cf4c0 2023-10-16T19:57:36.777 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.770+0000 7f2adaffd700 1 --2- 172.21.15.157:0/662737282 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2adc0cf4c0 0x7f2adc0b2710 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f2adc070fd0 tx=0x7f2acc009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4dbc82bd6f66199d server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:36.777 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.770+0000 7f2ada7fc700 1 -- 172.21.15.157:0/662737282 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2acc00b860 con 0x7f2adc0cf4c0 2023-10-16T19:57:36.777 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.770+0000 7f2ada7fc700 1 -- 172.21.15.157:0/662737282 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2acc00b9c0 con 0x7f2adc0cf4c0 2023-10-16T19:57:36.778 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.770+0000 7f2ada7fc700 1 -- 172.21.15.157:0/662737282 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2acc00bd50 con 0x7f2adc0cf4c0 2023-10-16T19:57:36.778 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.770+0000 7f2ae2156700 1 -- 172.21.15.157:0/662737282 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2adc0cf4c0 msgr2=0x7f2adc0b2710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:36.778 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.770+0000 7f2ae2156700 1 --2- 172.21.15.157:0/662737282 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2adc0cf4c0 0x7f2adc0b2710 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f2adc070fd0 tx=0x7f2acc009c00 comp rx=0 tx=0).stop 2023-10-16T19:57:36.778 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.770+0000 7f2ae2156700 1 -- 172.21.15.157:0/662737282 shutdown_connections 2023-10-16T19:57:36.779 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.770+0000 7f2ae2156700 1 --2- 172.21.15.157:0/662737282 >> v2:172.21.15.187:3300/0 conn(0x7f2adc0b2c50 0x7f2adc071080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:36.779 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.770+0000 7f2ae2156700 1 --2- 172.21.15.157:0/662737282 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2adc143bd0 0x7f2adc0cef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:36.779 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.770+0000 7f2ae2156700 1 --2- 172.21.15.157:0/662737282 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2adc0cf4c0 0x7f2adc0b2710 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:36.779 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.770+0000 7f2ae2156700 1 -- 172.21.15.157:0/662737282 >> 172.21.15.157:0/662737282 conn(0x7f2adc0d0b30 msgr2=0x7f2adc0d0f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:36.779 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.770+0000 7f2ae2156700 1 -- 172.21.15.157:0/662737282 shutdown_connections 2023-10-16T19:57:36.780 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.770+0000 7f2ae2156700 1 -- 172.21.15.157:0/662737282 wait complete. 2023-10-16T19:57:36.780 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.772+0000 7f2ae2156700 1 Processor -- start 2023-10-16T19:57:36.780 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.772+0000 7f2ae2156700 1 -- start start 2023-10-16T19:57:36.782 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.772+0000 7f2ae2156700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2adc0b2c50 0x7f2adc1f2cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:36.783 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.772+0000 7f2ae2156700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2adc0cf4c0 0x7f2adc06ad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:36.783 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.772+0000 7f2ae2156700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2adc143bd0 0x7f2adc06b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:36.783 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.772+0000 7f2ae2156700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2adc0af580 con 0x7f2adc0b2c50 2023-10-16T19:57:36.783 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.772+0000 7f2ae2156700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2adc0b0100 con 0x7f2adc143bd0 2023-10-16T19:57:36.784 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.772+0000 7f2ae2156700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2adc0af7d0 con 0x7f2adc0cf4c0 2023-10-16T19:57:36.784 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.773+0000 7f2adb7fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2adc0b2c50 0x7f2adc1f2cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:36.784 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.773+0000 7f2adb7fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2adc0b2c50 0x7f2adc1f2cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:46558/0 (socket says 172.21.15.157:46558) 2023-10-16T19:57:36.784 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.773+0000 7f2adb7fe700 1 -- 172.21.15.157:0/1542417225 learned_addr learned my addr 172.21.15.157:0/1542417225 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:57:36.784 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.773+0000 7f2adbfff700 1 --2- 172.21.15.157:0/1542417225 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2adc143bd0 0x7f2adc06b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:36.785 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.773+0000 7f2adaffd700 1 --2- 172.21.15.157:0/1542417225 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2adc0cf4c0 0x7f2adc06ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:36.785 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.773+0000 7f2adb7fe700 1 -- 172.21.15.157:0/1542417225 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2adc0cf4c0 msgr2=0x7f2adc06ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:36.785 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.773+0000 7f2adb7fe700 1 --2- 172.21.15.157:0/1542417225 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2adc0cf4c0 0x7f2adc06ad70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:36.785 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.773+0000 7f2adb7fe700 1 -- 172.21.15.157:0/1542417225 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2adc143bd0 msgr2=0x7f2adc06b2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:36.785 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.773+0000 7f2adb7fe700 1 --2- 172.21.15.157:0/1542417225 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2adc143bd0 0x7f2adc06b2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:36.785 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.773+0000 7f2adb7fe700 1 -- 172.21.15.157:0/1542417225 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2acc009550 con 0x7f2adc0b2c50 2023-10-16T19:57:36.786 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.773+0000 7f2adb7fe700 1 --2- 172.21.15.157:0/1542417225 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2adc0b2c50 0x7f2adc1f2cc0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f2ad000c7f0 tx=0x7f2ad000cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:36.787 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.773+0000 7f2ac3fff700 1 -- 172.21.15.157:0/1542417225 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ad0011800 con 0x7f2adc0b2c50 2023-10-16T19:57:36.787 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.773+0000 7f2ac3fff700 1 -- 172.21.15.157:0/1542417225 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ad0011960 con 0x7f2adc0b2c50 2023-10-16T19:57:36.787 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.773+0000 7f2ae2156700 1 -- 172.21.15.157:0/1542417225 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2adc0afab0 con 0x7f2adc0b2c50 2023-10-16T19:57:36.788 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.773+0000 7f2ac3fff700 1 -- 172.21.15.157:0/1542417225 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ad0011cf0 con 0x7f2adc0b2c50 2023-10-16T19:57:36.788 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.773+0000 7f2ae2156700 1 -- 172.21.15.157:0/1542417225 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2adc0c8410 con 0x7f2adc0b2c50 2023-10-16T19:57:36.788 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.774+0000 7f2ae2156700 1 -- 172.21.15.157:0/1542417225 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2adc0b0490 con 0x7f2adc0b2c50 2023-10-16T19:57:36.788 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.775+0000 7f2ac3fff700 1 -- 172.21.15.157:0/1542417225 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f2ad0018360 con 0x7f2adc0b2c50 2023-10-16T19:57:36.789 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.775+0000 7f2ac3fff700 1 --2- 172.21.15.157:0/1542417225 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f2ac806af00 0x7f2ac806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:36.789 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.775+0000 7f2ac3fff700 1 -- 172.21.15.157:0/1542417225 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2ad00895d0 con 0x7f2adc0b2c50 2023-10-16T19:57:36.789 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.775+0000 7f2adaffd700 1 --2- 172.21.15.157:0/1542417225 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f2ac806af00 0x7f2ac806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:36.789 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.776+0000 7f2adaffd700 1 --2- 172.21.15.157:0/1542417225 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f2ac806af00 0x7f2ac806d3c0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f2adc0b2780 tx=0x7f2acc008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:36.789 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.779+0000 7f2ac3fff700 1 -- 172.21.15.157:0/1542417225 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2ad0054690 con 0x7f2adc0b2c50 2023-10-16T19:57:36.970 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.968+0000 7f2ae2156700 1 -- 172.21.15.157:0/1542417225 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2adc04f400 con 0x7f2adc0b2c50 2023-10-16T19:57:36.971 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.968+0000 7f2ac3fff700 1 -- 172.21.15.157:0/1542417225 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2ad0057cb0 con 0x7f2adc0b2c50 2023-10-16T19:57:36.971 INFO:teuthology.orchestra.run.smithi157.stdout:pg_num: 32 2023-10-16T19:57:36.973 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.970+0000 7f2ae2156700 1 -- 172.21.15.157:0/1542417225 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f2ac806af00 msgr2=0x7f2ac806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:36.974 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.971+0000 7f2ae2156700 1 --2- 172.21.15.157:0/1542417225 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f2ac806af00 0x7f2ac806d3c0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f2adc0b2780 tx=0x7f2acc008030 comp rx=0 tx=0).stop 2023-10-16T19:57:36.974 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.971+0000 7f2ae2156700 1 -- 172.21.15.157:0/1542417225 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2adc0b2c50 msgr2=0x7f2adc1f2cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:36.974 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.971+0000 7f2ae2156700 1 --2- 172.21.15.157:0/1542417225 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2adc0b2c50 0x7f2adc1f2cc0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f2ad000c7f0 tx=0x7f2ad000cbb0 comp rx=0 tx=0).stop 2023-10-16T19:57:36.974 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.971+0000 7f2ae2156700 1 -- 172.21.15.157:0/1542417225 shutdown_connections 2023-10-16T19:57:36.974 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.971+0000 7f2ae2156700 1 --2- 172.21.15.157:0/1542417225 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f2ac806af00 0x7f2ac806d3c0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:36.975 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.971+0000 7f2ae2156700 1 --2- 172.21.15.157:0/1542417225 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2adc143bd0 0x7f2adc06b2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:36.975 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.971+0000 7f2ae2156700 1 --2- 172.21.15.157:0/1542417225 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2adc0b2c50 0x7f2adc1f2cc0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:36.975 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.971+0000 7f2ae2156700 1 --2- 172.21.15.157:0/1542417225 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2adc0cf4c0 0x7f2adc06ad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:36.975 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.971+0000 7f2ae2156700 1 -- 172.21.15.157:0/1542417225 >> 172.21.15.157:0/1542417225 conn(0x7f2adc0d0b30 msgr2=0x7f2adc0cbc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:36.976 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.971+0000 7f2ae2156700 1 -- 172.21.15.157:0/1542417225 shutdown_connections 2023-10-16T19:57:36.976 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:36.971+0000 7f2ae2156700 1 -- 172.21.15.157:0/1542417225 wait complete. 2023-10-16T19:57:36.985 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-16T19:57:36.991 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T19:57:37.030 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T19:57:37.115 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.111+0000 7fb6315ed700 1 Processor -- start 2023-10-16T19:57:37.116 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.111+0000 7fb6315ed700 1 -- start start 2023-10-16T19:57:37.116 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.111+0000 7fb6315ed700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fb62c15e760 0x7fb62c0d1460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:37.116 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.112+0000 7fb6315ed700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb62c0cfd10 0x7fb62c06b960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:37.117 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.112+0000 7fb6315ed700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb62c15f950 con 0x7fb62c0b36a0 2023-10-16T19:57:37.117 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.112+0000 7fb6315ed700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb62c06d530 con 0x7fb62c15e760 2023-10-16T19:57:37.117 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.112+0000 7fb6315ed700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb62c06d810 con 0x7fb62c0cfd10 2023-10-16T19:57:37.118 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.112+0000 7fb62b7fe700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb62c0cfd10 0x7fb62c06b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:37.118 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.112+0000 7fb62a7fc700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fb62c15e760 0x7fb62c0d1460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:37.118 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.112+0000 7fb62affd700 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7fb62c0b36a0 0x7fb62c0b3a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.157:39934/0 (socket says 172.21.15.157:39934) 2023-10-16T19:57:37.118 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.112+0000 7fb62affd700 1 -- 172.21.15.157:0/1661367510 learned_addr learned my addr 172.21.15.157:0/1661367510 (peer_addr_for_me v1:172.21.15.157:0/0) 2023-10-16T19:57:37.118 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.112+0000 7fb62b7fe700 1 -- 172.21.15.157:0/1661367510 >> v2:172.21.15.187:3300/0 conn(0x7fb62c15e760 msgr2=0x7fb62c0d1460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:57:37.119 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.112+0000 7fb62b7fe700 1 --2- 172.21.15.157:0/1661367510 >> v2:172.21.15.187:3300/0 conn(0x7fb62c15e760 0x7fb62c0d1460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:37.119 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.112+0000 7fb62b7fe700 1 -- 172.21.15.157:0/1661367510 >> v1:172.21.15.187:6789/0 conn(0x7fb62c0b36a0 legacy=0x7fb62c0b3a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:37.119 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.112+0000 7fb62b7fe700 1 -- 172.21.15.157:0/1661367510 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb62c0cf7f0 con 0x7fb62c0cfd10 2023-10-16T19:57:37.119 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.112+0000 7fb629ffb700 1 -- 172.21.15.157:0/1661367510 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3855817351 0 0) 0x7fb62c15f950 con 0x7fb62c0b36a0 2023-10-16T19:57:37.119 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.112+0000 7fb62a7fc700 1 --2- 172.21.15.157:0/1661367510 >> v2:172.21.15.187:3300/0 conn(0x7fb62c15e760 0x7fb62c0d1460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T19:57:37.120 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.112+0000 7fb62b7fe700 1 --2- 172.21.15.157:0/1661367510 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb62c0cfd10 0x7fb62c06b960 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fb624009d90 tx=0x7fb62400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2da339aab7b19ce5 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:37.120 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.113+0000 7fb629ffb700 1 -- 172.21.15.157:0/1661367510 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb62400e070 con 0x7fb62c0cfd10 2023-10-16T19:57:37.120 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.113+0000 7fb629ffb700 1 -- 172.21.15.157:0/1661367510 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb62400bb20 con 0x7fb62c0cfd10 2023-10-16T19:57:37.120 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.113+0000 7fb629ffb700 1 -- 172.21.15.157:0/1661367510 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb624012430 con 0x7fb62c0cfd10 2023-10-16T19:57:37.120 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.113+0000 7fb6315ed700 1 -- 172.21.15.157:0/1661367510 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb62c0cfd10 msgr2=0x7fb62c06b960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:37.121 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.113+0000 7fb6315ed700 1 --2- 172.21.15.157:0/1661367510 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb62c0cfd10 0x7fb62c06b960 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fb624009d90 tx=0x7fb62400b330 comp rx=0 tx=0).stop 2023-10-16T19:57:37.121 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.113+0000 7fb6315ed700 1 -- 172.21.15.157:0/1661367510 shutdown_connections 2023-10-16T19:57:37.121 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.113+0000 7fb6315ed700 1 --2- 172.21.15.157:0/1661367510 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb62c0cfd10 0x7fb62c06b960 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:37.121 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.113+0000 7fb6315ed700 1 --2- 172.21.15.157:0/1661367510 >> v2:172.21.15.187:3300/0 conn(0x7fb62c15e760 0x7fb62c0d1460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:37.121 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.113+0000 7fb6315ed700 1 -- 172.21.15.157:0/1661367510 >> 172.21.15.157:0/1661367510 conn(0x7fb62c06e310 msgr2=0x7fb62c06e6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:37.122 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.113+0000 7fb6315ed700 1 -- 172.21.15.157:0/1661367510 shutdown_connections 2023-10-16T19:57:37.122 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.113+0000 7fb6315ed700 1 -- 172.21.15.157:0/1661367510 wait complete. 2023-10-16T19:57:37.125 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.114+0000 7fb6315ed700 1 Processor -- start 2023-10-16T19:57:37.125 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.114+0000 7fb6315ed700 1 -- start start 2023-10-16T19:57:37.125 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.115+0000 7fb6315ed700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb62c0b36a0 0x7fb62c1591a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:37.126 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.115+0000 7fb6315ed700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb62c0cfd10 0x7fb62c15cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:37.126 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.115+0000 7fb6315ed700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb62c15e760 0x7fb62c15d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:37.126 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.115+0000 7fb6315ed700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb62c1f4b10 con 0x7fb62c0cfd10 2023-10-16T19:57:37.127 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.115+0000 7fb6315ed700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb62c1f53b0 con 0x7fb62c0b36a0 2023-10-16T19:57:37.127 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.115+0000 7fb6315ed700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb62c1f47a0 con 0x7fb62c15e760 2023-10-16T19:57:37.127 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.115+0000 7fb62a7fc700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb62c0cfd10 0x7fb62c15cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:37.129 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.115+0000 7fb62a7fc700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb62c0cfd10 0x7fb62c15cda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:46574/0 (socket says 172.21.15.157:46574) 2023-10-16T19:57:37.129 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.115+0000 7fb62a7fc700 1 -- 172.21.15.157:0/4079968708 learned_addr learned my addr 172.21.15.157:0/4079968708 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:57:37.129 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.115+0000 7fb62b7fe700 1 --2- 172.21.15.157:0/4079968708 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb62c15e760 0x7fb62c15d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:37.129 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.115+0000 7fb62affd700 1 --2- 172.21.15.157:0/4079968708 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb62c0b36a0 0x7fb62c1591a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:37.129 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.116+0000 7fb62a7fc700 1 -- 172.21.15.157:0/4079968708 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb62c15e760 msgr2=0x7fb62c15d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:37.130 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.116+0000 7fb62a7fc700 1 --2- 172.21.15.157:0/4079968708 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb62c15e760 0x7fb62c15d2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:37.130 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.116+0000 7fb62a7fc700 1 -- 172.21.15.157:0/4079968708 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb62c0b36a0 msgr2=0x7fb62c1591a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:37.130 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.116+0000 7fb62a7fc700 1 --2- 172.21.15.157:0/4079968708 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb62c0b36a0 0x7fb62c1591a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:37.130 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.116+0000 7fb62a7fc700 1 -- 172.21.15.157:0/4079968708 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6200094a0 con 0x7fb62c0cfd10 2023-10-16T19:57:37.131 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.116+0000 7fb62affd700 1 --2- 172.21.15.157:0/4079968708 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb62c0b36a0 0x7fb62c1591a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T19:57:37.131 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.116+0000 7fb62a7fc700 1 --2- 172.21.15.157:0/4079968708 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb62c0cfd10 0x7fb62c15cda0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fb62000ebe0 tx=0x7fb62000eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:37.131 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.116+0000 7fb6137fe700 1 -- 172.21.15.157:0/4079968708 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb62000c850 con 0x7fb62c0cfd10 2023-10-16T19:57:37.131 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.116+0000 7fb6137fe700 1 -- 172.21.15.157:0/4079968708 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb62000c9b0 con 0x7fb62c0cfd10 2023-10-16T19:57:37.131 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.116+0000 7fb6315ed700 1 -- 172.21.15.157:0/4079968708 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb624009a70 con 0x7fb62c0cfd10 2023-10-16T19:57:37.132 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.116+0000 7fb6137fe700 1 -- 172.21.15.157:0/4079968708 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb62000cd40 con 0x7fb62c0cfd10 2023-10-16T19:57:37.132 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.116+0000 7fb6315ed700 1 -- 172.21.15.157:0/4079968708 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb62c1f5040 con 0x7fb62c0cfd10 2023-10-16T19:57:37.132 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.117+0000 7fb6315ed700 1 -- 172.21.15.157:0/4079968708 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb62c15dfc0 con 0x7fb62c0cfd10 2023-10-16T19:57:37.132 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.118+0000 7fb6137fe700 1 -- 172.21.15.157:0/4079968708 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fb620013470 con 0x7fb62c0cfd10 2023-10-16T19:57:37.132 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.118+0000 7fb6137fe700 1 --2- 172.21.15.157:0/4079968708 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fb61806af00 0x7fb61806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:37.133 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.118+0000 7fb6137fe700 1 -- 172.21.15.157:0/4079968708 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb620089680 con 0x7fb62c0cfd10 2023-10-16T19:57:37.133 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.118+0000 7fb62affd700 1 --2- 172.21.15.157:0/4079968708 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fb61806af00 0x7fb61806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:37.133 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.119+0000 7fb62affd700 1 --2- 172.21.15.157:0/4079968708 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fb61806af00 0x7fb61806d3c0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fb61c000f60 tx=0x7fb61c007cc0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:37.133 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.123+0000 7fb6137fe700 1 -- 172.21.15.157:0/4079968708 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb620054730 con 0x7fb62c0cfd10 2023-10-16T19:57:37.315 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.313+0000 7fb6315ed700 1 -- 172.21.15.157:0/4079968708 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb62c04f400 con 0x7fb62c0cfd10 2023-10-16T19:57:37.317 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.313+0000 7fb6137fe700 1 -- 172.21.15.157:0/4079968708 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb62000cea0 con 0x7fb62c0cfd10 2023-10-16T19:57:37.318 INFO:teuthology.orchestra.run.smithi157.stdout:pg_num: 64 2023-10-16T19:57:37.319 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.315+0000 7fb6315ed700 1 -- 172.21.15.157:0/4079968708 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fb61806af00 msgr2=0x7fb61806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:37.319 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.315+0000 7fb6315ed700 1 --2- 172.21.15.157:0/4079968708 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fb61806af00 0x7fb61806d3c0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fb61c000f60 tx=0x7fb61c007cc0 comp rx=0 tx=0).stop 2023-10-16T19:57:37.319 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.315+0000 7fb6315ed700 1 -- 172.21.15.157:0/4079968708 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb62c0cfd10 msgr2=0x7fb62c15cda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:37.319 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.315+0000 7fb6315ed700 1 --2- 172.21.15.157:0/4079968708 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb62c0cfd10 0x7fb62c15cda0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fb62000ebe0 tx=0x7fb62000eef0 comp rx=0 tx=0).stop 2023-10-16T19:57:37.320 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.315+0000 7fb6315ed700 1 -- 172.21.15.157:0/4079968708 shutdown_connections 2023-10-16T19:57:37.320 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.315+0000 7fb6315ed700 1 --2- 172.21.15.157:0/4079968708 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fb61806af00 0x7fb61806d3c0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:37.320 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.315+0000 7fb6315ed700 1 --2- 172.21.15.157:0/4079968708 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb62c0b36a0 0x7fb62c1591a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:37.320 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.315+0000 7fb6315ed700 1 --2- 172.21.15.157:0/4079968708 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb62c15e760 0x7fb62c15d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:37.320 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.315+0000 7fb6315ed700 1 --2- 172.21.15.157:0/4079968708 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb62c0cfd10 0x7fb62c15cda0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:37.321 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.315+0000 7fb6315ed700 1 -- 172.21.15.157:0/4079968708 >> 172.21.15.157:0/4079968708 conn(0x7fb62c06e310 msgr2=0x7fb62c06b960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:37.321 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.315+0000 7fb6315ed700 1 -- 172.21.15.157:0/4079968708 shutdown_connections 2023-10-16T19:57:37.321 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.316+0000 7fb6315ed700 1 -- 172.21.15.157:0/4079968708 wait complete. 2023-10-16T19:57:37.330 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T19:57:37.491 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.488+0000 7f9f1685c700 1 Processor -- start 2023-10-16T19:57:37.491 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.488+0000 7f9f1685c700 1 -- start start 2023-10-16T19:57:37.494 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.489+0000 7f9f1685c700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f9f1015de80 0x7f9f100cf2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:37.494 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.489+0000 7f9f1685c700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9f1015e260 0x7f9f100b5810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:37.494 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.489+0000 7f9f1685c700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f100cee50 con 0x7f9f100b5d50 2023-10-16T19:57:37.495 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.489+0000 7f9f1685c700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f100b6200 con 0x7f9f1015de80 2023-10-16T19:57:37.495 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.489+0000 7f9f1685c700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f100ce5f0 con 0x7f9f1015e260 2023-10-16T19:57:37.495 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.489+0000 7f9f0ffff700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f9f1015de80 0x7f9f100cf2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:37.495 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.489+0000 7f9f0ffff700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f9f1015de80 0x7f9f100cf2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:46580/0 (socket says 172.21.15.157:46580) 2023-10-16T19:57:37.496 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.489+0000 7f9f14df9700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f9f100b5d50 0x7f9f10161cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:56256/0 (socket says 172.21.15.157:56256) 2023-10-16T19:57:37.496 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.489+0000 7f9f0ffff700 1 -- 172.21.15.157:0/338581004 learned_addr learned my addr 172.21.15.157:0/338581004 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:57:37.496 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.490+0000 7f9f0f7fe700 1 --2- 172.21.15.157:0/338581004 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9f1015e260 0x7f9f100b5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:37.496 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.490+0000 7f9f0ffff700 1 -- 172.21.15.157:0/338581004 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9f1015e260 msgr2=0x7f9f100b5810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:57:37.497 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.490+0000 7f9f0ffff700 1 --2- 172.21.15.157:0/338581004 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9f1015e260 0x7f9f100b5810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:37.497 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.490+0000 7f9f0ffff700 1 -- 172.21.15.157:0/338581004 >> v1:172.21.15.157:6789/0 conn(0x7f9f100b5d50 legacy=0x7f9f10161cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:37.498 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.490+0000 7f9f0ffff700 1 -- 172.21.15.157:0/338581004 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f100cf820 con 0x7f9f1015de80 2023-10-16T19:57:37.498 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.490+0000 7f9f0f7fe700 1 --2- 172.21.15.157:0/338581004 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9f1015e260 0x7f9f100b5810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T19:57:37.498 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.490+0000 7f9f0effd700 1 -- 172.21.15.157:0/338581004 <== mon.0 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2108780375 0 0) 0x7f9f100cee50 con 0x7f9f100b5d50 2023-10-16T19:57:37.498 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.490+0000 7f9f0ffff700 1 --2- 172.21.15.157:0/338581004 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9f1015de80 0x7f9f100cf2e0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f9f000098f0 tx=0x7f9f00009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=606b990f6e6e967b server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:37.499 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.490+0000 7f9f0effd700 1 -- 172.21.15.157:0/338581004 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f0000b8a0 con 0x7f9f1015de80 2023-10-16T19:57:37.499 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.490+0000 7f9f0effd700 1 -- 172.21.15.157:0/338581004 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f0000ba00 con 0x7f9f1015de80 2023-10-16T19:57:37.499 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.490+0000 7f9f0effd700 1 -- 172.21.15.157:0/338581004 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f0000bd90 con 0x7f9f1015de80 2023-10-16T19:57:37.499 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.490+0000 7f9f1685c700 1 -- 172.21.15.157:0/338581004 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9f1015de80 msgr2=0x7f9f100cf2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:37.499 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.490+0000 7f9f1685c700 1 --2- 172.21.15.157:0/338581004 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9f1015de80 0x7f9f100cf2e0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f9f000098f0 tx=0x7f9f00009c00 comp rx=0 tx=0).stop 2023-10-16T19:57:37.500 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.491+0000 7f9f1685c700 1 -- 172.21.15.157:0/338581004 shutdown_connections 2023-10-16T19:57:37.500 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.491+0000 7f9f1685c700 1 --2- 172.21.15.157:0/338581004 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9f1015de80 0x7f9f100cf2e0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:37.500 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.491+0000 7f9f1685c700 1 --2- 172.21.15.157:0/338581004 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9f1015e260 0x7f9f100b5810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:37.500 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.491+0000 7f9f1685c700 1 -- 172.21.15.157:0/338581004 >> 172.21.15.157:0/338581004 conn(0x7f9f100d0810 msgr2=0x7f9f100d0bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:37.500 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.491+0000 7f9f1685c700 1 -- 172.21.15.157:0/338581004 shutdown_connections 2023-10-16T19:57:37.501 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.491+0000 7f9f1685c700 1 -- 172.21.15.157:0/338581004 wait complete. 2023-10-16T19:57:37.501 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.492+0000 7f9f1685c700 1 Processor -- start 2023-10-16T19:57:37.501 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.492+0000 7f9f1685c700 1 -- start start 2023-10-16T19:57:37.504 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.493+0000 7f9f1685c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9f100b5d50 0x7f9f100cd6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:37.504 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.493+0000 7f9f1685c700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9f1015de80 0x7f9f1014a140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:37.504 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.493+0000 7f9f1685c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9f1015e260 0x7f9f10160dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:37.504 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.493+0000 7f9f1685c700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f100c88c0 con 0x7f9f100b5d50 2023-10-16T19:57:37.504 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.493+0000 7f9f1685c700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f100c8b60 con 0x7f9f1015e260 2023-10-16T19:57:37.505 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.493+0000 7f9f1685c700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f100c8e40 con 0x7f9f1015de80 2023-10-16T19:57:37.505 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.493+0000 7f9f0ffff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9f100b5d50 0x7f9f100cd6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:37.505 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.493+0000 7f9f0ffff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9f100b5d50 0x7f9f100cd6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:46586/0 (socket says 172.21.15.157:46586) 2023-10-16T19:57:37.505 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.493+0000 7f9f0ffff700 1 -- 172.21.15.157:0/702872642 learned_addr learned my addr 172.21.15.157:0/702872642 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:57:37.505 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.493+0000 7f9f0f7fe700 1 --2- 172.21.15.157:0/702872642 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9f1015de80 0x7f9f1014a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:37.506 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.493+0000 7f9f14df9700 1 --2- 172.21.15.157:0/702872642 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9f1015e260 0x7f9f10160dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:37.506 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.493+0000 7f9f0ffff700 1 -- 172.21.15.157:0/702872642 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9f1015de80 msgr2=0x7f9f1014a140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:37.506 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.493+0000 7f9f0ffff700 1 --2- 172.21.15.157:0/702872642 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9f1015de80 0x7f9f1014a140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:37.506 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.493+0000 7f9f0ffff700 1 -- 172.21.15.157:0/702872642 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9f1015e260 msgr2=0x7f9f10160dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:37.506 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.493+0000 7f9f0ffff700 1 --2- 172.21.15.157:0/702872642 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9f1015e260 0x7f9f10160dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:37.507 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.493+0000 7f9f0ffff700 1 -- 172.21.15.157:0/702872642 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f00009550 con 0x7f9f100b5d50 2023-10-16T19:57:37.507 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.493+0000 7f9f0ffff700 1 --2- 172.21.15.157:0/702872642 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9f100b5d50 0x7f9f100cd6c0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f9f00009c40 tx=0x7f9f00004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:37.507 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.493+0000 7f9f0cff9700 1 -- 172.21.15.157:0/702872642 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f000045d0 con 0x7f9f100b5d50 2023-10-16T19:57:37.507 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.493+0000 7f9f0cff9700 1 -- 172.21.15.157:0/702872642 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f0001f070 con 0x7f9f100b5d50 2023-10-16T19:57:37.508 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.493+0000 7f9f1685c700 1 -- 172.21.15.157:0/702872642 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f100c9120 con 0x7f9f100b5d50 2023-10-16T19:57:37.508 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.493+0000 7f9f0cff9700 1 -- 172.21.15.157:0/702872642 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f000038e0 con 0x7f9f100b5d50 2023-10-16T19:57:37.508 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.493+0000 7f9f1685c700 1 -- 172.21.15.157:0/702872642 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f100cdc00 con 0x7f9f100b5d50 2023-10-16T19:57:37.508 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.494+0000 7f9f1685c700 1 -- 172.21.15.157:0/702872642 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f100cdd90 con 0x7f9f100b5d50 2023-10-16T19:57:37.508 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.495+0000 7f9f0cff9700 1 -- 172.21.15.157:0/702872642 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f9f00003a40 con 0x7f9f100b5d50 2023-10-16T19:57:37.509 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.495+0000 7f9f0cff9700 1 --2- 172.21.15.157:0/702872642 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f9efc06af00 0x7f9efc06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:37.509 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.495+0000 7f9f0cff9700 1 -- 172.21.15.157:0/702872642 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9f00021070 con 0x7f9f100b5d50 2023-10-16T19:57:37.509 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.496+0000 7f9f0f7fe700 1 --2- 172.21.15.157:0/702872642 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f9efc06af00 0x7f9efc06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:37.509 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.496+0000 7f9f0f7fe700 1 --2- 172.21.15.157:0/702872642 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f9efc06af00 0x7f9efc06d3c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f9f04006f10 tx=0x7f9f04008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:37.509 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.500+0000 7f9f0cff9700 1 -- 172.21.15.157:0/702872642 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9f00055f30 con 0x7f9f100b5d50 2023-10-16T19:57:37.692 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.689+0000 7f9f1685c700 1 -- 172.21.15.157:0/702872642 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9f100ceab0 con 0x7f9f100b5d50 2023-10-16T19:57:37.693 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.690+0000 7f9f0cff9700 1 -- 172.21.15.157:0/702872642 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16517 (secure 0 0 0) 0x7f9f00015020 con 0x7f9f100b5d50 2023-10-16T19:57:37.693 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-10-16T19:57:37.693 INFO:teuthology.orchestra.run.smithi157.stdout:{"epoch":21,"fsid":"28199dc9-64d5-479e-83c6-21f097c33d39","created":"2023-10-16T19:56:49.201889+0000","modified":"2023-10-16T19:57:07.988567+0000","last_up_change":"2023-10-16T19:56:54.675673+0000","last_in_change":"2023-10-16T19:56:51.666728+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T19:56:56.932895+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-16T19:57:04.936105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-16T19:57:05.335279+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":335785898},{"type":"v1","addr":"172.21.15.157:6809","nonce":335785898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":335785898},{"type":"v1","addr":"172.21.15.157:6811","nonce":335785898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6815","nonce":335785898},{"type":"v1","addr":"172.21.15.157:6817","nonce":335785898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":335785898},{"type":"v1","addr":"172.21.15.157:6813","nonce":335785898}]},"public_addr":"172.21.15.157:6809/335785898","cluster_addr":"172.21.15.157:6811/335785898","heartbeat_back_addr":"172.21.15.157:6817/335785898","heartbeat_front_addr":"172.21.15.157:6813/335785898","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":3482825047},{"type":"v1","addr":"172.21.15.157:6801","nonce":3482825047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":3482825047},{"type":"v1","addr":"172.21.15.157:6803","nonce":3482825047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":3482825047},{"type":"v1","addr":"172.21.15.157:6807","nonce":3482825047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":3482825047},{"type":"v1","addr":"172.21.15.157:6805","nonce":3482825047}]},"public_addr":"172.21.15.157:6801/3482825047","cluster_addr":"172.21.15.157:6803/3482825047","heartbeat_back_addr":"172.21.15.157:6807/3482825047","heartbeat_front_addr":"172.21.15.157:6805/3482825047","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":1118292389},{"type":"v1","addr":"172.21.15.157:6825","nonce":1118292389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":1118292389},{"type":"v1","addr":"172.21.15.157:6827","nonce":1118292389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":1118292389},{"type":"v1","addr":"172.21.15.157:6831","nonce":1118292389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":1118292389},{"type":"v1","addr":"172.21.15.157:6829","nonce":1118292389}]},"public_addr":"172.21.15.157:6825/1118292389","cluster_addr":"172.21.15.157:6827/1118292389","heartbeat_back_addr":"172.21.15.157:6831/1118292389","heartbeat_front_addr":"172.21.15.157:6829/1118292389","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":989329821},{"type":"v1","addr":"172.21.15.157:6816","nonce":989329821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":989329821},{"type":"v1","addr":"172.21.15.157:6819","nonce":989329821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":989329821},{"type":"v1","addr":"172.21.15.157:6823","nonce":989329821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":989329821},{"type":"v1","addr":"172.21.15.157:6821","nonce":989329821}]},"public_addr":"172.21.15.157:6816/989329821","cluster_addr":"172.21.15.157:6819/989329821","heartbeat_back_addr":"172.21.15.157:6823/989329821","heartbeat_front_addr":"172.21.15.157:6821/989329821","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":3841016811},{"type":"v1","addr":"172.21.15.187:6801","nonce":3841016811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6803","nonce":3841016811},{"type":"v1","addr":"172.21.15.187:6804","nonce":3841016811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6809","nonce":3841016811},{"type":"v1","addr":"172.21.15.187:6811","nonce":3841016811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":3841016811},{"type":"v1","addr":"172.21.15.187:6808","nonce":3841016811}]},"public_addr":"172.21.15.187:6801/3841016811","cluster_addr":"172.21.15.187:6804/3841016811","heartbeat_back_addr":"172.21.15.187:6811/3841016811","heartbeat_front_addr":"172.21.15.187:6808/3841016811","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":915130263},{"type":"v1","addr":"172.21.15.187:6805","nonce":915130263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6807","nonce":915130263},{"type":"v1","addr":"172.21.15.187:6810","nonce":915130263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":915130263},{"type":"v1","addr":"172.21.15.187:6815","nonce":915130263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":915130263},{"type":"v1","addr":"172.21.15.187:6813","nonce":915130263}]},"public_addr":"172.21.15.187:6805/915130263","cluster_addr":"172.21.15.187:6810/915130263","heartbeat_back_addr":"172.21.15.187:6815/915130263","heartbeat_front_addr":"172.21.15.187:6813/915130263","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":654976824},{"type":"v1","addr":"172.21.15.187:6817","nonce":654976824}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":654976824},{"type":"v1","addr":"172.21.15.187:6819","nonce":654976824}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":654976824},{"type":"v1","addr":"172.21.15.187:6823","nonce":654976824}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":654976824},{"type":"v1","addr":"172.21.15.187:6821","nonce":654976824}]},"public_addr":"172.21.15.187:6817/654976824","cluster_addr":"172.21.15.187:6819/654976824","heartbeat_back_addr":"172.21.15.187:6823/654976824","heartbeat_front_addr":"172.21.15.187:6821/654976824","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":4284059445},{"type":"v1","addr":"172.21.15.187:6825","nonce":4284059445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":4284059445},{"type":"v1","addr":"172.21.15.187:6827","nonce":4284059445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":4284059445},{"type":"v1","addr":"172.21.15.187:6831","nonce":4284059445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":4284059445},{"type":"v1","addr":"172.21.15.187:6829","nonce":4284059445}]},"public_addr":"172.21.15.187:6825/4284059445","cluster_addr":"172.21.15.187:6827/4284059445","heartbeat_back_addr":"172.21.15.187:6831/4284059445","heartbeat_front_addr":"172.21.15.187:6829/4284059445","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.819780+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.824193+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.849575+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.824806+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.809540+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.805093+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.866109+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.807372+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T19:57:37.695 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.693+0000 7f9f1685c700 1 -- 172.21.15.157:0/702872642 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f9efc06af00 msgr2=0x7f9efc06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:37.696 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.693+0000 7f9f1685c700 1 --2- 172.21.15.157:0/702872642 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f9efc06af00 0x7f9efc06d3c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f9f04006f10 tx=0x7f9f04008040 comp rx=0 tx=0).stop 2023-10-16T19:57:37.696 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.693+0000 7f9f1685c700 1 -- 172.21.15.157:0/702872642 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9f100b5d50 msgr2=0x7f9f100cd6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:37.696 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.693+0000 7f9f1685c700 1 --2- 172.21.15.157:0/702872642 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9f100b5d50 0x7f9f100cd6c0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f9f00009c40 tx=0x7f9f00004750 comp rx=0 tx=0).stop 2023-10-16T19:57:37.696 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.693+0000 7f9f1685c700 1 -- 172.21.15.157:0/702872642 shutdown_connections 2023-10-16T19:57:37.696 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.693+0000 7f9f1685c700 1 --2- 172.21.15.157:0/702872642 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f9efc06af00 0x7f9efc06d3c0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:37.697 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.693+0000 7f9f1685c700 1 --2- 172.21.15.157:0/702872642 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9f1015e260 0x7f9f10160dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:37.697 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.693+0000 7f9f1685c700 1 --2- 172.21.15.157:0/702872642 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9f100b5d50 0x7f9f100cd6c0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:37.697 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.693+0000 7f9f1685c700 1 --2- 172.21.15.157:0/702872642 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9f1015de80 0x7f9f1014a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:37.697 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.693+0000 7f9f1685c700 1 -- 172.21.15.157:0/702872642 >> 172.21.15.157:0/702872642 conn(0x7f9f100d0810 msgr2=0x7f9f10161aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:37.697 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.693+0000 7f9f1685c700 1 -- 172.21.15.157:0/702872642 shutdown_connections 2023-10-16T19:57:37.698 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.693+0000 7f9f1685c700 1 -- 172.21.15.157:0/702872642 wait complete. 2023-10-16T19:57:37.707 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-16T19:56:56.932895+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-16T19:57:04.936105+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-16T19:57:05.335279+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-16T19:57:37.708 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-16T19:57:37.831 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.829+0000 7fa2c6a0b700 1 Processor -- start 2023-10-16T19:57:37.832 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.829+0000 7fa2c6a0b700 1 -- start start 2023-10-16T19:57:37.834 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.829+0000 7fa2c6a0b700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fa2c006b160 0x7fa2c00afa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:37.834 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.829+0000 7fa2c6a0b700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2c0072320 con 0x7fa2c015e090 2023-10-16T19:57:37.834 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.829+0000 7fa2c6a0b700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2c00b03d0 con 0x7fa2c00affc0 2023-10-16T19:57:37.834 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.830+0000 7fa2c6a0b700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2c0071b50 con 0x7fa2c006b160 2023-10-16T19:57:37.834 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.830+0000 7fa2bf7fe700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fa2c006b160 0x7fa2c00afa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:37.835 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.830+0000 7fa2bf7fe700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fa2c006b160 0x7fa2c00afa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:46596/0 (socket says 172.21.15.157:46596) 2023-10-16T19:57:37.835 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.830+0000 7fa2bf7fe700 1 -- 172.21.15.157:0/4046634365 learned_addr learned my addr 172.21.15.157:0/4046634365 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:57:37.835 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.830+0000 7fa2bf7fe700 1 -- 172.21.15.157:0/4046634365 >> v1:172.21.15.187:6789/0 conn(0x7fa2c00affc0 legacy=0x7fa2c015e470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:57:37.835 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.830+0000 7fa2bf7fe700 1 -- 172.21.15.157:0/4046634365 >> v1:172.21.15.157:6789/0 conn(0x7fa2c015e090 legacy=0x7fa2c006ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:37.835 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.830+0000 7fa2bf7fe700 1 -- 172.21.15.157:0/4046634365 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2c0071d60 con 0x7fa2c006b160 2023-10-16T19:57:37.836 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.830+0000 7fa2bf7fe700 1 --2- 172.21.15.157:0/4046634365 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa2c006b160 0x7fa2c00afa80 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fa2b40098f0 tx=0x7fa2b4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d02b50e256ecaefe server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:37.836 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.830+0000 7fa2beffd700 1 -- 172.21.15.157:0/4046634365 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2b4004230 con 0x7fa2c006b160 2023-10-16T19:57:37.836 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.830+0000 7fa2beffd700 1 -- 172.21.15.157:0/4046634365 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2b4004390 con 0x7fa2c006b160 2023-10-16T19:57:37.836 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.830+0000 7fa2beffd700 1 -- 172.21.15.157:0/4046634365 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2b40036a0 con 0x7fa2c006b160 2023-10-16T19:57:37.836 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.831+0000 7fa2c6a0b700 1 -- 172.21.15.157:0/4046634365 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa2c006b160 msgr2=0x7fa2c00afa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:37.837 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.831+0000 7fa2c6a0b700 1 --2- 172.21.15.157:0/4046634365 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa2c006b160 0x7fa2c00afa80 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fa2b40098f0 tx=0x7fa2b4009c00 comp rx=0 tx=0).stop 2023-10-16T19:57:37.837 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.831+0000 7fa2c6a0b700 1 -- 172.21.15.157:0/4046634365 shutdown_connections 2023-10-16T19:57:37.837 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.831+0000 7fa2c6a0b700 1 --2- 172.21.15.157:0/4046634365 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa2c006b160 0x7fa2c00afa80 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:37.837 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.831+0000 7fa2c6a0b700 1 -- 172.21.15.157:0/4046634365 >> 172.21.15.157:0/4046634365 conn(0x7fa2c00d0b30 msgr2=0x7fa2c00d0f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:37.837 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.831+0000 7fa2c6a0b700 1 -- 172.21.15.157:0/4046634365 shutdown_connections 2023-10-16T19:57:37.838 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.831+0000 7fa2c6a0b700 1 -- 172.21.15.157:0/4046634365 wait complete. 2023-10-16T19:57:37.840 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.832+0000 7fa2c6a0b700 1 Processor -- start 2023-10-16T19:57:37.841 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.833+0000 7fa2c6a0b700 1 -- start start 2023-10-16T19:57:37.841 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.833+0000 7fa2c6a0b700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa2c006b160 0x7fa2c01f3180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:37.841 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.833+0000 7fa2c6a0b700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa2c00affc0 0x7fa2c00d02e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:37.841 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.833+0000 7fa2c6a0b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa2c015e090 0x7fa2c00ae050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:37.841 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.833+0000 7fa2c6a0b700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2c00adbc0 con 0x7fa2c006b160 2023-10-16T19:57:37.842 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.833+0000 7fa2c6a0b700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2c006d780 con 0x7fa2c015e090 2023-10-16T19:57:37.842 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.833+0000 7fa2c6a0b700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2c006da60 con 0x7fa2c00affc0 2023-10-16T19:57:37.842 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.833+0000 7fa2bffff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa2c006b160 0x7fa2c01f3180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:37.842 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.834+0000 7fa2bffff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa2c006b160 0x7fa2c01f3180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:46600/0 (socket says 172.21.15.157:46600) 2023-10-16T19:57:37.843 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.834+0000 7fa2bffff700 1 -- 172.21.15.157:0/3994096096 learned_addr learned my addr 172.21.15.157:0/3994096096 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:57:37.843 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.834+0000 7fa2bf7fe700 1 --2- 172.21.15.157:0/3994096096 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa2c00affc0 0x7fa2c00d02e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:37.843 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.834+0000 7fa2c4fa8700 1 --2- 172.21.15.157:0/3994096096 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa2c015e090 0x7fa2c00ae050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:37.843 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.834+0000 7fa2bffff700 1 -- 172.21.15.157:0/3994096096 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa2c00affc0 msgr2=0x7fa2c00d02e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:37.843 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.834+0000 7fa2bffff700 1 --2- 172.21.15.157:0/3994096096 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa2c00affc0 0x7fa2c00d02e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:37.844 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.834+0000 7fa2bffff700 1 -- 172.21.15.157:0/3994096096 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa2c015e090 msgr2=0x7fa2c00ae050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:37.844 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.834+0000 7fa2bffff700 1 --2- 172.21.15.157:0/3994096096 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa2c015e090 0x7fa2c00ae050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:37.844 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.834+0000 7fa2bffff700 1 -- 172.21.15.157:0/3994096096 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2b4009550 con 0x7fa2c006b160 2023-10-16T19:57:37.844 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.834+0000 7fa2bffff700 1 --2- 172.21.15.157:0/3994096096 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa2c006b160 0x7fa2c01f3180 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fa2b000c450 tx=0x7fa2b000c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:37.844 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.834+0000 7fa2bcff9700 1 -- 172.21.15.157:0/3994096096 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2b00052d0 con 0x7fa2c006b160 2023-10-16T19:57:37.845 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.834+0000 7fa2bcff9700 1 -- 172.21.15.157:0/3994096096 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2b0005430 con 0x7fa2c006b160 2023-10-16T19:57:37.845 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.834+0000 7fa2c6a0b700 1 -- 172.21.15.157:0/3994096096 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2c006dd40 con 0x7fa2c006b160 2023-10-16T19:57:37.845 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.834+0000 7fa2bcff9700 1 -- 172.21.15.157:0/3994096096 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2b00038c0 con 0x7fa2c006b160 2023-10-16T19:57:37.845 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.834+0000 7fa2c6a0b700 1 -- 172.21.15.157:0/3994096096 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2c01f36c0 con 0x7fa2c006b160 2023-10-16T19:57:37.845 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.835+0000 7fa2c6a0b700 1 -- 172.21.15.157:0/3994096096 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2c004f400 con 0x7fa2c006b160 2023-10-16T19:57:37.846 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.835+0000 7fa2bcff9700 1 -- 172.21.15.157:0/3994096096 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fa2b0003a20 con 0x7fa2c006b160 2023-10-16T19:57:37.846 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.836+0000 7fa2bcff9700 1 --2- 172.21.15.157:0/3994096096 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fa2ac06af00 0x7fa2ac06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:37.846 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.836+0000 7fa2bcff9700 1 -- 172.21.15.157:0/3994096096 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa2b00888a0 con 0x7fa2c006b160 2023-10-16T19:57:37.846 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.836+0000 7fa2bf7fe700 1 --2- 172.21.15.157:0/3994096096 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fa2ac06af00 0x7fa2ac06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:37.846 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.836+0000 7fa2bf7fe700 1 --2- 172.21.15.157:0/3994096096 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fa2ac06af00 0x7fa2ac06d3c0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fa2b4009130 tx=0x7fa2b4008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:37.847 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:37.840+0000 7fa2bcff9700 1 -- 172.21.15.157:0/3994096096 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa2b00539e0 con 0x7fa2c006b160 2023-10-16T19:57:38.033 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.031+0000 7fa2c6a0b700 1 -- 172.21.15.157:0/3994096096 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa2c00adea0 con 0x7fa2c006b160 2023-10-16T19:57:38.034 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.031+0000 7fa2bcff9700 1 -- 172.21.15.157:0/3994096096 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa2b0057000 con 0x7fa2c006b160 2023-10-16T19:57:38.034 INFO:teuthology.orchestra.run.smithi157.stdout:pg_num: 1 2023-10-16T19:57:38.036 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.033+0000 7fa2c6a0b700 1 -- 172.21.15.157:0/3994096096 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fa2ac06af00 msgr2=0x7fa2ac06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:38.036 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.033+0000 7fa2c6a0b700 1 --2- 172.21.15.157:0/3994096096 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fa2ac06af00 0x7fa2ac06d3c0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fa2b4009130 tx=0x7fa2b4008030 comp rx=0 tx=0).stop 2023-10-16T19:57:38.037 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.033+0000 7fa2c6a0b700 1 -- 172.21.15.157:0/3994096096 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa2c006b160 msgr2=0x7fa2c01f3180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:38.037 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.033+0000 7fa2c6a0b700 1 --2- 172.21.15.157:0/3994096096 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa2c006b160 0x7fa2c01f3180 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fa2b000c450 tx=0x7fa2b000c810 comp rx=0 tx=0).stop 2023-10-16T19:57:38.037 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.033+0000 7fa2c6a0b700 1 -- 172.21.15.157:0/3994096096 shutdown_connections 2023-10-16T19:57:38.037 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.033+0000 7fa2c6a0b700 1 --2- 172.21.15.157:0/3994096096 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fa2ac06af00 0x7fa2ac06d3c0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:38.038 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.033+0000 7fa2c6a0b700 1 --2- 172.21.15.157:0/3994096096 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa2c015e090 0x7fa2c00ae050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:38.038 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.033+0000 7fa2c6a0b700 1 --2- 172.21.15.157:0/3994096096 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa2c006b160 0x7fa2c01f3180 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:38.038 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.033+0000 7fa2c6a0b700 1 --2- 172.21.15.157:0/3994096096 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa2c00affc0 0x7fa2c00d02e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:38.038 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.033+0000 7fa2c6a0b700 1 -- 172.21.15.157:0/3994096096 >> 172.21.15.157:0/3994096096 conn(0x7fa2c00d0b30 msgr2=0x7fa2c00cd540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:38.039 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.034+0000 7fa2c6a0b700 1 -- 172.21.15.157:0/3994096096 shutdown_connections 2023-10-16T19:57:38.039 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.034+0000 7fa2c6a0b700 1 -- 172.21.15.157:0/3994096096 wait complete. 2023-10-16T19:57:38.048 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-16T19:57:38.172 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.169+0000 7f4a56d54700 1 Processor -- start 2023-10-16T19:57:38.172 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.169+0000 7f4a56d54700 1 -- start start 2023-10-16T19:57:38.176 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.170+0000 7f4a56d54700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4a500b0190 0x7f4a5015e470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:38.176 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.170+0000 7f4a56d54700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a50072320 con 0x7f4a5006b160 2023-10-16T19:57:38.176 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.170+0000 7f4a56d54700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a50071d60 con 0x7f4a5015e090 2023-10-16T19:57:38.176 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.170+0000 7f4a56d54700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a50071b50 con 0x7f4a500b0190 2023-10-16T19:57:38.177 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.170+0000 7f4a4ffff700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f4a5006b160 0x7f4a500afa80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:56282/0 (socket says 172.21.15.157:56282) 2023-10-16T19:57:38.177 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.170+0000 7f4a4ffff700 1 -- 172.21.15.157:0/2417516131 learned_addr learned my addr 172.21.15.157:0/2417516131 (peer_addr_for_me v1:172.21.15.157:0/0) 2023-10-16T19:57:38.177 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.170+0000 7f4a552f1700 1 --2- 172.21.15.157:0/2417516131 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4a500b0190 0x7f4a5015e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:38.177 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.171+0000 7f4a4f7fe700 1 -- 172.21.15.157:0/2417516131 <== mon.0 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3698426235 0 0) 0x7f4a50072320 con 0x7f4a5006b160 2023-10-16T19:57:38.177 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.171+0000 7f4a4f7fe700 1 -- 172.21.15.157:0/2417516131 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4a400035b0 con 0x7f4a5006b160 2023-10-16T19:57:38.178 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.171+0000 7f4a4f7fe700 1 -- 172.21.15.157:0/2417516131 <== mon.0 v1:172.21.15.157:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3963816060 0 0) 0x7f4a400035b0 con 0x7f4a5006b160 2023-10-16T19:57:38.178 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.171+0000 7f4a4f7fe700 1 -- 172.21.15.157:0/2417516131 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4a500b0190 msgr2=0x7f4a5015e470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:57:38.178 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.171+0000 7f4a4f7fe700 1 --2- 172.21.15.157:0/2417516131 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4a500b0190 0x7f4a5015e470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:38.178 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.171+0000 7f4a4f7fe700 1 -- 172.21.15.157:0/2417516131 >> v1:172.21.15.187:6789/0 conn(0x7f4a5015e090 legacy=0x7f4a5006ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:38.178 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.171+0000 7f4a4f7fe700 1 -- 172.21.15.157:0/2417516131 --> v1:172.21.15.157:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a50072040 con 0x7f4a5006b160 2023-10-16T19:57:38.179 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.171+0000 7f4a4f7fe700 1 -- 172.21.15.157:0/2417516131 <== mon.0 v1:172.21.15.157:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4021145519 0 0) 0x7f4a3c001670 con 0x7f4a5006b160 2023-10-16T19:57:38.179 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.171+0000 7f4a4f7fe700 1 -- 172.21.15.157:0/2417516131 >> v1:172.21.15.157:6789/0 conn(0x7f4a5006b160 legacy=0x7f4a500afa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:38.179 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.171+0000 7f4a4f7fe700 1 --2- 172.21.15.157:0/2417516131 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4a500b0190 0x7f4a40003a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:38.179 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.171+0000 7f4a4f7fe700 1 --2- 172.21.15.157:0/2417516131 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4a40003f70 0x7f4a40004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:38.179 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.171+0000 7f4a4f7fe700 1 --2- 172.21.15.157:0/2417516131 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4a40004d90 0x7f4a40005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:38.180 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.171+0000 7f4a4f7fe700 1 -- 172.21.15.157:0/2417516131 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a50071b50 con 0x7f4a40004d90 2023-10-16T19:57:38.180 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.171+0000 7f4a4f7fe700 1 -- 172.21.15.157:0/2417516131 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a4000bb20 con 0x7f4a40003f70 2023-10-16T19:57:38.180 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.171+0000 7f4a4f7fe700 1 -- 172.21.15.157:0/2417516131 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a4000bce0 con 0x7f4a500b0190 2023-10-16T19:57:38.180 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.171+0000 7f4a552f1700 1 --2- 172.21.15.157:0/2417516131 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4a40004d90 0x7f4a40005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:38.180 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.171+0000 7f4a54af0700 1 --2- 172.21.15.157:0/2417516131 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4a500b0190 0x7f4a40003a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:38.181 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.171+0000 7f4a4ffff700 1 --2- 172.21.15.157:0/2417516131 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4a40003f70 0x7f4a40004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:38.181 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.171+0000 7f4a552f1700 1 -- 172.21.15.157:0/2417516131 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4a500b0190 msgr2=0x7f4a40003a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:57:38.181 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.171+0000 7f4a552f1700 1 --2- 172.21.15.157:0/2417516131 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4a500b0190 0x7f4a40003a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:38.181 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.171+0000 7f4a552f1700 1 -- 172.21.15.157:0/2417516131 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4a40003f70 msgr2=0x7f4a40004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:57:38.181 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.171+0000 7f4a552f1700 1 --2- 172.21.15.157:0/2417516131 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4a40003f70 0x7f4a40004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:38.181 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.171+0000 7f4a552f1700 1 -- 172.21.15.157:0/2417516131 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a400035b0 con 0x7f4a40004d90 2023-10-16T19:57:38.182 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.172+0000 7f4a552f1700 1 --2- 172.21.15.157:0/2417516131 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4a40004d90 0x7f4a40005210 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f4a48009f90 tx=0x7f4a40005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d516028fdbafd8b0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:38.182 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.172+0000 7f4a4f7fe700 1 -- 172.21.15.157:0/2417516131 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a4800ec30 con 0x7f4a40004d90 2023-10-16T19:57:38.182 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.172+0000 7f4a4f7fe700 1 -- 172.21.15.157:0/2417516131 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a4800f040 con 0x7f4a40004d90 2023-10-16T19:57:38.182 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.172+0000 7f4a4f7fe700 1 -- 172.21.15.157:0/2417516131 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a48014480 con 0x7f4a40004d90 2023-10-16T19:57:38.183 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.172+0000 7f4a56d54700 1 -- 172.21.15.157:0/2417516131 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4a40004d90 msgr2=0x7f4a40005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:38.183 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.172+0000 7f4a56d54700 1 --2- 172.21.15.157:0/2417516131 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4a40004d90 0x7f4a40005210 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f4a48009f90 tx=0x7f4a40005880 comp rx=0 tx=0).stop 2023-10-16T19:57:38.183 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.172+0000 7f4a552f1700 1 -- 172.21.15.157:0/2417516131 reap_dead start 2023-10-16T19:57:38.183 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.172+0000 7f4a56d54700 1 -- 172.21.15.157:0/2417516131 shutdown_connections 2023-10-16T19:57:38.183 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.172+0000 7f4a56d54700 1 -- 172.21.15.157:0/2417516131 >> 172.21.15.157:0/2417516131 conn(0x7f4a500d0b30 msgr2=0x7f4a500d0f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:38.184 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.172+0000 7f4a56d54700 1 -- 172.21.15.157:0/2417516131 shutdown_connections 2023-10-16T19:57:38.184 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.172+0000 7f4a56d54700 1 -- 172.21.15.157:0/2417516131 wait complete. 2023-10-16T19:57:38.184 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.173+0000 7f4a56d54700 1 Processor -- start 2023-10-16T19:57:38.184 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.174+0000 7f4a56d54700 1 -- start start 2023-10-16T19:57:38.187 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.174+0000 7f4a56d54700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4a50155020 0x7f4a500ad850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:38.187 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.174+0000 7f4a56d54700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4a5006d210 0x7f4a5006d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:38.187 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.174+0000 7f4a56d54700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4a500b4f50 0x7f4a500b5400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:38.187 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.174+0000 7f4a56d54700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a5006dbd0 con 0x7f4a5006d210 2023-10-16T19:57:38.188 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.174+0000 7f4a56d54700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a50155400 con 0x7f4a50155020 2023-10-16T19:57:38.188 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.174+0000 7f4a56d54700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a500b5940 con 0x7f4a500b4f50 2023-10-16T19:57:38.188 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.174+0000 7f4a4ffff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4a5006d210 0x7f4a5006d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:38.188 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.175+0000 7f4a4ffff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4a5006d210 0x7f4a5006d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:46622/0 (socket says 172.21.15.157:46622) 2023-10-16T19:57:38.188 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.175+0000 7f4a4ffff700 1 -- 172.21.15.157:0/1068310079 learned_addr learned my addr 172.21.15.157:0/1068310079 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:57:38.189 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.175+0000 7f4a54af0700 1 --2- 172.21.15.157:0/1068310079 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4a50155020 0x7f4a500ad850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:38.189 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.175+0000 7f4a4ffff700 1 -- 172.21.15.157:0/1068310079 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4a500b4f50 msgr2=0x7f4a500b5400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:38.189 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.175+0000 7f4a4ffff700 1 --2- 172.21.15.157:0/1068310079 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4a500b4f50 0x7f4a500b5400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:38.189 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.175+0000 7f4a4ffff700 1 -- 172.21.15.157:0/1068310079 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4a50155020 msgr2=0x7f4a500ad850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:38.189 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.175+0000 7f4a4ffff700 1 --2- 172.21.15.157:0/1068310079 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4a50155020 0x7f4a500ad850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:38.190 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.175+0000 7f4a4ffff700 1 -- 172.21.15.157:0/1068310079 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a50158e60 con 0x7f4a5006d210 2023-10-16T19:57:38.190 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.175+0000 7f4a54af0700 1 --2- 172.21.15.157:0/1068310079 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4a50155020 0x7f4a500ad850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T19:57:38.190 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.175+0000 7f4a4ffff700 1 --2- 172.21.15.157:0/1068310079 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4a5006d210 0x7f4a5006d690 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f4a3c0072c0 tx=0x7f4a3c007680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:38.190 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.175+0000 7f4a4d7fa700 1 -- 172.21.15.157:0/1068310079 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a3c00f7f0 con 0x7f4a5006d210 2023-10-16T19:57:38.190 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.175+0000 7f4a4d7fa700 1 -- 172.21.15.157:0/1068310079 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a3c00f950 con 0x7f4a5006d210 2023-10-16T19:57:38.191 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.175+0000 7f4a56d54700 1 -- 172.21.15.157:0/1068310079 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a5015b720 con 0x7f4a5006d210 2023-10-16T19:57:38.191 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.175+0000 7f4a4d7fa700 1 -- 172.21.15.157:0/1068310079 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a3c00fd00 con 0x7f4a5006d210 2023-10-16T19:57:38.191 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.175+0000 7f4a56d54700 1 -- 172.21.15.157:0/1068310079 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a5015bce0 con 0x7f4a5006d210 2023-10-16T19:57:38.191 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.176+0000 7f4a56d54700 1 -- 172.21.15.157:0/1068310079 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a5004f400 con 0x7f4a5006d210 2023-10-16T19:57:38.191 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.176+0000 7f4a4d7fa700 1 -- 172.21.15.157:0/1068310079 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f4a3c01d460 con 0x7f4a5006d210 2023-10-16T19:57:38.191 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.177+0000 7f4a4d7fa700 1 --2- 172.21.15.157:0/1068310079 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f4a3406af00 0x7f4a3406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:38.192 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.177+0000 7f4a4d7fa700 1 -- 172.21.15.157:0/1068310079 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4a3c089600 con 0x7f4a5006d210 2023-10-16T19:57:38.192 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.177+0000 7f4a54af0700 1 --2- 172.21.15.157:0/1068310079 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f4a3406af00 0x7f4a3406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:38.192 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.178+0000 7f4a54af0700 1 --2- 172.21.15.157:0/1068310079 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f4a3406af00 0x7f4a3406d3c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f4a44007fd0 tx=0x7f4a44009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:38.192 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.181+0000 7f4a4d7fa700 1 -- 172.21.15.157:0/1068310079 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4a3c0546b0 con 0x7f4a5006d210 2023-10-16T19:57:38.372 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.370+0000 7f4a56d54700 1 -- 172.21.15.157:0/1068310079 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4a50071700 con 0x7f4a5006d210 2023-10-16T19:57:38.372 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.370+0000 7f4a4d7fa700 1 -- 172.21.15.157:0/1068310079 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4a3c057cd0 con 0x7f4a5006d210 2023-10-16T19:57:38.373 INFO:teuthology.orchestra.run.smithi157.stdout:pg_num: 32 2023-10-16T19:57:38.375 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.372+0000 7f4a56d54700 1 -- 172.21.15.157:0/1068310079 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f4a3406af00 msgr2=0x7f4a3406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:38.375 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.372+0000 7f4a56d54700 1 --2- 172.21.15.157:0/1068310079 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f4a3406af00 0x7f4a3406d3c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f4a44007fd0 tx=0x7f4a44009040 comp rx=0 tx=0).stop 2023-10-16T19:57:38.375 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.372+0000 7f4a56d54700 1 -- 172.21.15.157:0/1068310079 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4a5006d210 msgr2=0x7f4a5006d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:38.376 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.372+0000 7f4a56d54700 1 --2- 172.21.15.157:0/1068310079 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4a5006d210 0x7f4a5006d690 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f4a3c0072c0 tx=0x7f4a3c007680 comp rx=0 tx=0).stop 2023-10-16T19:57:38.376 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.373+0000 7f4a56d54700 1 -- 172.21.15.157:0/1068310079 shutdown_connections 2023-10-16T19:57:38.376 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.373+0000 7f4a56d54700 1 --2- 172.21.15.157:0/1068310079 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f4a3406af00 0x7f4a3406d3c0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:38.376 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.373+0000 7f4a56d54700 1 --2- 172.21.15.157:0/1068310079 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4a50155020 0x7f4a500ad850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:38.376 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.373+0000 7f4a56d54700 1 --2- 172.21.15.157:0/1068310079 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4a500b4f50 0x7f4a500b5400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:38.377 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.373+0000 7f4a56d54700 1 --2- 172.21.15.157:0/1068310079 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4a5006d210 0x7f4a5006d690 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:38.377 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.373+0000 7f4a56d54700 1 -- 172.21.15.157:0/1068310079 >> 172.21.15.157:0/1068310079 conn(0x7f4a500d0b30 msgr2=0x7f4a500cd540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:38.377 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.373+0000 7f4a56d54700 1 -- 172.21.15.157:0/1068310079 shutdown_connections 2023-10-16T19:57:38.377 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.373+0000 7f4a56d54700 1 -- 172.21.15.157:0/1068310079 wait complete. 2023-10-16T19:57:38.387 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-16T19:57:38.510 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.508+0000 7f4d78893700 1 Processor -- start 2023-10-16T19:57:38.511 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.508+0000 7f4d78893700 1 -- start start 2023-10-16T19:57:38.515 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.509+0000 7f4d78893700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4d740d1610 0x7f4d74166b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:38.515 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.509+0000 7f4d78893700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d7415c2b0 con 0x7f4d7415bed0 2023-10-16T19:57:38.515 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.509+0000 7f4d78893700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d7415f9e0 con 0x7f4d740b3dc0 2023-10-16T19:57:38.516 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.509+0000 7f4d78893700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d7415fcc0 con 0x7f4d740d1610 2023-10-16T19:57:38.516 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.509+0000 7f4d7259c700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f4d7415bed0 0x7f4d740b36b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:56300/0 (socket says 172.21.15.157:56300) 2023-10-16T19:57:38.516 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.509+0000 7f4d7259c700 1 -- 172.21.15.157:0/4086863086 learned_addr learned my addr 172.21.15.157:0/4086863086 (peer_addr_for_me v1:172.21.15.157:0/0) 2023-10-16T19:57:38.517 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.510+0000 7f4d72d9d700 1 --2- 172.21.15.157:0/4086863086 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4d740d1610 0x7f4d74166b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:38.517 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.510+0000 7f4d7159a700 1 -- 172.21.15.157:0/4086863086 <== mon.0 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 113117372 0 0) 0x7f4d7415c2b0 con 0x7f4d7415bed0 2023-10-16T19:57:38.517 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.510+0000 7f4d7159a700 1 -- 172.21.15.157:0/4086863086 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4d5c0035b0 con 0x7f4d7415bed0 2023-10-16T19:57:38.518 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.510+0000 7f4d7159a700 1 -- 172.21.15.157:0/4086863086 <== mon.0 v1:172.21.15.157:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1268979851 0 0) 0x7f4d5c0035b0 con 0x7f4d7415bed0 2023-10-16T19:57:38.518 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.510+0000 7f4d7159a700 1 -- 172.21.15.157:0/4086863086 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4d740d1610 msgr2=0x7f4d74166b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:57:38.518 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.510+0000 7f4d7159a700 1 --2- 172.21.15.157:0/4086863086 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4d740d1610 0x7f4d74166b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:38.519 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.510+0000 7f4d7159a700 1 -- 172.21.15.157:0/4086863086 >> v1:172.21.15.187:6789/0 conn(0x7f4d740b3dc0 legacy=0x7f4d740d0f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:38.519 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.510+0000 7f4d7159a700 1 -- 172.21.15.157:0/4086863086 --> v1:172.21.15.157:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d7415ffa0 con 0x7f4d7415bed0 2023-10-16T19:57:38.519 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.510+0000 7f4d7159a700 1 -- 172.21.15.157:0/4086863086 <== mon.0 v1:172.21.15.157:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4021145519 0 0) 0x7f4d68001670 con 0x7f4d7415bed0 2023-10-16T19:57:38.519 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.510+0000 7f4d7159a700 1 -- 172.21.15.157:0/4086863086 >> v1:172.21.15.157:6789/0 conn(0x7f4d7415bed0 legacy=0x7f4d740b36b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:38.520 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.510+0000 7f4d7159a700 1 --2- 172.21.15.157:0/4086863086 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4d5c003a30 0x7f4d5c003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:38.520 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.510+0000 7f4d7159a700 1 --2- 172.21.15.157:0/4086863086 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4d5c004850 0x7f4d5c004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:38.521 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.510+0000 7f4d7159a700 1 --2- 172.21.15.157:0/4086863086 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4d740d1610 0x7f4d5c005250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:38.521 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.510+0000 7f4d7159a700 1 -- 172.21.15.157:0/4086863086 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d7415fcc0 con 0x7f4d5c004850 2023-10-16T19:57:38.521 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.510+0000 7f4d7159a700 1 -- 172.21.15.157:0/4086863086 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d5c00ff80 con 0x7f4d5c003a30 2023-10-16T19:57:38.522 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.510+0000 7f4d7159a700 1 -- 172.21.15.157:0/4086863086 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d5c010140 con 0x7f4d740d1610 2023-10-16T19:57:38.522 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.510+0000 7f4d71d9b700 1 --2- 172.21.15.157:0/4086863086 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4d5c004850 0x7f4d5c004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:38.523 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.510+0000 7f4d7259c700 1 --2- 172.21.15.157:0/4086863086 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4d5c003a30 0x7f4d5c003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:38.523 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.510+0000 7f4d72d9d700 1 --2- 172.21.15.157:0/4086863086 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4d740d1610 0x7f4d5c005250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:38.523 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.510+0000 7f4d71d9b700 1 -- 172.21.15.157:0/4086863086 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4d740d1610 msgr2=0x7f4d5c005250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:57:38.524 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.510+0000 7f4d71d9b700 1 --2- 172.21.15.157:0/4086863086 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4d740d1610 0x7f4d5c005250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:38.524 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.510+0000 7f4d71d9b700 1 -- 172.21.15.157:0/4086863086 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4d5c003a30 msgr2=0x7f4d5c003e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:57:38.524 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.510+0000 7f4d71d9b700 1 --2- 172.21.15.157:0/4086863086 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4d5c003a30 0x7f4d5c003e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:38.525 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.510+0000 7f4d71d9b700 1 -- 172.21.15.157:0/4086863086 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d5c0035b0 con 0x7f4d5c004850 2023-10-16T19:57:38.525 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.510+0000 7f4d71d9b700 1 --2- 172.21.15.157:0/4086863086 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4d5c004850 0x7f4d5c004cd0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f4d64001800 tx=0x7f4d5c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcf671413b341074 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:38.525 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.511+0000 7f4d7159a700 1 -- 172.21.15.157:0/4086863086 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d640012f0 con 0x7f4d5c004850 2023-10-16T19:57:38.526 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.511+0000 7f4d7159a700 1 -- 172.21.15.157:0/4086863086 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d640052f0 con 0x7f4d5c004850 2023-10-16T19:57:38.526 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.511+0000 7f4d7159a700 1 -- 172.21.15.157:0/4086863086 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d64006860 con 0x7f4d5c004850 2023-10-16T19:57:38.526 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.511+0000 7f4d78893700 1 -- 172.21.15.157:0/4086863086 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4d5c004850 msgr2=0x7f4d5c004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:38.527 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.511+0000 7f4d78893700 1 --2- 172.21.15.157:0/4086863086 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4d5c004850 0x7f4d5c004cd0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f4d64001800 tx=0x7f4d5c005880 comp rx=0 tx=0).stop 2023-10-16T19:57:38.527 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.511+0000 7f4d72d9d700 1 -- 172.21.15.157:0/4086863086 reap_dead start 2023-10-16T19:57:38.528 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.511+0000 7f4d78893700 1 -- 172.21.15.157:0/4086863086 shutdown_connections 2023-10-16T19:57:38.528 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.511+0000 7f4d78893700 1 -- 172.21.15.157:0/4086863086 >> 172.21.15.157:0/4086863086 conn(0x7f4d740ce6b0 msgr2=0x7f4d740ceac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:38.528 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.511+0000 7f4d78893700 1 -- 172.21.15.157:0/4086863086 shutdown_connections 2023-10-16T19:57:38.529 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.511+0000 7f4d78893700 1 -- 172.21.15.157:0/4086863086 wait complete. 2023-10-16T19:57:38.529 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.512+0000 7f4d78893700 1 Processor -- start 2023-10-16T19:57:38.529 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.513+0000 7f4d78893700 1 -- start start 2023-10-16T19:57:38.532 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.513+0000 7f4d78893700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4d5c004850 0x7f4d74152310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:38.532 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.513+0000 7f4d78893700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4d74153f80 0x7f4d7414e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:38.532 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.513+0000 7f4d78893700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4d7415e7d0 0x7f4d7415ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:38.532 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.513+0000 7f4d78893700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d7415f190 con 0x7f4d74153f80 2023-10-16T19:57:38.533 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.513+0000 7f4d78893700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d741535b0 con 0x7f4d5c004850 2023-10-16T19:57:38.533 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.513+0000 7f4d78893700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d741529a0 con 0x7f4d7415e7d0 2023-10-16T19:57:38.533 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.513+0000 7f4d71d9b700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4d74153f80 0x7f4d7414e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:38.533 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.513+0000 7f4d71d9b700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4d74153f80 0x7f4d7414e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:46640/0 (socket says 172.21.15.157:46640) 2023-10-16T19:57:38.533 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.513+0000 7f4d71d9b700 1 -- 172.21.15.157:0/3381815457 learned_addr learned my addr 172.21.15.157:0/3381815457 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:57:38.533 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.514+0000 7f4d71d9b700 1 -- 172.21.15.157:0/3381815457 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4d7415e7d0 msgr2=0x7f4d7415ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:38.534 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.514+0000 7f4d71d9b700 1 --2- 172.21.15.157:0/3381815457 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4d7415e7d0 0x7f4d7415ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:38.534 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.514+0000 7f4d71d9b700 1 -- 172.21.15.157:0/3381815457 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4d5c004850 msgr2=0x7f4d74152310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:38.535 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.514+0000 7f4d71d9b700 1 --2- 172.21.15.157:0/3381815457 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4d5c004850 0x7f4d74152310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:38.535 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.514+0000 7f4d71d9b700 1 -- 172.21.15.157:0/3381815457 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d74152c80 con 0x7f4d74153f80 2023-10-16T19:57:38.535 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.514+0000 7f4d71d9b700 1 --2- 172.21.15.157:0/3381815457 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4d74153f80 0x7f4d7414e000 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f4d64001df0 tx=0x7f4d64001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:38.536 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.514+0000 7f4d62ffd700 1 -- 172.21.15.157:0/3381815457 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d64006d70 con 0x7f4d74153f80 2023-10-16T19:57:38.536 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.514+0000 7f4d62ffd700 1 -- 172.21.15.157:0/3381815457 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d64007020 con 0x7f4d74153f80 2023-10-16T19:57:38.536 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.514+0000 7f4d78893700 1 -- 172.21.15.157:0/3381815457 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d74152f60 con 0x7f4d74153f80 2023-10-16T19:57:38.536 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.514+0000 7f4d62ffd700 1 -- 172.21.15.157:0/3381815457 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d640073b0 con 0x7f4d74153f80 2023-10-16T19:57:38.537 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.514+0000 7f4d78893700 1 -- 172.21.15.157:0/3381815457 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d7414e540 con 0x7f4d74153f80 2023-10-16T19:57:38.537 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.515+0000 7f4d78893700 1 -- 172.21.15.157:0/3381815457 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d7406b300 con 0x7f4d74153f80 2023-10-16T19:57:38.538 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.515+0000 7f4d62ffd700 1 -- 172.21.15.157:0/3381815457 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f4d64007510 con 0x7f4d74153f80 2023-10-16T19:57:38.538 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.516+0000 7f4d62ffd700 1 --2- 172.21.15.157:0/3381815457 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f4d5406af00 0x7f4d5406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:38.538 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.516+0000 7f4d62ffd700 1 -- 172.21.15.157:0/3381815457 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4d6408a8b0 con 0x7f4d74153f80 2023-10-16T19:57:38.539 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.516+0000 7f4d7259c700 1 --2- 172.21.15.157:0/3381815457 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f4d5406af00 0x7f4d5406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:38.539 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.516+0000 7f4d7259c700 1 --2- 172.21.15.157:0/3381815457 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f4d5406af00 0x7f4d5406d3c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f4d680011e0 tx=0x7f4d68001170 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:38.539 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.520+0000 7f4d62ffd700 1 -- 172.21.15.157:0/3381815457 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4d640559f0 con 0x7f4d74153f80 2023-10-16T19:57:38.710 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.707+0000 7f4d78893700 1 -- 172.21.15.157:0/3381815457 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4d741536f0 con 0x7f4d74153f80 2023-10-16T19:57:38.710 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.708+0000 7f4d62ffd700 1 -- 172.21.15.157:0/3381815457 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4d741536f0 con 0x7f4d74153f80 2023-10-16T19:57:38.711 INFO:teuthology.orchestra.run.smithi157.stdout:pg_num: 64 2023-10-16T19:57:38.713 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.710+0000 7f4d78893700 1 -- 172.21.15.157:0/3381815457 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f4d5406af00 msgr2=0x7f4d5406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:38.713 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.710+0000 7f4d78893700 1 --2- 172.21.15.157:0/3381815457 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f4d5406af00 0x7f4d5406d3c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f4d680011e0 tx=0x7f4d68001170 comp rx=0 tx=0).stop 2023-10-16T19:57:38.713 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.710+0000 7f4d78893700 1 -- 172.21.15.157:0/3381815457 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4d74153f80 msgr2=0x7f4d7414e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:38.713 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.710+0000 7f4d78893700 1 --2- 172.21.15.157:0/3381815457 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4d74153f80 0x7f4d7414e000 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f4d64001df0 tx=0x7f4d64001120 comp rx=0 tx=0).stop 2023-10-16T19:57:38.713 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.710+0000 7f4d78893700 1 -- 172.21.15.157:0/3381815457 shutdown_connections 2023-10-16T19:57:38.714 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.710+0000 7f4d78893700 1 --2- 172.21.15.157:0/3381815457 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f4d5406af00 0x7f4d5406d3c0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:38.714 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.710+0000 7f4d78893700 1 --2- 172.21.15.157:0/3381815457 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4d5c004850 0x7f4d74152310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:38.714 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.710+0000 7f4d78893700 1 --2- 172.21.15.157:0/3381815457 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4d7415e7d0 0x7f4d7415ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:38.714 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.710+0000 7f4d78893700 1 --2- 172.21.15.157:0/3381815457 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4d74153f80 0x7f4d7414e000 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:38.714 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.710+0000 7f4d78893700 1 -- 172.21.15.157:0/3381815457 >> 172.21.15.157:0/3381815457 conn(0x7f4d740ce6b0 msgr2=0x7f4d740d1a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:38.715 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.710+0000 7f4d78893700 1 -- 172.21.15.157:0/3381815457 shutdown_connections 2023-10-16T19:57:38.715 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.710+0000 7f4d78893700 1 -- 172.21.15.157:0/3381815457 wait complete. 2023-10-16T19:57:38.725 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T19:57:38.846 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.843+0000 7f7c81ecb700 1 Processor -- start 2023-10-16T19:57:38.846 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.843+0000 7f7c81ecb700 1 -- start start 2023-10-16T19:57:38.849 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.844+0000 7f7c81ecb700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f7c7c0af710 0x7f7c7c0cdd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:38.849 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.844+0000 7f7c81ecb700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7c7c15f100 0x7f7c7c06c670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:38.849 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.844+0000 7f7c81ecb700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f7c7c06cbb0 0x7f7c7c0ad860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:38.850 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.844+0000 7f7c81ecb700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c7c06d040 con 0x7f7c7c06cbb0 2023-10-16T19:57:38.850 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.844+0000 7f7c81ecb700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c7c162640 con 0x7f7c7c0af710 2023-10-16T19:57:38.850 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.844+0000 7f7c81ecb700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c7c0afaf0 con 0x7f7c7c15f100 2023-10-16T19:57:38.850 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.844+0000 7f7c7bfff700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f7c7c06cbb0 0x7f7c7c0ad860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:38.850 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.844+0000 7f7c7bfff700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f7c7c06cbb0 0x7f7c7c0ad860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:46652/0 (socket says 172.21.15.157:46652) 2023-10-16T19:57:38.851 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.844+0000 7f7c7bfff700 1 -- 172.21.15.157:0/3585654951 learned_addr learned my addr 172.21.15.157:0/3585654951 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:57:38.851 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.844+0000 7f7c7affd700 1 --2- 172.21.15.157:0/3585654951 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7c7c15f100 0x7f7c7c06c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:38.851 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.844+0000 7f7c7b7fe700 1 --2- 172.21.15.157:0/3585654951 >> v2:172.21.15.187:3300/0 conn(0x7f7c7c0af710 0x7f7c7c0cdd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:38.851 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.845+0000 7f7c7bfff700 1 -- 172.21.15.157:0/3585654951 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7c7c15f100 msgr2=0x7f7c7c06c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:57:38.851 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.845+0000 7f7c7bfff700 1 --2- 172.21.15.157:0/3585654951 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7c7c15f100 0x7f7c7c06c670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:38.852 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.845+0000 7f7c7bfff700 1 -- 172.21.15.157:0/3585654951 >> v2:172.21.15.187:3300/0 conn(0x7f7c7c0af710 msgr2=0x7f7c7c0cdd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:57:38.852 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.845+0000 7f7c7bfff700 1 --2- 172.21.15.157:0/3585654951 >> v2:172.21.15.187:3300/0 conn(0x7f7c7c0af710 0x7f7c7c0cdd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:38.852 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.845+0000 7f7c7bfff700 1 -- 172.21.15.157:0/3585654951 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c7c161a30 con 0x7f7c7c06cbb0 2023-10-16T19:57:38.852 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.845+0000 7f7c7bfff700 1 --2- 172.21.15.157:0/3585654951 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7c7c06cbb0 0x7f7c7c0ad860 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f7c7c0b2e40 tx=0x7f7c7400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=137f281634456fa8 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:38.852 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.845+0000 7f7c7a7fc700 1 -- 172.21.15.157:0/3585654951 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c7400e070 con 0x7f7c7c06cbb0 2023-10-16T19:57:38.853 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.845+0000 7f7c7a7fc700 1 -- 172.21.15.157:0/3585654951 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c7400b9c0 con 0x7f7c7c06cbb0 2023-10-16T19:57:38.853 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.845+0000 7f7c7a7fc700 1 -- 172.21.15.157:0/3585654951 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c7400bd70 con 0x7f7c7c06cbb0 2023-10-16T19:57:38.853 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.845+0000 7f7c81ecb700 1 -- 172.21.15.157:0/3585654951 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7c7c06cbb0 msgr2=0x7f7c7c0ad860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:38.853 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.845+0000 7f7c81ecb700 1 --2- 172.21.15.157:0/3585654951 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7c7c06cbb0 0x7f7c7c0ad860 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f7c7c0b2e40 tx=0x7f7c7400b330 comp rx=0 tx=0).stop 2023-10-16T19:57:38.853 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.845+0000 7f7c81ecb700 1 -- 172.21.15.157:0/3585654951 shutdown_connections 2023-10-16T19:57:38.854 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.845+0000 7f7c81ecb700 1 --2- 172.21.15.157:0/3585654951 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7c7c06cbb0 0x7f7c7c0ad860 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:38.854 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.845+0000 7f7c81ecb700 1 --2- 172.21.15.157:0/3585654951 >> v2:172.21.15.187:3300/0 conn(0x7f7c7c0af710 0x7f7c7c0cdd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:38.854 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.845+0000 7f7c81ecb700 1 --2- 172.21.15.157:0/3585654951 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7c7c15f100 0x7f7c7c06c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:38.854 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.845+0000 7f7c81ecb700 1 -- 172.21.15.157:0/3585654951 >> 172.21.15.157:0/3585654951 conn(0x7f7c7c0cceb0 msgr2=0x7f7c7c0cd290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:38.854 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.846+0000 7f7c81ecb700 1 -- 172.21.15.157:0/3585654951 shutdown_connections 2023-10-16T19:57:38.855 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.846+0000 7f7c81ecb700 1 -- 172.21.15.157:0/3585654951 wait complete. 2023-10-16T19:57:38.855 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.847+0000 7f7c81ecb700 1 Processor -- start 2023-10-16T19:57:38.855 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.847+0000 7f7c81ecb700 1 -- start start 2023-10-16T19:57:38.858 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.848+0000 7f7c81ecb700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7c7c06cbb0 0x7f7c7c1f0d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:38.858 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.848+0000 7f7c81ecb700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7c7c0af710 0x7f7c7c1f7810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:38.858 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.848+0000 7f7c81ecb700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7c7c15f100 0x7f7c7c15d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:38.858 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.848+0000 7f7c81ecb700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c7c1f7d50 con 0x7f7c7c06cbb0 2023-10-16T19:57:38.858 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.848+0000 7f7c81ecb700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c7c1f3d60 con 0x7f7c7c15f100 2023-10-16T19:57:38.859 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.848+0000 7f7c81ecb700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c7c1f4040 con 0x7f7c7c0af710 2023-10-16T19:57:38.859 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.848+0000 7f7c7b7fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7c7c06cbb0 0x7f7c7c1f0d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:38.859 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.848+0000 7f7c7b7fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7c7c06cbb0 0x7f7c7c1f0d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:46654/0 (socket says 172.21.15.157:46654) 2023-10-16T19:57:38.859 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.848+0000 7f7c7b7fe700 1 -- 172.21.15.157:0/3285384298 learned_addr learned my addr 172.21.15.157:0/3285384298 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:57:38.860 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.848+0000 7f7c7affd700 1 --2- 172.21.15.157:0/3285384298 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7c7c0af710 0x7f7c7c1f7810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:38.860 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.848+0000 7f7c7bfff700 1 --2- 172.21.15.157:0/3285384298 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7c7c15f100 0x7f7c7c15d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:38.860 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.848+0000 7f7c7b7fe700 1 -- 172.21.15.157:0/3285384298 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7c7c0af710 msgr2=0x7f7c7c1f7810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:38.860 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.848+0000 7f7c7b7fe700 1 --2- 172.21.15.157:0/3285384298 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7c7c0af710 0x7f7c7c1f7810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:38.861 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.848+0000 7f7c7b7fe700 1 -- 172.21.15.157:0/3285384298 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7c7c15f100 msgr2=0x7f7c7c15d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:38.861 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.848+0000 7f7c7b7fe700 1 --2- 172.21.15.157:0/3285384298 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7c7c15f100 0x7f7c7c15d2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:38.861 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.848+0000 7f7c7b7fe700 1 -- 172.21.15.157:0/3285384298 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c74009b30 con 0x7f7c7c06cbb0 2023-10-16T19:57:38.861 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.848+0000 7f7c7bfff700 1 --2- 172.21.15.157:0/3285384298 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7c7c15f100 0x7f7c7c15d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T19:57:38.861 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.848+0000 7f7c7affd700 1 --2- 172.21.15.157:0/3285384298 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7c7c0af710 0x7f7c7c1f7810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T19:57:38.862 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.848+0000 7f7c7b7fe700 1 --2- 172.21.15.157:0/3285384298 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7c7c06cbb0 0x7f7c7c1f0d30 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f7c7000e810 tx=0x7f7c7000ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:38.862 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.848+0000 7f7c63fff700 1 -- 172.21.15.157:0/3285384298 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c70013610 con 0x7f7c7c06cbb0 2023-10-16T19:57:38.862 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.848+0000 7f7c63fff700 1 -- 172.21.15.157:0/3285384298 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c70013770 con 0x7f7c7c06cbb0 2023-10-16T19:57:38.862 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.848+0000 7f7c63fff700 1 -- 172.21.15.157:0/3285384298 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c70013b00 con 0x7f7c7c06cbb0 2023-10-16T19:57:38.862 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.848+0000 7f7c81ecb700 1 -- 172.21.15.157:0/3285384298 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c7c1f4320 con 0x7f7c7c06cbb0 2023-10-16T19:57:38.863 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.848+0000 7f7c81ecb700 1 -- 172.21.15.157:0/3285384298 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c7c1f48e0 con 0x7f7c7c06cbb0 2023-10-16T19:57:38.863 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.849+0000 7f7c81ecb700 1 -- 172.21.15.157:0/3285384298 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c7c1f4c70 con 0x7f7c7c06cbb0 2023-10-16T19:57:38.863 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.850+0000 7f7c63fff700 1 -- 172.21.15.157:0/3285384298 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f7c70013c60 con 0x7f7c7c06cbb0 2023-10-16T19:57:38.863 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.850+0000 7f7c63fff700 1 --2- 172.21.15.157:0/3285384298 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f7c6806af00 0x7f7c6806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:38.863 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.850+0000 7f7c63fff700 1 -- 172.21.15.157:0/3285384298 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7c70089240 con 0x7f7c7c06cbb0 2023-10-16T19:57:38.864 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.850+0000 7f7c7affd700 1 --2- 172.21.15.157:0/3285384298 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f7c6806af00 0x7f7c6806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:38.864 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.851+0000 7f7c7affd700 1 --2- 172.21.15.157:0/3285384298 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f7c6806af00 0x7f7c6806d3c0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f7c7c0b05b0 tx=0x7f7c6c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:38.864 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:38.855+0000 7f7c63fff700 1 -- 172.21.15.157:0/3285384298 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7c700542f0 con 0x7f7c7c06cbb0 2023-10-16T19:57:39.052 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.050+0000 7f7c81ecb700 1 -- 172.21.15.157:0/3285384298 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7c7c04f400 con 0x7f7c7c06cbb0 2023-10-16T19:57:39.054 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.051+0000 7f7c63fff700 1 -- 172.21.15.157:0/3285384298 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16517 (secure 0 0 0) 0x7f7c70009440 con 0x7f7c7c06cbb0 2023-10-16T19:57:39.054 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-10-16T19:57:39.054 INFO:teuthology.orchestra.run.smithi157.stdout:{"epoch":21,"fsid":"28199dc9-64d5-479e-83c6-21f097c33d39","created":"2023-10-16T19:56:49.201889+0000","modified":"2023-10-16T19:57:07.988567+0000","last_up_change":"2023-10-16T19:56:54.675673+0000","last_in_change":"2023-10-16T19:56:51.666728+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T19:56:56.932895+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-16T19:57:04.936105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-16T19:57:05.335279+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":335785898},{"type":"v1","addr":"172.21.15.157:6809","nonce":335785898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":335785898},{"type":"v1","addr":"172.21.15.157:6811","nonce":335785898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6815","nonce":335785898},{"type":"v1","addr":"172.21.15.157:6817","nonce":335785898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":335785898},{"type":"v1","addr":"172.21.15.157:6813","nonce":335785898}]},"public_addr":"172.21.15.157:6809/335785898","cluster_addr":"172.21.15.157:6811/335785898","heartbeat_back_addr":"172.21.15.157:6817/335785898","heartbeat_front_addr":"172.21.15.157:6813/335785898","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":3482825047},{"type":"v1","addr":"172.21.15.157:6801","nonce":3482825047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":3482825047},{"type":"v1","addr":"172.21.15.157:6803","nonce":3482825047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":3482825047},{"type":"v1","addr":"172.21.15.157:6807","nonce":3482825047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":3482825047},{"type":"v1","addr":"172.21.15.157:6805","nonce":3482825047}]},"public_addr":"172.21.15.157:6801/3482825047","cluster_addr":"172.21.15.157:6803/3482825047","heartbeat_back_addr":"172.21.15.157:6807/3482825047","heartbeat_front_addr":"172.21.15.157:6805/3482825047","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":1118292389},{"type":"v1","addr":"172.21.15.157:6825","nonce":1118292389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":1118292389},{"type":"v1","addr":"172.21.15.157:6827","nonce":1118292389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":1118292389},{"type":"v1","addr":"172.21.15.157:6831","nonce":1118292389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":1118292389},{"type":"v1","addr":"172.21.15.157:6829","nonce":1118292389}]},"public_addr":"172.21.15.157:6825/1118292389","cluster_addr":"172.21.15.157:6827/1118292389","heartbeat_back_addr":"172.21.15.157:6831/1118292389","heartbeat_front_addr":"172.21.15.157:6829/1118292389","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":989329821},{"type":"v1","addr":"172.21.15.157:6816","nonce":989329821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":989329821},{"type":"v1","addr":"172.21.15.157:6819","nonce":989329821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":989329821},{"type":"v1","addr":"172.21.15.157:6823","nonce":989329821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":989329821},{"type":"v1","addr":"172.21.15.157:6821","nonce":989329821}]},"public_addr":"172.21.15.157:6816/989329821","cluster_addr":"172.21.15.157:6819/989329821","heartbeat_back_addr":"172.21.15.157:6823/989329821","heartbeat_front_addr":"172.21.15.157:6821/989329821","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":3841016811},{"type":"v1","addr":"172.21.15.187:6801","nonce":3841016811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6803","nonce":3841016811},{"type":"v1","addr":"172.21.15.187:6804","nonce":3841016811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6809","nonce":3841016811},{"type":"v1","addr":"172.21.15.187:6811","nonce":3841016811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":3841016811},{"type":"v1","addr":"172.21.15.187:6808","nonce":3841016811}]},"public_addr":"172.21.15.187:6801/3841016811","cluster_addr":"172.21.15.187:6804/3841016811","heartbeat_back_addr":"172.21.15.187:6811/3841016811","heartbeat_front_addr":"172.21.15.187:6808/3841016811","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":915130263},{"type":"v1","addr":"172.21.15.187:6805","nonce":915130263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6807","nonce":915130263},{"type":"v1","addr":"172.21.15.187:6810","nonce":915130263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":915130263},{"type":"v1","addr":"172.21.15.187:6815","nonce":915130263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":915130263},{"type":"v1","addr":"172.21.15.187:6813","nonce":915130263}]},"public_addr":"172.21.15.187:6805/915130263","cluster_addr":"172.21.15.187:6810/915130263","heartbeat_back_addr":"172.21.15.187:6815/915130263","heartbeat_front_addr":"172.21.15.187:6813/915130263","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":654976824},{"type":"v1","addr":"172.21.15.187:6817","nonce":654976824}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":654976824},{"type":"v1","addr":"172.21.15.187:6819","nonce":654976824}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":654976824},{"type":"v1","addr":"172.21.15.187:6823","nonce":654976824}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":654976824},{"type":"v1","addr":"172.21.15.187:6821","nonce":654976824}]},"public_addr":"172.21.15.187:6817/654976824","cluster_addr":"172.21.15.187:6819/654976824","heartbeat_back_addr":"172.21.15.187:6823/654976824","heartbeat_front_addr":"172.21.15.187:6821/654976824","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":4284059445},{"type":"v1","addr":"172.21.15.187:6825","nonce":4284059445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":4284059445},{"type":"v1","addr":"172.21.15.187:6827","nonce":4284059445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":4284059445},{"type":"v1","addr":"172.21.15.187:6831","nonce":4284059445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":4284059445},{"type":"v1","addr":"172.21.15.187:6829","nonce":4284059445}]},"public_addr":"172.21.15.187:6825/4284059445","cluster_addr":"172.21.15.187:6827/4284059445","heartbeat_back_addr":"172.21.15.187:6831/4284059445","heartbeat_front_addr":"172.21.15.187:6829/4284059445","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.819780+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.824193+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.849575+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.824806+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.809540+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.805093+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.866109+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.807372+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T19:57:39.056 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.054+0000 7f7c81ecb700 1 -- 172.21.15.157:0/3285384298 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f7c6806af00 msgr2=0x7f7c6806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:39.057 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.054+0000 7f7c81ecb700 1 --2- 172.21.15.157:0/3285384298 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f7c6806af00 0x7f7c6806d3c0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f7c7c0b05b0 tx=0x7f7c6c008040 comp rx=0 tx=0).stop 2023-10-16T19:57:39.057 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.054+0000 7f7c81ecb700 1 -- 172.21.15.157:0/3285384298 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7c7c06cbb0 msgr2=0x7f7c7c1f0d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:39.057 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.054+0000 7f7c81ecb700 1 --2- 172.21.15.157:0/3285384298 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7c7c06cbb0 0x7f7c7c1f0d30 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f7c7000e810 tx=0x7f7c7000ebd0 comp rx=0 tx=0).stop 2023-10-16T19:57:39.058 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.054+0000 7f7c81ecb700 1 -- 172.21.15.157:0/3285384298 shutdown_connections 2023-10-16T19:57:39.058 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.054+0000 7f7c81ecb700 1 --2- 172.21.15.157:0/3285384298 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f7c6806af00 0x7f7c6806d3c0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:39.058 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.054+0000 7f7c81ecb700 1 --2- 172.21.15.157:0/3285384298 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7c7c15f100 0x7f7c7c15d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:39.058 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.054+0000 7f7c81ecb700 1 --2- 172.21.15.157:0/3285384298 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7c7c06cbb0 0x7f7c7c1f0d30 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:39.059 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.054+0000 7f7c81ecb700 1 --2- 172.21.15.157:0/3285384298 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7c7c0af710 0x7f7c7c1f7810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:39.059 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.054+0000 7f7c81ecb700 1 -- 172.21.15.157:0/3285384298 >> 172.21.15.157:0/3285384298 conn(0x7f7c7c0cceb0 msgr2=0x7f7c7c15e220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:39.059 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.054+0000 7f7c81ecb700 1 -- 172.21.15.157:0/3285384298 shutdown_connections 2023-10-16T19:57:39.059 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.054+0000 7f7c81ecb700 1 -- 172.21.15.157:0/3285384298 wait complete. 2023-10-16T19:57:39.069 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-16T19:56:56.932895+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-16T19:57:04.936105+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-16T19:57:05.335279+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-16T19:57:39.069 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-16T19:57:39.194 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.192+0000 7f1e16d19700 1 Processor -- start 2023-10-16T19:57:39.195 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.192+0000 7f1e16d19700 1 -- start start 2023-10-16T19:57:39.198 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.193+0000 7f1e16d19700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1e10161ab0 0x7f1e1006b260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:39.199 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.193+0000 7f1e16d19700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e100cf8c0 con 0x7f1e100aee10 2023-10-16T19:57:39.199 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.193+0000 7f1e16d19700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e100ce440 con 0x7f1e100ae870 2023-10-16T19:57:39.199 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.193+0000 7f1e16d19700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e1015e300 con 0x7f1e10161ab0 2023-10-16T19:57:39.199 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.193+0000 7f1e0ffff700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f1e100aee10 0x7f1e10161e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:56334/0 (socket says 172.21.15.157:56334) 2023-10-16T19:57:39.199 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.193+0000 7f1e0ffff700 1 -- 172.21.15.157:0/1718050249 learned_addr learned my addr 172.21.15.157:0/1718050249 (peer_addr_for_me v1:172.21.15.157:0/0) 2023-10-16T19:57:39.200 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.193+0000 7f1e14ab5700 1 --2- 172.21.15.157:0/1718050249 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1e10161ab0 0x7f1e1006b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:39.200 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.193+0000 7f1e0f7fe700 1 -- 172.21.15.157:0/1718050249 <== mon.0 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 219659552 0 0) 0x7f1e100cf8c0 con 0x7f1e100aee10 2023-10-16T19:57:39.200 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.193+0000 7f1e0f7fe700 1 -- 172.21.15.157:0/1718050249 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1e000035b0 con 0x7f1e100aee10 2023-10-16T19:57:39.201 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.193+0000 7f1e0f7fe700 1 -- 172.21.15.157:0/1718050249 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2088571478 0 0) 0x7f1e100ce440 con 0x7f1e100ae870 2023-10-16T19:57:39.201 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.193+0000 7f1e0f7fe700 1 -- 172.21.15.157:0/1718050249 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1e100cf8c0 con 0x7f1e100ae870 2023-10-16T19:57:39.201 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.193+0000 7f1e0f7fe700 1 -- 172.21.15.157:0/1718050249 <== mon.0 v1:172.21.15.157:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3686730722 0 0) 0x7f1e000035b0 con 0x7f1e100aee10 2023-10-16T19:57:39.201 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.193+0000 7f1e0f7fe700 1 -- 172.21.15.157:0/1718050249 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1e10161ab0 msgr2=0x7f1e1006b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:57:39.201 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.193+0000 7f1e0f7fe700 1 --2- 172.21.15.157:0/1718050249 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1e10161ab0 0x7f1e1006b260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:39.202 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.193+0000 7f1e0f7fe700 1 -- 172.21.15.157:0/1718050249 >> v1:172.21.15.187:6789/0 conn(0x7f1e100ae870 legacy=0x7f1e100af360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:39.202 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.193+0000 7f1e0f7fe700 1 -- 172.21.15.157:0/1718050249 --> v1:172.21.15.157:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e101628c0 con 0x7f1e100aee10 2023-10-16T19:57:39.202 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.193+0000 7f1e0f7fe700 1 -- 172.21.15.157:0/1718050249 <== mon.0 v1:172.21.15.157:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4021145519 0 0) 0x7f1dfc001670 con 0x7f1e100aee10 2023-10-16T19:57:39.202 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.193+0000 7f1e0f7fe700 1 -- 172.21.15.157:0/1718050249 >> v1:172.21.15.157:6789/0 conn(0x7f1e100aee10 legacy=0x7f1e10161e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:39.202 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.194+0000 7f1e0f7fe700 1 --2- 172.21.15.157:0/1718050249 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1e10161ab0 0x7f1e00003bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:39.203 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.194+0000 7f1e0f7fe700 1 --2- 172.21.15.157:0/1718050249 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1e00004120 0x7f1e00004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:39.203 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.194+0000 7f1e0f7fe700 1 --2- 172.21.15.157:0/1718050249 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1e00004d90 0x7f1e00005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:39.203 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.194+0000 7f1e0f7fe700 1 -- 172.21.15.157:0/1718050249 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e1015e300 con 0x7f1e00004120 2023-10-16T19:57:39.203 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.194+0000 7f1e0f7fe700 1 -- 172.21.15.157:0/1718050249 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e0000baf0 con 0x7f1e00004d90 2023-10-16T19:57:39.204 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.194+0000 7f1e0f7fe700 1 -- 172.21.15.157:0/1718050249 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e0000bcb0 con 0x7f1e10161ab0 2023-10-16T19:57:39.204 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.194+0000 7f1e0ffff700 1 --2- 172.21.15.157:0/1718050249 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1e00004120 0x7f1e00004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:39.204 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.194+0000 7f1e14ab5700 1 --2- 172.21.15.157:0/1718050249 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1e10161ab0 0x7f1e00003bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:39.204 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.194+0000 7f1e152b6700 1 --2- 172.21.15.157:0/1718050249 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1e00004d90 0x7f1e00005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:39.204 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.194+0000 7f1e0ffff700 1 -- 172.21.15.157:0/1718050249 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1e10161ab0 msgr2=0x7f1e00003bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:57:39.205 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.194+0000 7f1e0ffff700 1 --2- 172.21.15.157:0/1718050249 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1e10161ab0 0x7f1e00003bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:39.205 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.194+0000 7f1e0ffff700 1 -- 172.21.15.157:0/1718050249 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1e00004d90 msgr2=0x7f1e00005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:57:39.205 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.194+0000 7f1e0ffff700 1 --2- 172.21.15.157:0/1718050249 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1e00004d90 0x7f1e00005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:39.205 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.194+0000 7f1e0ffff700 1 -- 172.21.15.157:0/1718050249 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e000035b0 con 0x7f1e00004120 2023-10-16T19:57:39.206 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.194+0000 7f1e0ffff700 1 --2- 172.21.15.157:0/1718050249 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1e00004120 0x7f1e00004850 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f1dfc00c210 tx=0x7f1e00005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a03462eb1dec01c server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:39.206 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.194+0000 7f1e0f7fe700 1 -- 172.21.15.157:0/1718050249 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dfc00cd50 con 0x7f1e00004120 2023-10-16T19:57:39.206 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.194+0000 7f1e0f7fe700 1 -- 172.21.15.157:0/1718050249 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dfc001af0 con 0x7f1e00004120 2023-10-16T19:57:39.206 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.194+0000 7f1e0f7fe700 1 -- 172.21.15.157:0/1718050249 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dfc005ba0 con 0x7f1e00004120 2023-10-16T19:57:39.206 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.195+0000 7f1e16d19700 1 -- 172.21.15.157:0/1718050249 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1e00004120 msgr2=0x7f1e00004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:39.207 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.195+0000 7f1e16d19700 1 --2- 172.21.15.157:0/1718050249 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1e00004120 0x7f1e00004850 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f1dfc00c210 tx=0x7f1e00005880 comp rx=0 tx=0).stop 2023-10-16T19:57:39.207 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.195+0000 7f1e152b6700 1 -- 172.21.15.157:0/1718050249 reap_dead start 2023-10-16T19:57:39.207 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.195+0000 7f1e16d19700 1 -- 172.21.15.157:0/1718050249 shutdown_connections 2023-10-16T19:57:39.207 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.195+0000 7f1e16d19700 1 -- 172.21.15.157:0/1718050249 >> 172.21.15.157:0/1718050249 conn(0x7f1e1006c7e0 msgr2=0x7f1e1006cbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:39.207 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.195+0000 7f1e16d19700 1 -- 172.21.15.157:0/1718050249 shutdown_connections 2023-10-16T19:57:39.208 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.195+0000 7f1e16d19700 1 -- 172.21.15.157:0/1718050249 wait complete. 2023-10-16T19:57:39.208 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.196+0000 7f1e16d19700 1 Processor -- start 2023-10-16T19:57:39.208 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.196+0000 7f1e16d19700 1 -- start start 2023-10-16T19:57:39.211 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.197+0000 7f1e16d19700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1e00004120 0x7f1e101f33b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:39.211 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.197+0000 7f1e16d19700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1e100c6ac0 0x7f1e1015e440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:39.212 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.197+0000 7f1e16d19700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1e100b0860 0x7f1e100b0d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:39.212 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.197+0000 7f1e16d19700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e100b1250 con 0x7f1e100c6ac0 2023-10-16T19:57:39.212 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.197+0000 7f1e16d19700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e1014f210 con 0x7f1e100b0860 2023-10-16T19:57:39.212 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.197+0000 7f1e16d19700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e1015ed90 con 0x7f1e00004120 2023-10-16T19:57:39.213 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.197+0000 7f1e0ffff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1e100c6ac0 0x7f1e1015e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:39.213 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.197+0000 7f1e0ffff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1e100c6ac0 0x7f1e1015e440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:46676/0 (socket says 172.21.15.157:46676) 2023-10-16T19:57:39.213 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.197+0000 7f1e0ffff700 1 -- 172.21.15.157:0/830751569 learned_addr learned my addr 172.21.15.157:0/830751569 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:57:39.213 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.197+0000 7f1e14ab5700 1 --2- 172.21.15.157:0/830751569 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1e00004120 0x7f1e101f33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:39.213 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.197+0000 7f1e152b6700 1 --2- 172.21.15.157:0/830751569 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1e100b0860 0x7f1e100b0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:39.213 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.197+0000 7f1e0ffff700 1 -- 172.21.15.157:0/830751569 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1e00004120 msgr2=0x7f1e101f33b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:39.214 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.197+0000 7f1e0ffff700 1 --2- 172.21.15.157:0/830751569 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1e00004120 0x7f1e101f33b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:39.214 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.197+0000 7f1e0ffff700 1 -- 172.21.15.157:0/830751569 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1e100b0860 msgr2=0x7f1e100b0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:39.214 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.197+0000 7f1e0ffff700 1 --2- 172.21.15.157:0/830751569 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1e100b0860 0x7f1e100b0d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:39.214 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.197+0000 7f1e0ffff700 1 -- 172.21.15.157:0/830751569 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e1015f070 con 0x7f1e100c6ac0 2023-10-16T19:57:39.215 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.197+0000 7f1e0ffff700 1 --2- 172.21.15.157:0/830751569 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1e100c6ac0 0x7f1e1015e440 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f1e0000bac0 tx=0x7f1dfc001980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:39.215 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.198+0000 7f1e0d7fa700 1 -- 172.21.15.157:0/830751569 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dfc0072d0 con 0x7f1e100c6ac0 2023-10-16T19:57:39.215 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.198+0000 7f1e0d7fa700 1 -- 172.21.15.157:0/830751569 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dfc007450 con 0x7f1e100c6ac0 2023-10-16T19:57:39.215 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.198+0000 7f1e16d19700 1 -- 172.21.15.157:0/830751569 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e1015f350 con 0x7f1e100c6ac0 2023-10-16T19:57:39.215 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.198+0000 7f1e0d7fa700 1 -- 172.21.15.157:0/830751569 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dfc007800 con 0x7f1e100c6ac0 2023-10-16T19:57:39.216 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.198+0000 7f1e16d19700 1 -- 172.21.15.157:0/830751569 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e1015f9a0 con 0x7f1e100c6ac0 2023-10-16T19:57:39.216 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.199+0000 7f1e16d19700 1 -- 172.21.15.157:0/830751569 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e1004f400 con 0x7f1e100c6ac0 2023-10-16T19:57:39.216 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.199+0000 7f1e0d7fa700 1 -- 172.21.15.157:0/830751569 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f1dfc01e430 con 0x7f1e100c6ac0 2023-10-16T19:57:39.216 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.199+0000 7f1e0d7fa700 1 --2- 172.21.15.157:0/830751569 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f1df406af00 0x7f1df406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:39.216 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.200+0000 7f1e0d7fa700 1 -- 172.21.15.157:0/830751569 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1dfc08a240 con 0x7f1e100c6ac0 2023-10-16T19:57:39.217 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.200+0000 7f1e14ab5700 1 --2- 172.21.15.157:0/830751569 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f1df406af00 0x7f1df406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:39.217 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.200+0000 7f1e14ab5700 1 --2- 172.21.15.157:0/830751569 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f1df406af00 0x7f1df406d3c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f1e04009b80 tx=0x7f1e04009210 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:39.217 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.204+0000 7f1e0d7fa700 1 -- 172.21.15.157:0/830751569 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1dfc055380 con 0x7f1e100c6ac0 2023-10-16T19:57:39.394 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.391+0000 7f1e16d19700 1 -- 172.21.15.157:0/830751569 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1e1006d7e0 con 0x7f1e100c6ac0 2023-10-16T19:57:39.395 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.392+0000 7f1e0d7fa700 1 -- 172.21.15.157:0/830751569 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1dfc0589a0 con 0x7f1e100c6ac0 2023-10-16T19:57:39.395 INFO:teuthology.orchestra.run.smithi157.stdout:pg_num: 1 2023-10-16T19:57:39.396 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.394+0000 7f1e16d19700 1 -- 172.21.15.157:0/830751569 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f1df406af00 msgr2=0x7f1df406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:39.397 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.394+0000 7f1e16d19700 1 --2- 172.21.15.157:0/830751569 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f1df406af00 0x7f1df406d3c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f1e04009b80 tx=0x7f1e04009210 comp rx=0 tx=0).stop 2023-10-16T19:57:39.397 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.394+0000 7f1e16d19700 1 -- 172.21.15.157:0/830751569 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1e100c6ac0 msgr2=0x7f1e1015e440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:39.397 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.394+0000 7f1e16d19700 1 --2- 172.21.15.157:0/830751569 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1e100c6ac0 0x7f1e1015e440 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f1e0000bac0 tx=0x7f1dfc001980 comp rx=0 tx=0).stop 2023-10-16T19:57:39.397 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.394+0000 7f1e16d19700 1 -- 172.21.15.157:0/830751569 shutdown_connections 2023-10-16T19:57:39.397 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.394+0000 7f1e16d19700 1 --2- 172.21.15.157:0/830751569 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f1df406af00 0x7f1df406d3c0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:39.398 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.394+0000 7f1e16d19700 1 --2- 172.21.15.157:0/830751569 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1e100b0860 0x7f1e100b0d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:39.398 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.394+0000 7f1e16d19700 1 --2- 172.21.15.157:0/830751569 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1e00004120 0x7f1e101f33b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:39.398 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.394+0000 7f1e16d19700 1 --2- 172.21.15.157:0/830751569 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1e100c6ac0 0x7f1e1015e440 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:39.398 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.394+0000 7f1e16d19700 1 -- 172.21.15.157:0/830751569 >> 172.21.15.157:0/830751569 conn(0x7f1e1006c7e0 msgr2=0x7f1e10161e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:39.398 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.394+0000 7f1e16d19700 1 -- 172.21.15.157:0/830751569 shutdown_connections 2023-10-16T19:57:39.399 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.394+0000 7f1e16d19700 1 -- 172.21.15.157:0/830751569 wait complete. 2023-10-16T19:57:39.408 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-16T19:57:39.532 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.529+0000 7f5e3ed17700 1 Processor -- start 2023-10-16T19:57:39.532 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.529+0000 7f5e3ed17700 1 -- start start 2023-10-16T19:57:39.534 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.530+0000 7f5e3ed17700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f5e38143bd0 0x7f5e380cef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:39.534 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.530+0000 7f5e3ed17700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e3806e180 con 0x7f5e380cf4c0 2023-10-16T19:57:39.535 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.530+0000 7f5e3ed17700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e38144480 con 0x7f5e380b2e20 2023-10-16T19:57:39.535 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.530+0000 7f5e3ed17700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e38143fb0 con 0x7f5e38143bd0 2023-10-16T19:57:39.535 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.530+0000 7f5e3cab3700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f5e38143bd0 0x7f5e380cef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:39.535 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.530+0000 7f5e37fff700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f5e380cf4c0 0x7f5e380b2710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:56354/0 (socket says 172.21.15.157:56354) 2023-10-16T19:57:39.536 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.530+0000 7f5e37fff700 1 -- 172.21.15.157:0/4079339574 learned_addr learned my addr 172.21.15.157:0/4079339574 (peer_addr_for_me v1:172.21.15.157:0/0) 2023-10-16T19:57:39.536 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.531+0000 7f5e3cab3700 1 -- 172.21.15.157:0/4079339574 >> v1:172.21.15.187:6789/0 conn(0x7f5e380b2e20 legacy=0x7f5e38071080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:57:39.536 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.531+0000 7f5e3cab3700 1 -- 172.21.15.157:0/4079339574 >> v1:172.21.15.157:6789/0 conn(0x7f5e380cf4c0 legacy=0x7f5e380b2710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:39.536 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.531+0000 7f5e3cab3700 1 -- 172.21.15.157:0/4079339574 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e38071c60 con 0x7f5e38143bd0 2023-10-16T19:57:39.536 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.531+0000 7f5e3cab3700 1 --2- 172.21.15.157:0/4079339574 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5e38143bd0 0x7f5e380cef80 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f5e2c009840 tx=0x7f5e2c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d577dc8b0a844ca2 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:39.537 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.531+0000 7f5e377fe700 1 -- 172.21.15.157:0/4079339574 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e2c004230 con 0x7f5e38143bd0 2023-10-16T19:57:39.537 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.531+0000 7f5e377fe700 1 -- 172.21.15.157:0/4079339574 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e2c004390 con 0x7f5e38143bd0 2023-10-16T19:57:39.537 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.531+0000 7f5e377fe700 1 -- 172.21.15.157:0/4079339574 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e2c0036a0 con 0x7f5e38143bd0 2023-10-16T19:57:39.537 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.532+0000 7f5e3ed17700 1 -- 172.21.15.157:0/4079339574 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5e38143bd0 msgr2=0x7f5e380cef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:39.537 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.532+0000 7f5e3ed17700 1 --2- 172.21.15.157:0/4079339574 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5e38143bd0 0x7f5e380cef80 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f5e2c009840 tx=0x7f5e2c009b50 comp rx=0 tx=0).stop 2023-10-16T19:57:39.538 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.532+0000 7f5e3ed17700 1 -- 172.21.15.157:0/4079339574 shutdown_connections 2023-10-16T19:57:39.538 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.532+0000 7f5e3ed17700 1 --2- 172.21.15.157:0/4079339574 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5e38143bd0 0x7f5e380cef80 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:39.538 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.532+0000 7f5e3ed17700 1 -- 172.21.15.157:0/4079339574 >> 172.21.15.157:0/4079339574 conn(0x7f5e380d0b30 msgr2=0x7f5e380d0f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:39.538 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.532+0000 7f5e3ed17700 1 -- 172.21.15.157:0/4079339574 shutdown_connections 2023-10-16T19:57:39.538 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.532+0000 7f5e3ed17700 1 -- 172.21.15.157:0/4079339574 wait complete. 2023-10-16T19:57:39.541 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.533+0000 7f5e3ed17700 1 Processor -- start 2023-10-16T19:57:39.541 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.533+0000 7f5e3ed17700 1 -- start start 2023-10-16T19:57:39.542 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.534+0000 7f5e3ed17700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5e380b2e20 0x7f5e3806aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:39.542 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.534+0000 7f5e3ed17700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5e380cf4c0 0x7f5e3813efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:39.542 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.534+0000 7f5e3ed17700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5e38143bd0 0x7f5e3813f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:39.542 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.534+0000 7f5e3ed17700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e380afe90 con 0x7f5e380b2e20 2023-10-16T19:57:39.542 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.534+0000 7f5e3ed17700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e380af250 con 0x7f5e38143bd0 2023-10-16T19:57:39.543 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.534+0000 7f5e3ed17700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e380af4f0 con 0x7f5e380cf4c0 2023-10-16T19:57:39.543 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.534+0000 7f5e3cab3700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5e380b2e20 0x7f5e3806aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:39.543 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.534+0000 7f5e3cab3700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5e380b2e20 0x7f5e3806aac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:46688/0 (socket says 172.21.15.157:46688) 2023-10-16T19:57:39.543 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.534+0000 7f5e3cab3700 1 -- 172.21.15.157:0/1763384206 learned_addr learned my addr 172.21.15.157:0/1763384206 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:57:39.543 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.534+0000 7f5e3d2b4700 1 --2- 172.21.15.157:0/1763384206 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5e38143bd0 0x7f5e3813f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:39.544 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.534+0000 7f5e37fff700 1 --2- 172.21.15.157:0/1763384206 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5e380cf4c0 0x7f5e3813efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:39.544 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.534+0000 7f5e3cab3700 1 -- 172.21.15.157:0/1763384206 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5e380cf4c0 msgr2=0x7f5e3813efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:39.544 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.534+0000 7f5e3cab3700 1 --2- 172.21.15.157:0/1763384206 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5e380cf4c0 0x7f5e3813efa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:39.544 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.534+0000 7f5e3cab3700 1 -- 172.21.15.157:0/1763384206 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5e38143bd0 msgr2=0x7f5e3813f4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:39.544 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.534+0000 7f5e3cab3700 1 --2- 172.21.15.157:0/1763384206 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5e38143bd0 0x7f5e3813f4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:39.545 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.534+0000 7f5e3cab3700 1 -- 172.21.15.157:0/1763384206 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e2c0094a0 con 0x7f5e380b2e20 2023-10-16T19:57:39.545 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.534+0000 7f5e3cab3700 1 --2- 172.21.15.157:0/1763384206 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5e380b2e20 0x7f5e3806aac0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f5e2c009b90 tx=0x7f5e2c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:39.545 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.534+0000 7f5e357fa700 1 -- 172.21.15.157:0/1763384206 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e2c011630 con 0x7f5e380b2e20 2023-10-16T19:57:39.545 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.534+0000 7f5e357fa700 1 -- 172.21.15.157:0/1763384206 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e2c01e070 con 0x7f5e380b2e20 2023-10-16T19:57:39.545 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.534+0000 7f5e3ed17700 1 -- 172.21.15.157:0/1763384206 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e380af7d0 con 0x7f5e380b2e20 2023-10-16T19:57:39.546 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.534+0000 7f5e357fa700 1 -- 172.21.15.157:0/1763384206 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e2c0119d0 con 0x7f5e380b2e20 2023-10-16T19:57:39.546 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.534+0000 7f5e3ed17700 1 -- 172.21.15.157:0/1763384206 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e3813fa20 con 0x7f5e380b2e20 2023-10-16T19:57:39.546 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.535+0000 7f5e3ed17700 1 -- 172.21.15.157:0/1763384206 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e380cf2e0 con 0x7f5e380b2e20 2023-10-16T19:57:39.546 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.536+0000 7f5e357fa700 1 -- 172.21.15.157:0/1763384206 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f5e2c011b30 con 0x7f5e380b2e20 2023-10-16T19:57:39.546 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.536+0000 7f5e357fa700 1 --2- 172.21.15.157:0/1763384206 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f5e1c06af00 0x7f5e1c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:39.547 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.536+0000 7f5e357fa700 1 -- 172.21.15.157:0/1763384206 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5e2c08a8f0 con 0x7f5e380b2e20 2023-10-16T19:57:39.547 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.536+0000 7f5e37fff700 1 --2- 172.21.15.157:0/1763384206 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f5e1c06af00 0x7f5e1c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:39.547 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.537+0000 7f5e37fff700 1 --2- 172.21.15.157:0/1763384206 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f5e1c06af00 0x7f5e1c06d3c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f5e24000f60 tx=0x7f5e24009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:39.547 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.540+0000 7f5e357fa700 1 -- 172.21.15.157:0/1763384206 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5e2c055a30 con 0x7f5e380b2e20 2023-10-16T19:57:39.732 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.730+0000 7f5e3ed17700 1 -- 172.21.15.157:0/1763384206 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5e3804f400 con 0x7f5e380b2e20 2023-10-16T19:57:39.732 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.730+0000 7f5e357fa700 1 -- 172.21.15.157:0/1763384206 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5e2c0200a0 con 0x7f5e380b2e20 2023-10-16T19:57:39.733 INFO:teuthology.orchestra.run.smithi157.stdout:pg_num: 32 2023-10-16T19:57:39.735 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.732+0000 7f5e3ed17700 1 -- 172.21.15.157:0/1763384206 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f5e1c06af00 msgr2=0x7f5e1c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:39.735 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.732+0000 7f5e3ed17700 1 --2- 172.21.15.157:0/1763384206 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f5e1c06af00 0x7f5e1c06d3c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f5e24000f60 tx=0x7f5e24009040 comp rx=0 tx=0).stop 2023-10-16T19:57:39.735 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.732+0000 7f5e3ed17700 1 -- 172.21.15.157:0/1763384206 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5e380b2e20 msgr2=0x7f5e3806aac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:39.735 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.732+0000 7f5e3ed17700 1 --2- 172.21.15.157:0/1763384206 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5e380b2e20 0x7f5e3806aac0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f5e2c009b90 tx=0x7f5e2c004750 comp rx=0 tx=0).stop 2023-10-16T19:57:39.736 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.732+0000 7f5e3ed17700 1 -- 172.21.15.157:0/1763384206 shutdown_connections 2023-10-16T19:57:39.736 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.732+0000 7f5e3ed17700 1 --2- 172.21.15.157:0/1763384206 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f5e1c06af00 0x7f5e1c06d3c0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:39.736 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.732+0000 7f5e3ed17700 1 --2- 172.21.15.157:0/1763384206 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5e38143bd0 0x7f5e3813f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:39.736 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.732+0000 7f5e3ed17700 1 --2- 172.21.15.157:0/1763384206 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5e380b2e20 0x7f5e3806aac0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:39.736 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.732+0000 7f5e3ed17700 1 --2- 172.21.15.157:0/1763384206 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5e380cf4c0 0x7f5e3813efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:39.737 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.732+0000 7f5e3ed17700 1 -- 172.21.15.157:0/1763384206 >> 172.21.15.157:0/1763384206 conn(0x7f5e380d0b30 msgr2=0x7f5e380cf920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:39.737 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.732+0000 7f5e3ed17700 1 -- 172.21.15.157:0/1763384206 shutdown_connections 2023-10-16T19:57:39.737 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.732+0000 7f5e3ed17700 1 -- 172.21.15.157:0/1763384206 wait complete. 2023-10-16T19:57:39.747 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-16T19:57:39.870 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.868+0000 7f91c59a1700 1 Processor -- start 2023-10-16T19:57:39.871 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.868+0000 7f91c59a1700 1 -- start start 2023-10-16T19:57:39.873 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.869+0000 7f91c59a1700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f91c015e0d0 0x7f91c00d36d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:39.874 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.869+0000 7f91c59a1700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f91c00d0780 0x7f91c00d0bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:39.874 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.869+0000 7f91c59a1700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91c00d1110 con 0x7f91c00b9a30 2023-10-16T19:57:39.874 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.869+0000 7f91c59a1700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91c00d2630 con 0x7f91c015e0d0 2023-10-16T19:57:39.874 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.869+0000 7f91c59a1700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91c00d2910 con 0x7f91c00d0780 2023-10-16T19:57:39.875 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.869+0000 7f91beffd700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f91c015e0d0 0x7f91c00d36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:39.875 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.869+0000 7f91beffd700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f91c015e0d0 0x7f91c00d36d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:46700/0 (socket says 172.21.15.157:46700) 2023-10-16T19:57:39.875 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.869+0000 7f91beffd700 1 -- 172.21.15.157:0/2606917483 learned_addr learned my addr 172.21.15.157:0/2606917483 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:57:39.875 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.869+0000 7f91bf7fe700 1 --2- 172.21.15.157:0/2606917483 >> v2:172.21.15.187:3300/0 conn(0x7f91c00d0780 0x7f91c00d0bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:39.876 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.869+0000 7f91beffd700 1 -- 172.21.15.157:0/2606917483 >> v2:172.21.15.187:3300/0 conn(0x7f91c00d0780 msgr2=0x7f91c00d0bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:57:39.876 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.869+0000 7f91beffd700 1 --2- 172.21.15.157:0/2606917483 >> v2:172.21.15.187:3300/0 conn(0x7f91c00d0780 0x7f91c00d0bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:39.876 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.869+0000 7f91beffd700 1 -- 172.21.15.157:0/2606917483 >> v1:172.21.15.187:6789/0 conn(0x7f91c00b9a30 legacy=0x7f91c00d1d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:39.876 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.869+0000 7f91beffd700 1 -- 172.21.15.157:0/2606917483 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91c00d2bf0 con 0x7f91c015e0d0 2023-10-16T19:57:39.876 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.869+0000 7f91beffd700 1 --2- 172.21.15.157:0/2606917483 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f91c015e0d0 0x7f91c00d36d0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f91c00ce2c0 tx=0x7f91b4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b568b743063580f server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:39.877 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.870+0000 7f91bdffb700 1 -- 172.21.15.157:0/2606917483 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91b4011830 con 0x7f91c015e0d0 2023-10-16T19:57:39.877 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.870+0000 7f91bdffb700 1 -- 172.21.15.157:0/2606917483 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91b4011990 con 0x7f91c015e0d0 2023-10-16T19:57:39.877 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.870+0000 7f91bdffb700 1 -- 172.21.15.157:0/2606917483 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91b4011d20 con 0x7f91c015e0d0 2023-10-16T19:57:39.877 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.870+0000 7f91c59a1700 1 -- 172.21.15.157:0/2606917483 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f91c015e0d0 msgr2=0x7f91c00d36d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:39.878 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.870+0000 7f91c59a1700 1 --2- 172.21.15.157:0/2606917483 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f91c015e0d0 0x7f91c00d36d0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f91c00ce2c0 tx=0x7f91b4009bd0 comp rx=0 tx=0).stop 2023-10-16T19:57:39.878 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.870+0000 7f91c59a1700 1 -- 172.21.15.157:0/2606917483 shutdown_connections 2023-10-16T19:57:39.878 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.870+0000 7f91c59a1700 1 --2- 172.21.15.157:0/2606917483 >> v2:172.21.15.187:3300/0 conn(0x7f91c00d0780 0x7f91c00d0bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:39.878 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.870+0000 7f91c59a1700 1 --2- 172.21.15.157:0/2606917483 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f91c015e0d0 0x7f91c00d36d0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:39.879 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.870+0000 7f91c59a1700 1 -- 172.21.15.157:0/2606917483 >> 172.21.15.157:0/2606917483 conn(0x7f91c006aeb0 msgr2=0x7f91c006b2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:39.879 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.870+0000 7f91c59a1700 1 -- 172.21.15.157:0/2606917483 shutdown_connections 2023-10-16T19:57:39.879 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.870+0000 7f91c59a1700 1 -- 172.21.15.157:0/2606917483 wait complete. 2023-10-16T19:57:39.879 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.871+0000 7f91c59a1700 1 Processor -- start 2023-10-16T19:57:39.883 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.872+0000 7f91c59a1700 1 -- start start 2023-10-16T19:57:39.883 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.872+0000 7f91c59a1700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f91c00b9a30 0x7f91c0160270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:39.883 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.872+0000 7f91c59a1700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f91c00d0780 0x7f91c01f6770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:39.883 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.872+0000 7f91c59a1700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f91c015e0d0 0x7f91c00c9b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:39.884 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.872+0000 7f91c59a1700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91c015f1d0 con 0x7f91c00b9a30 2023-10-16T19:57:39.884 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.872+0000 7f91c59a1700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91c015f4b0 con 0x7f91c00d0780 2023-10-16T19:57:39.884 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.872+0000 7f91c59a1700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91c015f790 con 0x7f91c015e0d0 2023-10-16T19:57:39.884 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.872+0000 7f91beffd700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f91c00b9a30 0x7f91c0160270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:39.885 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.872+0000 7f91beffd700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f91c00b9a30 0x7f91c0160270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:46702/0 (socket says 172.21.15.157:46702) 2023-10-16T19:57:39.885 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.872+0000 7f91beffd700 1 -- 172.21.15.157:0/262050631 learned_addr learned my addr 172.21.15.157:0/262050631 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:57:39.885 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.873+0000 7f91bf7fe700 1 --2- 172.21.15.157:0/262050631 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f91c015e0d0 0x7f91c00c9b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:39.885 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.873+0000 7f91be7fc700 1 --2- 172.21.15.157:0/262050631 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f91c00d0780 0x7f91c01f6770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:39.885 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.873+0000 7f91beffd700 1 -- 172.21.15.157:0/262050631 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f91c015e0d0 msgr2=0x7f91c00c9b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:39.886 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.873+0000 7f91beffd700 1 --2- 172.21.15.157:0/262050631 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f91c015e0d0 0x7f91c00c9b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:39.886 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.873+0000 7f91beffd700 1 -- 172.21.15.157:0/262050631 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f91c00d0780 msgr2=0x7f91c01f6770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:39.886 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.873+0000 7f91beffd700 1 --2- 172.21.15.157:0/262050631 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f91c00d0780 0x7f91c01f6770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:39.886 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.873+0000 7f91beffd700 1 -- 172.21.15.157:0/262050631 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91b4009550 con 0x7f91c00b9a30 2023-10-16T19:57:39.887 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.873+0000 7f91be7fc700 1 --2- 172.21.15.157:0/262050631 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f91c00d0780 0x7f91c01f6770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T19:57:39.887 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.873+0000 7f91bf7fe700 1 --2- 172.21.15.157:0/262050631 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f91c015e0d0 0x7f91c00c9b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T19:57:39.887 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.873+0000 7f91beffd700 1 --2- 172.21.15.157:0/262050631 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f91c00b9a30 0x7f91c0160270 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f91b4009c10 tx=0x7f91b4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:39.887 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.873+0000 7f91a7fff700 1 -- 172.21.15.157:0/262050631 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91b40036a0 con 0x7f91c00b9a30 2023-10-16T19:57:39.887 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.873+0000 7f91a7fff700 1 -- 172.21.15.157:0/262050631 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91b401e070 con 0x7f91c00b9a30 2023-10-16T19:57:39.888 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.873+0000 7f91a7fff700 1 -- 172.21.15.157:0/262050631 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91b4003a60 con 0x7f91c00b9a30 2023-10-16T19:57:39.888 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.873+0000 7f91c59a1700 1 -- 172.21.15.157:0/262050631 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91c015fa70 con 0x7f91c00b9a30 2023-10-16T19:57:39.888 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.873+0000 7f91c59a1700 1 -- 172.21.15.157:0/262050631 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91c015eec0 con 0x7f91c00b9a30 2023-10-16T19:57:39.888 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.874+0000 7f91c59a1700 1 -- 172.21.15.157:0/262050631 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91c00cf9d0 con 0x7f91c00b9a30 2023-10-16T19:57:39.888 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.875+0000 7f91a7fff700 1 -- 172.21.15.157:0/262050631 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f91b4003bc0 con 0x7f91c00b9a30 2023-10-16T19:57:39.889 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.875+0000 7f91a7fff700 1 --2- 172.21.15.157:0/262050631 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f91ac06af00 0x7f91ac06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:39.889 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.875+0000 7f91a7fff700 1 -- 172.21.15.157:0/262050631 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f91b408a4d0 con 0x7f91c00b9a30 2023-10-16T19:57:39.889 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.875+0000 7f91be7fc700 1 --2- 172.21.15.157:0/262050631 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f91ac06af00 0x7f91ac06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:39.889 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.876+0000 7f91be7fc700 1 --2- 172.21.15.157:0/262050631 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f91ac06af00 0x7f91ac06d3c0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f91c014b1e0 tx=0x7f91b0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:39.889 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:39.879+0000 7f91a7fff700 1 -- 172.21.15.157:0/262050631 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f91b4055610 con 0x7f91c00b9a30 2023-10-16T19:57:40.070 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.068+0000 7f91c59a1700 1 -- 172.21.15.157:0/262050631 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f91c015ff90 con 0x7f91c00b9a30 2023-10-16T19:57:40.071 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.069+0000 7f91a7fff700 1 -- 172.21.15.157:0/262050631 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f91b4020020 con 0x7f91c00b9a30 2023-10-16T19:57:40.071 INFO:teuthology.orchestra.run.smithi157.stdout:pg_num: 64 2023-10-16T19:57:40.074 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.071+0000 7f91c59a1700 1 -- 172.21.15.157:0/262050631 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f91ac06af00 msgr2=0x7f91ac06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:40.074 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.071+0000 7f91c59a1700 1 --2- 172.21.15.157:0/262050631 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f91ac06af00 0x7f91ac06d3c0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f91c014b1e0 tx=0x7f91b0009040 comp rx=0 tx=0).stop 2023-10-16T19:57:40.074 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.071+0000 7f91c59a1700 1 -- 172.21.15.157:0/262050631 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f91c00b9a30 msgr2=0x7f91c0160270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:40.074 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.071+0000 7f91c59a1700 1 --2- 172.21.15.157:0/262050631 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f91c00b9a30 0x7f91c0160270 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f91b4009c10 tx=0x7f91b4004750 comp rx=0 tx=0).stop 2023-10-16T19:57:40.074 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.071+0000 7f91c59a1700 1 -- 172.21.15.157:0/262050631 shutdown_connections 2023-10-16T19:57:40.075 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.071+0000 7f91c59a1700 1 --2- 172.21.15.157:0/262050631 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f91c015e0d0 0x7f91c00c9b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:40.075 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.071+0000 7f91c59a1700 1 --2- 172.21.15.157:0/262050631 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f91c00b9a30 0x7f91c0160270 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:40.075 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.071+0000 7f91c59a1700 1 --2- 172.21.15.157:0/262050631 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f91ac06af00 0x7f91ac06d3c0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:40.075 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.071+0000 7f91c59a1700 1 --2- 172.21.15.157:0/262050631 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f91c00d0780 0x7f91c01f6770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:40.075 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.071+0000 7f91c59a1700 1 -- 172.21.15.157:0/262050631 >> 172.21.15.157:0/262050631 conn(0x7f91c006aeb0 msgr2=0x7f91c00c78a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:40.076 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.071+0000 7f91c59a1700 1 -- 172.21.15.157:0/262050631 shutdown_connections 2023-10-16T19:57:40.076 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.071+0000 7f91c59a1700 1 -- 172.21.15.157:0/262050631 wait complete. 2023-10-16T19:57:40.123 INFO:tasks.cephfs_test_runner:Starting test: test_barrier (tasks.cephfs.test_full.TestClusterFull) That when an OSD epoch barrier is set on an MDS, subsequently 2023-10-16T19:57:40.124 INFO:tasks.cephfs_test_runner:test_barrier (tasks.cephfs.test_full.TestClusterFull) 2023-10-16T19:57:40.124 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T19:57:40.246 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.244+0000 7fb23e781700 1 Processor -- start 2023-10-16T19:57:40.246 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.244+0000 7fb23e781700 1 -- start start 2023-10-16T19:57:40.248 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.244+0000 7fb23e781700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fb238072320 0x7fb2380cfad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:40.249 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.244+0000 7fb23e781700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb238072d50 con 0x7fb2380cbaf0 2023-10-16T19:57:40.249 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.244+0000 7fb23e781700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2380cf640 con 0x7fb23815eed0 2023-10-16T19:57:40.249 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.244+0000 7fb23e781700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2380d0010 con 0x7fb238072320 2023-10-16T19:57:40.249 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.245+0000 7fb237fff700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7fb2380cbaf0 0x7fb23815e7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:56382/0 (socket says 172.21.15.157:56382) 2023-10-16T19:57:40.249 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.245+0000 7fb23cd1e700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fb238072320 0x7fb2380cfad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:40.250 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.245+0000 7fb237fff700 1 -- 172.21.15.157:0/125646248 learned_addr learned my addr 172.21.15.157:0/125646248 (peer_addr_for_me v1:172.21.15.157:0/0) 2023-10-16T19:57:40.250 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.245+0000 7fb23cd1e700 1 -- 172.21.15.157:0/125646248 >> v1:172.21.15.187:6789/0 conn(0x7fb23815eed0 legacy=0x7fb238071c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:40.250 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.245+0000 7fb23cd1e700 1 -- 172.21.15.157:0/125646248 >> v1:172.21.15.157:6789/0 conn(0x7fb2380cbaf0 legacy=0x7fb23815e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:40.250 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.245+0000 7fb23cd1e700 1 -- 172.21.15.157:0/125646248 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2380cea30 con 0x7fb238072320 2023-10-16T19:57:40.250 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.245+0000 7fb236ffd700 1 -- 172.21.15.157:0/125646248 <== mon.0 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3111904301 0 0) 0x7fb238072d50 con 0x7fb2380cbaf0 2023-10-16T19:57:40.250 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.245+0000 7fb23cd1e700 1 --2- 172.21.15.157:0/125646248 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb238072320 0x7fb2380cfad0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fb230009d90 tx=0x7fb23000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b96a060559bd5978 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:40.251 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.245+0000 7fb236ffd700 1 -- 172.21.15.157:0/125646248 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb23000e070 con 0x7fb238072320 2023-10-16T19:57:40.251 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.245+0000 7fb236ffd700 1 -- 172.21.15.157:0/125646248 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb23000bbd0 con 0x7fb238072320 2023-10-16T19:57:40.251 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.245+0000 7fb236ffd700 1 -- 172.21.15.157:0/125646248 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb230012430 con 0x7fb238072320 2023-10-16T19:57:40.251 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.246+0000 7fb23e781700 1 -- 172.21.15.157:0/125646248 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb238072320 msgr2=0x7fb2380cfad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:40.251 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.246+0000 7fb23e781700 1 --2- 172.21.15.157:0/125646248 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb238072320 0x7fb2380cfad0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fb230009d90 tx=0x7fb23000b330 comp rx=0 tx=0).stop 2023-10-16T19:57:40.252 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.246+0000 7fb23e781700 1 -- 172.21.15.157:0/125646248 shutdown_connections 2023-10-16T19:57:40.252 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.246+0000 7fb23e781700 1 --2- 172.21.15.157:0/125646248 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb238072320 0x7fb2380cfad0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:40.252 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.246+0000 7fb23e781700 1 -- 172.21.15.157:0/125646248 >> 172.21.15.157:0/125646248 conn(0x7fb2380cceb0 msgr2=0x7fb2380cd290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:40.252 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.246+0000 7fb23e781700 1 -- 172.21.15.157:0/125646248 shutdown_connections 2023-10-16T19:57:40.252 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.246+0000 7fb23e781700 1 -- 172.21.15.157:0/125646248 wait complete. 2023-10-16T19:57:40.255 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.247+0000 7fb23e781700 1 Processor -- start 2023-10-16T19:57:40.255 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.247+0000 7fb23e781700 1 -- start start 2023-10-16T19:57:40.255 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.248+0000 7fb23e781700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb238072320 0x7fb238150c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:40.255 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.248+0000 7fb23e781700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb2380cbaf0 0x7fb2381584c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:40.255 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.248+0000 7fb23e781700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb23815eed0 0x7fb2381f4a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:40.256 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.248+0000 7fb23e781700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb23814afd0 con 0x7fb23815eed0 2023-10-16T19:57:40.256 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.248+0000 7fb23e781700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb238158e70 con 0x7fb238072320 2023-10-16T19:57:40.256 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.248+0000 7fb23e781700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb238159150 con 0x7fb2380cbaf0 2023-10-16T19:57:40.256 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.248+0000 7fb23cd1e700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb23815eed0 0x7fb2381f4a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:40.256 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.248+0000 7fb23cd1e700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb23815eed0 0x7fb2381f4a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:46716/0 (socket says 172.21.15.157:46716) 2023-10-16T19:57:40.257 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.248+0000 7fb23cd1e700 1 -- 172.21.15.157:0/2947700089 learned_addr learned my addr 172.21.15.157:0/2947700089 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:57:40.257 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.248+0000 7fb237fff700 1 --2- 172.21.15.157:0/2947700089 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb238072320 0x7fb238150c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:40.257 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.248+0000 7fb23cd1e700 1 -- 172.21.15.157:0/2947700089 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb2380cbaf0 msgr2=0x7fb2381584c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:40.257 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.248+0000 7fb23cd1e700 1 --2- 172.21.15.157:0/2947700089 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb2380cbaf0 0x7fb2381584c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:40.257 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.248+0000 7fb23cd1e700 1 -- 172.21.15.157:0/2947700089 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb238072320 msgr2=0x7fb238150c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:40.257 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.248+0000 7fb23cd1e700 1 --2- 172.21.15.157:0/2947700089 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb238072320 0x7fb238150c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:40.258 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.248+0000 7fb23cd1e700 1 -- 172.21.15.157:0/2947700089 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb230009a70 con 0x7fb23815eed0 2023-10-16T19:57:40.258 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.248+0000 7fb23cd1e700 1 --2- 172.21.15.157:0/2947700089 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb23815eed0 0x7fb2381f4a00 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fb230014040 tx=0x7fb230004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:40.258 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.249+0000 7fb234ff9700 1 -- 172.21.15.157:0/2947700089 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb23001b810 con 0x7fb23815eed0 2023-10-16T19:57:40.258 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.249+0000 7fb234ff9700 1 -- 172.21.15.157:0/2947700089 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb230020070 con 0x7fb23815eed0 2023-10-16T19:57:40.258 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.249+0000 7fb23e781700 1 -- 172.21.15.157:0/2947700089 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb238159430 con 0x7fb23815eed0 2023-10-16T19:57:40.259 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.249+0000 7fb234ff9700 1 -- 172.21.15.157:0/2947700089 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb23001bbb0 con 0x7fb23815eed0 2023-10-16T19:57:40.259 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.249+0000 7fb23e781700 1 -- 172.21.15.157:0/2947700089 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb238158a00 con 0x7fb23815eed0 2023-10-16T19:57:40.259 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.250+0000 7fb23e781700 1 -- 172.21.15.157:0/2947700089 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb23814eac0 con 0x7fb23815eed0 2023-10-16T19:57:40.259 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.250+0000 7fb234ff9700 1 -- 172.21.15.157:0/2947700089 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fb23001bd10 con 0x7fb23815eed0 2023-10-16T19:57:40.259 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.250+0000 7fb234ff9700 1 --2- 172.21.15.157:0/2947700089 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fb22406af00 0x7fb22406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:40.260 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.250+0000 7fb234ff9700 1 -- 172.21.15.157:0/2947700089 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb230022070 con 0x7fb23815eed0 2023-10-16T19:57:40.260 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.251+0000 7fb237fff700 1 --2- 172.21.15.157:0/2947700089 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fb22406af00 0x7fb22406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:40.260 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.251+0000 7fb237fff700 1 --2- 172.21.15.157:0/2947700089 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fb22406af00 0x7fb22406d3c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fb228000f60 tx=0x7fb228009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:40.260 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.255+0000 7fb234ff9700 1 -- 172.21.15.157:0/2947700089 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb23814eac0 con 0x7fb23815eed0 2023-10-16T19:57:40.446 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.443+0000 7fb23e781700 1 -- 172.21.15.157:0/2947700089 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb23814eac0 con 0x7fb23815eed0 2023-10-16T19:57:40.447 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.444+0000 7fb234ff9700 1 -- 172.21.15.157:0/2947700089 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16517 (secure 0 0 0) 0x7fb23814eac0 con 0x7fb23815eed0 2023-10-16T19:57:40.448 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-10-16T19:57:40.448 INFO:teuthology.orchestra.run.smithi157.stdout:{"epoch":21,"fsid":"28199dc9-64d5-479e-83c6-21f097c33d39","created":"2023-10-16T19:56:49.201889+0000","modified":"2023-10-16T19:57:07.988567+0000","last_up_change":"2023-10-16T19:56:54.675673+0000","last_in_change":"2023-10-16T19:56:51.666728+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T19:56:56.932895+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-16T19:57:04.936105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-16T19:57:05.335279+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":335785898},{"type":"v1","addr":"172.21.15.157:6809","nonce":335785898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":335785898},{"type":"v1","addr":"172.21.15.157:6811","nonce":335785898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6815","nonce":335785898},{"type":"v1","addr":"172.21.15.157:6817","nonce":335785898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":335785898},{"type":"v1","addr":"172.21.15.157:6813","nonce":335785898}]},"public_addr":"172.21.15.157:6809/335785898","cluster_addr":"172.21.15.157:6811/335785898","heartbeat_back_addr":"172.21.15.157:6817/335785898","heartbeat_front_addr":"172.21.15.157:6813/335785898","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":3482825047},{"type":"v1","addr":"172.21.15.157:6801","nonce":3482825047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":3482825047},{"type":"v1","addr":"172.21.15.157:6803","nonce":3482825047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":3482825047},{"type":"v1","addr":"172.21.15.157:6807","nonce":3482825047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":3482825047},{"type":"v1","addr":"172.21.15.157:6805","nonce":3482825047}]},"public_addr":"172.21.15.157:6801/3482825047","cluster_addr":"172.21.15.157:6803/3482825047","heartbeat_back_addr":"172.21.15.157:6807/3482825047","heartbeat_front_addr":"172.21.15.157:6805/3482825047","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":1118292389},{"type":"v1","addr":"172.21.15.157:6825","nonce":1118292389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":1118292389},{"type":"v1","addr":"172.21.15.157:6827","nonce":1118292389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":1118292389},{"type":"v1","addr":"172.21.15.157:6831","nonce":1118292389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":1118292389},{"type":"v1","addr":"172.21.15.157:6829","nonce":1118292389}]},"public_addr":"172.21.15.157:6825/1118292389","cluster_addr":"172.21.15.157:6827/1118292389","heartbeat_back_addr":"172.21.15.157:6831/1118292389","heartbeat_front_addr":"172.21.15.157:6829/1118292389","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":989329821},{"type":"v1","addr":"172.21.15.157:6816","nonce":989329821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":989329821},{"type":"v1","addr":"172.21.15.157:6819","nonce":989329821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":989329821},{"type":"v1","addr":"172.21.15.157:6823","nonce":989329821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":989329821},{"type":"v1","addr":"172.21.15.157:6821","nonce":989329821}]},"public_addr":"172.21.15.157:6816/989329821","cluster_addr":"172.21.15.157:6819/989329821","heartbeat_back_addr":"172.21.15.157:6823/989329821","heartbeat_front_addr":"172.21.15.157:6821/989329821","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":3841016811},{"type":"v1","addr":"172.21.15.187:6801","nonce":3841016811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6803","nonce":3841016811},{"type":"v1","addr":"172.21.15.187:6804","nonce":3841016811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6809","nonce":3841016811},{"type":"v1","addr":"172.21.15.187:6811","nonce":3841016811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":3841016811},{"type":"v1","addr":"172.21.15.187:6808","nonce":3841016811}]},"public_addr":"172.21.15.187:6801/3841016811","cluster_addr":"172.21.15.187:6804/3841016811","heartbeat_back_addr":"172.21.15.187:6811/3841016811","heartbeat_front_addr":"172.21.15.187:6808/3841016811","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":915130263},{"type":"v1","addr":"172.21.15.187:6805","nonce":915130263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6807","nonce":915130263},{"type":"v1","addr":"172.21.15.187:6810","nonce":915130263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":915130263},{"type":"v1","addr":"172.21.15.187:6815","nonce":915130263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":915130263},{"type":"v1","addr":"172.21.15.187:6813","nonce":915130263}]},"public_addr":"172.21.15.187:6805/915130263","cluster_addr":"172.21.15.187:6810/915130263","heartbeat_back_addr":"172.21.15.187:6815/915130263","heartbeat_front_addr":"172.21.15.187:6813/915130263","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":654976824},{"type":"v1","addr":"172.21.15.187:6817","nonce":654976824}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":654976824},{"type":"v1","addr":"172.21.15.187:6819","nonce":654976824}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":654976824},{"type":"v1","addr":"172.21.15.187:6823","nonce":654976824}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":654976824},{"type":"v1","addr":"172.21.15.187:6821","nonce":654976824}]},"public_addr":"172.21.15.187:6817/654976824","cluster_addr":"172.21.15.187:6819/654976824","heartbeat_back_addr":"172.21.15.187:6823/654976824","heartbeat_front_addr":"172.21.15.187:6821/654976824","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":4284059445},{"type":"v1","addr":"172.21.15.187:6825","nonce":4284059445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":4284059445},{"type":"v1","addr":"172.21.15.187:6827","nonce":4284059445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":4284059445},{"type":"v1","addr":"172.21.15.187:6831","nonce":4284059445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":4284059445},{"type":"v1","addr":"172.21.15.187:6829","nonce":4284059445}]},"public_addr":"172.21.15.187:6825/4284059445","cluster_addr":"172.21.15.187:6827/4284059445","heartbeat_back_addr":"172.21.15.187:6831/4284059445","heartbeat_front_addr":"172.21.15.187:6829/4284059445","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.819780+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.824193+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.849575+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.824806+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.809540+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.805093+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.866109+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.807372+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T19:57:40.449 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.447+0000 7fb23e781700 1 -- 172.21.15.157:0/2947700089 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fb22406af00 msgr2=0x7fb22406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:40.449 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.447+0000 7fb23e781700 1 --2- 172.21.15.157:0/2947700089 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fb22406af00 0x7fb22406d3c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fb228000f60 tx=0x7fb228009040 comp rx=0 tx=0).stop 2023-10-16T19:57:40.450 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.447+0000 7fb23e781700 1 -- 172.21.15.157:0/2947700089 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb23815eed0 msgr2=0x7fb2381f4a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:40.450 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.447+0000 7fb23e781700 1 --2- 172.21.15.157:0/2947700089 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb23815eed0 0x7fb2381f4a00 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fb230014040 tx=0x7fb230004ad0 comp rx=0 tx=0).stop 2023-10-16T19:57:40.450 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.447+0000 7fb23e781700 1 -- 172.21.15.157:0/2947700089 shutdown_connections 2023-10-16T19:57:40.450 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.447+0000 7fb23e781700 1 --2- 172.21.15.157:0/2947700089 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fb22406af00 0x7fb22406d3c0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:40.450 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.447+0000 7fb23e781700 1 --2- 172.21.15.157:0/2947700089 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb238072320 0x7fb238150c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:40.451 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.447+0000 7fb23e781700 1 --2- 172.21.15.157:0/2947700089 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb23815eed0 0x7fb2381f4a00 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:40.451 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.447+0000 7fb23e781700 1 --2- 172.21.15.157:0/2947700089 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb2380cbaf0 0x7fb2381584c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:40.451 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.447+0000 7fb23e781700 1 -- 172.21.15.157:0/2947700089 >> 172.21.15.157:0/2947700089 conn(0x7fb2380cceb0 msgr2=0x7fb2380c94a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:40.451 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.447+0000 7fb23e781700 1 -- 172.21.15.157:0/2947700089 shutdown_connections 2023-10-16T19:57:40.451 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.447+0000 7fb23e781700 1 -- 172.21.15.157:0/2947700089 wait complete. 2023-10-16T19:57:40.461 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-16T19:56:56.932895+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-16T19:57:04.936105+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-16T19:57:05.335279+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-16T19:57:40.462 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-16T19:57:40.585 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.583+0000 7f0998d6e700 1 Processor -- start 2023-10-16T19:57:40.586 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.583+0000 7f0998d6e700 1 -- start start 2023-10-16T19:57:40.588 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.584+0000 7f0998d6e700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f0994161ab0 0x7f099406b260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:40.588 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.584+0000 7f0998d6e700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f09940aee10 0x7f0994161e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:40.589 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.584+0000 7f0998d6e700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09940cf8c0 con 0x7f09941623d0 2023-10-16T19:57:40.589 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.584+0000 7f0998d6e700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09940ce440 con 0x7f0994161ab0 2023-10-16T19:57:40.589 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.584+0000 7f0998d6e700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f099415e300 con 0x7f09940aee10 2023-10-16T19:57:40.589 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.584+0000 7f099259c700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f0994161ab0 0x7f099406b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:40.589 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.584+0000 7f099259c700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f0994161ab0 0x7f099406b260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:46722/0 (socket says 172.21.15.157:46722) 2023-10-16T19:57:40.590 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.584+0000 7f099259c700 1 -- 172.21.15.157:0/1775924544 learned_addr learned my addr 172.21.15.157:0/1775924544 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:57:40.590 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.584+0000 7f0991d9b700 1 --2- 172.21.15.157:0/1775924544 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f09940aee10 0x7f0994161e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:40.590 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.584+0000 7f099259c700 1 -- 172.21.15.157:0/1775924544 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f09940aee10 msgr2=0x7f0994161e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:57:40.591 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.584+0000 7f099259c700 1 --2- 172.21.15.157:0/1775924544 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f09940aee10 0x7f0994161e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:40.591 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.584+0000 7f099259c700 1 -- 172.21.15.157:0/1775924544 >> v1:172.21.15.187:6789/0 conn(0x7f09941623d0 legacy=0x7f09940af360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:40.591 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.584+0000 7f099259c700 1 -- 172.21.15.157:0/1775924544 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09941628c0 con 0x7f0994161ab0 2023-10-16T19:57:40.591 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.585+0000 7f099259c700 1 --2- 172.21.15.157:0/1775924544 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0994161ab0 0x7f099406b260 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f09880098f0 tx=0x7f0988009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebce2f402bcb2c83 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:40.591 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.585+0000 7f099159a700 1 -- 172.21.15.157:0/1775924544 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0988011830 con 0x7f0994161ab0 2023-10-16T19:57:40.592 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.585+0000 7f099159a700 1 -- 172.21.15.157:0/1775924544 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0988011990 con 0x7f0994161ab0 2023-10-16T19:57:40.592 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.585+0000 7f099159a700 1 -- 172.21.15.157:0/1775924544 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0988011d20 con 0x7f0994161ab0 2023-10-16T19:57:40.592 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.585+0000 7f0998d6e700 1 -- 172.21.15.157:0/1775924544 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0994161ab0 msgr2=0x7f099406b260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:40.592 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.585+0000 7f0998d6e700 1 --2- 172.21.15.157:0/1775924544 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0994161ab0 0x7f099406b260 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f09880098f0 tx=0x7f0988009c00 comp rx=0 tx=0).stop 2023-10-16T19:57:40.592 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.585+0000 7f0998d6e700 1 -- 172.21.15.157:0/1775924544 shutdown_connections 2023-10-16T19:57:40.593 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.585+0000 7f0998d6e700 1 --2- 172.21.15.157:0/1775924544 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0994161ab0 0x7f099406b260 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:40.593 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.585+0000 7f0998d6e700 1 --2- 172.21.15.157:0/1775924544 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f09940aee10 0x7f0994161e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:40.593 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.585+0000 7f0998d6e700 1 -- 172.21.15.157:0/1775924544 >> 172.21.15.157:0/1775924544 conn(0x7f099406c7e0 msgr2=0x7f099406cbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:40.593 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.585+0000 7f0998d6e700 1 -- 172.21.15.157:0/1775924544 shutdown_connections 2023-10-16T19:57:40.593 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.585+0000 7f0998d6e700 1 -- 172.21.15.157:0/1775924544 wait complete. 2023-10-16T19:57:40.596 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.587+0000 7f0998d6e700 1 Processor -- start 2023-10-16T19:57:40.596 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.587+0000 7f0998d6e700 1 -- start start 2023-10-16T19:57:40.596 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.588+0000 7f0998d6e700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f09940aee10 0x7f0994155bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:40.596 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.588+0000 7f0998d6e700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0994161ab0 0x7f0994160d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:40.597 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.588+0000 7f0998d6e700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f09941623d0 0x7f09940ae200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:40.597 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.588+0000 7f0998d6e700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0994160910 con 0x7f0994161ab0 2023-10-16T19:57:40.597 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.588+0000 7f0998d6e700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09940c3f80 con 0x7f09940aee10 2023-10-16T19:57:40.597 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.588+0000 7f0998d6e700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f099415ff80 con 0x7f09941623d0 2023-10-16T19:57:40.597 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.588+0000 7f0991d9b700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0994161ab0 0x7f0994160d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:40.598 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.588+0000 7f0991d9b700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0994161ab0 0x7f0994160d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:46730/0 (socket says 172.21.15.157:46730) 2023-10-16T19:57:40.598 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.588+0000 7f0991d9b700 1 -- 172.21.15.157:0/1518559230 learned_addr learned my addr 172.21.15.157:0/1518559230 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:57:40.598 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.588+0000 7f099259c700 1 --2- 172.21.15.157:0/1518559230 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f09940aee10 0x7f0994155bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:40.598 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.588+0000 7f0992d9d700 1 --2- 172.21.15.157:0/1518559230 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f09941623d0 0x7f09940ae200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:40.598 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.588+0000 7f0991d9b700 1 -- 172.21.15.157:0/1518559230 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f09941623d0 msgr2=0x7f09940ae200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:40.599 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.588+0000 7f0991d9b700 1 --2- 172.21.15.157:0/1518559230 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f09941623d0 0x7f09940ae200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:40.599 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.588+0000 7f0991d9b700 1 -- 172.21.15.157:0/1518559230 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f09940aee10 msgr2=0x7f0994155bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:40.599 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.588+0000 7f0991d9b700 1 --2- 172.21.15.157:0/1518559230 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f09940aee10 0x7f0994155bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:40.599 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.588+0000 7f0991d9b700 1 -- 172.21.15.157:0/1518559230 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0988009550 con 0x7f0994161ab0 2023-10-16T19:57:40.599 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.588+0000 7f0991d9b700 1 --2- 172.21.15.157:0/1518559230 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0994161ab0 0x7f0994160d30 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f098400e9e0 tx=0x7f098400ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:40.600 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.588+0000 7f0982ffd700 1 -- 172.21.15.157:0/1518559230 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0984009710 con 0x7f0994161ab0 2023-10-16T19:57:40.600 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.588+0000 7f0982ffd700 1 -- 172.21.15.157:0/1518559230 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f098400ee80 con 0x7f0994161ab0 2023-10-16T19:57:40.601 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.588+0000 7f0998d6e700 1 -- 172.21.15.157:0/1518559230 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f099415f380 con 0x7f0994161ab0 2023-10-16T19:57:40.601 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.588+0000 7f0982ffd700 1 -- 172.21.15.157:0/1518559230 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f098400ca50 con 0x7f0994161ab0 2023-10-16T19:57:40.601 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.588+0000 7f0998d6e700 1 -- 172.21.15.157:0/1518559230 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0994160530 con 0x7f0994161ab0 2023-10-16T19:57:40.601 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.589+0000 7f0998d6e700 1 -- 172.21.15.157:0/1518559230 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0994160a50 con 0x7f0994161ab0 2023-10-16T19:57:40.602 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.590+0000 7f0982ffd700 1 -- 172.21.15.157:0/1518559230 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f098400cbb0 con 0x7f0994161ab0 2023-10-16T19:57:40.602 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.591+0000 7f0982ffd700 1 --2- 172.21.15.157:0/1518559230 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f097406af00 0x7f097406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:40.602 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.591+0000 7f0982ffd700 1 -- 172.21.15.157:0/1518559230 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0984089aa0 con 0x7f0994161ab0 2023-10-16T19:57:40.602 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.591+0000 7f099259c700 1 --2- 172.21.15.157:0/1518559230 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f097406af00 0x7f097406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:40.602 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.591+0000 7f099259c700 1 --2- 172.21.15.157:0/1518559230 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f097406af00 0x7f097406d3c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f0988009c40 tx=0x7f0988008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:40.603 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.595+0000 7f0982ffd700 1 -- 172.21.15.157:0/1518559230 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0984054cc0 con 0x7f0994161ab0 2023-10-16T19:57:40.784 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.782+0000 7f0998d6e700 1 -- 172.21.15.157:0/1518559230 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0994160a50 con 0x7f0994161ab0 2023-10-16T19:57:40.785 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.782+0000 7f0982ffd700 1 -- 172.21.15.157:0/1518559230 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0994160a50 con 0x7f0994161ab0 2023-10-16T19:57:40.785 INFO:teuthology.orchestra.run.smithi157.stdout:pg_num: 1 2023-10-16T19:57:40.786 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.784+0000 7f0998d6e700 1 -- 172.21.15.157:0/1518559230 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f097406af00 msgr2=0x7f097406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:40.787 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.784+0000 7f0998d6e700 1 --2- 172.21.15.157:0/1518559230 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f097406af00 0x7f097406d3c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f0988009c40 tx=0x7f0988008030 comp rx=0 tx=0).stop 2023-10-16T19:57:40.787 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.784+0000 7f0998d6e700 1 -- 172.21.15.157:0/1518559230 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0994161ab0 msgr2=0x7f0994160d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:40.787 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.784+0000 7f0998d6e700 1 --2- 172.21.15.157:0/1518559230 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0994161ab0 0x7f0994160d30 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f098400e9e0 tx=0x7f098400ecf0 comp rx=0 tx=0).stop 2023-10-16T19:57:40.787 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.784+0000 7f0998d6e700 1 -- 172.21.15.157:0/1518559230 shutdown_connections 2023-10-16T19:57:40.788 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.784+0000 7f0998d6e700 1 --2- 172.21.15.157:0/1518559230 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f097406af00 0x7f097406d3c0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:40.788 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.784+0000 7f0998d6e700 1 --2- 172.21.15.157:0/1518559230 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f09940aee10 0x7f0994155bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:40.788 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.784+0000 7f0998d6e700 1 --2- 172.21.15.157:0/1518559230 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f09941623d0 0x7f09940ae200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:40.788 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.784+0000 7f0998d6e700 1 --2- 172.21.15.157:0/1518559230 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0994161ab0 0x7f0994160d30 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:40.788 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.784+0000 7f0998d6e700 1 -- 172.21.15.157:0/1518559230 >> 172.21.15.157:0/1518559230 conn(0x7f099406c7e0 msgr2=0x7f099406b7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:40.788 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.784+0000 7f0998d6e700 1 -- 172.21.15.157:0/1518559230 shutdown_connections 2023-10-16T19:57:40.789 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.784+0000 7f0998d6e700 1 -- 172.21.15.157:0/1518559230 wait complete. 2023-10-16T19:57:40.799 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-16T19:57:40.923 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.921+0000 7fd3486dc700 1 Processor -- start 2023-10-16T19:57:40.923 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.921+0000 7fd3486dc700 1 -- start start 2023-10-16T19:57:40.926 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.922+0000 7fd3486dc700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fd34015bed0 0x7fd3400b36b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:40.926 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.922+0000 7fd3486dc700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fd3400b3bf0 0x7fd3400d0f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:40.926 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.922+0000 7fd3486dc700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd34015c2b0 con 0x7fd3400d1440 2023-10-16T19:57:40.926 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.922+0000 7fd3486dc700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3400b4070 con 0x7fd3400b3bf0 2023-10-16T19:57:40.927 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.922+0000 7fd3486dc700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd34015f9e0 con 0x7fd34015bed0 2023-10-16T19:57:40.927 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.922+0000 7fd345c77700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fd3400b3bf0 0x7fd3400d0f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:40.927 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.922+0000 7fd345c77700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fd3400b3bf0 0x7fd3400d0f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:46736/0 (socket says 172.21.15.157:46736) 2023-10-16T19:57:40.927 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.922+0000 7fd345c77700 1 -- 172.21.15.157:0/2953120145 learned_addr learned my addr 172.21.15.157:0/2953120145 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:57:40.927 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.922+0000 7fd346478700 1 --2- 172.21.15.157:0/2953120145 >> v2:172.21.15.187:3300/0 conn(0x7fd34015bed0 0x7fd3400b36b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:40.928 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.922+0000 7fd345c77700 1 -- 172.21.15.157:0/2953120145 >> v2:172.21.15.187:3300/0 conn(0x7fd34015bed0 msgr2=0x7fd3400b36b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:57:40.928 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.922+0000 7fd345c77700 1 --2- 172.21.15.157:0/2953120145 >> v2:172.21.15.187:3300/0 conn(0x7fd34015bed0 0x7fd3400b36b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:40.928 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.922+0000 7fd345c77700 1 -- 172.21.15.157:0/2953120145 >> v1:172.21.15.187:6789/0 conn(0x7fd3400d1440 legacy=0x7fd3400cf800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:40.928 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.922+0000 7fd345c77700 1 -- 172.21.15.157:0/2953120145 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd34015fcc0 con 0x7fd3400b3bf0 2023-10-16T19:57:40.928 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.922+0000 7fd345c77700 1 --2- 172.21.15.157:0/2953120145 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd3400b3bf0 0x7fd3400d0f00 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fd3400b4820 tx=0x7fd330009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8d54cbdf3f3372 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:40.929 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.923+0000 7fd345476700 1 -- 172.21.15.157:0/2953120145 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd33000b870 con 0x7fd3400b3bf0 2023-10-16T19:57:40.929 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.923+0000 7fd345476700 1 -- 172.21.15.157:0/2953120145 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd33000b9d0 con 0x7fd3400b3bf0 2023-10-16T19:57:40.929 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.923+0000 7fd345476700 1 -- 172.21.15.157:0/2953120145 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd33000bd60 con 0x7fd3400b3bf0 2023-10-16T19:57:40.929 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.923+0000 7fd3486dc700 1 -- 172.21.15.157:0/2953120145 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd3400b3bf0 msgr2=0x7fd3400d0f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:40.930 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.923+0000 7fd3486dc700 1 --2- 172.21.15.157:0/2953120145 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd3400b3bf0 0x7fd3400d0f00 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fd3400b4820 tx=0x7fd330009bd0 comp rx=0 tx=0).stop 2023-10-16T19:57:40.930 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.923+0000 7fd3486dc700 1 -- 172.21.15.157:0/2953120145 shutdown_connections 2023-10-16T19:57:40.930 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.923+0000 7fd3486dc700 1 --2- 172.21.15.157:0/2953120145 >> v2:172.21.15.187:3300/0 conn(0x7fd34015bed0 0x7fd3400b36b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:40.930 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.923+0000 7fd3486dc700 1 --2- 172.21.15.157:0/2953120145 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd3400b3bf0 0x7fd3400d0f00 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:40.930 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.923+0000 7fd3486dc700 1 -- 172.21.15.157:0/2953120145 >> 172.21.15.157:0/2953120145 conn(0x7fd3400ce6b0 msgr2=0x7fd3400ceac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:40.931 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.923+0000 7fd3486dc700 1 -- 172.21.15.157:0/2953120145 shutdown_connections 2023-10-16T19:57:40.931 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.923+0000 7fd3486dc700 1 -- 172.21.15.157:0/2953120145 wait complete. 2023-10-16T19:57:40.934 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.924+0000 7fd3486dc700 1 Processor -- start 2023-10-16T19:57:40.934 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.924+0000 7fd3486dc700 1 -- start start 2023-10-16T19:57:40.934 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.925+0000 7fd3486dc700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd3400b3bf0 0x7fd3400c9710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:40.935 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.925+0000 7fd3486dc700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd3400d1440 0x7fd3401f6c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:40.935 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.925+0000 7fd3486dc700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd34015bed0 0x7fd3401f7160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:40.935 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.925+0000 7fd3486dc700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3400adce0 con 0x7fd34015bed0 2023-10-16T19:57:40.935 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.925+0000 7fd3486dc700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3400ca670 con 0x7fd3400d1440 2023-10-16T19:57:40.935 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.925+0000 7fd3486dc700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3400ca0b0 con 0x7fd3400b3bf0 2023-10-16T19:57:40.936 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.925+0000 7fd346c79700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd34015bed0 0x7fd3401f7160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:40.936 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.925+0000 7fd346c79700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd34015bed0 0x7fd3401f7160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:46746/0 (socket says 172.21.15.157:46746) 2023-10-16T19:57:40.936 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.925+0000 7fd346c79700 1 -- 172.21.15.157:0/712341157 learned_addr learned my addr 172.21.15.157:0/712341157 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:57:40.936 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.925+0000 7fd346478700 1 --2- 172.21.15.157:0/712341157 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd3400b3bf0 0x7fd3400c9710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:40.936 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.925+0000 7fd345c77700 1 --2- 172.21.15.157:0/712341157 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd3400d1440 0x7fd3401f6c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:40.937 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.926+0000 7fd346c79700 1 -- 172.21.15.157:0/712341157 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd3400b3bf0 msgr2=0x7fd3400c9710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:40.937 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.926+0000 7fd346c79700 1 --2- 172.21.15.157:0/712341157 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd3400b3bf0 0x7fd3400c9710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:40.937 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.926+0000 7fd346c79700 1 -- 172.21.15.157:0/712341157 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd3400d1440 msgr2=0x7fd3401f6c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:40.937 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.926+0000 7fd346c79700 1 --2- 172.21.15.157:0/712341157 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd3400d1440 0x7fd3401f6c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:40.937 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.926+0000 7fd346c79700 1 -- 172.21.15.157:0/712341157 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd330009550 con 0x7fd34015bed0 2023-10-16T19:57:40.937 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.926+0000 7fd346c79700 1 --2- 172.21.15.157:0/712341157 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd34015bed0 0x7fd3401f7160 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fd33800cb80 tx=0x7fd33800cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:40.938 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.926+0000 7fd336ffd700 1 -- 172.21.15.157:0/712341157 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd338003c00 con 0x7fd34015bed0 2023-10-16T19:57:40.938 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.926+0000 7fd336ffd700 1 -- 172.21.15.157:0/712341157 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd338003d60 con 0x7fd34015bed0 2023-10-16T19:57:40.938 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.926+0000 7fd3486dc700 1 -- 172.21.15.157:0/712341157 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3400ca390 con 0x7fd34015bed0 2023-10-16T19:57:40.938 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.926+0000 7fd336ffd700 1 -- 172.21.15.157:0/712341157 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd33800abb0 con 0x7fd34015bed0 2023-10-16T19:57:40.938 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.926+0000 7fd3486dc700 1 -- 172.21.15.157:0/712341157 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3400c9c50 con 0x7fd34015bed0 2023-10-16T19:57:40.939 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.927+0000 7fd3486dc700 1 -- 172.21.15.157:0/712341157 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd34006b300 con 0x7fd34015bed0 2023-10-16T19:57:40.939 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.927+0000 7fd336ffd700 1 -- 172.21.15.157:0/712341157 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fd33800ad10 con 0x7fd34015bed0 2023-10-16T19:57:40.939 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.928+0000 7fd336ffd700 1 --2- 172.21.15.157:0/712341157 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fd32406af00 0x7fd32406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:40.939 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.928+0000 7fd336ffd700 1 -- 172.21.15.157:0/712341157 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd338089670 con 0x7fd34015bed0 2023-10-16T19:57:40.939 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.928+0000 7fd346478700 1 --2- 172.21.15.157:0/712341157 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fd32406af00 0x7fd32406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:40.940 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.928+0000 7fd346478700 1 --2- 172.21.15.157:0/712341157 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fd32406af00 0x7fd32406d3c0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fd33c00b9b0 tx=0x7fd33c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:40.940 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:40.932+0000 7fd336ffd700 1 -- 172.21.15.157:0/712341157 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd338054720 con 0x7fd34015bed0 2023-10-16T19:57:41.121 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:41.118+0000 7fd3486dc700 1 -- 172.21.15.157:0/712341157 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd3400ade90 con 0x7fd34015bed0 2023-10-16T19:57:41.121 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:41.119+0000 7fd336ffd700 1 -- 172.21.15.157:0/712341157 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd338057d40 con 0x7fd34015bed0 2023-10-16T19:57:41.122 INFO:teuthology.orchestra.run.smithi157.stdout:pg_num: 32 2023-10-16T19:57:41.124 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:41.121+0000 7fd3486dc700 1 -- 172.21.15.157:0/712341157 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fd32406af00 msgr2=0x7fd32406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:41.124 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:41.121+0000 7fd3486dc700 1 --2- 172.21.15.157:0/712341157 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fd32406af00 0x7fd32406d3c0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fd33c00b9b0 tx=0x7fd33c008040 comp rx=0 tx=0).stop 2023-10-16T19:57:41.124 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:41.121+0000 7fd3486dc700 1 -- 172.21.15.157:0/712341157 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd34015bed0 msgr2=0x7fd3401f7160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:41.125 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:41.121+0000 7fd3486dc700 1 --2- 172.21.15.157:0/712341157 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd34015bed0 0x7fd3401f7160 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fd33800cb80 tx=0x7fd33800cf40 comp rx=0 tx=0).stop 2023-10-16T19:57:41.125 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:41.121+0000 7fd3486dc700 1 -- 172.21.15.157:0/712341157 shutdown_connections 2023-10-16T19:57:41.125 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:41.121+0000 7fd3486dc700 1 --2- 172.21.15.157:0/712341157 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd34015bed0 0x7fd3401f7160 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:41.125 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:41.121+0000 7fd3486dc700 1 --2- 172.21.15.157:0/712341157 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd3400b3bf0 0x7fd3400c9710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:41.125 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:41.121+0000 7fd3486dc700 1 --2- 172.21.15.157:0/712341157 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fd32406af00 0x7fd32406d3c0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:41.126 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:41.121+0000 7fd3486dc700 1 --2- 172.21.15.157:0/712341157 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd3400d1440 0x7fd3401f6c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:41.126 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:41.121+0000 7fd3486dc700 1 -- 172.21.15.157:0/712341157 >> 172.21.15.157:0/712341157 conn(0x7fd3400ce6b0 msgr2=0x7fd3400b67c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:41.126 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:41.121+0000 7fd3486dc700 1 -- 172.21.15.157:0/712341157 shutdown_connections 2023-10-16T19:57:41.126 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:41.121+0000 7fd3486dc700 1 -- 172.21.15.157:0/712341157 wait complete. 2023-10-16T19:57:41.136 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-16T19:57:41.260 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:41.257+0000 7f40c2eaa700 1 Processor -- start 2023-10-16T19:57:41.260 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:41.257+0000 7f40c2eaa700 1 -- start start 2023-10-16T19:57:41.265 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:41.258+0000 7f40c2eaa700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f40bc15e090 0x7f40bc06b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:41.266 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:41.258+0000 7f40c2eaa700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f40bc06ea10 0x7f40bc0afa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:41.266 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:41.258+0000 7f40c2eaa700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40bc06b6a0 con 0x7f40bc0affc0 2023-10-16T19:57:41.266 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:41.258+0000 7f40c2eaa700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40bc071b50 con 0x7f40bc06ea10 2023-10-16T19:57:41.266 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:41.258+0000 7f40c2eaa700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40bc0b0430 con 0x7f40bc15e090 2023-10-16T19:57:41.267 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:41.258+0000 7f40c1447700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f40bc0affc0 0x7f40bc15e470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:56426/0 (socket says 172.21.15.157:56426) 2023-10-16T19:57:41.267 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:41.258+0000 7f40c1447700 1 -- 172.21.15.157:0/1081815694 learned_addr learned my addr 172.21.15.157:0/1081815694 (peer_addr_for_me v1:172.21.15.157:0/0) 2023-10-16T19:57:41.267 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:41.258+0000 7f40bb7fe700 1 -- 172.21.15.157:0/1081815694 <== mon.0 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2336210898 0 0) 0x7f40bc06b6a0 con 0x7f40bc0affc0 2023-10-16T19:57:41.267 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:41.259+0000 7f40bb7fe700 1 -- 172.21.15.157:0/1081815694 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f40ac0035b0 con 0x7f40bc0affc0 2023-10-16T19:57:41.267 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:41.259+0000 7f40c0c46700 1 --2- 172.21.15.157:0/1081815694 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f40bc15e090 0x7f40bc06b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:41.268 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:41.259+0000 7f40bbfff700 1 --2- 172.21.15.157:0/1081815694 >> v2:172.21.15.187:3300/0 conn(0x7f40bc06ea10 0x7f40bc0afa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:41.268 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:41.259+0000 7f40bb7fe700 1 -- 172.21.15.157:0/1081815694 <== mon.0 v1:172.21.15.157:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 443080622 0 0) 0x7f40ac0035b0 con 0x7f40bc0affc0 2023-10-16T19:57:41.268 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:41.259+0000 7f40bb7fe700 1 -- 172.21.15.157:0/1081815694 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f40bc15e090 msgr2=0x7f40bc06b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:57:41.268 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:41.259+0000 7f40bb7fe700 1 --2- 172.21.15.157:0/1081815694 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f40bc15e090 0x7f40bc06b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:41.268 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:41.259+0000 7f40bb7fe700 1 -- 172.21.15.157:0/1081815694 >> v2:172.21.15.187:3300/0 conn(0x7f40bc06ea10 msgr2=0x7f40bc0afa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:57:41.269 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:41.259+0000 7f40bb7fe700 1 --2- 172.21.15.157:0/1081815694 >> v2:172.21.15.187:3300/0 conn(0x7f40bc06ea10 0x7f40bc0afa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:41.269 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:41.259+0000 7f40bb7fe700 1 -- 172.21.15.157:0/1081815694 --> v1:172.21.15.157:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40bc072320 con 0x7f40bc0affc0 2023-10-16T19:57:41.269 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:41.259+0000 7f40bb7fe700 1 -- 172.21.15.157:0/1081815694 <== mon.0 v1:172.21.15.157:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4021145519 0 0) 0x7f40b40019f0 con 0x7f40bc0affc0 2023-10-16T19:57:41.269 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:41.259+0000 7f40bb7fe700 1 -- 172.21.15.157:0/1081815694 >> v1:172.21.15.157:6789/0 conn(0x7f40bc0affc0 legacy=0x7f40bc15e470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:41.269 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:41.259+0000 7f40bb7fe700 1 --2- 172.21.15.157:0/1081815694 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f40bc15e090 0x7f40ac003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:41.270 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:41.259+0000 7f40bb7fe700 1 --2- 172.21.15.157:0/1081815694 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f40ac003f80 0x7f40ac004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:41.270 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:41.259+0000 7f40bb7fe700 1 --2- 172.21.15.157:0/1081815694 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f40ac004d90 0x7f40ac005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:41.270 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:41.259+0000 7f40bb7fe700 1 -- 172.21.15.157:0/1081815694 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40bc071b50 con 0x7f40ac003f80 2023-10-16T19:57:41.270 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:41.259+0000 7f40bb7fe700 1 -- 172.21.15.157:0/1081815694 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40bc0b0430 con 0x7f40ac004d90 2023-10-16T19:57:41.270 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:41.259+0000 7f40bb7fe700 1 -- 172.21.15.157:0/1081815694 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40ac00ba60 con 0x7f40bc15e090 2023-10-16T19:57:41.271 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:41.259+0000 7f40bbfff700 1 --2- 172.21.15.157:0/1081815694 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f40ac003f80 0x7f40ac004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:41.271 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:41.259+0000 7f40c0c46700 1 --2- 172.21.15.157:0/1081815694 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f40bc15e090 0x7f40ac003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:41.271 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:41.259+0000 7f40c1447700 1 --2- 172.21.15.157:0/1081815694 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f40ac004d90 0x7f40ac005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:41.271 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:41.259+0000 7f40bbfff700 1 -- 172.21.15.157:0/1081815694 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f40bc15e090 msgr2=0x7f40ac003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:57:41.271 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:41.259+0000 7f40bbfff700 1 --2- 172.21.15.157:0/1081815694 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f40bc15e090 0x7f40ac003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:41.272 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:41.259+0000 7f40bbfff700 1 -- 172.21.15.157:0/1081815694 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f40ac004d90 msgr2=0x7f40ac005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:57:41.272 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:41.259+0000 7f40bbfff700 1 --2- 172.21.15.157:0/1081815694 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f40ac004d90 0x7f40ac005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:41.272 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:41.259+0000 7f40bbfff700 1 -- 172.21.15.157:0/1081815694 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40ac0035b0 con 0x7f40ac003f80 2023-10-16T19:57:41.272 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:41.259+0000 7f40bbfff700 1 --2- 172.21.15.157:0/1081815694 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f40ac003f80 0x7f40ac004850 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f40a8009b90 tx=0x7f40ac005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=514f614e9fbea631 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:41.272 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:41.260+0000 7f40bb7fe700 1 -- 172.21.15.157:0/1081815694 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40a800e6c0 con 0x7f40ac003f80 2023-10-16T19:57:41.273 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:41.260+0000 7f40bb7fe700 1 -- 172.21.15.157:0/1081815694 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40a800e820 con 0x7f40ac003f80 2023-10-16T19:57:41.273 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:41.260+0000 7f40bb7fe700 1 -- 172.21.15.157:0/1081815694 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40a800eb90 con 0x7f40ac003f80 2023-10-16T19:57:41.273 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:41.260+0000 7f40c2eaa700 1 -- 172.21.15.157:0/1081815694 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f40ac003f80 msgr2=0x7f40ac004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:41.273 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:41.260+0000 7f40c2eaa700 1 --2- 172.21.15.157:0/1081815694 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f40ac003f80 0x7f40ac004850 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f40a8009b90 tx=0x7f40ac005880 comp rx=0 tx=0).stop 2023-10-16T19:57:41.273 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:41.260+0000 7f40c1447700 1 -- 172.21.15.157:0/1081815694 reap_dead start 2023-10-16T19:57:41.274 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:41.260+0000 7f40c2eaa700 1 -- 172.21.15.157:0/1081815694 shutdown_connections 2023-10-16T19:57:41.274 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:41.260+0000 7f40c2eaa700 1 -- 172.21.15.157:0/1081815694 >> 172.21.15.157:0/1081815694 conn(0x7f40bc0d0b30 msgr2=0x7f40bc0d0f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:41.274 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:41.260+0000 7f40c2eaa700 1 -- 172.21.15.157:0/1081815694 shutdown_connections 2023-10-16T19:57:41.274 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:41.260+0000 7f40c2eaa700 1 -- 172.21.15.157:0/1081815694 wait complete. 2023-10-16T19:57:41.274 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:41.261+0000 7f40c2eaa700 1 Processor -- start 2023-10-16T19:57:41.275 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:41.261+0000 7f40c2eaa700 1 -- start start 2023-10-16T19:57:41.275 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:41.262+0000 7f40c2eaa700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f40ac003f80 0x7f40bc148180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:41.275 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:41.262+0000 7f40c2eaa700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f40bc0c7f00 0x7f40bc15c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:41.275 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:41.262+0000 7f40c2eaa700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f40bc0c8380 0x7f40bc0ca800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:41.275 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:41.262+0000 7f40c2eaa700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40bc149900 con 0x7f40ac003f80 2023-10-16T19:57:41.276 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:41.262+0000 7f40c2eaa700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40bc1486c0 con 0x7f40bc0c8380 2023-10-16T19:57:41.276 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:41.262+0000 7f40c2eaa700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40bc1489a0 con 0x7f40bc0c7f00 2023-10-16T19:57:41.276 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:41.262+0000 7f40c0c46700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f40ac003f80 0x7f40bc148180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:41.276 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:41.262+0000 7f40c0c46700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f40ac003f80 0x7f40bc148180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:46764/0 (socket says 172.21.15.157:46764) 2023-10-16T19:57:41.276 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:41.262+0000 7f40c0c46700 1 -- 172.21.15.157:0/568885926 learned_addr learned my addr 172.21.15.157:0/568885926 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:57:41.277 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:41.263+0000 7f40bbfff700 1 --2- 172.21.15.157:0/568885926 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f40bc0c7f00 0x7f40bc15c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:41.277 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:41.263+0000 7f40c1447700 1 --2- 172.21.15.157:0/568885926 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f40bc0c8380 0x7f40bc0ca800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:41.277 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:41.263+0000 7f40c0c46700 1 -- 172.21.15.157:0/568885926 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f40bc0c7f00 msgr2=0x7f40bc15c4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:41.277 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:41.263+0000 7f40c0c46700 1 --2- 172.21.15.157:0/568885926 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f40bc0c7f00 0x7f40bc15c4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:41.277 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:41.263+0000 7f40c0c46700 1 -- 172.21.15.157:0/568885926 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f40bc0c8380 msgr2=0x7f40bc0ca800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:41.277 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:41.263+0000 7f40c0c46700 1 --2- 172.21.15.157:0/568885926 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f40bc0c8380 0x7f40bc0ca800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:41.278 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:41.263+0000 7f40c0c46700 1 -- 172.21.15.157:0/568885926 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40bc148c80 con 0x7f40ac003f80 2023-10-16T19:57:41.278 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:41.263+0000 7f40bbfff700 1 --2- 172.21.15.157:0/568885926 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f40bc0c7f00 0x7f40bc15c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T19:57:41.278 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:41.263+0000 7f40c1447700 1 --2- 172.21.15.157:0/568885926 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f40bc0c8380 0x7f40bc0ca800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T19:57:41.278 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:41.263+0000 7f40c0c46700 1 --2- 172.21.15.157:0/568885926 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f40ac003f80 0x7f40bc148180 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f40b0011aa0 tx=0x7f40b0011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:41.278 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:41.263+0000 7f40b97fa700 1 -- 172.21.15.157:0/568885926 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40b000f980 con 0x7f40ac003f80 2023-10-16T19:57:41.279 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:41.263+0000 7f40b97fa700 1 -- 172.21.15.157:0/568885926 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40b000fae0 con 0x7f40ac003f80 2023-10-16T19:57:41.279 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:41.263+0000 7f40c2eaa700 1 -- 172.21.15.157:0/568885926 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40bc148f60 con 0x7f40ac003f80 2023-10-16T19:57:41.279 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:41.263+0000 7f40b97fa700 1 -- 172.21.15.157:0/568885926 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40b000fe90 con 0x7f40ac003f80 2023-10-16T19:57:41.279 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:41.263+0000 7f40c2eaa700 1 -- 172.21.15.157:0/568885926 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40bc149520 con 0x7f40ac003f80 2023-10-16T19:57:41.280 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:41.264+0000 7f40c2eaa700 1 -- 172.21.15.157:0/568885926 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40bc1496e0 con 0x7f40ac003f80 2023-10-16T19:57:41.281 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:41.265+0000 7f40b97fa700 1 -- 172.21.15.157:0/568885926 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f40b00263a0 con 0x7f40ac003f80 2023-10-16T19:57:41.281 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:41.265+0000 7f40b97fa700 1 --2- 172.21.15.157:0/568885926 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f40a006af00 0x7f40a006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:41.281 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:41.265+0000 7f40b97fa700 1 -- 172.21.15.157:0/568885926 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f40b0089e80 con 0x7f40ac003f80 2023-10-16T19:57:41.281 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:41.265+0000 7f40bbfff700 1 --2- 172.21.15.157:0/568885926 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f40a006af00 0x7f40a006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:41.281 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:41.266+0000 7f40bbfff700 1 --2- 172.21.15.157:0/568885926 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f40a006af00 0x7f40a006d3c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f40bc15d030 tx=0x7f40a8008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:41.282 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:41.269+0000 7f40b97fa700 1 -- 172.21.15.157:0/568885926 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f40b0055040 con 0x7f40ac003f80 2023-10-16T19:57:41.459 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:41.457+0000 7f40c2eaa700 1 -- 172.21.15.157:0/568885926 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f40bc04f400 con 0x7f40ac003f80 2023-10-16T19:57:41.460 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:41.457+0000 7f40b97fa700 1 -- 172.21.15.157:0/568885926 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f40b0058660 con 0x7f40ac003f80 2023-10-16T19:57:41.460 INFO:teuthology.orchestra.run.smithi157.stdout:pg_num: 64 2023-10-16T19:57:41.462 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:41.460+0000 7f40c2eaa700 1 -- 172.21.15.157:0/568885926 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f40a006af00 msgr2=0x7f40a006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:41.462 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:41.460+0000 7f40c2eaa700 1 --2- 172.21.15.157:0/568885926 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f40a006af00 0x7f40a006d3c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f40bc15d030 tx=0x7f40a8008030 comp rx=0 tx=0).stop 2023-10-16T19:57:41.462 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:41.460+0000 7f40c2eaa700 1 -- 172.21.15.157:0/568885926 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f40ac003f80 msgr2=0x7f40bc148180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:41.462 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:41.460+0000 7f40c2eaa700 1 --2- 172.21.15.157:0/568885926 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f40ac003f80 0x7f40bc148180 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f40b0011aa0 tx=0x7f40b0011e60 comp rx=0 tx=0).stop 2023-10-16T19:57:41.463 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:41.460+0000 7f40c2eaa700 1 -- 172.21.15.157:0/568885926 shutdown_connections 2023-10-16T19:57:41.463 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:41.460+0000 7f40c2eaa700 1 --2- 172.21.15.157:0/568885926 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f40a006af00 0x7f40a006d3c0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:41.464 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:41.460+0000 7f40c2eaa700 1 --2- 172.21.15.157:0/568885926 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f40bc0c8380 0x7f40bc0ca800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:41.464 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:41.460+0000 7f40c2eaa700 1 --2- 172.21.15.157:0/568885926 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f40ac003f80 0x7f40bc148180 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:41.464 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:41.460+0000 7f40c2eaa700 1 --2- 172.21.15.157:0/568885926 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f40bc0c7f00 0x7f40bc15c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:41.464 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:41.460+0000 7f40c2eaa700 1 -- 172.21.15.157:0/568885926 >> 172.21.15.157:0/568885926 conn(0x7f40bc0d0b30 msgr2=0x7f40bc0cd540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:41.464 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:41.460+0000 7f40c2eaa700 1 -- 172.21.15.157:0/568885926 shutdown_connections 2023-10-16T19:57:41.465 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:41.460+0000 7f40c2eaa700 1 -- 172.21.15.157:0/568885926 wait complete. 2023-10-16T19:57:41.474 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestClusterFull.test_barrier' 2023-10-16T19:57:41.595 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:41.593+0000 7f707191c700 1 Processor -- start 2023-10-16T19:57:41.595 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:41.593+0000 7f707191c700 1 -- start start 2023-10-16T19:57:41.598 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:41.593+0000 7f707191c700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f706c071e10 0x7f706c06ff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:41.598 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:41.593+0000 7f707191c700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f706c0721f0 con 0x7f706c06c660 2023-10-16T19:57:41.598 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:41.593+0000 7f707191c700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f706c0cd5c0 con 0x7f706c0aead0 2023-10-16T19:57:41.598 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:41.593+0000 7f707191c700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f706c0cd8a0 con 0x7f706c071e10 2023-10-16T19:57:41.598 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:41.594+0000 7f706b7fe700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f706c06c660 0x7f706c0ce660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:56444/0 (socket says 172.21.15.157:56444) 2023-10-16T19:57:41.599 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:41.594+0000 7f706b7fe700 1 -- 172.21.15.157:0/485456009 learned_addr learned my addr 172.21.15.157:0/485456009 (peer_addr_for_me v1:172.21.15.157:0/0) 2023-10-16T19:57:41.599 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:41.594+0000 7f706affd700 1 --2- 172.21.15.157:0/485456009 >> v2:172.21.15.187:3300/0 conn(0x7f706c071e10 0x7f706c06ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:41.599 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:41.594+0000 7f7069ffb700 1 -- 172.21.15.157:0/485456009 <== mon.0 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 678981717 0 0) 0x7f706c0721f0 con 0x7f706c06c660 2023-10-16T19:57:41.599 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:41.594+0000 7f7069ffb700 1 -- 172.21.15.157:0/485456009 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f70540035b0 con 0x7f706c06c660 2023-10-16T19:57:41.599 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:41.594+0000 7f7069ffb700 1 -- 172.21.15.157:0/485456009 <== mon.0 v1:172.21.15.157:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3485377128 0 0) 0x7f70540035b0 con 0x7f706c06c660 2023-10-16T19:57:41.600 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:41.594+0000 7f706affd700 1 -- 172.21.15.157:0/485456009 >> v1:172.21.15.187:6789/0 conn(0x7f706c0aead0 legacy=0x7f706c06bf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:41.600 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:41.594+0000 7f706affd700 1 -- 172.21.15.157:0/485456009 >> v1:172.21.15.157:6789/0 conn(0x7f706c06c660 legacy=0x7f706c0ce660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:41.600 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:41.594+0000 7f706affd700 1 -- 172.21.15.157:0/485456009 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f706c0cdb80 con 0x7f706c071e10 2023-10-16T19:57:41.600 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:41.594+0000 7f706affd700 1 --2- 172.21.15.157:0/485456009 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f706c071e10 0x7f706c06ff50 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f705c009840 tx=0x7f705c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3e09c390ede67dd9 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:41.600 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:41.594+0000 7f7069ffb700 1 -- 172.21.15.157:0/485456009 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70640019f0 con 0x7f706c071e10 2023-10-16T19:57:41.601 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:41.594+0000 7f7069ffb700 1 -- 172.21.15.157:0/485456009 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f705c004030 con 0x7f706c071e10 2023-10-16T19:57:41.601 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:41.594+0000 7f7069ffb700 1 -- 172.21.15.157:0/485456009 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f705c0043a0 con 0x7f706c071e10 2023-10-16T19:57:41.601 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:41.595+0000 7f707191c700 1 -- 172.21.15.157:0/485456009 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f706c071e10 msgr2=0x7f706c06ff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:41.601 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:41.595+0000 7f707191c700 1 --2- 172.21.15.157:0/485456009 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f706c071e10 0x7f706c06ff50 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f705c009840 tx=0x7f705c009b50 comp rx=0 tx=0).stop 2023-10-16T19:57:41.601 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:41.595+0000 7f707191c700 1 -- 172.21.15.157:0/485456009 shutdown_connections 2023-10-16T19:57:41.602 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:41.595+0000 7f707191c700 1 --2- 172.21.15.157:0/485456009 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f706c071e10 0x7f706c06ff50 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:41.602 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:41.595+0000 7f707191c700 1 -- 172.21.15.157:0/485456009 >> 172.21.15.157:0/485456009 conn(0x7f706c0b1540 msgr2=0x7f706c0b1920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:41.602 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:41.595+0000 7f707191c700 1 -- 172.21.15.157:0/485456009 shutdown_connections 2023-10-16T19:57:41.602 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:41.595+0000 7f707191c700 1 -- 172.21.15.157:0/485456009 wait complete. 2023-10-16T19:57:41.605 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:41.596+0000 7f707191c700 1 Processor -- start 2023-10-16T19:57:41.605 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:41.596+0000 7f707191c700 1 -- start start 2023-10-16T19:57:41.605 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:41.597+0000 7f707191c700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f706c06c660 0x7f706c0c5f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:41.605 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:41.597+0000 7f707191c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f706c071e10 0x7f706c151020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:41.606 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:41.597+0000 7f707191c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f706c0aead0 0x7f706c0ad860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:41.606 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:41.597+0000 7f707191c700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f706c151dc0 con 0x7f706c0aead0 2023-10-16T19:57:41.606 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:41.597+0000 7f707191c700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f706c151ae0 con 0x7f706c071e10 2023-10-16T19:57:41.606 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:41.597+0000 7f707191c700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f706c0b2880 con 0x7f706c06c660 2023-10-16T19:57:41.607 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:41.597+0000 7f706b7fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f706c0aead0 0x7f706c0ad860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:41.607 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:41.597+0000 7f706b7fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f706c0aead0 0x7f706c0ad860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:46780/0 (socket says 172.21.15.157:46780) 2023-10-16T19:57:41.607 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:41.597+0000 7f706b7fe700 1 -- 172.21.15.157:0/292553791 learned_addr learned my addr 172.21.15.157:0/292553791 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:57:41.607 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:41.597+0000 7f706affd700 1 --2- 172.21.15.157:0/292553791 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f706c06c660 0x7f706c0c5f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:41.607 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:41.597+0000 7f706a7fc700 1 --2- 172.21.15.157:0/292553791 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f706c071e10 0x7f706c151020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:41.608 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:41.597+0000 7f706b7fe700 1 -- 172.21.15.157:0/292553791 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f706c06c660 msgr2=0x7f706c0c5f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:41.608 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:41.597+0000 7f706b7fe700 1 --2- 172.21.15.157:0/292553791 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f706c06c660 0x7f706c0c5f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:41.608 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:41.597+0000 7f706b7fe700 1 -- 172.21.15.157:0/292553791 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f706c071e10 msgr2=0x7f706c151020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:41.608 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:41.597+0000 7f706b7fe700 1 --2- 172.21.15.157:0/292553791 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f706c071e10 0x7f706c151020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:41.608 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:41.597+0000 7f706b7fe700 1 -- 172.21.15.157:0/292553791 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f705c0094a0 con 0x7f706c0aead0 2023-10-16T19:57:41.609 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:41.597+0000 7f706a7fc700 1 --2- 172.21.15.157:0/292553791 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f706c071e10 0x7f706c151020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T19:57:41.609 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:41.597+0000 7f706affd700 1 --2- 172.21.15.157:0/292553791 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f706c06c660 0x7f706c0c5f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T19:57:41.609 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:41.598+0000 7f706b7fe700 1 --2- 172.21.15.157:0/292553791 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f706c0aead0 0x7f706c0ad860 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f7064001560 tx=0x7f706400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:41.609 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:41.598+0000 7f7053fff700 1 -- 172.21.15.157:0/292553791 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f706400abf0 con 0x7f706c0aead0 2023-10-16T19:57:41.609 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:41.598+0000 7f7053fff700 1 -- 172.21.15.157:0/292553791 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f706400ad50 con 0x7f706c0aead0 2023-10-16T19:57:41.609 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:41.598+0000 7f707191c700 1 -- 172.21.15.157:0/292553791 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f706c0b2b60 con 0x7f706c0aead0 2023-10-16T19:57:41.610 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:41.598+0000 7f7053fff700 1 -- 172.21.15.157:0/292553791 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7064007310 con 0x7f706c0aead0 2023-10-16T19:57:41.610 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:41.598+0000 7f707191c700 1 -- 172.21.15.157:0/292553791 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f706c0b5330 con 0x7f706c0aead0 2023-10-16T19:57:41.610 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:41.599+0000 7f707191c700 1 -- 172.21.15.157:0/292553791 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f706c0b26e0 con 0x7f706c0aead0 2023-10-16T19:57:41.610 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:41.599+0000 7f7053fff700 1 -- 172.21.15.157:0/292553791 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f7064007470 con 0x7f706c0aead0 2023-10-16T19:57:41.611 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:41.599+0000 7f7053fff700 1 --2- 172.21.15.157:0/292553791 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f705806af00 0x7f705806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:41.611 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:41.600+0000 7f7053fff700 1 -- 172.21.15.157:0/292553791 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7064089440 con 0x7f706c0aead0 2023-10-16T19:57:41.611 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:41.600+0000 7f706affd700 1 --2- 172.21.15.157:0/292553791 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f705806af00 0x7f705806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:41.611 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:41.600+0000 7f706affd700 1 --2- 172.21.15.157:0/292553791 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f705806af00 0x7f705806d3c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f705c0090b0 tx=0x7f705c008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:41.612 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:41.604+0000 7f7053fff700 1 -- 172.21.15.157:0/292553791 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f706c0b26e0 con 0x7f706c0aead0 2023-10-16T19:57:41.872 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:41.869+0000 7f707191c700 1 -- 172.21.15.157:0/292553791 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_barrier"]} v 0) v1 -- 0x7f706c0b3080 con 0x7f706c0aead0 2023-10-16T19:57:42.138 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:42.136+0000 7f7053fff700 1 -- 172.21.15.157:0/292553791 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_barrier"]}]=0 v51) v1 ==== 133+0+0 (secure 0 0 0) 0x7f706c0b3080 con 0x7f706c0aead0 2023-10-16T19:57:42.141 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:42.138+0000 7f707191c700 1 -- 172.21.15.157:0/292553791 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f705806af00 msgr2=0x7f705806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:42.141 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:42.138+0000 7f707191c700 1 --2- 172.21.15.157:0/292553791 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f705806af00 0x7f705806d3c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f705c0090b0 tx=0x7f705c008030 comp rx=0 tx=0).stop 2023-10-16T19:57:42.141 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:42.138+0000 7f707191c700 1 -- 172.21.15.157:0/292553791 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f706c0aead0 msgr2=0x7f706c0ad860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:42.141 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:42.138+0000 7f707191c700 1 --2- 172.21.15.157:0/292553791 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f706c0aead0 0x7f706c0ad860 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f7064001560 tx=0x7f706400a060 comp rx=0 tx=0).stop 2023-10-16T19:57:42.142 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:42.138+0000 7f707191c700 1 -- 172.21.15.157:0/292553791 shutdown_connections 2023-10-16T19:57:42.142 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:42.138+0000 7f707191c700 1 --2- 172.21.15.157:0/292553791 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f706c0aead0 0x7f706c0ad860 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:42.142 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:42.138+0000 7f707191c700 1 --2- 172.21.15.157:0/292553791 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f706c06c660 0x7f706c0c5f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:42.142 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:42.138+0000 7f707191c700 1 --2- 172.21.15.157:0/292553791 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f705806af00 0x7f705806d3c0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:42.143 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:42.138+0000 7f707191c700 1 --2- 172.21.15.157:0/292553791 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f706c071e10 0x7f706c151020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:42.143 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:42.138+0000 7f707191c700 1 -- 172.21.15.157:0/292553791 >> 172.21.15.157:0/292553791 conn(0x7f706c0b1540 msgr2=0x7f706c0affc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:42.143 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:42.138+0000 7f707191c700 1 -- 172.21.15.157:0/292553791 shutdown_connections 2023-10-16T19:57:42.143 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:42.138+0000 7f707191c700 1 -- 172.21.15.157:0/292553791 wait complete. 2023-10-16T19:57:42.155 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_objectstore 2023-10-16T19:57:42.290 INFO:teuthology.orchestra.run.smithi157.stdout:{"osd_objectstore":"memstore"} 2023-10-16T19:57:42.291 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_objectstore": "memstore" } 2023-10-16T19:57:42.292 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-16T19:57:42.415 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:42.413+0000 7fd639d22700 1 Processor -- start 2023-10-16T19:57:42.415 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:42.413+0000 7fd639d22700 1 -- start start 2023-10-16T19:57:42.417 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:42.413+0000 7fd639d22700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fd6340b3dc0 0x7fd6340d0f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:42.418 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:42.413+0000 7fd639d22700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd63415c2b0 con 0x7fd63415bed0 2023-10-16T19:57:42.418 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:42.413+0000 7fd639d22700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd63415f9e0 con 0x7fd6340d1440 2023-10-16T19:57:42.418 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:42.413+0000 7fd639d22700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd63415fcc0 con 0x7fd6340b3dc0 2023-10-16T19:57:42.418 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:42.413+0000 7fd632ffd700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fd6340b3dc0 0x7fd6340d0f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:42.418 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:42.413+0000 7fd632ffd700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fd6340b3dc0 0x7fd6340d0f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:46786/0 (socket says 172.21.15.157:46786) 2023-10-16T19:57:42.419 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:42.414+0000 7fd632ffd700 1 -- 172.21.15.157:0/3910098545 learned_addr learned my addr 172.21.15.157:0/3910098545 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:57:42.419 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:42.413+0000 7fd6337fe700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7fd63415bed0 0x7fd6340b36b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:56456/0 (socket says 172.21.15.157:56456) 2023-10-16T19:57:42.419 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:42.414+0000 7fd632ffd700 1 -- 172.21.15.157:0/3910098545 >> v1:172.21.15.187:6789/0 conn(0x7fd6340d1440 legacy=0x7fd63406fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:57:42.419 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:42.414+0000 7fd632ffd700 1 -- 172.21.15.157:0/3910098545 >> v1:172.21.15.157:6789/0 conn(0x7fd63415bed0 legacy=0x7fd6340b36b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:42.419 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:42.414+0000 7fd632ffd700 1 -- 172.21.15.157:0/3910098545 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd63415ffa0 con 0x7fd6340b3dc0 2023-10-16T19:57:42.420 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:42.414+0000 7fd6327fc700 1 -- 172.21.15.157:0/3910098545 <== mon.0 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1642303098 0 0) 0x7fd63415c2b0 con 0x7fd63415bed0 2023-10-16T19:57:42.420 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:42.414+0000 7fd632ffd700 1 --2- 172.21.15.157:0/3910098545 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd6340b3dc0 0x7fd6340d0f00 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fd6240098f0 tx=0x7fd624009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f58f0a32ad94d9c3 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:42.420 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:42.414+0000 7fd6327fc700 1 -- 172.21.15.157:0/3910098545 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd624004230 con 0x7fd6340b3dc0 2023-10-16T19:57:42.420 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:42.414+0000 7fd6327fc700 1 -- 172.21.15.157:0/3910098545 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd624004390 con 0x7fd6340b3dc0 2023-10-16T19:57:42.420 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:42.414+0000 7fd6327fc700 1 -- 172.21.15.157:0/3910098545 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6240036a0 con 0x7fd6340b3dc0 2023-10-16T19:57:42.421 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:42.415+0000 7fd639d22700 1 -- 172.21.15.157:0/3910098545 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd6340b3dc0 msgr2=0x7fd6340d0f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:42.421 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:42.415+0000 7fd639d22700 1 --2- 172.21.15.157:0/3910098545 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd6340b3dc0 0x7fd6340d0f00 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fd6240098f0 tx=0x7fd624009c00 comp rx=0 tx=0).stop 2023-10-16T19:57:42.421 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:42.415+0000 7fd639d22700 1 -- 172.21.15.157:0/3910098545 shutdown_connections 2023-10-16T19:57:42.421 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:42.415+0000 7fd639d22700 1 --2- 172.21.15.157:0/3910098545 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd6340b3dc0 0x7fd6340d0f00 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:42.421 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:42.415+0000 7fd639d22700 1 -- 172.21.15.157:0/3910098545 >> 172.21.15.157:0/3910098545 conn(0x7fd6340ce6b0 msgr2=0x7fd6340ceac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:42.422 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:42.415+0000 7fd639d22700 1 -- 172.21.15.157:0/3910098545 shutdown_connections 2023-10-16T19:57:42.422 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:42.415+0000 7fd639d22700 1 -- 172.21.15.157:0/3910098545 wait complete. 2023-10-16T19:57:42.424 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:42.416+0000 7fd639d22700 1 Processor -- start 2023-10-16T19:57:42.425 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:42.416+0000 7fd639d22700 1 -- start start 2023-10-16T19:57:42.425 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:42.417+0000 7fd639d22700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd6340b3dc0 0x7fd6340c79d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:42.425 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:42.417+0000 7fd639d22700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd6340d1440 0x7fd634159860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:42.425 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:42.417+0000 7fd639d22700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd63415bed0 0x7fd634159da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:42.425 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:42.417+0000 7fd639d22700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd634156630 con 0x7fd6340d1440 2023-10-16T19:57:42.426 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:42.417+0000 7fd639d22700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd634156910 con 0x7fd63415bed0 2023-10-16T19:57:42.426 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:42.417+0000 7fd639d22700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd634156bf0 con 0x7fd6340b3dc0 2023-10-16T19:57:42.426 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:42.417+0000 7fd632ffd700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd6340d1440 0x7fd634159860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:42.426 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:42.417+0000 7fd632ffd700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd6340d1440 0x7fd634159860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:46792/0 (socket says 172.21.15.157:46792) 2023-10-16T19:57:42.426 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:42.417+0000 7fd632ffd700 1 -- 172.21.15.157:0/3955217705 learned_addr learned my addr 172.21.15.157:0/3955217705 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:57:42.427 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:42.418+0000 7fd632ffd700 1 -- 172.21.15.157:0/3955217705 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd6340b3dc0 msgr2=0x7fd6340c79d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:42.427 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:42.418+0000 7fd632ffd700 1 --2- 172.21.15.157:0/3955217705 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd6340b3dc0 0x7fd6340c79d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:42.427 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:42.418+0000 7fd632ffd700 1 -- 172.21.15.157:0/3955217705 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd63415bed0 msgr2=0x7fd634159da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:42.427 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:42.418+0000 7fd633fff700 1 --2- 172.21.15.157:0/3955217705 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd63415bed0 0x7fd634159da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:42.427 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:42.418+0000 7fd632ffd700 1 --2- 172.21.15.157:0/3955217705 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd63415bed0 0x7fd634159da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:42.428 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:42.418+0000 7fd632ffd700 1 -- 172.21.15.157:0/3955217705 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd624009550 con 0x7fd6340d1440 2023-10-16T19:57:42.428 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:42.418+0000 7fd633fff700 1 --2- 172.21.15.157:0/3955217705 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd63415bed0 0x7fd634159da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T19:57:42.428 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:42.418+0000 7fd632ffd700 1 --2- 172.21.15.157:0/3955217705 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd6340d1440 0x7fd634159860 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fd624009130 tx=0x7fd624004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:42.428 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:42.418+0000 7fd62bfff700 1 -- 172.21.15.157:0/3955217705 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd62400b660 con 0x7fd6340d1440 2023-10-16T19:57:42.428 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:42.418+0000 7fd62bfff700 1 -- 172.21.15.157:0/3955217705 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd62400b7c0 con 0x7fd6340d1440 2023-10-16T19:57:42.429 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:42.418+0000 7fd639d22700 1 -- 172.21.15.157:0/3955217705 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd634156ed0 con 0x7fd6340d1440 2023-10-16T19:57:42.429 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:42.418+0000 7fd62bfff700 1 -- 172.21.15.157:0/3955217705 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd62400bb70 con 0x7fd6340d1440 2023-10-16T19:57:42.429 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:42.418+0000 7fd639d22700 1 -- 172.21.15.157:0/3955217705 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd634151830 con 0x7fd6340d1440 2023-10-16T19:57:42.429 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:42.419+0000 7fd639d22700 1 -- 172.21.15.157:0/3955217705 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd63406b300 con 0x7fd6340d1440 2023-10-16T19:57:42.429 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:42.419+0000 7fd62bfff700 1 -- 172.21.15.157:0/3955217705 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fd62400bcd0 con 0x7fd6340d1440 2023-10-16T19:57:42.430 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:42.420+0000 7fd62bfff700 1 --2- 172.21.15.157:0/3955217705 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fd61406af00 0x7fd61406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:42.430 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:42.420+0000 7fd62bfff700 1 -- 172.21.15.157:0/3955217705 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd62408ade0 con 0x7fd6340d1440 2023-10-16T19:57:42.430 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:42.420+0000 7fd6337fe700 1 --2- 172.21.15.157:0/3955217705 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fd61406af00 0x7fd61406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:42.430 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:42.420+0000 7fd6337fe700 1 --2- 172.21.15.157:0/3955217705 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fd61406af00 0x7fd61406d3c0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fd61c000c00 tx=0x7fd61c007a50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:42.431 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:42.424+0000 7fd62bfff700 1 -- 172.21.15.157:0/3955217705 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd624055f20 con 0x7fd6340d1440 2023-10-16T19:57:42.617 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:42.615+0000 7fd639d22700 1 -- 172.21.15.157:0/3955217705 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fd634156770 con 0x7fd6340d1440 2023-10-16T19:57:42.620 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:42.618+0000 7fd62bfff700 1 -- 172.21.15.157:0/3955217705 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v2)=0 v2) v1 ==== 122+0+0 (secure 0 0 0) 0x7fd634156770 con 0x7fd6340d1440 2023-10-16T19:57:42.623 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:42.620+0000 7fd639d22700 1 -- 172.21.15.157:0/3955217705 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fd61406af00 msgr2=0x7fd61406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:42.623 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:42.620+0000 7fd639d22700 1 --2- 172.21.15.157:0/3955217705 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fd61406af00 0x7fd61406d3c0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fd61c000c00 tx=0x7fd61c007a50 comp rx=0 tx=0).stop 2023-10-16T19:57:42.624 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:42.620+0000 7fd639d22700 1 -- 172.21.15.157:0/3955217705 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd6340d1440 msgr2=0x7fd634159860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:42.624 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:42.620+0000 7fd639d22700 1 --2- 172.21.15.157:0/3955217705 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd6340d1440 0x7fd634159860 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fd624009130 tx=0x7fd624004750 comp rx=0 tx=0).stop 2023-10-16T19:57:42.624 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:42.620+0000 7fd639d22700 1 -- 172.21.15.157:0/3955217705 shutdown_connections 2023-10-16T19:57:42.625 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:42.620+0000 7fd639d22700 1 --2- 172.21.15.157:0/3955217705 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fd61406af00 0x7fd61406d3c0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:42.625 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:42.620+0000 7fd639d22700 1 --2- 172.21.15.157:0/3955217705 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd63415bed0 0x7fd634159da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:42.625 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:42.620+0000 7fd639d22700 1 --2- 172.21.15.157:0/3955217705 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd6340b3dc0 0x7fd6340c79d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:42.625 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:42.620+0000 7fd639d22700 1 --2- 172.21.15.157:0/3955217705 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd6340d1440 0x7fd634159860 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:42.625 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:42.620+0000 7fd639d22700 1 -- 172.21.15.157:0/3955217705 >> 172.21.15.157:0/3955217705 conn(0x7fd6340ce6b0 msgr2=0x7fd6340b4a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:42.625 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:42.620+0000 7fd639d22700 1 -- 172.21.15.157:0/3955217705 shutdown_connections 2023-10-16T19:57:42.626 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:42.620+0000 7fd639d22700 1 -- 172.21.15.157:0/3955217705 wait complete. 2023-10-16T19:57:42.635 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-16T19:57:42.635 DEBUG:teuthology.orchestra.run.smithi157:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-16T19:57:42.683 DEBUG:teuthology.orchestra.run.smithi187:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-16T19:57:42.735 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-16T19:57:42.735 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2023-10-16T19:57:42.736 DEBUG:teuthology.orchestra.run.smithi157:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T19:57:42.754 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2023-10-16T19:57:42.755 DEBUG:teuthology.orchestra.run.smithi157:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T19:57:42.811 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2023-10-16T19:57:42.812 DEBUG:teuthology.orchestra.run.smithi157:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T19:57:42.870 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T19:57:43.030 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.028+0000 7f5cf4d26700 1 Processor -- start 2023-10-16T19:57:43.030 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.028+0000 7f5cf4d26700 1 -- start start 2023-10-16T19:57:43.033 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.028+0000 7f5cf4d26700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f5cf015f100 0x7f5cf006c670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:43.033 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.028+0000 7f5cf4d26700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f5cf006cbb0 0x7f5cf006a850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:43.033 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.029+0000 7f5cf4d26700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5cf0162640 con 0x7f5cf00af710 2023-10-16T19:57:43.033 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.029+0000 7f5cf4d26700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5cf00afaf0 con 0x7f5cf006cbb0 2023-10-16T19:57:43.033 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.029+0000 7f5cf4d26700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5cf00ce4a0 con 0x7f5cf015f100 2023-10-16T19:57:43.034 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.029+0000 7f5ceed9d700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f5cf006cbb0 0x7f5cf006a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:43.034 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.029+0000 7f5cee59c700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f5cf00af710 0x7f5cf00cdd90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:56470/0 (socket says 172.21.15.157:56470) 2023-10-16T19:57:43.034 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.029+0000 7f5ceed9d700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f5cf006cbb0 0x7f5cf006a850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:46802/0 (socket says 172.21.15.157:46802) 2023-10-16T19:57:43.034 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.029+0000 7f5cee59c700 1 -- 172.21.15.157:0/3653857027 learned_addr learned my addr 172.21.15.157:0/3653857027 (peer_addr_for_me v1:172.21.15.157:0/0) 2023-10-16T19:57:43.034 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.029+0000 7f5cedd9b700 1 --2- 172.21.15.157:0/3653857027 >> v2:172.21.15.187:3300/0 conn(0x7f5cf015f100 0x7f5cf006c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:43.035 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.029+0000 7f5ceed9d700 1 -- 172.21.15.157:0/3653857027 >> v2:172.21.15.187:3300/0 conn(0x7f5cf015f100 msgr2=0x7f5cf006c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:57:43.035 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.029+0000 7f5ceed9d700 1 --2- 172.21.15.157:0/3653857027 >> v2:172.21.15.187:3300/0 conn(0x7f5cf015f100 0x7f5cf006c670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:43.035 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.029+0000 7f5ceed9d700 1 -- 172.21.15.157:0/3653857027 >> v1:172.21.15.157:6789/0 conn(0x7f5cf00af710 legacy=0x7f5cf00cdd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:43.036 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.029+0000 7f5ceed9d700 1 -- 172.21.15.157:0/3653857027 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cf006cfd0 con 0x7f5cf006cbb0 2023-10-16T19:57:43.036 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.029+0000 7f5ced59a700 1 -- 172.21.15.157:0/3653857027 <== mon.0 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1929703552 0 0) 0x7f5cf0162640 con 0x7f5cf00af710 2023-10-16T19:57:43.036 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.029+0000 7f5ceed9d700 1 --2- 172.21.15.157:0/3653857027 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5cf006cbb0 0x7f5cf006a850 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f5cf0066870 tx=0x7f5ce800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56ea3db47d4a936d server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:43.036 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.029+0000 7f5ced59a700 1 -- 172.21.15.157:0/3653857027 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ce800e070 con 0x7f5cf006cbb0 2023-10-16T19:57:43.036 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.029+0000 7f5ced59a700 1 -- 172.21.15.157:0/3653857027 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ce800bbd0 con 0x7f5cf006cbb0 2023-10-16T19:57:43.037 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.029+0000 7f5ced59a700 1 -- 172.21.15.157:0/3653857027 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ce8012430 con 0x7f5cf006cbb0 2023-10-16T19:57:43.037 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.030+0000 7f5cf4d26700 1 -- 172.21.15.157:0/3653857027 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5cf006cbb0 msgr2=0x7f5cf006a850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:43.037 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.030+0000 7f5cf4d26700 1 --2- 172.21.15.157:0/3653857027 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5cf006cbb0 0x7f5cf006a850 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f5cf0066870 tx=0x7f5ce800b330 comp rx=0 tx=0).stop 2023-10-16T19:57:43.037 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.030+0000 7f5cf4d26700 1 -- 172.21.15.157:0/3653857027 shutdown_connections 2023-10-16T19:57:43.037 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.030+0000 7f5cf4d26700 1 --2- 172.21.15.157:0/3653857027 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5cf006cbb0 0x7f5cf006a850 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:43.038 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.030+0000 7f5cf4d26700 1 --2- 172.21.15.157:0/3653857027 >> v2:172.21.15.187:3300/0 conn(0x7f5cf015f100 0x7f5cf006c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:43.038 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.030+0000 7f5cf4d26700 1 -- 172.21.15.157:0/3653857027 >> 172.21.15.157:0/3653857027 conn(0x7f5cf00cceb0 msgr2=0x7f5cf00cd290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:43.038 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.030+0000 7f5cf4d26700 1 -- 172.21.15.157:0/3653857027 shutdown_connections 2023-10-16T19:57:43.038 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.030+0000 7f5cf4d26700 1 -- 172.21.15.157:0/3653857027 wait complete. 2023-10-16T19:57:43.041 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.031+0000 7f5cf4d26700 1 Processor -- start 2023-10-16T19:57:43.041 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.031+0000 7f5cf4d26700 1 -- start start 2023-10-16T19:57:43.041 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.032+0000 7f5cf4d26700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5cf006cbb0 0x7f5cf015aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:43.042 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.032+0000 7f5cf4d26700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5cf00af710 0x7f5cf00721e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:43.042 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.032+0000 7f5cf4d26700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5cf015f100 0x7f5cf00cb820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:43.042 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.032+0000 7f5cf4d26700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cf00714c0 con 0x7f5cf006cbb0 2023-10-16T19:57:43.042 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.032+0000 7f5cf4d26700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cf0071950 con 0x7f5cf00af710 2023-10-16T19:57:43.042 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.032+0000 7f5cf4d26700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cf00708b0 con 0x7f5cf015f100 2023-10-16T19:57:43.043 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.032+0000 7f5cee59c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5cf006cbb0 0x7f5cf015aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:43.043 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.032+0000 7f5cee59c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5cf006cbb0 0x7f5cf015aaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:46804/0 (socket says 172.21.15.157:46804) 2023-10-16T19:57:43.043 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.032+0000 7f5cee59c700 1 -- 172.21.15.157:0/254476681 learned_addr learned my addr 172.21.15.157:0/254476681 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:57:43.043 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.032+0000 7f5ceed9d700 1 --2- 172.21.15.157:0/254476681 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5cf015f100 0x7f5cf00cb820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:43.044 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.032+0000 7f5cedd9b700 1 --2- 172.21.15.157:0/254476681 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5cf00af710 0x7f5cf00721e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:43.044 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.032+0000 7f5cee59c700 1 -- 172.21.15.157:0/254476681 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5cf015f100 msgr2=0x7f5cf00cb820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:43.044 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.032+0000 7f5cee59c700 1 --2- 172.21.15.157:0/254476681 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5cf015f100 0x7f5cf00cb820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:43.044 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.032+0000 7f5cee59c700 1 -- 172.21.15.157:0/254476681 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5cf00af710 msgr2=0x7f5cf00721e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:43.044 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.032+0000 7f5cee59c700 1 --2- 172.21.15.157:0/254476681 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5cf00af710 0x7f5cf00721e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:43.045 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.032+0000 7f5cee59c700 1 -- 172.21.15.157:0/254476681 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ce8009a70 con 0x7f5cf006cbb0 2023-10-16T19:57:43.045 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.033+0000 7f5cee59c700 1 --2- 172.21.15.157:0/254476681 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5cf006cbb0 0x7f5cf015aaa0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f5ce40011e0 tx=0x7f5ce400cae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:43.045 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.033+0000 7f5cdeffd700 1 -- 172.21.15.157:0/254476681 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ce4004c80 con 0x7f5cf006cbb0 2023-10-16T19:57:43.045 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.033+0000 7f5cdeffd700 1 -- 172.21.15.157:0/254476681 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ce4004e00 con 0x7f5cf006cbb0 2023-10-16T19:57:43.046 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.033+0000 7f5cf4d26700 1 -- 172.21.15.157:0/254476681 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cf0070b90 con 0x7f5cf006cbb0 2023-10-16T19:57:43.046 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.033+0000 7f5cdeffd700 1 -- 172.21.15.157:0/254476681 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ce4007310 con 0x7f5cf006cbb0 2023-10-16T19:57:43.046 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.033+0000 7f5cf4d26700 1 -- 172.21.15.157:0/254476681 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cf0071150 con 0x7f5cf006cbb0 2023-10-16T19:57:43.046 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.034+0000 7f5cf4d26700 1 -- 172.21.15.157:0/254476681 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5cf004f400 con 0x7f5cf006cbb0 2023-10-16T19:57:43.046 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.034+0000 7f5cdeffd700 1 -- 172.21.15.157:0/254476681 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f5ce4007470 con 0x7f5cf006cbb0 2023-10-16T19:57:43.046 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.034+0000 7f5cdeffd700 1 --2- 172.21.15.157:0/254476681 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f5cd006af00 0x7f5cd006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:43.047 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.035+0000 7f5cdeffd700 1 -- 172.21.15.157:0/254476681 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5ce4089360 con 0x7f5cf006cbb0 2023-10-16T19:57:43.047 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.035+0000 7f5cedd9b700 1 --2- 172.21.15.157:0/254476681 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f5cd006af00 0x7f5cd006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:43.047 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.035+0000 7f5cedd9b700 1 --2- 172.21.15.157:0/254476681 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f5cd006af00 0x7f5cd006d3c0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f5cf00c8d20 tx=0x7f5ce0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:43.047 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.039+0000 7f5cdeffd700 1 -- 172.21.15.157:0/254476681 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5ce40544a0 con 0x7f5cf006cbb0 2023-10-16T19:57:43.234 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.232+0000 7f5cf4d26700 1 -- 172.21.15.157:0/254476681 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5cf006bbe0 con 0x7f5cf006cbb0 2023-10-16T19:57:43.235 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.233+0000 7f5cdeffd700 1 -- 172.21.15.157:0/254476681 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16517 (secure 0 0 0) 0x7f5ce4057ac0 con 0x7f5cf006cbb0 2023-10-16T19:57:43.235 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-10-16T19:57:43.236 INFO:teuthology.orchestra.run.smithi157.stdout:{"epoch":21,"fsid":"28199dc9-64d5-479e-83c6-21f097c33d39","created":"2023-10-16T19:56:49.201889+0000","modified":"2023-10-16T19:57:07.988567+0000","last_up_change":"2023-10-16T19:56:54.675673+0000","last_in_change":"2023-10-16T19:56:51.666728+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T19:56:56.932895+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-16T19:57:04.936105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-16T19:57:05.335279+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":335785898},{"type":"v1","addr":"172.21.15.157:6809","nonce":335785898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":335785898},{"type":"v1","addr":"172.21.15.157:6811","nonce":335785898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6815","nonce":335785898},{"type":"v1","addr":"172.21.15.157:6817","nonce":335785898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":335785898},{"type":"v1","addr":"172.21.15.157:6813","nonce":335785898}]},"public_addr":"172.21.15.157:6809/335785898","cluster_addr":"172.21.15.157:6811/335785898","heartbeat_back_addr":"172.21.15.157:6817/335785898","heartbeat_front_addr":"172.21.15.157:6813/335785898","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":3482825047},{"type":"v1","addr":"172.21.15.157:6801","nonce":3482825047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":3482825047},{"type":"v1","addr":"172.21.15.157:6803","nonce":3482825047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":3482825047},{"type":"v1","addr":"172.21.15.157:6807","nonce":3482825047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":3482825047},{"type":"v1","addr":"172.21.15.157:6805","nonce":3482825047}]},"public_addr":"172.21.15.157:6801/3482825047","cluster_addr":"172.21.15.157:6803/3482825047","heartbeat_back_addr":"172.21.15.157:6807/3482825047","heartbeat_front_addr":"172.21.15.157:6805/3482825047","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":1118292389},{"type":"v1","addr":"172.21.15.157:6825","nonce":1118292389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":1118292389},{"type":"v1","addr":"172.21.15.157:6827","nonce":1118292389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":1118292389},{"type":"v1","addr":"172.21.15.157:6831","nonce":1118292389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":1118292389},{"type":"v1","addr":"172.21.15.157:6829","nonce":1118292389}]},"public_addr":"172.21.15.157:6825/1118292389","cluster_addr":"172.21.15.157:6827/1118292389","heartbeat_back_addr":"172.21.15.157:6831/1118292389","heartbeat_front_addr":"172.21.15.157:6829/1118292389","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":989329821},{"type":"v1","addr":"172.21.15.157:6816","nonce":989329821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":989329821},{"type":"v1","addr":"172.21.15.157:6819","nonce":989329821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":989329821},{"type":"v1","addr":"172.21.15.157:6823","nonce":989329821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":989329821},{"type":"v1","addr":"172.21.15.157:6821","nonce":989329821}]},"public_addr":"172.21.15.157:6816/989329821","cluster_addr":"172.21.15.157:6819/989329821","heartbeat_back_addr":"172.21.15.157:6823/989329821","heartbeat_front_addr":"172.21.15.157:6821/989329821","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":3841016811},{"type":"v1","addr":"172.21.15.187:6801","nonce":3841016811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6803","nonce":3841016811},{"type":"v1","addr":"172.21.15.187:6804","nonce":3841016811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6809","nonce":3841016811},{"type":"v1","addr":"172.21.15.187:6811","nonce":3841016811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":3841016811},{"type":"v1","addr":"172.21.15.187:6808","nonce":3841016811}]},"public_addr":"172.21.15.187:6801/3841016811","cluster_addr":"172.21.15.187:6804/3841016811","heartbeat_back_addr":"172.21.15.187:6811/3841016811","heartbeat_front_addr":"172.21.15.187:6808/3841016811","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":915130263},{"type":"v1","addr":"172.21.15.187:6805","nonce":915130263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6807","nonce":915130263},{"type":"v1","addr":"172.21.15.187:6810","nonce":915130263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":915130263},{"type":"v1","addr":"172.21.15.187:6815","nonce":915130263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":915130263},{"type":"v1","addr":"172.21.15.187:6813","nonce":915130263}]},"public_addr":"172.21.15.187:6805/915130263","cluster_addr":"172.21.15.187:6810/915130263","heartbeat_back_addr":"172.21.15.187:6815/915130263","heartbeat_front_addr":"172.21.15.187:6813/915130263","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":654976824},{"type":"v1","addr":"172.21.15.187:6817","nonce":654976824}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":654976824},{"type":"v1","addr":"172.21.15.187:6819","nonce":654976824}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":654976824},{"type":"v1","addr":"172.21.15.187:6823","nonce":654976824}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":654976824},{"type":"v1","addr":"172.21.15.187:6821","nonce":654976824}]},"public_addr":"172.21.15.187:6817/654976824","cluster_addr":"172.21.15.187:6819/654976824","heartbeat_back_addr":"172.21.15.187:6823/654976824","heartbeat_front_addr":"172.21.15.187:6821/654976824","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":4284059445},{"type":"v1","addr":"172.21.15.187:6825","nonce":4284059445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":4284059445},{"type":"v1","addr":"172.21.15.187:6827","nonce":4284059445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":4284059445},{"type":"v1","addr":"172.21.15.187:6831","nonce":4284059445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":4284059445},{"type":"v1","addr":"172.21.15.187:6829","nonce":4284059445}]},"public_addr":"172.21.15.187:6825/4284059445","cluster_addr":"172.21.15.187:6827/4284059445","heartbeat_back_addr":"172.21.15.187:6831/4284059445","heartbeat_front_addr":"172.21.15.187:6829/4284059445","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.819780+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.824193+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.849575+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.824806+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.809540+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.805093+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.866109+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.807372+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T19:57:43.237 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.235+0000 7f5cf4d26700 1 -- 172.21.15.157:0/254476681 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f5cd006af00 msgr2=0x7f5cd006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:43.238 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.235+0000 7f5cf4d26700 1 --2- 172.21.15.157:0/254476681 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f5cd006af00 0x7f5cd006d3c0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f5cf00c8d20 tx=0x7f5ce0008040 comp rx=0 tx=0).stop 2023-10-16T19:57:43.238 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.235+0000 7f5cf4d26700 1 -- 172.21.15.157:0/254476681 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5cf006cbb0 msgr2=0x7f5cf015aaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:43.238 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.235+0000 7f5cf4d26700 1 --2- 172.21.15.157:0/254476681 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5cf006cbb0 0x7f5cf015aaa0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f5ce40011e0 tx=0x7f5ce400cae0 comp rx=0 tx=0).stop 2023-10-16T19:57:43.238 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.235+0000 7f5cf4d26700 1 -- 172.21.15.157:0/254476681 shutdown_connections 2023-10-16T19:57:43.239 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.235+0000 7f5cf4d26700 1 --2- 172.21.15.157:0/254476681 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5cf015f100 0x7f5cf00cb820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:43.239 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.235+0000 7f5cf4d26700 1 --2- 172.21.15.157:0/254476681 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5cf006cbb0 0x7f5cf015aaa0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:43.239 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.235+0000 7f5cf4d26700 1 --2- 172.21.15.157:0/254476681 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f5cd006af00 0x7f5cd006d3c0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:43.239 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.235+0000 7f5cf4d26700 1 --2- 172.21.15.157:0/254476681 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5cf00af710 0x7f5cf00721e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:43.239 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.235+0000 7f5cf4d26700 1 -- 172.21.15.157:0/254476681 >> 172.21.15.157:0/254476681 conn(0x7f5cf00cceb0 msgr2=0x7f5cf015d1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:43.240 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.235+0000 7f5cf4d26700 1 -- 172.21.15.157:0/254476681 shutdown_connections 2023-10-16T19:57:43.240 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.235+0000 7f5cf4d26700 1 -- 172.21.15.157:0/254476681 wait complete. 2023-10-16T19:57:43.250 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-16T19:56:56.932895+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-16T19:57:04.936105+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-16T19:57:05.335279+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-16T19:57:43.250 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-16T19:57:43.375 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.373+0000 7f798816c700 1 Processor -- start 2023-10-16T19:57:43.376 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.373+0000 7f798816c700 1 -- start start 2023-10-16T19:57:43.378 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.374+0000 7f798816c700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f79800b3dc0 0x7f79800d0f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:43.378 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.374+0000 7f798816c700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f79800d1440 0x7f798006fa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:43.378 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.374+0000 7f798816c700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f798015c2b0 con 0x7f798015bed0 2023-10-16T19:57:43.379 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.374+0000 7f798816c700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f798015f9e0 con 0x7f79800b3dc0 2023-10-16T19:57:43.379 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.374+0000 7f798816c700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f798015fcc0 con 0x7f79800d1440 2023-10-16T19:57:43.379 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.374+0000 7f7985707700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f79800b3dc0 0x7f79800d0f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:43.379 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.374+0000 7f7985707700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f79800b3dc0 0x7f79800d0f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:46814/0 (socket says 172.21.15.157:46814) 2023-10-16T19:57:43.379 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.374+0000 7f7985707700 1 -- 172.21.15.157:0/1298080164 learned_addr learned my addr 172.21.15.157:0/1298080164 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:57:43.380 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.374+0000 7f7986709700 1 --2- 172.21.15.157:0/1298080164 >> v2:172.21.15.187:3300/0 conn(0x7f79800d1440 0x7f798006fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:43.380 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.374+0000 7f7985707700 1 -- 172.21.15.157:0/1298080164 >> v2:172.21.15.187:3300/0 conn(0x7f79800d1440 msgr2=0x7f798006fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:57:43.380 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.374+0000 7f7985707700 1 --2- 172.21.15.157:0/1298080164 >> v2:172.21.15.187:3300/0 conn(0x7f79800d1440 0x7f798006fa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:43.380 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.374+0000 7f7985707700 1 -- 172.21.15.157:0/1298080164 >> v1:172.21.15.187:6789/0 conn(0x7f798015bed0 legacy=0x7f79800b36b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:57:43.380 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.374+0000 7f7985707700 1 -- 172.21.15.157:0/1298080164 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f798015ffa0 con 0x7f79800b3dc0 2023-10-16T19:57:43.381 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.374+0000 7f7986709700 1 --2- 172.21.15.157:0/1298080164 >> v2:172.21.15.187:3300/0 conn(0x7f79800d1440 0x7f798006fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T19:57:43.381 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.374+0000 7f7985707700 1 --2- 172.21.15.157:0/1298080164 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f79800b3dc0 0x7f79800d0f00 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f79800ce610 tx=0x7f7970009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37a16aa72e3d4748 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:43.381 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.375+0000 7f7984f06700 1 -- 172.21.15.157:0/1298080164 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7970004230 con 0x7f79800b3dc0 2023-10-16T19:57:43.381 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.375+0000 7f7984f06700 1 -- 172.21.15.157:0/1298080164 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7970004390 con 0x7f79800b3dc0 2023-10-16T19:57:43.381 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.375+0000 7f7984f06700 1 -- 172.21.15.157:0/1298080164 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79700036a0 con 0x7f79800b3dc0 2023-10-16T19:57:43.382 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.375+0000 7f798816c700 1 -- 172.21.15.157:0/1298080164 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f79800b3dc0 msgr2=0x7f79800d0f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:43.382 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.375+0000 7f798816c700 1 --2- 172.21.15.157:0/1298080164 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f79800b3dc0 0x7f79800d0f00 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f79800ce610 tx=0x7f7970009bd0 comp rx=0 tx=0).stop 2023-10-16T19:57:43.382 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.375+0000 7f798816c700 1 -- 172.21.15.157:0/1298080164 shutdown_connections 2023-10-16T19:57:43.382 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.375+0000 7f798816c700 1 --2- 172.21.15.157:0/1298080164 >> v2:172.21.15.187:3300/0 conn(0x7f79800d1440 0x7f798006fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:43.383 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.375+0000 7f798816c700 1 --2- 172.21.15.157:0/1298080164 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f79800b3dc0 0x7f79800d0f00 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:43.383 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.375+0000 7f798816c700 1 -- 172.21.15.157:0/1298080164 >> 172.21.15.157:0/1298080164 conn(0x7f79800ce6b0 msgr2=0x7f79800ceac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:43.383 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.375+0000 7f798816c700 1 -- 172.21.15.157:0/1298080164 shutdown_connections 2023-10-16T19:57:43.383 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.375+0000 7f798816c700 1 -- 172.21.15.157:0/1298080164 wait complete. 2023-10-16T19:57:43.386 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.376+0000 7f798816c700 1 Processor -- start 2023-10-16T19:57:43.386 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.376+0000 7f798816c700 1 -- start start 2023-10-16T19:57:43.386 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.377+0000 7f798816c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f79800b3dc0 0x7f7980157060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:43.386 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.377+0000 7f798816c700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f79800d1440 0x7f7980159b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:43.387 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.377+0000 7f798816c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f798015bed0 0x7f7980151200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:43.387 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.377+0000 7f798816c700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7980155fc0 con 0x7f79800b3dc0 2023-10-16T19:57:43.387 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.377+0000 7f798816c700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79801562a0 con 0x7f798015bed0 2023-10-16T19:57:43.387 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.377+0000 7f798816c700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7980156580 con 0x7f79800d1440 2023-10-16T19:57:43.387 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.377+0000 7f7985f08700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f79800b3dc0 0x7f7980157060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:43.388 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.377+0000 7f7985f08700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f79800b3dc0 0x7f7980157060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:46818/0 (socket says 172.21.15.157:46818) 2023-10-16T19:57:43.388 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.377+0000 7f7985f08700 1 -- 172.21.15.157:0/2239805967 learned_addr learned my addr 172.21.15.157:0/2239805967 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:57:43.388 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.377+0000 7f7985707700 1 --2- 172.21.15.157:0/2239805967 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f79800d1440 0x7f7980159b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:43.388 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.377+0000 7f7986709700 1 --2- 172.21.15.157:0/2239805967 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f798015bed0 0x7f7980151200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:43.388 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.378+0000 7f7985f08700 1 -- 172.21.15.157:0/2239805967 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f79800d1440 msgr2=0x7f7980159b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:43.389 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.378+0000 7f7985f08700 1 --2- 172.21.15.157:0/2239805967 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f79800d1440 0x7f7980159b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:43.389 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.378+0000 7f7985f08700 1 -- 172.21.15.157:0/2239805967 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f798015bed0 msgr2=0x7f7980151200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:43.389 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.378+0000 7f7985f08700 1 --2- 172.21.15.157:0/2239805967 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f798015bed0 0x7f7980151200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:43.389 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.378+0000 7f7985f08700 1 -- 172.21.15.157:0/2239805967 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7970009550 con 0x7f79800b3dc0 2023-10-16T19:57:43.389 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.378+0000 7f7985f08700 1 --2- 172.21.15.157:0/2239805967 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f79800b3dc0 0x7f7980157060 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f797c00b4a0 tx=0x7f797c00b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:43.390 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.378+0000 7f79767fc700 1 -- 172.21.15.157:0/2239805967 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f797c011830 con 0x7f79800b3dc0 2023-10-16T19:57:43.390 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.378+0000 7f79767fc700 1 -- 172.21.15.157:0/2239805967 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f797c011990 con 0x7f79800b3dc0 2023-10-16T19:57:43.390 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.378+0000 7f798816c700 1 -- 172.21.15.157:0/2239805967 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7980156860 con 0x7f79800b3dc0 2023-10-16T19:57:43.390 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.378+0000 7f79767fc700 1 -- 172.21.15.157:0/2239805967 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f797c011d40 con 0x7f79800b3dc0 2023-10-16T19:57:43.391 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.378+0000 7f798816c700 1 -- 172.21.15.157:0/2239805967 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79801575a0 con 0x7f79800b3dc0 2023-10-16T19:57:43.391 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.379+0000 7f798816c700 1 -- 172.21.15.157:0/2239805967 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f798006b300 con 0x7f79800b3dc0 2023-10-16T19:57:43.391 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.379+0000 7f79767fc700 1 -- 172.21.15.157:0/2239805967 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f797c01a400 con 0x7f79800b3dc0 2023-10-16T19:57:43.391 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.379+0000 7f79767fc700 1 --2- 172.21.15.157:0/2239805967 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f796406af00 0x7f796406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:43.391 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.380+0000 7f79767fc700 1 -- 172.21.15.157:0/2239805967 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f797c089290 con 0x7f79800b3dc0 2023-10-16T19:57:43.391 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.380+0000 7f7985707700 1 --2- 172.21.15.157:0/2239805967 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f796406af00 0x7f796406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:43.392 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.380+0000 7f7985707700 1 --2- 172.21.15.157:0/2239805967 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f796406af00 0x7f796406d3c0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f7970009130 tx=0x7f7970008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:43.392 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.384+0000 7f79767fc700 1 -- 172.21.15.157:0/2239805967 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f797c0543d0 con 0x7f79800b3dc0 2023-10-16T19:57:43.574 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.571+0000 7f798816c700 1 -- 172.21.15.157:0/2239805967 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f798004f400 con 0x7f79800b3dc0 2023-10-16T19:57:43.575 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.571+0000 7f79767fc700 1 -- 172.21.15.157:0/2239805967 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f797c0579f0 con 0x7f79800b3dc0 2023-10-16T19:57:43.575 INFO:teuthology.orchestra.run.smithi157.stdout:pg_num: 1 2023-10-16T19:57:43.576 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.573+0000 7f798816c700 1 -- 172.21.15.157:0/2239805967 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f796406af00 msgr2=0x7f796406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:43.576 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.573+0000 7f798816c700 1 --2- 172.21.15.157:0/2239805967 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f796406af00 0x7f796406d3c0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f7970009130 tx=0x7f7970008030 comp rx=0 tx=0).stop 2023-10-16T19:57:43.577 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.573+0000 7f798816c700 1 -- 172.21.15.157:0/2239805967 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f79800b3dc0 msgr2=0x7f7980157060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:43.577 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.573+0000 7f798816c700 1 --2- 172.21.15.157:0/2239805967 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f79800b3dc0 0x7f7980157060 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f797c00b4a0 tx=0x7f797c00b860 comp rx=0 tx=0).stop 2023-10-16T19:57:43.577 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.574+0000 7f798816c700 1 -- 172.21.15.157:0/2239805967 shutdown_connections 2023-10-16T19:57:43.578 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.574+0000 7f798816c700 1 --2- 172.21.15.157:0/2239805967 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f796406af00 0x7f796406d3c0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:43.578 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.574+0000 7f798816c700 1 --2- 172.21.15.157:0/2239805967 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f798015bed0 0x7f7980151200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:43.578 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.574+0000 7f798816c700 1 --2- 172.21.15.157:0/2239805967 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f79800b3dc0 0x7f7980157060 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:43.579 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.574+0000 7f798816c700 1 --2- 172.21.15.157:0/2239805967 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f79800d1440 0x7f7980159b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:43.579 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.574+0000 7f798816c700 1 -- 172.21.15.157:0/2239805967 >> 172.21.15.157:0/2239805967 conn(0x7f79800ce6b0 msgr2=0x7f79800c8540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:43.579 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.574+0000 7f798816c700 1 -- 172.21.15.157:0/2239805967 shutdown_connections 2023-10-16T19:57:43.579 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.574+0000 7f798816c700 1 -- 172.21.15.157:0/2239805967 wait complete. 2023-10-16T19:57:43.588 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-16T19:57:43.713 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.711+0000 7f6722919700 1 Processor -- start 2023-10-16T19:57:43.714 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.711+0000 7f6722919700 1 -- start start 2023-10-16T19:57:43.716 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.712+0000 7f6722919700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f671c15bed0 0x7f671c0b36b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:43.716 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.712+0000 7f6722919700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f671c0b3bf0 0x7f671c0d0f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:43.716 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.712+0000 7f6722919700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f671c15c2b0 con 0x7f671c0d1440 2023-10-16T19:57:43.717 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.712+0000 7f6722919700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f671c0b4070 con 0x7f671c0b3bf0 2023-10-16T19:57:43.717 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.712+0000 7f6722919700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f671c15f9e0 con 0x7f671c15bed0 2023-10-16T19:57:43.717 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.712+0000 7f671b7fe700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f671c0b3bf0 0x7f671c0d0f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:43.717 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.712+0000 7f671b7fe700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f671c0b3bf0 0x7f671c0d0f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:46826/0 (socket says 172.21.15.157:46826) 2023-10-16T19:57:43.717 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.712+0000 7f671b7fe700 1 -- 172.21.15.157:0/2676002030 learned_addr learned my addr 172.21.15.157:0/2676002030 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:57:43.718 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.712+0000 7f671bfff700 1 --2- 172.21.15.157:0/2676002030 >> v2:172.21.15.187:3300/0 conn(0x7f671c15bed0 0x7f671c0b36b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:43.718 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.712+0000 7f671b7fe700 1 -- 172.21.15.157:0/2676002030 >> v2:172.21.15.187:3300/0 conn(0x7f671c15bed0 msgr2=0x7f671c0b36b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:57:43.718 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.712+0000 7f671b7fe700 1 --2- 172.21.15.157:0/2676002030 >> v2:172.21.15.187:3300/0 conn(0x7f671c15bed0 0x7f671c0b36b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:43.718 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.712+0000 7f671b7fe700 1 -- 172.21.15.157:0/2676002030 >> v1:172.21.15.187:6789/0 conn(0x7f671c0d1440 legacy=0x7f671c0cf800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:43.718 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.712+0000 7f671b7fe700 1 -- 172.21.15.157:0/2676002030 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f671c15fcc0 con 0x7f671c0b3bf0 2023-10-16T19:57:43.719 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.712+0000 7f671b7fe700 1 --2- 172.21.15.157:0/2676002030 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f671c0b3bf0 0x7f671c0d0f00 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f671c0b4820 tx=0x7f670c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4797f703f555c331 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:43.719 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.712+0000 7f671affd700 1 -- 172.21.15.157:0/2676002030 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f670c00b870 con 0x7f671c0b3bf0 2023-10-16T19:57:43.719 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.712+0000 7f671affd700 1 -- 172.21.15.157:0/2676002030 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f670c00b9d0 con 0x7f671c0b3bf0 2023-10-16T19:57:43.719 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.713+0000 7f671affd700 1 -- 172.21.15.157:0/2676002030 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f670c00bd60 con 0x7f671c0b3bf0 2023-10-16T19:57:43.719 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.713+0000 7f6722919700 1 -- 172.21.15.157:0/2676002030 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f671c0b3bf0 msgr2=0x7f671c0d0f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:43.720 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.713+0000 7f6722919700 1 --2- 172.21.15.157:0/2676002030 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f671c0b3bf0 0x7f671c0d0f00 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f671c0b4820 tx=0x7f670c009bd0 comp rx=0 tx=0).stop 2023-10-16T19:57:43.720 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.713+0000 7f6722919700 1 -- 172.21.15.157:0/2676002030 shutdown_connections 2023-10-16T19:57:43.720 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.713+0000 7f6722919700 1 --2- 172.21.15.157:0/2676002030 >> v2:172.21.15.187:3300/0 conn(0x7f671c15bed0 0x7f671c0b36b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:43.720 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.713+0000 7f6722919700 1 --2- 172.21.15.157:0/2676002030 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f671c0b3bf0 0x7f671c0d0f00 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:43.720 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.713+0000 7f6722919700 1 -- 172.21.15.157:0/2676002030 >> 172.21.15.157:0/2676002030 conn(0x7f671c0ce6b0 msgr2=0x7f671c0ceac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:43.721 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.713+0000 7f6722919700 1 -- 172.21.15.157:0/2676002030 shutdown_connections 2023-10-16T19:57:43.721 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.713+0000 7f6722919700 1 -- 172.21.15.157:0/2676002030 wait complete. 2023-10-16T19:57:43.724 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.714+0000 7f6722919700 1 Processor -- start 2023-10-16T19:57:43.724 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.714+0000 7f6722919700 1 -- start start 2023-10-16T19:57:43.725 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.715+0000 7f6722919700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f671c0b3bf0 0x7f671c0caed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:43.725 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.715+0000 7f6722919700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f671c0d1440 0x7f671c0cb410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:43.725 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.715+0000 7f6722919700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f671c15bed0 0x7f671c1f4e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:43.725 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.715+0000 7f6722919700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f671c1f3010 con 0x7f671c0b3bf0 2023-10-16T19:57:43.725 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.715+0000 7f6722919700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f671c1f2370 con 0x7f671c15bed0 2023-10-16T19:57:43.726 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.715+0000 7f6722919700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f671c1f2650 con 0x7f671c0d1440 2023-10-16T19:57:43.726 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.715+0000 7f671bfff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f671c0b3bf0 0x7f671c0caed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:43.726 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.715+0000 7f671bfff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f671c0b3bf0 0x7f671c0caed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:46830/0 (socket says 172.21.15.157:46830) 2023-10-16T19:57:43.726 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.715+0000 7f671bfff700 1 -- 172.21.15.157:0/1634351948 learned_addr learned my addr 172.21.15.157:0/1634351948 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:57:43.726 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.715+0000 7f671b7fe700 1 --2- 172.21.15.157:0/1634351948 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f671c0d1440 0x7f671c0cb410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:43.727 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.715+0000 7f6720eb6700 1 --2- 172.21.15.157:0/1634351948 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f671c15bed0 0x7f671c1f4e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:43.727 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.716+0000 7f671bfff700 1 -- 172.21.15.157:0/1634351948 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f671c0d1440 msgr2=0x7f671c0cb410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:43.727 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.716+0000 7f671bfff700 1 --2- 172.21.15.157:0/1634351948 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f671c0d1440 0x7f671c0cb410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:43.727 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.716+0000 7f671bfff700 1 -- 172.21.15.157:0/1634351948 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f671c15bed0 msgr2=0x7f671c1f4e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:43.727 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.716+0000 7f671bfff700 1 --2- 172.21.15.157:0/1634351948 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f671c15bed0 0x7f671c1f4e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:43.728 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.716+0000 7f671bfff700 1 -- 172.21.15.157:0/1634351948 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f670c009550 con 0x7f671c0b3bf0 2023-10-16T19:57:43.728 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.716+0000 7f671bfff700 1 --2- 172.21.15.157:0/1634351948 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f671c0b3bf0 0x7f671c0caed0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f671000d800 tx=0x7f671000dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:43.728 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.716+0000 7f6718ff9700 1 -- 172.21.15.157:0/1634351948 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67100125f0 con 0x7f671c0b3bf0 2023-10-16T19:57:43.728 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.716+0000 7f6718ff9700 1 -- 172.21.15.157:0/1634351948 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6710012750 con 0x7f671c0b3bf0 2023-10-16T19:57:43.728 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.716+0000 7f6722919700 1 -- 172.21.15.157:0/1634351948 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f671c1f2c30 con 0x7f671c0b3bf0 2023-10-16T19:57:43.728 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.716+0000 7f6718ff9700 1 -- 172.21.15.157:0/1634351948 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6710012b00 con 0x7f671c0b3bf0 2023-10-16T19:57:43.729 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.716+0000 7f6722919700 1 -- 172.21.15.157:0/1634351948 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f671c0cc2f0 con 0x7f671c0b3bf0 2023-10-16T19:57:43.729 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.717+0000 7f6722919700 1 -- 172.21.15.157:0/1634351948 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f671c06b300 con 0x7f671c0b3bf0 2023-10-16T19:57:43.729 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.717+0000 7f6718ff9700 1 -- 172.21.15.157:0/1634351948 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f6710012c60 con 0x7f671c0b3bf0 2023-10-16T19:57:43.729 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.718+0000 7f6718ff9700 1 --2- 172.21.15.157:0/1634351948 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f670806af00 0x7f670806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:43.729 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.718+0000 7f6718ff9700 1 -- 172.21.15.157:0/1634351948 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f67100898f0 con 0x7f671c0b3bf0 2023-10-16T19:57:43.730 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.718+0000 7f671b7fe700 1 --2- 172.21.15.157:0/1634351948 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f670806af00 0x7f670806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:43.730 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.718+0000 7f671b7fe700 1 --2- 172.21.15.157:0/1634351948 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f670806af00 0x7f670806d3c0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f670c014040 tx=0x7f670c008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:43.730 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.722+0000 7f6718ff9700 1 -- 172.21.15.157:0/1634351948 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6710054a30 con 0x7f671c0b3bf0 2023-10-16T19:57:43.912 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.910+0000 7f6722919700 1 -- 172.21.15.157:0/1634351948 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f671c04f400 con 0x7f671c0b3bf0 2023-10-16T19:57:43.913 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.910+0000 7f6718ff9700 1 -- 172.21.15.157:0/1634351948 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6710058050 con 0x7f671c0b3bf0 2023-10-16T19:57:43.913 INFO:teuthology.orchestra.run.smithi157.stdout:pg_num: 32 2023-10-16T19:57:43.915 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.912+0000 7f6722919700 1 -- 172.21.15.157:0/1634351948 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f670806af00 msgr2=0x7f670806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:43.915 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.912+0000 7f6722919700 1 --2- 172.21.15.157:0/1634351948 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f670806af00 0x7f670806d3c0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f670c014040 tx=0x7f670c008030 comp rx=0 tx=0).stop 2023-10-16T19:57:43.915 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.912+0000 7f6722919700 1 -- 172.21.15.157:0/1634351948 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f671c0b3bf0 msgr2=0x7f671c0caed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:43.915 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.912+0000 7f6722919700 1 --2- 172.21.15.157:0/1634351948 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f671c0b3bf0 0x7f671c0caed0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f671000d800 tx=0x7f671000dbc0 comp rx=0 tx=0).stop 2023-10-16T19:57:43.916 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.912+0000 7f6722919700 1 -- 172.21.15.157:0/1634351948 shutdown_connections 2023-10-16T19:57:43.916 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.912+0000 7f6722919700 1 --2- 172.21.15.157:0/1634351948 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f670806af00 0x7f670806d3c0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:43.916 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.912+0000 7f6722919700 1 --2- 172.21.15.157:0/1634351948 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f671c15bed0 0x7f671c1f4e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:43.916 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.912+0000 7f6722919700 1 --2- 172.21.15.157:0/1634351948 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f671c0b3bf0 0x7f671c0caed0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:43.916 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.912+0000 7f6722919700 1 --2- 172.21.15.157:0/1634351948 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f671c0d1440 0x7f671c0cb410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:43.916 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.912+0000 7f6722919700 1 -- 172.21.15.157:0/1634351948 >> 172.21.15.157:0/1634351948 conn(0x7f671c0ce6b0 msgr2=0x7f671c0b5260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:43.917 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.912+0000 7f6722919700 1 -- 172.21.15.157:0/1634351948 shutdown_connections 2023-10-16T19:57:43.917 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:43.912+0000 7f6722919700 1 -- 172.21.15.157:0/1634351948 wait complete. 2023-10-16T19:57:43.926 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-16T19:57:44.050 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.048+0000 7f8675648700 1 Processor -- start 2023-10-16T19:57:44.051 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.048+0000 7f8675648700 1 -- start start 2023-10-16T19:57:44.055 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.049+0000 7f8675648700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f867015e0d0 0x7f86700d36d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:44.055 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.049+0000 7f8675648700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86700d2630 con 0x7f86700d0780 2023-10-16T19:57:44.055 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.049+0000 7f8675648700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86700d2910 con 0x7f86700b9a30 2023-10-16T19:57:44.055 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.049+0000 7f8675648700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86700d2bf0 con 0x7f867015e0d0 2023-10-16T19:57:44.055 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.049+0000 7f866f7fe700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f86700d0780 0x7f86700b6e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:56512/0 (socket says 172.21.15.157:56512) 2023-10-16T19:57:44.056 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.049+0000 7f866f7fe700 1 -- 172.21.15.157:0/3105227971 learned_addr learned my addr 172.21.15.157:0/3105227971 (peer_addr_for_me v1:172.21.15.157:0/0) 2023-10-16T19:57:44.056 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.049+0000 7f866effd700 1 --2- 172.21.15.157:0/3105227971 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f867015e0d0 0x7f86700d36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:44.056 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.049+0000 7f866dffb700 1 -- 172.21.15.157:0/3105227971 <== mon.0 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3739313320 0 0) 0x7f86700d2630 con 0x7f86700d0780 2023-10-16T19:57:44.056 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.049+0000 7f866dffb700 1 -- 172.21.15.157:0/3105227971 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f86580035b0 con 0x7f86700d0780 2023-10-16T19:57:44.056 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.050+0000 7f866dffb700 1 -- 172.21.15.157:0/3105227971 <== mon.0 v1:172.21.15.157:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2643093891 0 0) 0x7f86580035b0 con 0x7f86700d0780 2023-10-16T19:57:44.057 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.050+0000 7f866dffb700 1 -- 172.21.15.157:0/3105227971 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f867015e0d0 msgr2=0x7f86700d36d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:57:44.057 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.050+0000 7f866dffb700 1 --2- 172.21.15.157:0/3105227971 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f867015e0d0 0x7f86700d36d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:44.057 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.050+0000 7f866dffb700 1 -- 172.21.15.157:0/3105227971 >> v1:172.21.15.187:6789/0 conn(0x7f86700b9a30 legacy=0x7f86700d1d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:44.057 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.050+0000 7f866dffb700 1 -- 172.21.15.157:0/3105227971 --> v1:172.21.15.157:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86700d2ed0 con 0x7f86700d0780 2023-10-16T19:57:44.057 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.050+0000 7f866dffb700 1 -- 172.21.15.157:0/3105227971 <== mon.0 v1:172.21.15.157:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4021145519 0 0) 0x7f86680019f0 con 0x7f86700d0780 2023-10-16T19:57:44.058 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.050+0000 7f866effd700 1 --2- 172.21.15.157:0/3105227971 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f867015e0d0 0x7f86700d36d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T19:57:44.058 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.050+0000 7f866dffb700 1 -- 172.21.15.157:0/3105227971 >> v1:172.21.15.157:6789/0 conn(0x7f86700d0780 legacy=0x7f86700b6e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:44.058 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.050+0000 7f866dffb700 1 --2- 172.21.15.157:0/3105227971 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8658003a30 0x7f8658003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:44.058 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.050+0000 7f866dffb700 1 --2- 172.21.15.157:0/3105227971 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f86580043e0 0x7f86580048b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:44.058 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.050+0000 7f866dffb700 1 --2- 172.21.15.157:0/3105227971 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f867015e0d0 0x7f86580050d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:44.059 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.050+0000 7f866dffb700 1 -- 172.21.15.157:0/3105227971 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86700d2bf0 con 0x7f8658003a30 2023-10-16T19:57:44.059 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.050+0000 7f866dffb700 1 -- 172.21.15.157:0/3105227971 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f865800ba10 con 0x7f86580043e0 2023-10-16T19:57:44.059 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.050+0000 7f866dffb700 1 -- 172.21.15.157:0/3105227971 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f865800bb80 con 0x7f867015e0d0 2023-10-16T19:57:44.059 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.050+0000 7f866effd700 1 --2- 172.21.15.157:0/3105227971 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8658003a30 0x7f8658003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:44.059 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.050+0000 7f866e7fc700 1 --2- 172.21.15.157:0/3105227971 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f86580043e0 0x7f86580048b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:44.060 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.050+0000 7f866f7fe700 1 --2- 172.21.15.157:0/3105227971 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f867015e0d0 0x7f86580050d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:44.060 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.050+0000 7f866effd700 1 -- 172.21.15.157:0/3105227971 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f867015e0d0 msgr2=0x7f86580050d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:57:44.060 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.050+0000 7f866effd700 1 --2- 172.21.15.157:0/3105227971 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f867015e0d0 0x7f86580050d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:44.060 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.050+0000 7f866effd700 1 -- 172.21.15.157:0/3105227971 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f86580043e0 msgr2=0x7f86580048b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:57:44.060 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.050+0000 7f866effd700 1 --2- 172.21.15.157:0/3105227971 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f86580043e0 0x7f86580048b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:44.060 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.050+0000 7f866effd700 1 -- 172.21.15.157:0/3105227971 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86640094a0 con 0x7f8658003a30 2023-10-16T19:57:44.061 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.050+0000 7f866effd700 1 --2- 172.21.15.157:0/3105227971 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8658003a30 0x7f8658003e10 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f8664009d30 tx=0x7f8658005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab3253ebbd80815e server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:44.061 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.050+0000 7f866dffb700 1 -- 172.21.15.157:0/3105227971 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8664009e80 con 0x7f8658003a30 2023-10-16T19:57:44.061 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.051+0000 7f866dffb700 1 -- 172.21.15.157:0/3105227971 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f866400e9a0 con 0x7f8658003a30 2023-10-16T19:57:44.061 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.051+0000 7f866dffb700 1 -- 172.21.15.157:0/3105227971 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f866400ed10 con 0x7f8658003a30 2023-10-16T19:57:44.061 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.051+0000 7f8675648700 1 -- 172.21.15.157:0/3105227971 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8658003a30 msgr2=0x7f8658003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:44.062 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.051+0000 7f8675648700 1 --2- 172.21.15.157:0/3105227971 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8658003a30 0x7f8658003e10 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f8664009d30 tx=0x7f8658005880 comp rx=0 tx=0).stop 2023-10-16T19:57:44.062 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.051+0000 7f866f7fe700 1 -- 172.21.15.157:0/3105227971 reap_dead start 2023-10-16T19:57:44.062 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.051+0000 7f8675648700 1 -- 172.21.15.157:0/3105227971 shutdown_connections 2023-10-16T19:57:44.062 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.051+0000 7f8675648700 1 -- 172.21.15.157:0/3105227971 >> 172.21.15.157:0/3105227971 conn(0x7f867006aeb0 msgr2=0x7f867006b2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:44.062 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.051+0000 7f8675648700 1 -- 172.21.15.157:0/3105227971 shutdown_connections 2023-10-16T19:57:44.063 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.051+0000 7f8675648700 1 -- 172.21.15.157:0/3105227971 wait complete. 2023-10-16T19:57:44.063 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.052+0000 7f8675648700 1 Processor -- start 2023-10-16T19:57:44.063 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.052+0000 7f8675648700 1 -- start start 2023-10-16T19:57:44.065 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.053+0000 7f8675648700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8658003a30 0x7f86701f7730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:44.066 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.053+0000 7f8675648700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f86700cd9c0 0x7f867014f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:44.066 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.053+0000 7f8675648700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f867015e4b0 0x7f8670150030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:44.066 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.053+0000 7f8675648700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f867015e940 con 0x7f867015e4b0 2023-10-16T19:57:44.066 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.053+0000 7f8675648700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86701f6c90 con 0x7f8658003a30 2023-10-16T19:57:44.066 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.053+0000 7f8675648700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f867015ee70 con 0x7f86700cd9c0 2023-10-16T19:57:44.067 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.053+0000 7f866f7fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f867015e4b0 0x7f8670150030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:44.068 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.053+0000 7f866f7fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f867015e4b0 0x7f8670150030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:46852/0 (socket says 172.21.15.157:46852) 2023-10-16T19:57:44.068 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.053+0000 7f866f7fe700 1 -- 172.21.15.157:0/2062510033 learned_addr learned my addr 172.21.15.157:0/2062510033 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:57:44.068 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.054+0000 7f866e7fc700 1 --2- 172.21.15.157:0/2062510033 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f86700cd9c0 0x7f867014f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:44.068 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.054+0000 7f866effd700 1 --2- 172.21.15.157:0/2062510033 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8658003a30 0x7f86701f7730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:44.069 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.054+0000 7f866f7fe700 1 -- 172.21.15.157:0/2062510033 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f86700cd9c0 msgr2=0x7f867014f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:44.069 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.054+0000 7f866f7fe700 1 --2- 172.21.15.157:0/2062510033 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f86700cd9c0 0x7f867014f4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:44.069 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.054+0000 7f866f7fe700 1 -- 172.21.15.157:0/2062510033 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8658003a30 msgr2=0x7f86701f7730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:44.069 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.054+0000 7f866f7fe700 1 --2- 172.21.15.157:0/2062510033 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8658003a30 0x7f86701f7730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:44.069 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.054+0000 7f866f7fe700 1 -- 172.21.15.157:0/2062510033 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f867015f150 con 0x7f867015e4b0 2023-10-16T19:57:44.070 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.054+0000 7f866f7fe700 1 --2- 172.21.15.157:0/2062510033 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f867015e4b0 0x7f8670150030 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f8668000f80 tx=0x7f866800a640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:44.070 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.054+0000 7f86577fe700 1 -- 172.21.15.157:0/2062510033 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f866800ae10 con 0x7f867015e4b0 2023-10-16T19:57:44.070 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.054+0000 7f86577fe700 1 -- 172.21.15.157:0/2062510033 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86680133f0 con 0x7f867015e4b0 2023-10-16T19:57:44.070 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.054+0000 7f8675648700 1 -- 172.21.15.157:0/2062510033 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86701f6f30 con 0x7f867015e4b0 2023-10-16T19:57:44.070 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.054+0000 7f86577fe700 1 -- 172.21.15.157:0/2062510033 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86680137a0 con 0x7f867015e4b0 2023-10-16T19:57:44.071 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.054+0000 7f8675648700 1 -- 172.21.15.157:0/2062510033 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f867015f430 con 0x7f867015e4b0 2023-10-16T19:57:44.071 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.055+0000 7f8675648700 1 -- 172.21.15.157:0/2062510033 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86700cf9d0 con 0x7f867015e4b0 2023-10-16T19:57:44.071 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.055+0000 7f86577fe700 1 -- 172.21.15.157:0/2062510033 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f8668013900 con 0x7f867015e4b0 2023-10-16T19:57:44.071 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.056+0000 7f86577fe700 1 --2- 172.21.15.157:0/2062510033 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f865c06af30 0x7f865c06d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:44.071 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.056+0000 7f86577fe700 1 -- 172.21.15.157:0/2062510033 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8668089e90 con 0x7f867015e4b0 2023-10-16T19:57:44.071 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.056+0000 7f866effd700 1 --2- 172.21.15.157:0/2062510033 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f865c06af30 0x7f865c06d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:44.072 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.056+0000 7f866effd700 1 --2- 172.21.15.157:0/2062510033 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f865c06af30 0x7f865c06d3f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f8664000c00 tx=0x7f8664008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:44.072 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.060+0000 7f86577fe700 1 -- 172.21.15.157:0/2062510033 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8668054f40 con 0x7f867015e4b0 2023-10-16T19:57:44.252 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.249+0000 7f8675648700 1 -- 172.21.15.157:0/2062510033 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f867004f400 con 0x7f867015e4b0 2023-10-16T19:57:44.252 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.250+0000 7f86577fe700 1 -- 172.21.15.157:0/2062510033 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8668058560 con 0x7f867015e4b0 2023-10-16T19:57:44.252 INFO:teuthology.orchestra.run.smithi157.stdout:pg_num: 64 2023-10-16T19:57:44.255 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.252+0000 7f8675648700 1 -- 172.21.15.157:0/2062510033 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f865c06af30 msgr2=0x7f865c06d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:44.255 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.252+0000 7f8675648700 1 --2- 172.21.15.157:0/2062510033 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f865c06af30 0x7f865c06d3f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f8664000c00 tx=0x7f8664008030 comp rx=0 tx=0).stop 2023-10-16T19:57:44.255 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.252+0000 7f8675648700 1 -- 172.21.15.157:0/2062510033 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f867015e4b0 msgr2=0x7f8670150030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:44.255 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.252+0000 7f8675648700 1 --2- 172.21.15.157:0/2062510033 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f867015e4b0 0x7f8670150030 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f8668000f80 tx=0x7f866800a640 comp rx=0 tx=0).stop 2023-10-16T19:57:44.255 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.252+0000 7f8675648700 1 -- 172.21.15.157:0/2062510033 shutdown_connections 2023-10-16T19:57:44.256 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.252+0000 7f8675648700 1 --2- 172.21.15.157:0/2062510033 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f865c06af30 0x7f865c06d3f0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:44.256 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.252+0000 7f8675648700 1 --2- 172.21.15.157:0/2062510033 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8658003a30 0x7f86701f7730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:44.256 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.252+0000 7f8675648700 1 --2- 172.21.15.157:0/2062510033 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f867015e4b0 0x7f8670150030 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:44.256 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.252+0000 7f8675648700 1 --2- 172.21.15.157:0/2062510033 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f86700cd9c0 0x7f867014f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:44.256 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.252+0000 7f8675648700 1 -- 172.21.15.157:0/2062510033 >> 172.21.15.157:0/2062510033 conn(0x7f867006aeb0 msgr2=0x7f86700b7690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:44.257 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.252+0000 7f8675648700 1 -- 172.21.15.157:0/2062510033 shutdown_connections 2023-10-16T19:57:44.257 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.252+0000 7f8675648700 1 -- 172.21.15.157:0/2062510033 wait complete. 2023-10-16T19:57:44.267 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-16T19:57:44.389 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.387+0000 7f8290367700 1 Processor -- start 2023-10-16T19:57:44.389 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.387+0000 7f8290367700 1 -- start start 2023-10-16T19:57:44.396 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.388+0000 7f8290367700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8288071f60 0x7f828806d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:44.397 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.388+0000 7f8290367700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82880cefc0 con 0x7f828815b130 2023-10-16T19:57:44.397 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.388+0000 7f8290367700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f828806e090 con 0x7f828806eb20 2023-10-16T19:57:44.397 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.388+0000 7f8290367700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82880b0050 con 0x7f8288071f60 2023-10-16T19:57:44.397 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.388+0000 7f828e103700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f828815b130 0x7f82880cb970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:56528/0 (socket says 172.21.15.157:56528) 2023-10-16T19:57:44.398 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.388+0000 7f828e103700 1 -- 172.21.15.157:0/3326434501 learned_addr learned my addr 172.21.15.157:0/3326434501 (peer_addr_for_me v1:172.21.15.157:0/0) 2023-10-16T19:57:44.398 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.388+0000 7f828d902700 1 --2- 172.21.15.157:0/3326434501 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8288071f60 0x7f828806d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:44.398 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.388+0000 7f828d101700 1 -- 172.21.15.157:0/3326434501 <== mon.0 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2576594796 0 0) 0x7f82880cefc0 con 0x7f828815b130 2023-10-16T19:57:44.398 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.388+0000 7f828d101700 1 -- 172.21.15.157:0/3326434501 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f82740035b0 con 0x7f828815b130 2023-10-16T19:57:44.398 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.388+0000 7f828d101700 1 -- 172.21.15.157:0/3326434501 <== mon.0 v1:172.21.15.157:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3482391413 0 0) 0x7f82740035b0 con 0x7f828815b130 2023-10-16T19:57:44.399 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.388+0000 7f828d101700 1 -- 172.21.15.157:0/3326434501 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8288071f60 msgr2=0x7f828806d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:57:44.399 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.388+0000 7f828d101700 1 --2- 172.21.15.157:0/3326434501 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8288071f60 0x7f828806d0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:44.399 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.388+0000 7f828d101700 1 -- 172.21.15.157:0/3326434501 >> v1:172.21.15.187:6789/0 conn(0x7f828806eb20 legacy=0x7f82880cf450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:44.399 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.388+0000 7f828d101700 1 -- 172.21.15.157:0/3326434501 --> v1:172.21.15.157:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f828806d7f0 con 0x7f828815b130 2023-10-16T19:57:44.399 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.388+0000 7f828d101700 1 -- 172.21.15.157:0/3326434501 <== mon.0 v1:172.21.15.157:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4021145519 0 0) 0x7f8278001670 con 0x7f828815b130 2023-10-16T19:57:44.400 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.388+0000 7f828d101700 1 -- 172.21.15.157:0/3326434501 >> v1:172.21.15.157:6789/0 conn(0x7f828815b130 legacy=0x7f82880cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:44.400 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.388+0000 7f828d101700 1 --2- 172.21.15.157:0/3326434501 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8274003a30 0x7f8274003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:44.400 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.388+0000 7f828d101700 1 --2- 172.21.15.157:0/3326434501 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8288071f60 0x7f8274004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:44.400 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.388+0000 7f828d101700 1 --2- 172.21.15.157:0/3326434501 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8274004d90 0x7f8274005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:44.400 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.388+0000 7f828d101700 1 -- 172.21.15.157:0/3326434501 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f827400bb10 con 0x7f8274004d90 2023-10-16T19:57:44.401 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.388+0000 7f828d101700 1 -- 172.21.15.157:0/3326434501 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f827400bc80 con 0x7f8274003a30 2023-10-16T19:57:44.401 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.388+0000 7f828d101700 1 -- 172.21.15.157:0/3326434501 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f827400be40 con 0x7f8288071f60 2023-10-16T19:57:44.401 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.388+0000 7f828e904700 1 --2- 172.21.15.157:0/3326434501 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8274004d90 0x7f8274005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:44.401 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.389+0000 7f828d902700 1 --2- 172.21.15.157:0/3326434501 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8288071f60 0x7f8274004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:44.401 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.389+0000 7f828e103700 1 --2- 172.21.15.157:0/3326434501 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8274003a30 0x7f8274003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:44.401 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.389+0000 7f828e904700 1 -- 172.21.15.157:0/3326434501 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8288071f60 msgr2=0x7f8274004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:57:44.402 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.389+0000 7f828e904700 1 --2- 172.21.15.157:0/3326434501 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8288071f60 0x7f8274004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:44.402 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.389+0000 7f828e904700 1 -- 172.21.15.157:0/3326434501 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8274003a30 msgr2=0x7f8274003e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:57:44.402 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.389+0000 7f828e904700 1 --2- 172.21.15.157:0/3326434501 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8274003a30 0x7f8274003e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:44.402 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.389+0000 7f828e904700 1 -- 172.21.15.157:0/3326434501 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82740035b0 con 0x7f8274004d90 2023-10-16T19:57:44.402 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.389+0000 7f828e904700 1 --2- 172.21.15.157:0/3326434501 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8274004d90 0x7f8274005210 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f828000c110 tx=0x7f8274005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c43e859bb8748b3c server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:44.403 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.389+0000 7f828d101700 1 -- 172.21.15.157:0/3326434501 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8280001da0 con 0x7f8274004d90 2023-10-16T19:57:44.403 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.389+0000 7f828d101700 1 -- 172.21.15.157:0/3326434501 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8280003c50 con 0x7f8274004d90 2023-10-16T19:57:44.403 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.389+0000 7f828d101700 1 -- 172.21.15.157:0/3326434501 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f828000ca50 con 0x7f8274004d90 2023-10-16T19:57:44.403 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.390+0000 7f8290367700 1 -- 172.21.15.157:0/3326434501 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8274004d90 msgr2=0x7f8274005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:44.403 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.390+0000 7f8290367700 1 --2- 172.21.15.157:0/3326434501 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8274004d90 0x7f8274005210 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f828000c110 tx=0x7f8274005880 comp rx=0 tx=0).stop 2023-10-16T19:57:44.404 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.390+0000 7f828e904700 1 -- 172.21.15.157:0/3326434501 reap_dead start 2023-10-16T19:57:44.404 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.390+0000 7f8290367700 1 -- 172.21.15.157:0/3326434501 shutdown_connections 2023-10-16T19:57:44.404 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.390+0000 7f8290367700 1 -- 172.21.15.157:0/3326434501 >> 172.21.15.157:0/3326434501 conn(0x7f82880cd4e0 msgr2=0x7f82880cd8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:44.404 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.390+0000 7f8290367700 1 -- 172.21.15.157:0/3326434501 shutdown_connections 2023-10-16T19:57:44.404 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.390+0000 7f8290367700 1 -- 172.21.15.157:0/3326434501 wait complete. 2023-10-16T19:57:44.404 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.391+0000 7f8290367700 1 Processor -- start 2023-10-16T19:57:44.405 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.391+0000 7f8290367700 1 -- start start 2023-10-16T19:57:44.405 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.392+0000 7f8290367700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8274004d90 0x7f82880c72b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:44.405 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.392+0000 7f8290367700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f828815b7b0 0x7f828815ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:44.405 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.392+0000 7f8290367700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f828815bc30 0x7f828815f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:44.405 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.392+0000 7f8290367700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f828815cdf0 con 0x7f828815b7b0 2023-10-16T19:57:44.406 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.392+0000 7f8290367700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f828815c1e0 con 0x7f8274004d90 2023-10-16T19:57:44.406 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.392+0000 7f8290367700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f828815c4c0 con 0x7f828815bc30 2023-10-16T19:57:44.406 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.392+0000 7f828d902700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f828815b7b0 0x7f828815ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:44.406 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.392+0000 7f828d902700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f828815b7b0 0x7f828815ef90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:46870/0 (socket says 172.21.15.157:46870) 2023-10-16T19:57:44.406 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.392+0000 7f828d902700 1 -- 172.21.15.157:0/2910157413 learned_addr learned my addr 172.21.15.157:0/2910157413 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:57:44.407 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.392+0000 7f828e103700 1 --2- 172.21.15.157:0/2910157413 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8274004d90 0x7f82880c72b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:44.407 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.392+0000 7f828e904700 1 --2- 172.21.15.157:0/2910157413 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f828815bc30 0x7f828815f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:44.407 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.392+0000 7f828d902700 1 -- 172.21.15.157:0/2910157413 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f828815bc30 msgr2=0x7f828815f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:44.407 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.392+0000 7f828d902700 1 --2- 172.21.15.157:0/2910157413 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f828815bc30 0x7f828815f4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:44.407 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.392+0000 7f828d902700 1 -- 172.21.15.157:0/2910157413 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8274004d90 msgr2=0x7f82880c72b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:44.408 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.392+0000 7f828d902700 1 --2- 172.21.15.157:0/2910157413 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8274004d90 0x7f82880c72b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:44.408 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.392+0000 7f828d902700 1 -- 172.21.15.157:0/2910157413 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f828815c7a0 con 0x7f828815b7b0 2023-10-16T19:57:44.408 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.392+0000 7f828d902700 1 --2- 172.21.15.157:0/2910157413 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f828815b7b0 0x7f828815ef90 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f8284011aa0 tx=0x7f8284011db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:44.408 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.392+0000 7f827effd700 1 -- 172.21.15.157:0/2910157413 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8284011ee0 con 0x7f828815b7b0 2023-10-16T19:57:44.408 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.392+0000 7f827effd700 1 -- 172.21.15.157:0/2910157413 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f828400f940 con 0x7f828815b7b0 2023-10-16T19:57:44.409 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.392+0000 7f8290367700 1 -- 172.21.15.157:0/2910157413 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f828815ca80 con 0x7f828815b7b0 2023-10-16T19:57:44.409 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.392+0000 7f827effd700 1 -- 172.21.15.157:0/2910157413 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f828400fcf0 con 0x7f828815b7b0 2023-10-16T19:57:44.409 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.392+0000 7f8290367700 1 -- 172.21.15.157:0/2910157413 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82881552a0 con 0x7f828815b7b0 2023-10-16T19:57:44.409 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.393+0000 7f8290367700 1 -- 172.21.15.157:0/2910157413 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f828804f400 con 0x7f828815b7b0 2023-10-16T19:57:44.409 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.394+0000 7f827effd700 1 -- 172.21.15.157:0/2910157413 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f8284014440 con 0x7f828815b7b0 2023-10-16T19:57:44.410 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.394+0000 7f827effd700 1 --2- 172.21.15.157:0/2910157413 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f826c06af00 0x7f826c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:44.410 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.394+0000 7f827effd700 1 -- 172.21.15.157:0/2910157413 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8284089b90 con 0x7f828815b7b0 2023-10-16T19:57:44.410 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.394+0000 7f828e103700 1 --2- 172.21.15.157:0/2910157413 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f826c06af00 0x7f826c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:44.411 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.395+0000 7f828e103700 1 --2- 172.21.15.157:0/2910157413 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f826c06af00 0x7f826c06d3c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f8278001050 tx=0x7f8278000f80 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:44.411 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.399+0000 7f827effd700 1 -- 172.21.15.157:0/2910157413 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8284054d90 con 0x7f828815b7b0 2023-10-16T19:57:44.603 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.601+0000 7f8290367700 1 -- 172.21.15.157:0/2910157413 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f828806f720 con 0x7f828815b7b0 2023-10-16T19:57:44.604 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.601+0000 7f827effd700 1 -- 172.21.15.157:0/2910157413 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) v1 ==== 80+0+0 (secure 0 0 0) 0x7f82840583b0 con 0x7f828815b7b0 2023-10-16T19:57:44.606 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.603+0000 7f8290367700 1 -- 172.21.15.157:0/2910157413 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f826c06af00 msgr2=0x7f826c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:44.607 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.603+0000 7f8290367700 1 --2- 172.21.15.157:0/2910157413 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f826c06af00 0x7f826c06d3c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f8278001050 tx=0x7f8278000f80 comp rx=0 tx=0).stop 2023-10-16T19:57:44.607 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.603+0000 7f8290367700 1 -- 172.21.15.157:0/2910157413 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f828815b7b0 msgr2=0x7f828815ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:44.607 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.603+0000 7f8290367700 1 --2- 172.21.15.157:0/2910157413 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f828815b7b0 0x7f828815ef90 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f8284011aa0 tx=0x7f8284011db0 comp rx=0 tx=0).stop 2023-10-16T19:57:44.607 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.604+0000 7f8290367700 1 -- 172.21.15.157:0/2910157413 shutdown_connections 2023-10-16T19:57:44.607 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.604+0000 7f8290367700 1 --2- 172.21.15.157:0/2910157413 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f826c06af00 0x7f826c06d3c0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:44.608 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.604+0000 7f8290367700 1 --2- 172.21.15.157:0/2910157413 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8274004d90 0x7f82880c72b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:44.608 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.604+0000 7f8290367700 1 --2- 172.21.15.157:0/2910157413 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f828815bc30 0x7f828815f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:44.608 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.604+0000 7f8290367700 1 --2- 172.21.15.157:0/2910157413 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f828815b7b0 0x7f828815ef90 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:44.608 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.604+0000 7f8290367700 1 -- 172.21.15.157:0/2910157413 >> 172.21.15.157:0/2910157413 conn(0x7f82880cd4e0 msgr2=0x7f82880cf350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:44.608 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.604+0000 7f8290367700 1 -- 172.21.15.157:0/2910157413 shutdown_connections 2023-10-16T19:57:44.609 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.604+0000 7f8290367700 1 -- 172.21.15.157:0/2910157413 wait complete. 2023-10-16T19:57:44.609 INFO:teuthology.orchestra.run.smithi157.stderr:listed 0 entries 2023-10-16T19:57:44.618 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-16T19:57:44.618 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T19:57:44.619 DEBUG:teuthology.orchestra.run.smithi157:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2023-10-16T19:57:44.666 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi157.front.sepia.ceph.com 2023-10-16T19:57:44.666 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T19:57:44.667 DEBUG:teuthology.orchestra.run.smithi157:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-16T19:57:44.692 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-10-16T19:57:44.693 DEBUG:teuthology.orchestra.run.smithi187:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T19:57:44.714 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-10-16T19:57:44.714 DEBUG:teuthology.orchestra.run.smithi187:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T19:57:44.775 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-10-16T19:57:44.775 DEBUG:teuthology.orchestra.run.smithi187:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T19:57:44.835 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T19:57:44.956 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.954+0000 7f476e33a700 1 Processor -- start 2023-10-16T19:57:44.956 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.954+0000 7f476e33a700 1 -- start start 2023-10-16T19:57:44.959 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.954+0000 7f476e33a700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f47680cfb30 0x7f47680cdc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:44.959 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.954+0000 7f476e33a700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4768161c40 0x7f47681620d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:44.959 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.954+0000 7f476e33a700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f476815e6b0 con 0x7f47680cff10 2023-10-16T19:57:44.959 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.954+0000 7f476e33a700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f476815f330 con 0x7f47680cfb30 2023-10-16T19:57:44.960 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.954+0000 7f476e33a700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47680d19f0 con 0x7f4768161c40 2023-10-16T19:57:44.960 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.955+0000 7f4767fff700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f47680cfb30 0x7f47680cdc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:44.960 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.955+0000 7f4767fff700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f47680cfb30 0x7f47680cdc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:46876/0 (socket says 172.21.15.157:46876) 2023-10-16T19:57:44.960 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.955+0000 7f4767fff700 1 -- 172.21.15.157:0/2567534951 learned_addr learned my addr 172.21.15.157:0/2567534951 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:57:44.960 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.955+0000 7f476c8d7700 1 --2- 172.21.15.157:0/2567534951 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4768161c40 0x7f47681620d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:44.961 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.955+0000 7f4767fff700 1 -- 172.21.15.157:0/2567534951 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4768161c40 msgr2=0x7f47681620d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:57:44.961 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.955+0000 7f4767fff700 1 --2- 172.21.15.157:0/2567534951 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4768161c40 0x7f47681620d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:44.961 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.955+0000 7f4767fff700 1 -- 172.21.15.157:0/2567534951 >> v1:172.21.15.187:6789/0 conn(0x7f47680cff10 legacy=0x7f47680b3e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:44.961 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.955+0000 7f4767fff700 1 -- 172.21.15.157:0/2567534951 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f476815e990 con 0x7f47680cfb30 2023-10-16T19:57:44.961 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.955+0000 7f476c8d7700 1 --2- 172.21.15.157:0/2567534951 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4768161c40 0x7f47681620d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T19:57:44.962 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.955+0000 7f4767fff700 1 --2- 172.21.15.157:0/2567534951 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f47680cfb30 0x7f47680cdc90 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f47580098f0 tx=0x7f4758009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68adad3b21daf7ac server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:44.962 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.955+0000 7f4766ffd700 1 -- 172.21.15.157:0/2567534951 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f475800b8a0 con 0x7f47680cfb30 2023-10-16T19:57:44.962 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.955+0000 7f4766ffd700 1 -- 172.21.15.157:0/2567534951 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f475800ba00 con 0x7f47680cfb30 2023-10-16T19:57:44.962 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.955+0000 7f4766ffd700 1 -- 172.21.15.157:0/2567534951 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f475800bd90 con 0x7f47680cfb30 2023-10-16T19:57:44.962 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.956+0000 7f476e33a700 1 -- 172.21.15.157:0/2567534951 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f47680cfb30 msgr2=0x7f47680cdc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:44.963 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.956+0000 7f476e33a700 1 --2- 172.21.15.157:0/2567534951 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f47680cfb30 0x7f47680cdc90 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f47580098f0 tx=0x7f4758009c00 comp rx=0 tx=0).stop 2023-10-16T19:57:44.963 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.956+0000 7f476e33a700 1 -- 172.21.15.157:0/2567534951 shutdown_connections 2023-10-16T19:57:44.963 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.956+0000 7f476e33a700 1 --2- 172.21.15.157:0/2567534951 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4768161c40 0x7f47681620d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:44.963 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.956+0000 7f476e33a700 1 --2- 172.21.15.157:0/2567534951 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f47680cfb30 0x7f47680cdc90 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:44.963 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.956+0000 7f476e33a700 1 -- 172.21.15.157:0/2567534951 >> 172.21.15.157:0/2567534951 conn(0x7f476806e2e0 msgr2=0x7f476806e6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:44.964 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.956+0000 7f476e33a700 1 -- 172.21.15.157:0/2567534951 shutdown_connections 2023-10-16T19:57:44.964 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.956+0000 7f476e33a700 1 -- 172.21.15.157:0/2567534951 wait complete. 2023-10-16T19:57:44.967 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.957+0000 7f476e33a700 1 Processor -- start 2023-10-16T19:57:44.967 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.957+0000 7f476e33a700 1 -- start start 2023-10-16T19:57:44.968 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.958+0000 7f476e33a700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f47680cfb30 0x7f476815cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:44.968 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.958+0000 7f476e33a700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f47680cff10 0x7f47680cb180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:44.968 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.958+0000 7f476e33a700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4768161c40 0x7f47680cb6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:44.968 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.958+0000 7f476e33a700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f476815da80 con 0x7f47680cff10 2023-10-16T19:57:44.968 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.958+0000 7f476e33a700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47680b6220 con 0x7f47680cfb30 2023-10-16T19:57:44.969 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.958+0000 7f476e33a700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47680af4c0 con 0x7f4768161c40 2023-10-16T19:57:44.969 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.958+0000 7f47677fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f47680cff10 0x7f47680cb180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:44.969 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.958+0000 7f47677fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f47680cff10 0x7f47680cb180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:46884/0 (socket says 172.21.15.157:46884) 2023-10-16T19:57:44.969 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.958+0000 7f47677fe700 1 -- 172.21.15.157:0/2588056151 learned_addr learned my addr 172.21.15.157:0/2588056151 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:57:44.969 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.958+0000 7f476c8d7700 1 --2- 172.21.15.157:0/2588056151 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4768161c40 0x7f47680cb6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:44.970 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.958+0000 7f4767fff700 1 --2- 172.21.15.157:0/2588056151 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f47680cfb30 0x7f476815cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:44.970 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.958+0000 7f47677fe700 1 -- 172.21.15.157:0/2588056151 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4768161c40 msgr2=0x7f47680cb6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:44.970 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.958+0000 7f47677fe700 1 --2- 172.21.15.157:0/2588056151 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4768161c40 0x7f47680cb6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:44.970 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.958+0000 7f47677fe700 1 -- 172.21.15.157:0/2588056151 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f47680cfb30 msgr2=0x7f476815cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:44.970 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.958+0000 7f47677fe700 1 --2- 172.21.15.157:0/2588056151 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f47680cfb30 0x7f476815cd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:44.971 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.958+0000 7f47677fe700 1 -- 172.21.15.157:0/2588056151 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4758009550 con 0x7f47680cff10 2023-10-16T19:57:44.971 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.959+0000 7f47677fe700 1 --2- 172.21.15.157:0/2588056151 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f47680cff10 0x7f47680cb180 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f475c00c4e0 tx=0x7f475c00c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:44.971 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.959+0000 7f4764ff9700 1 -- 172.21.15.157:0/2588056151 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f475c0052d0 con 0x7f47680cff10 2023-10-16T19:57:44.971 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.959+0000 7f4764ff9700 1 -- 172.21.15.157:0/2588056151 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f475c005430 con 0x7f47680cff10 2023-10-16T19:57:44.971 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.959+0000 7f476e33a700 1 -- 172.21.15.157:0/2588056151 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f476815d7a0 con 0x7f47680cff10 2023-10-16T19:57:44.972 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.959+0000 7f4764ff9700 1 -- 172.21.15.157:0/2588056151 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f475c0038c0 con 0x7f47680cff10 2023-10-16T19:57:44.972 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.959+0000 7f476e33a700 1 -- 172.21.15.157:0/2588056151 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47680af0e0 con 0x7f47680cff10 2023-10-16T19:57:44.972 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.960+0000 7f476e33a700 1 -- 172.21.15.157:0/2588056151 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47680aec60 con 0x7f47680cff10 2023-10-16T19:57:44.972 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.960+0000 7f4764ff9700 1 -- 172.21.15.157:0/2588056151 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f475c003a20 con 0x7f47680cff10 2023-10-16T19:57:44.972 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.960+0000 7f4764ff9700 1 --2- 172.21.15.157:0/2588056151 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f475406af00 0x7f475406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:44.973 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.961+0000 7f4764ff9700 1 -- 172.21.15.157:0/2588056151 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f475c088ab0 con 0x7f47680cff10 2023-10-16T19:57:44.973 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.961+0000 7f4767fff700 1 --2- 172.21.15.157:0/2588056151 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f475406af00 0x7f475406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:44.973 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.961+0000 7f4767fff700 1 --2- 172.21.15.157:0/2588056151 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f475406af00 0x7f475406d3c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f4758014040 tx=0x7f4758008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:44.973 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:44.965+0000 7f4764ff9700 1 -- 172.21.15.157:0/2588056151 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f47680aec60 con 0x7f47680cff10 2023-10-16T19:57:45.157 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.154+0000 7f476e33a700 1 -- 172.21.15.157:0/2588056151 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f47680aec60 con 0x7f47680cff10 2023-10-16T19:57:45.158 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.155+0000 7f4764ff9700 1 -- 172.21.15.157:0/2588056151 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16517 (secure 0 0 0) 0x7f47680aec60 con 0x7f47680cff10 2023-10-16T19:57:45.158 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-10-16T19:57:45.158 INFO:teuthology.orchestra.run.smithi157.stdout:{"epoch":21,"fsid":"28199dc9-64d5-479e-83c6-21f097c33d39","created":"2023-10-16T19:56:49.201889+0000","modified":"2023-10-16T19:57:07.988567+0000","last_up_change":"2023-10-16T19:56:54.675673+0000","last_in_change":"2023-10-16T19:56:51.666728+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T19:56:56.932895+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-16T19:57:04.936105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-16T19:57:05.335279+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":335785898},{"type":"v1","addr":"172.21.15.157:6809","nonce":335785898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":335785898},{"type":"v1","addr":"172.21.15.157:6811","nonce":335785898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6815","nonce":335785898},{"type":"v1","addr":"172.21.15.157:6817","nonce":335785898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":335785898},{"type":"v1","addr":"172.21.15.157:6813","nonce":335785898}]},"public_addr":"172.21.15.157:6809/335785898","cluster_addr":"172.21.15.157:6811/335785898","heartbeat_back_addr":"172.21.15.157:6817/335785898","heartbeat_front_addr":"172.21.15.157:6813/335785898","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":3482825047},{"type":"v1","addr":"172.21.15.157:6801","nonce":3482825047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":3482825047},{"type":"v1","addr":"172.21.15.157:6803","nonce":3482825047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":3482825047},{"type":"v1","addr":"172.21.15.157:6807","nonce":3482825047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":3482825047},{"type":"v1","addr":"172.21.15.157:6805","nonce":3482825047}]},"public_addr":"172.21.15.157:6801/3482825047","cluster_addr":"172.21.15.157:6803/3482825047","heartbeat_back_addr":"172.21.15.157:6807/3482825047","heartbeat_front_addr":"172.21.15.157:6805/3482825047","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":1118292389},{"type":"v1","addr":"172.21.15.157:6825","nonce":1118292389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":1118292389},{"type":"v1","addr":"172.21.15.157:6827","nonce":1118292389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":1118292389},{"type":"v1","addr":"172.21.15.157:6831","nonce":1118292389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":1118292389},{"type":"v1","addr":"172.21.15.157:6829","nonce":1118292389}]},"public_addr":"172.21.15.157:6825/1118292389","cluster_addr":"172.21.15.157:6827/1118292389","heartbeat_back_addr":"172.21.15.157:6831/1118292389","heartbeat_front_addr":"172.21.15.157:6829/1118292389","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":989329821},{"type":"v1","addr":"172.21.15.157:6816","nonce":989329821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":989329821},{"type":"v1","addr":"172.21.15.157:6819","nonce":989329821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":989329821},{"type":"v1","addr":"172.21.15.157:6823","nonce":989329821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":989329821},{"type":"v1","addr":"172.21.15.157:6821","nonce":989329821}]},"public_addr":"172.21.15.157:6816/989329821","cluster_addr":"172.21.15.157:6819/989329821","heartbeat_back_addr":"172.21.15.157:6823/989329821","heartbeat_front_addr":"172.21.15.157:6821/989329821","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":3841016811},{"type":"v1","addr":"172.21.15.187:6801","nonce":3841016811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6803","nonce":3841016811},{"type":"v1","addr":"172.21.15.187:6804","nonce":3841016811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6809","nonce":3841016811},{"type":"v1","addr":"172.21.15.187:6811","nonce":3841016811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":3841016811},{"type":"v1","addr":"172.21.15.187:6808","nonce":3841016811}]},"public_addr":"172.21.15.187:6801/3841016811","cluster_addr":"172.21.15.187:6804/3841016811","heartbeat_back_addr":"172.21.15.187:6811/3841016811","heartbeat_front_addr":"172.21.15.187:6808/3841016811","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":915130263},{"type":"v1","addr":"172.21.15.187:6805","nonce":915130263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6807","nonce":915130263},{"type":"v1","addr":"172.21.15.187:6810","nonce":915130263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":915130263},{"type":"v1","addr":"172.21.15.187:6815","nonce":915130263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":915130263},{"type":"v1","addr":"172.21.15.187:6813","nonce":915130263}]},"public_addr":"172.21.15.187:6805/915130263","cluster_addr":"172.21.15.187:6810/915130263","heartbeat_back_addr":"172.21.15.187:6815/915130263","heartbeat_front_addr":"172.21.15.187:6813/915130263","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":654976824},{"type":"v1","addr":"172.21.15.187:6817","nonce":654976824}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":654976824},{"type":"v1","addr":"172.21.15.187:6819","nonce":654976824}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":654976824},{"type":"v1","addr":"172.21.15.187:6823","nonce":654976824}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":654976824},{"type":"v1","addr":"172.21.15.187:6821","nonce":654976824}]},"public_addr":"172.21.15.187:6817/654976824","cluster_addr":"172.21.15.187:6819/654976824","heartbeat_back_addr":"172.21.15.187:6823/654976824","heartbeat_front_addr":"172.21.15.187:6821/654976824","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":4284059445},{"type":"v1","addr":"172.21.15.187:6825","nonce":4284059445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":4284059445},{"type":"v1","addr":"172.21.15.187:6827","nonce":4284059445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":4284059445},{"type":"v1","addr":"172.21.15.187:6831","nonce":4284059445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":4284059445},{"type":"v1","addr":"172.21.15.187:6829","nonce":4284059445}]},"public_addr":"172.21.15.187:6825/4284059445","cluster_addr":"172.21.15.187:6827/4284059445","heartbeat_back_addr":"172.21.15.187:6831/4284059445","heartbeat_front_addr":"172.21.15.187:6829/4284059445","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.819780+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.824193+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.849575+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.824806+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.809540+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.805093+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.866109+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.807372+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T19:57:45.161 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.158+0000 7f476e33a700 1 -- 172.21.15.157:0/2588056151 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f475406af00 msgr2=0x7f475406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:45.161 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.158+0000 7f476e33a700 1 --2- 172.21.15.157:0/2588056151 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f475406af00 0x7f475406d3c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f4758014040 tx=0x7f4758008030 comp rx=0 tx=0).stop 2023-10-16T19:57:45.161 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.158+0000 7f476e33a700 1 -- 172.21.15.157:0/2588056151 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f47680cff10 msgr2=0x7f47680cb180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:45.161 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.158+0000 7f476e33a700 1 --2- 172.21.15.157:0/2588056151 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f47680cff10 0x7f47680cb180 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f475c00c4e0 tx=0x7f475c00c8a0 comp rx=0 tx=0).stop 2023-10-16T19:57:45.162 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.158+0000 7f476e33a700 1 -- 172.21.15.157:0/2588056151 shutdown_connections 2023-10-16T19:57:45.162 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.158+0000 7f476e33a700 1 --2- 172.21.15.157:0/2588056151 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f475406af00 0x7f475406d3c0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:45.162 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.158+0000 7f476e33a700 1 --2- 172.21.15.157:0/2588056151 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f47680cfb30 0x7f476815cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:45.162 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.158+0000 7f476e33a700 1 --2- 172.21.15.157:0/2588056151 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4768161c40 0x7f47680cb6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:45.162 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.158+0000 7f476e33a700 1 --2- 172.21.15.157:0/2588056151 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f47680cff10 0x7f47680cb180 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:45.163 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.158+0000 7f476e33a700 1 -- 172.21.15.157:0/2588056151 >> 172.21.15.157:0/2588056151 conn(0x7f476806e2e0 msgr2=0x7f47680665a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:45.163 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.158+0000 7f476e33a700 1 -- 172.21.15.157:0/2588056151 shutdown_connections 2023-10-16T19:57:45.163 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.158+0000 7f476e33a700 1 -- 172.21.15.157:0/2588056151 wait complete. 2023-10-16T19:57:45.173 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-16T19:56:56.932895+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-16T19:57:04.936105+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-16T19:57:05.335279+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-16T19:57:45.173 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-16T19:57:45.297 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.294+0000 7fea17414700 1 Processor -- start 2023-10-16T19:57:45.297 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.294+0000 7fea17414700 1 -- start start 2023-10-16T19:57:45.300 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.295+0000 7fea17414700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fea1015bed0 0x7fea100b36b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:45.300 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.295+0000 7fea17414700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fea100b3bf0 0x7fea100d0f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:45.300 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.295+0000 7fea17414700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea1015c2b0 con 0x7fea100d1440 2023-10-16T19:57:45.300 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.295+0000 7fea17414700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea100b4070 con 0x7fea100b3bf0 2023-10-16T19:57:45.300 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.295+0000 7fea17414700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea1015f9e0 con 0x7fea1015bed0 2023-10-16T19:57:45.301 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.295+0000 7fea149af700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fea100b3bf0 0x7fea100d0f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:45.301 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.295+0000 7fea151b0700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fea1015bed0 0x7fea100b36b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:45.301 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.295+0000 7fea159b1700 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7fea100d1440 0x7fea100cf800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.157:40260/0 (socket says 172.21.15.157:40260) 2023-10-16T19:57:45.301 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.295+0000 7fea159b1700 1 -- 172.21.15.157:0/4193924638 learned_addr learned my addr 172.21.15.157:0/4193924638 (peer_addr_for_me v1:172.21.15.157:0/0) 2023-10-16T19:57:45.301 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.296+0000 7fea07fff700 1 -- 172.21.15.157:0/4193924638 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 955819547 0 0) 0x7fea1015c2b0 con 0x7fea100d1440 2023-10-16T19:57:45.302 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.296+0000 7fea07fff700 1 -- 172.21.15.157:0/4193924638 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe9fc0035b0 con 0x7fea100d1440 2023-10-16T19:57:45.302 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.296+0000 7fea149af700 1 -- 172.21.15.157:0/4193924638 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fea1015bed0 msgr2=0x7fea100b36b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:57:45.302 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.296+0000 7fea149af700 1 --2- 172.21.15.157:0/4193924638 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fea1015bed0 0x7fea100b36b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:45.302 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.296+0000 7fea149af700 1 -- 172.21.15.157:0/4193924638 >> v1:172.21.15.187:6789/0 conn(0x7fea100d1440 legacy=0x7fea100cf800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:45.303 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.296+0000 7fea149af700 1 -- 172.21.15.157:0/4193924638 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea1015fcc0 con 0x7fea100b3bf0 2023-10-16T19:57:45.303 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.296+0000 7fea151b0700 1 --2- 172.21.15.157:0/4193924638 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fea1015bed0 0x7fea100b36b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T19:57:45.303 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.296+0000 7fea149af700 1 --2- 172.21.15.157:0/4193924638 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fea100b3bf0 0x7fea100d0f00 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fea0c009840 tx=0x7fea0c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d2d805a87d5a44f8 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:45.303 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.296+0000 7fea07fff700 1 -- 172.21.15.157:0/4193924638 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea0c011830 con 0x7fea100b3bf0 2023-10-16T19:57:45.304 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.296+0000 7fea07fff700 1 -- 172.21.15.157:0/4193924638 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea0c011990 con 0x7fea100b3bf0 2023-10-16T19:57:45.304 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.296+0000 7fea07fff700 1 -- 172.21.15.157:0/4193924638 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea0c011d00 con 0x7fea100b3bf0 2023-10-16T19:57:45.304 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.297+0000 7fea17414700 1 -- 172.21.15.157:0/4193924638 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fea100b3bf0 msgr2=0x7fea100d0f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:45.304 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.297+0000 7fea17414700 1 --2- 172.21.15.157:0/4193924638 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fea100b3bf0 0x7fea100d0f00 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fea0c009840 tx=0x7fea0c009b50 comp rx=0 tx=0).stop 2023-10-16T19:57:45.305 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.297+0000 7fea17414700 1 -- 172.21.15.157:0/4193924638 shutdown_connections 2023-10-16T19:57:45.305 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.297+0000 7fea17414700 1 --2- 172.21.15.157:0/4193924638 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fea1015bed0 0x7fea100b36b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:45.305 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.297+0000 7fea17414700 1 --2- 172.21.15.157:0/4193924638 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fea100b3bf0 0x7fea100d0f00 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:45.305 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.297+0000 7fea17414700 1 -- 172.21.15.157:0/4193924638 >> 172.21.15.157:0/4193924638 conn(0x7fea100ce6b0 msgr2=0x7fea100ceac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:45.305 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.297+0000 7fea17414700 1 -- 172.21.15.157:0/4193924638 shutdown_connections 2023-10-16T19:57:45.306 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.297+0000 7fea17414700 1 -- 172.21.15.157:0/4193924638 wait complete. 2023-10-16T19:57:45.308 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.298+0000 7fea17414700 1 Processor -- start 2023-10-16T19:57:45.309 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.298+0000 7fea17414700 1 -- start start 2023-10-16T19:57:45.309 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.299+0000 7fea17414700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fea100b3bf0 0x7fea100cc030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:45.309 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.299+0000 7fea17414700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fea100d1440 0x7fea100a9450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:45.309 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.299+0000 7fea17414700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fea1015bed0 0x7fea100cb680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:45.309 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.299+0000 7fea17414700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea100cc610 con 0x7fea1015bed0 2023-10-16T19:57:45.310 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.299+0000 7fea17414700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea101578c0 con 0x7fea100d1440 2023-10-16T19:57:45.310 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.299+0000 7fea17414700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea100cb1f0 con 0x7fea100b3bf0 2023-10-16T19:57:45.310 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.299+0000 7fea159b1700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fea1015bed0 0x7fea100cb680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:45.310 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.299+0000 7fea159b1700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fea1015bed0 0x7fea100cb680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:46900/0 (socket says 172.21.15.157:46900) 2023-10-16T19:57:45.311 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.299+0000 7fea159b1700 1 -- 172.21.15.157:0/623659816 learned_addr learned my addr 172.21.15.157:0/623659816 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:57:45.311 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.299+0000 7fea151b0700 1 --2- 172.21.15.157:0/623659816 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fea100b3bf0 0x7fea100cc030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:45.311 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.299+0000 7fea149af700 1 --2- 172.21.15.157:0/623659816 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fea100d1440 0x7fea100a9450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:45.311 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.299+0000 7fea159b1700 1 -- 172.21.15.157:0/623659816 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fea100b3bf0 msgr2=0x7fea100cc030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:45.311 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.299+0000 7fea159b1700 1 --2- 172.21.15.157:0/623659816 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fea100b3bf0 0x7fea100cc030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:45.312 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.299+0000 7fea159b1700 1 -- 172.21.15.157:0/623659816 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fea100d1440 msgr2=0x7fea100a9450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:45.312 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.299+0000 7fea159b1700 1 --2- 172.21.15.157:0/623659816 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fea100d1440 0x7fea100a9450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:45.312 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.299+0000 7fea159b1700 1 -- 172.21.15.157:0/623659816 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea000094a0 con 0x7fea1015bed0 2023-10-16T19:57:45.312 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.299+0000 7fea159b1700 1 --2- 172.21.15.157:0/623659816 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fea1015bed0 0x7fea100cb680 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fea0800caa0 tx=0x7fea0800cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:45.312 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.299+0000 7fea05ffb700 1 -- 172.21.15.157:0/623659816 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea0800a9e0 con 0x7fea1015bed0 2023-10-16T19:57:45.313 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.300+0000 7fea05ffb700 1 -- 172.21.15.157:0/623659816 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea0800ab40 con 0x7fea1015bed0 2023-10-16T19:57:45.313 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.300+0000 7fea17414700 1 -- 172.21.15.157:0/623659816 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea0c0094a0 con 0x7fea1015bed0 2023-10-16T19:57:45.313 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.300+0000 7fea05ffb700 1 -- 172.21.15.157:0/623659816 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea08012400 con 0x7fea1015bed0 2023-10-16T19:57:45.313 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.300+0000 7fea17414700 1 -- 172.21.15.157:0/623659816 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea100caba0 con 0x7fea1015bed0 2023-10-16T19:57:45.313 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.301+0000 7fea17414700 1 -- 172.21.15.157:0/623659816 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea1006b300 con 0x7fea1015bed0 2023-10-16T19:57:45.314 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.301+0000 7fea05ffb700 1 -- 172.21.15.157:0/623659816 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fea0801b3b0 con 0x7fea1015bed0 2023-10-16T19:57:45.314 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.301+0000 7fea05ffb700 1 --2- 172.21.15.157:0/623659816 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fe9f406af00 0x7fe9f406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:45.314 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.302+0000 7fea05ffb700 1 -- 172.21.15.157:0/623659816 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fea080892c0 con 0x7fea1015bed0 2023-10-16T19:57:45.314 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.302+0000 7fea151b0700 1 --2- 172.21.15.157:0/623659816 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fe9f406af00 0x7fe9f406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:45.314 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.302+0000 7fea151b0700 1 --2- 172.21.15.157:0/623659816 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fe9f406af00 0x7fe9f406d3c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fea00009d70 tx=0x7fea00009210 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:45.315 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.306+0000 7fea05ffb700 1 -- 172.21.15.157:0/623659816 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fea08054390 con 0x7fea1015bed0 2023-10-16T19:57:45.497 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.495+0000 7fea17414700 1 -- 172.21.15.157:0/623659816 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fea1004f400 con 0x7fea1015bed0 2023-10-16T19:57:45.498 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.495+0000 7fea05ffb700 1 -- 172.21.15.157:0/623659816 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7fea080579b0 con 0x7fea1015bed0 2023-10-16T19:57:45.498 INFO:teuthology.orchestra.run.smithi157.stdout:pg_num: 1 2023-10-16T19:57:45.500 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.497+0000 7fea17414700 1 -- 172.21.15.157:0/623659816 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fe9f406af00 msgr2=0x7fe9f406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:45.500 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.497+0000 7fea17414700 1 --2- 172.21.15.157:0/623659816 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fe9f406af00 0x7fe9f406d3c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fea00009d70 tx=0x7fea00009210 comp rx=0 tx=0).stop 2023-10-16T19:57:45.500 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.497+0000 7fea17414700 1 -- 172.21.15.157:0/623659816 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fea1015bed0 msgr2=0x7fea100cb680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:45.501 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.497+0000 7fea17414700 1 --2- 172.21.15.157:0/623659816 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fea1015bed0 0x7fea100cb680 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fea0800caa0 tx=0x7fea0800cdb0 comp rx=0 tx=0).stop 2023-10-16T19:57:45.501 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.497+0000 7fea17414700 1 -- 172.21.15.157:0/623659816 shutdown_connections 2023-10-16T19:57:45.501 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.497+0000 7fea17414700 1 --2- 172.21.15.157:0/623659816 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fea1015bed0 0x7fea100cb680 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:45.501 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.497+0000 7fea17414700 1 --2- 172.21.15.157:0/623659816 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fea100b3bf0 0x7fea100cc030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:45.501 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.497+0000 7fea17414700 1 --2- 172.21.15.157:0/623659816 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fe9f406af00 0x7fe9f406d3c0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:45.502 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.497+0000 7fea17414700 1 --2- 172.21.15.157:0/623659816 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fea100d1440 0x7fea100a9450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:45.502 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.497+0000 7fea17414700 1 -- 172.21.15.157:0/623659816 >> 172.21.15.157:0/623659816 conn(0x7fea100ce6b0 msgr2=0x7fea1006fca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:45.502 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.497+0000 7fea17414700 1 -- 172.21.15.157:0/623659816 shutdown_connections 2023-10-16T19:57:45.502 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.497+0000 7fea17414700 1 -- 172.21.15.157:0/623659816 wait complete. 2023-10-16T19:57:45.512 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-16T19:57:45.635 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.632+0000 7f0bfd04f700 1 Processor -- start 2023-10-16T19:57:45.635 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.632+0000 7f0bfd04f700 1 -- start start 2023-10-16T19:57:45.638 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.633+0000 7f0bfd04f700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f0bf80d1610 0x7f0bf8166b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:45.638 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.633+0000 7f0bfd04f700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bf815c2b0 con 0x7f0bf815bed0 2023-10-16T19:57:45.639 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.633+0000 7f0bfd04f700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bf815f9e0 con 0x7f0bf80b3dc0 2023-10-16T19:57:45.639 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.633+0000 7f0bfd04f700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bf815fcc0 con 0x7f0bf80d1610 2023-10-16T19:57:45.639 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.633+0000 7f0bf6d9d700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f0bf815bed0 0x7f0bf80b36b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:56576/0 (socket says 172.21.15.157:56576) 2023-10-16T19:57:45.639 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.633+0000 7f0bf6d9d700 1 -- 172.21.15.157:0/55894596 learned_addr learned my addr 172.21.15.157:0/55894596 (peer_addr_for_me v1:172.21.15.157:0/0) 2023-10-16T19:57:45.640 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.633+0000 7f0bf759e700 1 --2- 172.21.15.157:0/55894596 >> v2:172.21.15.187:3300/0 conn(0x7f0bf80d1610 0x7f0bf8166b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:45.640 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.633+0000 7f0bf5d9b700 1 -- 172.21.15.157:0/55894596 <== mon.0 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2828133440 0 0) 0x7f0bf815c2b0 con 0x7f0bf815bed0 2023-10-16T19:57:45.640 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.633+0000 7f0bf5d9b700 1 -- 172.21.15.157:0/55894596 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0be00035b0 con 0x7f0bf815bed0 2023-10-16T19:57:45.640 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.634+0000 7f0bf5d9b700 1 -- 172.21.15.157:0/55894596 <== mon.0 v1:172.21.15.157:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1671988310 0 0) 0x7f0be00035b0 con 0x7f0bf815bed0 2023-10-16T19:57:45.640 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.634+0000 7f0bf5d9b700 1 -- 172.21.15.157:0/55894596 >> v2:172.21.15.187:3300/0 conn(0x7f0bf80d1610 msgr2=0x7f0bf8166b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:57:45.641 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.634+0000 7f0bf5d9b700 1 --2- 172.21.15.157:0/55894596 >> v2:172.21.15.187:3300/0 conn(0x7f0bf80d1610 0x7f0bf8166b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:45.641 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.634+0000 7f0bf5d9b700 1 -- 172.21.15.157:0/55894596 >> v1:172.21.15.187:6789/0 conn(0x7f0bf80b3dc0 legacy=0x7f0bf80d0f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:45.641 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.634+0000 7f0bf5d9b700 1 -- 172.21.15.157:0/55894596 --> v1:172.21.15.157:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bf815ffa0 con 0x7f0bf815bed0 2023-10-16T19:57:45.641 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.634+0000 7f0bf5d9b700 1 -- 172.21.15.157:0/55894596 <== mon.0 v1:172.21.15.157:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4021145519 0 0) 0x7f0bec001670 con 0x7f0bf815bed0 2023-10-16T19:57:45.641 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.634+0000 7f0bf5d9b700 1 -- 172.21.15.157:0/55894596 >> v1:172.21.15.157:6789/0 conn(0x7f0bf815bed0 legacy=0x7f0bf80b36b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:45.641 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.634+0000 7f0bf5d9b700 1 --2- 172.21.15.157:0/55894596 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0be0003a00 0x7f0be0003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:45.642 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.634+0000 7f0bf5d9b700 1 --2- 172.21.15.157:0/55894596 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0be0004850 0x7f0be0004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:45.642 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.634+0000 7f0bf5d9b700 1 --2- 172.21.15.157:0/55894596 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0be0005210 0x7f0be000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:45.642 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.634+0000 7f0bf5d9b700 1 -- 172.21.15.157:0/55894596 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bf815fcc0 con 0x7f0be0004850 2023-10-16T19:57:45.642 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.634+0000 7f0bf5d9b700 1 -- 172.21.15.157:0/55894596 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0be000c1b0 con 0x7f0be0003a00 2023-10-16T19:57:45.642 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.634+0000 7f0bf5d9b700 1 -- 172.21.15.157:0/55894596 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0be000c370 con 0x7f0be0005210 2023-10-16T19:57:45.643 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.634+0000 7f0bf659c700 1 --2- 172.21.15.157:0/55894596 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0be0004850 0x7f0be0004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:45.643 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.634+0000 7f0bf6d9d700 1 --2- 172.21.15.157:0/55894596 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0be0003a00 0x7f0be0003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:45.643 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.634+0000 7f0bf759e700 1 --2- 172.21.15.157:0/55894596 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0be0005210 0x7f0be000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:45.643 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.634+0000 7f0bf659c700 1 -- 172.21.15.157:0/55894596 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0be0005210 msgr2=0x7f0be000ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:57:45.643 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.634+0000 7f0bf659c700 1 --2- 172.21.15.157:0/55894596 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0be0005210 0x7f0be000ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:45.644 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.634+0000 7f0bf659c700 1 -- 172.21.15.157:0/55894596 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0be0003a00 msgr2=0x7f0be0003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:57:45.644 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.634+0000 7f0bf659c700 1 --2- 172.21.15.157:0/55894596 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0be0003a00 0x7f0be0003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:45.644 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.634+0000 7f0bf659c700 1 -- 172.21.15.157:0/55894596 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0be00035b0 con 0x7f0be0004850 2023-10-16T19:57:45.644 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.634+0000 7f0bf759e700 1 --2- 172.21.15.157:0/55894596 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0be0005210 0x7f0be000ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T19:57:45.644 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.634+0000 7f0bf759e700 1 -- 172.21.15.157:0/55894596 reap_dead start 2023-10-16T19:57:45.645 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.634+0000 7f0bf659c700 1 --2- 172.21.15.157:0/55894596 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0be0004850 0x7f0be0004cd0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f0be80017c0 tx=0x7f0be0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfbf595218087f59 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:45.645 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.634+0000 7f0bf5d9b700 1 -- 172.21.15.157:0/55894596 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0be80052d0 con 0x7f0be0004850 2023-10-16T19:57:45.645 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.634+0000 7f0bf5d9b700 1 -- 172.21.15.157:0/55894596 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0be8005430 con 0x7f0be0004850 2023-10-16T19:57:45.645 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.634+0000 7f0bf5d9b700 1 -- 172.21.15.157:0/55894596 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0be80038c0 con 0x7f0be0004850 2023-10-16T19:57:45.645 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.635+0000 7f0bfd04f700 1 -- 172.21.15.157:0/55894596 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0be0004850 msgr2=0x7f0be0004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:45.646 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.635+0000 7f0bfd04f700 1 --2- 172.21.15.157:0/55894596 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0be0004850 0x7f0be0004cd0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f0be80017c0 tx=0x7f0be0005880 comp rx=0 tx=0).stop 2023-10-16T19:57:45.646 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.635+0000 7f0bfd04f700 1 -- 172.21.15.157:0/55894596 shutdown_connections 2023-10-16T19:57:45.646 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.635+0000 7f0bfd04f700 1 --2- 172.21.15.157:0/55894596 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0be0004850 0x7f0be0004cd0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:45.646 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.635+0000 7f0bfd04f700 1 -- 172.21.15.157:0/55894596 >> 172.21.15.157:0/55894596 conn(0x7f0bf80ce6b0 msgr2=0x7f0bf80ceac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:45.646 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.635+0000 7f0bfd04f700 1 -- 172.21.15.157:0/55894596 shutdown_connections 2023-10-16T19:57:45.647 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.635+0000 7f0bfd04f700 1 -- 172.21.15.157:0/55894596 wait complete. 2023-10-16T19:57:45.650 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.636+0000 7f0bfd04f700 1 Processor -- start 2023-10-16T19:57:45.650 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.637+0000 7f0bfd04f700 1 -- start start 2023-10-16T19:57:45.650 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.637+0000 7f0bfd04f700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0be0004850 0x7f0bf814bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:45.651 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.637+0000 7f0bfd04f700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0bf80c92d0 0x7f0bf81489c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:45.651 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.637+0000 7f0bfd04f700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0bf80a9450 0x7f0bf80b59a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:45.651 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.637+0000 7f0bfd04f700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bf8149ba0 con 0x7f0bf80a9450 2023-10-16T19:57:45.651 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.637+0000 7f0bfd04f700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bf814c0e0 con 0x7f0be0004850 2023-10-16T19:57:45.651 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.637+0000 7f0bfd04f700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bf80a9900 con 0x7f0bf80c92d0 2023-10-16T19:57:45.652 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.637+0000 7f0bf759e700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0bf80a9450 0x7f0bf80b59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:45.652 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.637+0000 7f0bf759e700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0bf80a9450 0x7f0bf80b59a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:46920/0 (socket says 172.21.15.157:46920) 2023-10-16T19:57:45.652 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.638+0000 7f0bf759e700 1 -- 172.21.15.157:0/948145406 learned_addr learned my addr 172.21.15.157:0/948145406 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:57:45.652 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.638+0000 7f0bf659c700 1 --2- 172.21.15.157:0/948145406 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0bf80c92d0 0x7f0bf81489c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:45.652 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.638+0000 7f0bf6d9d700 1 --2- 172.21.15.157:0/948145406 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0be0004850 0x7f0bf814bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:45.653 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.638+0000 7f0bf759e700 1 -- 172.21.15.157:0/948145406 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0bf80c92d0 msgr2=0x7f0bf81489c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:45.653 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.638+0000 7f0bf759e700 1 --2- 172.21.15.157:0/948145406 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0bf80c92d0 0x7f0bf81489c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:45.653 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.638+0000 7f0bf759e700 1 -- 172.21.15.157:0/948145406 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0be0004850 msgr2=0x7f0bf814bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:45.653 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.638+0000 7f0bf759e700 1 --2- 172.21.15.157:0/948145406 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0be0004850 0x7f0bf814bac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:45.653 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.638+0000 7f0bf759e700 1 -- 172.21.15.157:0/948145406 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bf8149200 con 0x7f0bf80a9450 2023-10-16T19:57:45.654 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.638+0000 7f0bf659c700 1 --2- 172.21.15.157:0/948145406 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0bf80c92d0 0x7f0bf81489c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T19:57:45.654 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.638+0000 7f0bf6d9d700 1 --2- 172.21.15.157:0/948145406 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0be0004850 0x7f0bf814bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T19:57:45.654 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.638+0000 7f0bf759e700 1 --2- 172.21.15.157:0/948145406 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0bf80a9450 0x7f0bf80b59a0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f0bf80ce5e0 tx=0x7f0bf00104a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:45.654 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.638+0000 7f0bdf7fe700 1 -- 172.21.15.157:0/948145406 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bf001b070 con 0x7f0bf80a9450 2023-10-16T19:57:45.655 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.638+0000 7f0bdf7fe700 1 -- 172.21.15.157:0/948145406 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bf000f040 con 0x7f0bf80a9450 2023-10-16T19:57:45.655 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.638+0000 7f0bfd04f700 1 -- 172.21.15.157:0/948145406 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bf81494e0 con 0x7f0bf80a9450 2023-10-16T19:57:45.655 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.638+0000 7f0bdf7fe700 1 -- 172.21.15.157:0/948145406 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bf000e050 con 0x7f0bf80a9450 2023-10-16T19:57:45.655 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.638+0000 7f0bfd04f700 1 -- 172.21.15.157:0/948145406 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bf80b5ee0 con 0x7f0bf80a9450 2023-10-16T19:57:45.656 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.639+0000 7f0bfd04f700 1 -- 172.21.15.157:0/948145406 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bf806b300 con 0x7f0bf80a9450 2023-10-16T19:57:45.656 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.639+0000 7f0bdf7fe700 1 -- 172.21.15.157:0/948145406 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f0bf0003a20 con 0x7f0bf80a9450 2023-10-16T19:57:45.656 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.640+0000 7f0bdf7fe700 1 --2- 172.21.15.157:0/948145406 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f0be406af00 0x7f0be406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:45.656 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.640+0000 7f0bdf7fe700 1 -- 172.21.15.157:0/948145406 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0bf0089960 con 0x7f0bf80a9450 2023-10-16T19:57:45.656 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.640+0000 7f0bf6d9d700 1 --2- 172.21.15.157:0/948145406 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f0be406af00 0x7f0be406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:45.656 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.641+0000 7f0bf6d9d700 1 --2- 172.21.15.157:0/948145406 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f0be406af00 0x7f0be406d3c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f0bec007d10 tx=0x7f0bec009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:45.657 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.644+0000 7f0bdf7fe700 1 -- 172.21.15.157:0/948145406 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0bf0054a10 con 0x7f0bf80a9450 2023-10-16T19:57:45.834 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.831+0000 7f0bfd04f700 1 -- 172.21.15.157:0/948145406 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0bf8149ce0 con 0x7f0bf80a9450 2023-10-16T19:57:45.834 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.832+0000 7f0bdf7fe700 1 -- 172.21.15.157:0/948145406 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0bf8149ce0 con 0x7f0bf80a9450 2023-10-16T19:57:45.834 INFO:teuthology.orchestra.run.smithi157.stdout:pg_num: 32 2023-10-16T19:57:45.836 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.833+0000 7f0bfd04f700 1 -- 172.21.15.157:0/948145406 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f0be406af00 msgr2=0x7f0be406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:45.837 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.833+0000 7f0bfd04f700 1 --2- 172.21.15.157:0/948145406 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f0be406af00 0x7f0be406d3c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f0bec007d10 tx=0x7f0bec009040 comp rx=0 tx=0).stop 2023-10-16T19:57:45.837 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.833+0000 7f0bfd04f700 1 -- 172.21.15.157:0/948145406 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0bf80a9450 msgr2=0x7f0bf80b59a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:45.837 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.833+0000 7f0bfd04f700 1 --2- 172.21.15.157:0/948145406 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0bf80a9450 0x7f0bf80b59a0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f0bf80ce5e0 tx=0x7f0bf00104a0 comp rx=0 tx=0).stop 2023-10-16T19:57:45.837 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.834+0000 7f0bfd04f700 1 -- 172.21.15.157:0/948145406 shutdown_connections 2023-10-16T19:57:45.837 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.834+0000 7f0bfd04f700 1 --2- 172.21.15.157:0/948145406 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f0be406af00 0x7f0be406d3c0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:45.838 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.834+0000 7f0bfd04f700 1 --2- 172.21.15.157:0/948145406 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0be0004850 0x7f0bf814bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:45.838 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.834+0000 7f0bfd04f700 1 --2- 172.21.15.157:0/948145406 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0bf80a9450 0x7f0bf80b59a0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:45.838 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.834+0000 7f0bfd04f700 1 --2- 172.21.15.157:0/948145406 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0bf80c92d0 0x7f0bf81489c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:45.838 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.834+0000 7f0bfd04f700 1 -- 172.21.15.157:0/948145406 >> 172.21.15.157:0/948145406 conn(0x7f0bf80ce6b0 msgr2=0x7f0bf80c7770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:45.839 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.834+0000 7f0bfd04f700 1 -- 172.21.15.157:0/948145406 shutdown_connections 2023-10-16T19:57:45.839 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.834+0000 7f0bfd04f700 1 -- 172.21.15.157:0/948145406 wait complete. 2023-10-16T19:57:45.848 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-16T19:57:45.972 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.969+0000 7fe231e78700 1 Processor -- start 2023-10-16T19:57:45.972 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.970+0000 7fe231e78700 1 -- start start 2023-10-16T19:57:45.974 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.970+0000 7fe231e78700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fe22c0cc310 0x7fe22c06fa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:45.975 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.970+0000 7fe231e78700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe22c0cdc30 con 0x7fe22c0b0cc0 2023-10-16T19:57:45.975 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.970+0000 7fe231e78700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe22c0b1140 con 0x7fe22c0b36b0 2023-10-16T19:57:45.975 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.970+0000 7fe231e78700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe22c15f6c0 con 0x7fe22c0cc310 2023-10-16T19:57:45.975 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.970+0000 7fe22bfff700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fe22c0cc310 0x7fe22c06fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:45.976 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.970+0000 7fe22affd700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7fe22c0b0cc0 0x7fe22c15efb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:56598/0 (socket says 172.21.15.157:56598) 2023-10-16T19:57:45.976 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.970+0000 7fe22affd700 1 -- 172.21.15.157:0/3872554641 learned_addr learned my addr 172.21.15.157:0/3872554641 (peer_addr_for_me v1:172.21.15.157:0/0) 2023-10-16T19:57:45.976 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.971+0000 7fe22bfff700 1 -- 172.21.15.157:0/3872554641 >> v1:172.21.15.187:6789/0 conn(0x7fe22c0b36b0 legacy=0x7fe22c0b3a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:45.976 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.971+0000 7fe22bfff700 1 -- 172.21.15.157:0/3872554641 >> v1:172.21.15.157:6789/0 conn(0x7fe22c0b0cc0 legacy=0x7fe22c15efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:45.977 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.971+0000 7fe22a7fc700 1 -- 172.21.15.157:0/3872554641 <== mon.0 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1161210782 0 0) 0x7fe22c0cdc30 con 0x7fe22c0b0cc0 2023-10-16T19:57:45.977 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.971+0000 7fe22bfff700 1 -- 172.21.15.157:0/3872554641 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe22c0cc7a0 con 0x7fe22c0cc310 2023-10-16T19:57:45.977 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.971+0000 7fe22bfff700 1 --2- 172.21.15.157:0/3872554641 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe22c0cc310 0x7fe22c06fa90 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fe224009d90 tx=0x7fe22400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e994f39d3dbb841d server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:45.977 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.971+0000 7fe22a7fc700 1 -- 172.21.15.157:0/3872554641 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe22400e070 con 0x7fe22c0cc310 2023-10-16T19:57:45.977 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.971+0000 7fe22a7fc700 1 -- 172.21.15.157:0/3872554641 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe22400bbd0 con 0x7fe22c0cc310 2023-10-16T19:57:45.978 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.971+0000 7fe22a7fc700 1 -- 172.21.15.157:0/3872554641 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe224012430 con 0x7fe22c0cc310 2023-10-16T19:57:45.978 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.971+0000 7fe231e78700 1 -- 172.21.15.157:0/3872554641 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe22c0cc310 msgr2=0x7fe22c06fa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:45.978 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.971+0000 7fe231e78700 1 --2- 172.21.15.157:0/3872554641 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe22c0cc310 0x7fe22c06fa90 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fe224009d90 tx=0x7fe22400b330 comp rx=0 tx=0).stop 2023-10-16T19:57:45.978 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.972+0000 7fe231e78700 1 -- 172.21.15.157:0/3872554641 shutdown_connections 2023-10-16T19:57:45.978 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.972+0000 7fe231e78700 1 --2- 172.21.15.157:0/3872554641 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe22c0cc310 0x7fe22c06fa90 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:45.979 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.972+0000 7fe231e78700 1 -- 172.21.15.157:0/3872554641 >> 172.21.15.157:0/3872554641 conn(0x7fe22c0ce6b0 msgr2=0x7fe22c0ceac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:45.979 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.972+0000 7fe231e78700 1 -- 172.21.15.157:0/3872554641 shutdown_connections 2023-10-16T19:57:45.979 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.972+0000 7fe231e78700 1 -- 172.21.15.157:0/3872554641 wait complete. 2023-10-16T19:57:45.982 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.973+0000 7fe231e78700 1 Processor -- start 2023-10-16T19:57:45.982 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.973+0000 7fe231e78700 1 -- start start 2023-10-16T19:57:45.982 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.974+0000 7fe231e78700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe22c0b0cc0 0x7fe22c1552a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:45.982 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.974+0000 7fe231e78700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe22c0b36b0 0x7fe22c0cb2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:45.983 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.974+0000 7fe231e78700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe22c0cc310 0x7fe22c0ca4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:45.983 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.974+0000 7fe231e78700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe22c1557e0 con 0x7fe22c0cc310 2023-10-16T19:57:45.983 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.974+0000 7fe231e78700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe22c0c5bd0 con 0x7fe22c0b0cc0 2023-10-16T19:57:45.983 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.974+0000 7fe231e78700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe22c0c5eb0 con 0x7fe22c0b36b0 2023-10-16T19:57:45.983 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.974+0000 7fe22bfff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe22c0cc310 0x7fe22c0ca4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:45.984 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.974+0000 7fe22bfff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe22c0cc310 0x7fe22c0ca4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:46934/0 (socket says 172.21.15.157:46934) 2023-10-16T19:57:45.984 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.974+0000 7fe22bfff700 1 -- 172.21.15.157:0/2069874159 learned_addr learned my addr 172.21.15.157:0/2069874159 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:57:45.984 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.974+0000 7fe22b7fe700 1 --2- 172.21.15.157:0/2069874159 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe22c0b0cc0 0x7fe22c1552a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:45.984 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.974+0000 7fe22affd700 1 --2- 172.21.15.157:0/2069874159 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe22c0b36b0 0x7fe22c0cb2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:45.984 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.974+0000 7fe22bfff700 1 -- 172.21.15.157:0/2069874159 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe22c0b36b0 msgr2=0x7fe22c0cb2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:45.985 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.974+0000 7fe22bfff700 1 --2- 172.21.15.157:0/2069874159 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe22c0b36b0 0x7fe22c0cb2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:45.985 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.974+0000 7fe22bfff700 1 -- 172.21.15.157:0/2069874159 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe22c0b0cc0 msgr2=0x7fe22c1552a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:45.985 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.974+0000 7fe22bfff700 1 --2- 172.21.15.157:0/2069874159 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe22c0b0cc0 0x7fe22c1552a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:45.985 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.974+0000 7fe22bfff700 1 -- 172.21.15.157:0/2069874159 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe224009a70 con 0x7fe22c0cc310 2023-10-16T19:57:45.985 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.974+0000 7fe22bfff700 1 --2- 172.21.15.157:0/2069874159 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe22c0cc310 0x7fe22c0ca4e0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fe224014040 tx=0x7fe224004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:45.986 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.974+0000 7fe223fff700 1 -- 172.21.15.157:0/2069874159 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe22401b810 con 0x7fe22c0cc310 2023-10-16T19:57:45.986 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.974+0000 7fe223fff700 1 -- 172.21.15.157:0/2069874159 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe224020070 con 0x7fe22c0cc310 2023-10-16T19:57:45.986 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.974+0000 7fe231e78700 1 -- 172.21.15.157:0/2069874159 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe22c0c6190 con 0x7fe22c0cc310 2023-10-16T19:57:45.986 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.974+0000 7fe223fff700 1 -- 172.21.15.157:0/2069874159 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe22401bbb0 con 0x7fe22c0cc310 2023-10-16T19:57:45.986 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.974+0000 7fe231e78700 1 -- 172.21.15.157:0/2069874159 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe22c0c6750 con 0x7fe22c0cc310 2023-10-16T19:57:45.987 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.975+0000 7fe231e78700 1 -- 172.21.15.157:0/2069874159 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe22c0cd210 con 0x7fe22c0cc310 2023-10-16T19:57:45.987 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.976+0000 7fe223fff700 1 -- 172.21.15.157:0/2069874159 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fe22401bd10 con 0x7fe22c0cc310 2023-10-16T19:57:45.987 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.976+0000 7fe223fff700 1 --2- 172.21.15.157:0/2069874159 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fe20c06af00 0x7fe20c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:45.987 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.976+0000 7fe223fff700 1 -- 172.21.15.157:0/2069874159 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe224022070 con 0x7fe22c0cc310 2023-10-16T19:57:45.987 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.976+0000 7fe22b7fe700 1 --2- 172.21.15.157:0/2069874159 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fe20c06af00 0x7fe20c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:45.988 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.977+0000 7fe22b7fe700 1 --2- 172.21.15.157:0/2069874159 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fe20c06af00 0x7fe20c06d3c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fe214007fd0 tx=0x7fe214009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:45.988 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:45.981+0000 7fe223fff700 1 -- 172.21.15.157:0/2069874159 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe224056cb0 con 0x7fe22c0cc310 2023-10-16T19:57:46.173 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:46.170+0000 7fe231e78700 1 -- 172.21.15.157:0/2069874159 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe22c04f400 con 0x7fe22c0cc310 2023-10-16T19:57:46.173 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:46.171+0000 7fe223fff700 1 -- 172.21.15.157:0/2069874159 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe22405a2d0 con 0x7fe22c0cc310 2023-10-16T19:57:46.174 INFO:teuthology.orchestra.run.smithi157.stdout:pg_num: 64 2023-10-16T19:57:46.175 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:46.173+0000 7fe231e78700 1 -- 172.21.15.157:0/2069874159 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fe20c06af00 msgr2=0x7fe20c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:46.176 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:46.173+0000 7fe231e78700 1 --2- 172.21.15.157:0/2069874159 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fe20c06af00 0x7fe20c06d3c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fe214007fd0 tx=0x7fe214009040 comp rx=0 tx=0).stop 2023-10-16T19:57:46.176 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:46.173+0000 7fe231e78700 1 -- 172.21.15.157:0/2069874159 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe22c0cc310 msgr2=0x7fe22c0ca4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:46.176 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:46.173+0000 7fe231e78700 1 --2- 172.21.15.157:0/2069874159 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe22c0cc310 0x7fe22c0ca4e0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fe224014040 tx=0x7fe224004ad0 comp rx=0 tx=0).stop 2023-10-16T19:57:46.176 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:46.173+0000 7fe231e78700 1 -- 172.21.15.157:0/2069874159 shutdown_connections 2023-10-16T19:57:46.176 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:46.173+0000 7fe231e78700 1 --2- 172.21.15.157:0/2069874159 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fe20c06af00 0x7fe20c06d3c0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:46.177 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:46.173+0000 7fe231e78700 1 --2- 172.21.15.157:0/2069874159 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe22c0b0cc0 0x7fe22c1552a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:46.177 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:46.173+0000 7fe231e78700 1 --2- 172.21.15.157:0/2069874159 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe22c0cc310 0x7fe22c0ca4e0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:46.177 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:46.173+0000 7fe231e78700 1 --2- 172.21.15.157:0/2069874159 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe22c0b36b0 0x7fe22c0cb2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:46.177 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:46.173+0000 7fe231e78700 1 -- 172.21.15.157:0/2069874159 >> 172.21.15.157:0/2069874159 conn(0x7fe22c0ce6b0 msgr2=0x7fe22c06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:46.178 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:46.173+0000 7fe231e78700 1 -- 172.21.15.157:0/2069874159 shutdown_connections 2023-10-16T19:57:46.178 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:46.173+0000 7fe231e78700 1 -- 172.21.15.157:0/2069874159 wait complete. 2023-10-16T19:57:46.188 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-16T19:57:46.312 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:46.307+0000 7f5296909700 1 Processor -- start 2023-10-16T19:57:46.312 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:46.307+0000 7f5296909700 1 -- start start 2023-10-16T19:57:46.313 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:46.308+0000 7f5296909700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f529015b130 0x7f5290071f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:46.313 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:46.308+0000 7f5296909700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f529006d0f0 0x7f52900cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:46.313 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:46.308+0000 7f5296909700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52900cefc0 con 0x7f52900cbeb0 2023-10-16T19:57:46.313 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:46.308+0000 7f5296909700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52900b0050 con 0x7f529015b130 2023-10-16T19:57:46.313 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:46.308+0000 7f5296909700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f529006e090 con 0x7f529006d0f0 2023-10-16T19:57:46.314 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:46.308+0000 7f528f7fe700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f529006d0f0 0x7f52900cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:46.314 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:46.308+0000 7f528ffff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f529015b130 0x7f5290071f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:46.314 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:46.308+0000 7f5294ea6700 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7f52900cbeb0 0x7f529006eb20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.157:40310/0 (socket says 172.21.15.157:40310) 2023-10-16T19:57:46.314 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:46.308+0000 7f528f7fe700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f529006d0f0 0x7f52900cb970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.157:56246/0 (socket says 172.21.15.157:56246) 2023-10-16T19:57:46.315 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:46.308+0000 7f5294ea6700 1 -- 172.21.15.157:0/152384463 learned_addr learned my addr 172.21.15.157:0/152384463 (peer_addr_for_me v1:172.21.15.157:0/0) 2023-10-16T19:57:46.315 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:46.309+0000 7f528effd700 1 -- 172.21.15.157:0/152384463 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2846382792 0 0) 0x7f52900cefc0 con 0x7f52900cbeb0 2023-10-16T19:57:46.315 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:46.309+0000 7f528effd700 1 -- 172.21.15.157:0/152384463 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f52780035b0 con 0x7f52900cbeb0 2023-10-16T19:57:46.315 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:46.309+0000 7f528ffff700 1 -- 172.21.15.157:0/152384463 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f529006d0f0 msgr2=0x7f52900cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:57:46.315 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:46.309+0000 7f528ffff700 1 --2- 172.21.15.157:0/152384463 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f529006d0f0 0x7f52900cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:46.316 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:46.309+0000 7f528ffff700 1 -- 172.21.15.157:0/152384463 >> v1:172.21.15.187:6789/0 conn(0x7f52900cbeb0 legacy=0x7f529006eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:46.316 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:46.309+0000 7f528ffff700 1 -- 172.21.15.157:0/152384463 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f529006d570 con 0x7f529015b130 2023-10-16T19:57:46.316 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:46.309+0000 7f528f7fe700 1 --2- 172.21.15.157:0/152384463 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f529006d0f0 0x7f52900cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T19:57:46.316 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:46.309+0000 7f528ffff700 1 --2- 172.21.15.157:0/152384463 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f529015b130 0x7f5290071f60 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f5284009840 tx=0x7f5284009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9fc959c43925efbf server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:46.316 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:46.309+0000 7f528effd700 1 -- 172.21.15.157:0/152384463 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5284011830 con 0x7f529015b130 2023-10-16T19:57:46.317 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:46.309+0000 7f528effd700 1 -- 172.21.15.157:0/152384463 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5284011990 con 0x7f529015b130 2023-10-16T19:57:46.317 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:46.309+0000 7f528effd700 1 -- 172.21.15.157:0/152384463 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5284011d20 con 0x7f529015b130 2023-10-16T19:57:46.317 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:46.310+0000 7f5296909700 1 -- 172.21.15.157:0/152384463 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f529015b130 msgr2=0x7f5290071f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:46.318 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:46.310+0000 7f5296909700 1 --2- 172.21.15.157:0/152384463 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f529015b130 0x7f5290071f60 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f5284009840 tx=0x7f5284009b50 comp rx=0 tx=0).stop 2023-10-16T19:57:46.318 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:46.310+0000 7f5296909700 1 -- 172.21.15.157:0/152384463 shutdown_connections 2023-10-16T19:57:46.318 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:46.310+0000 7f5296909700 1 --2- 172.21.15.157:0/152384463 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f529015b130 0x7f5290071f60 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:46.318 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:46.310+0000 7f5296909700 1 --2- 172.21.15.157:0/152384463 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f529006d0f0 0x7f52900cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:46.318 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:46.310+0000 7f5296909700 1 -- 172.21.15.157:0/152384463 >> 172.21.15.157:0/152384463 conn(0x7f52900cd4e0 msgr2=0x7f52900cd8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:46.319 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:46.310+0000 7f5296909700 1 -- 172.21.15.157:0/152384463 shutdown_connections 2023-10-16T19:57:46.319 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:46.310+0000 7f5296909700 1 -- 172.21.15.157:0/152384463 wait complete. 2023-10-16T19:57:46.322 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:46.311+0000 7f5296909700 1 Processor -- start 2023-10-16T19:57:46.322 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:46.311+0000 7f5296909700 1 -- start start 2023-10-16T19:57:46.322 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:46.312+0000 7f5296909700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f529006d0f0 0x7f5290159690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:46.322 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:46.312+0000 7f5296909700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f52900cbeb0 0x7f5290152000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:46.323 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:46.312+0000 7f5296909700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f529015b130 0x7f52901f6f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:46.323 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:46.312+0000 7f5296909700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52900b4720 con 0x7f52900cbeb0 2023-10-16T19:57:46.323 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:46.312+0000 7f5296909700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52900c84b0 con 0x7f529015b130 2023-10-16T19:57:46.323 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:46.312+0000 7f5296909700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52900c8790 con 0x7f529006d0f0 2023-10-16T19:57:46.323 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:46.312+0000 7f528f7fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f52900cbeb0 0x7f5290152000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:46.324 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:46.312+0000 7f528f7fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f52900cbeb0 0x7f5290152000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:46946/0 (socket says 172.21.15.157:46946) 2023-10-16T19:57:46.324 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:46.312+0000 7f528f7fe700 1 -- 172.21.15.157:0/1613665332 learned_addr learned my addr 172.21.15.157:0/1613665332 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:57:46.324 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:46.312+0000 7f528ffff700 1 --2- 172.21.15.157:0/1613665332 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f529006d0f0 0x7f5290159690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:46.324 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:46.312+0000 7f5294ea6700 1 --2- 172.21.15.157:0/1613665332 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f529015b130 0x7f52901f6f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:46.324 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:46.312+0000 7f528f7fe700 1 -- 172.21.15.157:0/1613665332 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f529006d0f0 msgr2=0x7f5290159690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:46.325 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:46.312+0000 7f528f7fe700 1 --2- 172.21.15.157:0/1613665332 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f529006d0f0 0x7f5290159690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:46.325 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:46.312+0000 7f528f7fe700 1 -- 172.21.15.157:0/1613665332 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f529015b130 msgr2=0x7f52901f6f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:46.325 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:46.312+0000 7f528f7fe700 1 --2- 172.21.15.157:0/1613665332 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f529015b130 0x7f52901f6f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:46.325 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:46.312+0000 7f528f7fe700 1 -- 172.21.15.157:0/1613665332 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f528000b740 con 0x7f52900cbeb0 2023-10-16T19:57:46.325 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:46.312+0000 7f528f7fe700 1 --2- 172.21.15.157:0/1613665332 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f52900cbeb0 0x7f5290152000 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f528000ed40 tx=0x7f528000d630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:46.326 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:46.312+0000 7f528cff9700 1 -- 172.21.15.157:0/1613665332 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f528000eee0 con 0x7f52900cbeb0 2023-10-16T19:57:46.326 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:46.313+0000 7f528cff9700 1 -- 172.21.15.157:0/1613665332 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5280010640 con 0x7f52900cbeb0 2023-10-16T19:57:46.326 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:46.313+0000 7f5296909700 1 -- 172.21.15.157:0/1613665332 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52840094a0 con 0x7f52900cbeb0 2023-10-16T19:57:46.326 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:46.313+0000 7f528cff9700 1 -- 172.21.15.157:0/1613665332 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52800109b0 con 0x7f52900cbeb0 2023-10-16T19:57:46.326 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:46.313+0000 7f5296909700 1 -- 172.21.15.157:0/1613665332 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52900c8d50 con 0x7f52900cbeb0 2023-10-16T19:57:46.327 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:46.313+0000 7f5296909700 1 -- 172.21.15.157:0/1613665332 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5290067b30 con 0x7f52900cbeb0 2023-10-16T19:57:46.327 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:46.314+0000 7f528cff9700 1 -- 172.21.15.157:0/1613665332 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f5280010b10 con 0x7f52900cbeb0 2023-10-16T19:57:46.327 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:46.314+0000 7f528cff9700 1 --2- 172.21.15.157:0/1613665332 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f527c06af00 0x7f527c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:46.328 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:46.314+0000 7f528cff9700 1 -- 172.21.15.157:0/1613665332 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5280089ea0 con 0x7f52900cbeb0 2023-10-16T19:57:46.328 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:46.315+0000 7f528ffff700 1 --2- 172.21.15.157:0/1613665332 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f527c06af00 0x7f527c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:46.328 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:46.315+0000 7f528ffff700 1 --2- 172.21.15.157:0/1613665332 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f527c06af00 0x7f527c06d3c0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f5284009fd0 tx=0x7f5284008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:46.328 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:46.319+0000 7f528cff9700 1 -- 172.21.15.157:0/1613665332 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5280054fe0 con 0x7f52900cbeb0 2023-10-16T19:57:46.524 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:46.522+0000 7f5296909700 1 -- 172.21.15.157:0/1613665332 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f529004f400 con 0x7f52900cbeb0 2023-10-16T19:57:46.524 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:46.522+0000 7f528cff9700 1 -- 172.21.15.157:0/1613665332 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) v1 ==== 80+0+0 (secure 0 0 0) 0x7f5280058600 con 0x7f52900cbeb0 2023-10-16T19:57:46.528 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:46.524+0000 7f5296909700 1 -- 172.21.15.157:0/1613665332 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f527c06af00 msgr2=0x7f527c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:46.528 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:46.524+0000 7f5296909700 1 --2- 172.21.15.157:0/1613665332 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f527c06af00 0x7f527c06d3c0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f5284009fd0 tx=0x7f5284008030 comp rx=0 tx=0).stop 2023-10-16T19:57:46.528 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:46.524+0000 7f5296909700 1 -- 172.21.15.157:0/1613665332 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f52900cbeb0 msgr2=0x7f5290152000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:46.529 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:46.524+0000 7f5296909700 1 --2- 172.21.15.157:0/1613665332 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f52900cbeb0 0x7f5290152000 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f528000ed40 tx=0x7f528000d630 comp rx=0 tx=0).stop 2023-10-16T19:57:46.529 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:46.524+0000 7f5296909700 1 -- 172.21.15.157:0/1613665332 shutdown_connections 2023-10-16T19:57:46.529 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:46.524+0000 7f5296909700 1 --2- 172.21.15.157:0/1613665332 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f527c06af00 0x7f527c06d3c0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:46.529 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:46.524+0000 7f5296909700 1 --2- 172.21.15.157:0/1613665332 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f529015b130 0x7f52901f6f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:46.529 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:46.524+0000 7f5296909700 1 --2- 172.21.15.157:0/1613665332 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f529006d0f0 0x7f5290159690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:46.530 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:46.524+0000 7f5296909700 1 --2- 172.21.15.157:0/1613665332 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f52900cbeb0 0x7f5290152000 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:46.530 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:46.524+0000 7f5296909700 1 -- 172.21.15.157:0/1613665332 >> 172.21.15.157:0/1613665332 conn(0x7f52900cd4e0 msgr2=0x7f52900b0410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:46.530 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:46.525+0000 7f5296909700 1 -- 172.21.15.157:0/1613665332 shutdown_connections 2023-10-16T19:57:46.530 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:46.525+0000 7f5296909700 1 -- 172.21.15.157:0/1613665332 wait complete. 2023-10-16T19:57:46.530 INFO:teuthology.orchestra.run.smithi157.stderr:listed 0 entries 2023-10-16T19:57:46.539 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-10-16T19:57:46.539 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T19:57:46.540 DEBUG:teuthology.orchestra.run.smithi187:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2023-10-16T19:57:46.581 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi187.front.sepia.ceph.com 2023-10-16T19:57:46.581 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T19:57:46.582 DEBUG:teuthology.orchestra.run.smithi187:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-16T19:57:46.650 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2023-10-16T19:57:46.650 DEBUG:teuthology.orchestra.run.smithi157:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T19:57:46.668 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2023-10-16T19:57:46.669 DEBUG:teuthology.orchestra.run.smithi157:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T19:57:46.725 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2023-10-16T19:57:46.726 DEBUG:teuthology.orchestra.run.smithi157:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T19:57:46.782 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T19:57:46.945 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:46.939+0000 7fed1674c700 1 Processor -- start 2023-10-16T19:57:46.946 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:46.939+0000 7fed1674c700 1 -- start start 2023-10-16T19:57:46.946 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:46.940+0000 7fed1674c700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fed1006af60 0x7fed1006d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:46.946 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:46.940+0000 7fed1674c700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed100d08b0 con 0x7fed1015e2f0 2023-10-16T19:57:46.947 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:46.940+0000 7fed1674c700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed101628f0 con 0x7fed1006de00 2023-10-16T19:57:46.947 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:46.940+0000 7fed1674c700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed10162bd0 con 0x7fed1006af60 2023-10-16T19:57:46.947 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:46.940+0000 7fed0f7fe700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fed1006af60 0x7fed1006d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:46.947 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:46.941+0000 7fed0f7fe700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fed1006af60 0x7fed1006d0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:46952/0 (socket says 172.21.15.157:46952) 2023-10-16T19:57:46.948 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:46.941+0000 7fed0f7fe700 1 -- 172.21.15.157:0/1176849026 learned_addr learned my addr 172.21.15.157:0/1176849026 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:57:46.948 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:46.941+0000 7fed0ffff700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7fed1015e2f0 0x7fed1006a850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:56624/0 (socket says 172.21.15.157:56624) 2023-10-16T19:57:46.949 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:46.941+0000 7fed0f7fe700 1 -- 172.21.15.157:0/1176849026 >> v1:172.21.15.187:6789/0 conn(0x7fed1006de00 legacy=0x7fed10070f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:57:46.949 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:46.941+0000 7fed0f7fe700 1 -- 172.21.15.157:0/1176849026 >> v1:172.21.15.157:6789/0 conn(0x7fed1015e2f0 legacy=0x7fed1006a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:46.949 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:46.941+0000 7fed0f7fe700 1 -- 172.21.15.157:0/1176849026 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed100d05d0 con 0x7fed1006af60 2023-10-16T19:57:46.949 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:46.941+0000 7fed0f7fe700 1 --2- 172.21.15.157:0/1176849026 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fed1006af60 0x7fed1006d0f0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fed040098f0 tx=0x7fed04009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb8dfd7ddfc58dff server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:46.950 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:46.941+0000 7fed0effd700 1 -- 172.21.15.157:0/1176849026 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed04004230 con 0x7fed1006af60 2023-10-16T19:57:46.950 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:46.941+0000 7fed0effd700 1 -- 172.21.15.157:0/1176849026 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed04004390 con 0x7fed1006af60 2023-10-16T19:57:46.950 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:46.941+0000 7fed0effd700 1 -- 172.21.15.157:0/1176849026 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed040036a0 con 0x7fed1006af60 2023-10-16T19:57:46.951 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:46.942+0000 7fed1674c700 1 -- 172.21.15.157:0/1176849026 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fed1006af60 msgr2=0x7fed1006d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:46.951 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:46.942+0000 7fed1674c700 1 --2- 172.21.15.157:0/1176849026 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fed1006af60 0x7fed1006d0f0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fed040098f0 tx=0x7fed04009c00 comp rx=0 tx=0).stop 2023-10-16T19:57:46.951 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:46.942+0000 7fed1674c700 1 -- 172.21.15.157:0/1176849026 shutdown_connections 2023-10-16T19:57:46.952 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:46.942+0000 7fed1674c700 1 --2- 172.21.15.157:0/1176849026 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fed1006af60 0x7fed1006d0f0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:46.952 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:46.942+0000 7fed1674c700 1 -- 172.21.15.157:0/1176849026 >> 172.21.15.157:0/1176849026 conn(0x7fed100cd4e0 msgr2=0x7fed100cd8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:46.952 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:46.942+0000 7fed1674c700 1 -- 172.21.15.157:0/1176849026 shutdown_connections 2023-10-16T19:57:46.953 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:46.942+0000 7fed1674c700 1 -- 172.21.15.157:0/1176849026 wait complete. 2023-10-16T19:57:46.953 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:46.943+0000 7fed1674c700 1 Processor -- start 2023-10-16T19:57:46.958 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:46.944+0000 7fed1674c700 1 -- start start 2023-10-16T19:57:46.959 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:46.944+0000 7fed1674c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fed1006af60 0x7fed100c64d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:46.959 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:46.944+0000 7fed1674c700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fed1006de00 0x7fed100b36d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:46.959 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:46.944+0000 7fed1674c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fed1015e2f0 0x7fed101f3120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:46.959 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:46.944+0000 7fed1674c700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed1015a520 con 0x7fed1006af60 2023-10-16T19:57:46.960 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:46.944+0000 7fed1674c700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed100c6a10 con 0x7fed1015e2f0 2023-10-16T19:57:46.960 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:46.944+0000 7fed1674c700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed1015fe30 con 0x7fed1006de00 2023-10-16T19:57:46.961 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:46.944+0000 7fed0ffff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fed1006af60 0x7fed100c64d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:46.961 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:46.944+0000 7fed0ffff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fed1006af60 0x7fed100c64d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:46956/0 (socket says 172.21.15.157:46956) 2023-10-16T19:57:46.961 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:46.944+0000 7fed0ffff700 1 -- 172.21.15.157:0/4197107316 learned_addr learned my addr 172.21.15.157:0/4197107316 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:57:46.962 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:46.945+0000 7fed14ce9700 1 --2- 172.21.15.157:0/4197107316 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fed1015e2f0 0x7fed101f3120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:46.962 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:46.945+0000 7fed0f7fe700 1 --2- 172.21.15.157:0/4197107316 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fed1006de00 0x7fed100b36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:46.963 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:46.945+0000 7fed0ffff700 1 -- 172.21.15.157:0/4197107316 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fed1006de00 msgr2=0x7fed100b36d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:46.963 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:46.945+0000 7fed0ffff700 1 --2- 172.21.15.157:0/4197107316 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fed1006de00 0x7fed100b36d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:46.963 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:46.945+0000 7fed0ffff700 1 -- 172.21.15.157:0/4197107316 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fed1015e2f0 msgr2=0x7fed101f3120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:46.964 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:46.945+0000 7fed0ffff700 1 --2- 172.21.15.157:0/4197107316 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fed1015e2f0 0x7fed101f3120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:46.964 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:46.945+0000 7fed0ffff700 1 -- 172.21.15.157:0/4197107316 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed04009550 con 0x7fed1006af60 2023-10-16T19:57:46.964 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:46.945+0000 7fed0ffff700 1 --2- 172.21.15.157:0/4197107316 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fed1006af60 0x7fed100c64d0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fed0000c430 tx=0x7fed0000c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:46.965 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:46.945+0000 7fed0cff9700 1 -- 172.21.15.157:0/4197107316 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed00005cb0 con 0x7fed1006af60 2023-10-16T19:57:46.966 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:46.945+0000 7fed0cff9700 1 -- 172.21.15.157:0/4197107316 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed00005e10 con 0x7fed1006af60 2023-10-16T19:57:46.966 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:46.945+0000 7fed1674c700 1 -- 172.21.15.157:0/4197107316 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed100c6c40 con 0x7fed1006af60 2023-10-16T19:57:46.967 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:46.945+0000 7fed0cff9700 1 -- 172.21.15.157:0/4197107316 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed000072d0 con 0x7fed1006af60 2023-10-16T19:57:46.967 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:46.945+0000 7fed1674c700 1 -- 172.21.15.157:0/4197107316 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed100c6fd0 con 0x7fed1006af60 2023-10-16T19:57:46.967 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:46.946+0000 7fed1674c700 1 -- 172.21.15.157:0/4197107316 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed100c7160 con 0x7fed1006af60 2023-10-16T19:57:46.970 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:46.947+0000 7fed0cff9700 1 -- 172.21.15.157:0/4197107316 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fed00007430 con 0x7fed1006af60 2023-10-16T19:57:46.970 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:46.947+0000 7fed0cff9700 1 --2- 172.21.15.157:0/4197107316 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fecfc06af00 0x7fecfc06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:46.970 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:46.947+0000 7fed0cff9700 1 -- 172.21.15.157:0/4197107316 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fed000888a0 con 0x7fed1006af60 2023-10-16T19:57:46.970 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:46.947+0000 7fed0f7fe700 1 --2- 172.21.15.157:0/4197107316 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fecfc06af00 0x7fecfc06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:46.971 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:46.948+0000 7fed0f7fe700 1 --2- 172.21.15.157:0/4197107316 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fecfc06af00 0x7fecfc06d3c0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fed100b1300 tx=0x7fed04008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:46.971 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:46.951+0000 7fed0cff9700 1 -- 172.21.15.157:0/4197107316 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fed100c7160 con 0x7fed1006af60 2023-10-16T19:57:47.144 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.142+0000 7fed1674c700 1 -- 172.21.15.157:0/4197107316 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fed100c7160 con 0x7fed1006af60 2023-10-16T19:57:47.145 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.143+0000 7fed0cff9700 1 -- 172.21.15.157:0/4197107316 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16517 (secure 0 0 0) 0x7fed100c7160 con 0x7fed1006af60 2023-10-16T19:57:47.146 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-10-16T19:57:47.146 INFO:teuthology.orchestra.run.smithi157.stdout:{"epoch":21,"fsid":"28199dc9-64d5-479e-83c6-21f097c33d39","created":"2023-10-16T19:56:49.201889+0000","modified":"2023-10-16T19:57:07.988567+0000","last_up_change":"2023-10-16T19:56:54.675673+0000","last_in_change":"2023-10-16T19:56:51.666728+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T19:56:56.932895+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-16T19:57:04.936105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-16T19:57:05.335279+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":335785898},{"type":"v1","addr":"172.21.15.157:6809","nonce":335785898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":335785898},{"type":"v1","addr":"172.21.15.157:6811","nonce":335785898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6815","nonce":335785898},{"type":"v1","addr":"172.21.15.157:6817","nonce":335785898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":335785898},{"type":"v1","addr":"172.21.15.157:6813","nonce":335785898}]},"public_addr":"172.21.15.157:6809/335785898","cluster_addr":"172.21.15.157:6811/335785898","heartbeat_back_addr":"172.21.15.157:6817/335785898","heartbeat_front_addr":"172.21.15.157:6813/335785898","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":3482825047},{"type":"v1","addr":"172.21.15.157:6801","nonce":3482825047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":3482825047},{"type":"v1","addr":"172.21.15.157:6803","nonce":3482825047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":3482825047},{"type":"v1","addr":"172.21.15.157:6807","nonce":3482825047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":3482825047},{"type":"v1","addr":"172.21.15.157:6805","nonce":3482825047}]},"public_addr":"172.21.15.157:6801/3482825047","cluster_addr":"172.21.15.157:6803/3482825047","heartbeat_back_addr":"172.21.15.157:6807/3482825047","heartbeat_front_addr":"172.21.15.157:6805/3482825047","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":1118292389},{"type":"v1","addr":"172.21.15.157:6825","nonce":1118292389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":1118292389},{"type":"v1","addr":"172.21.15.157:6827","nonce":1118292389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":1118292389},{"type":"v1","addr":"172.21.15.157:6831","nonce":1118292389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":1118292389},{"type":"v1","addr":"172.21.15.157:6829","nonce":1118292389}]},"public_addr":"172.21.15.157:6825/1118292389","cluster_addr":"172.21.15.157:6827/1118292389","heartbeat_back_addr":"172.21.15.157:6831/1118292389","heartbeat_front_addr":"172.21.15.157:6829/1118292389","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":989329821},{"type":"v1","addr":"172.21.15.157:6816","nonce":989329821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":989329821},{"type":"v1","addr":"172.21.15.157:6819","nonce":989329821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":989329821},{"type":"v1","addr":"172.21.15.157:6823","nonce":989329821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":989329821},{"type":"v1","addr":"172.21.15.157:6821","nonce":989329821}]},"public_addr":"172.21.15.157:6816/989329821","cluster_addr":"172.21.15.157:6819/989329821","heartbeat_back_addr":"172.21.15.157:6823/989329821","heartbeat_front_addr":"172.21.15.157:6821/989329821","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":3841016811},{"type":"v1","addr":"172.21.15.187:6801","nonce":3841016811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6803","nonce":3841016811},{"type":"v1","addr":"172.21.15.187:6804","nonce":3841016811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6809","nonce":3841016811},{"type":"v1","addr":"172.21.15.187:6811","nonce":3841016811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":3841016811},{"type":"v1","addr":"172.21.15.187:6808","nonce":3841016811}]},"public_addr":"172.21.15.187:6801/3841016811","cluster_addr":"172.21.15.187:6804/3841016811","heartbeat_back_addr":"172.21.15.187:6811/3841016811","heartbeat_front_addr":"172.21.15.187:6808/3841016811","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":915130263},{"type":"v1","addr":"172.21.15.187:6805","nonce":915130263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6807","nonce":915130263},{"type":"v1","addr":"172.21.15.187:6810","nonce":915130263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":915130263},{"type":"v1","addr":"172.21.15.187:6815","nonce":915130263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":915130263},{"type":"v1","addr":"172.21.15.187:6813","nonce":915130263}]},"public_addr":"172.21.15.187:6805/915130263","cluster_addr":"172.21.15.187:6810/915130263","heartbeat_back_addr":"172.21.15.187:6815/915130263","heartbeat_front_addr":"172.21.15.187:6813/915130263","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":654976824},{"type":"v1","addr":"172.21.15.187:6817","nonce":654976824}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":654976824},{"type":"v1","addr":"172.21.15.187:6819","nonce":654976824}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":654976824},{"type":"v1","addr":"172.21.15.187:6823","nonce":654976824}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":654976824},{"type":"v1","addr":"172.21.15.187:6821","nonce":654976824}]},"public_addr":"172.21.15.187:6817/654976824","cluster_addr":"172.21.15.187:6819/654976824","heartbeat_back_addr":"172.21.15.187:6823/654976824","heartbeat_front_addr":"172.21.15.187:6821/654976824","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":4284059445},{"type":"v1","addr":"172.21.15.187:6825","nonce":4284059445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":4284059445},{"type":"v1","addr":"172.21.15.187:6827","nonce":4284059445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":4284059445},{"type":"v1","addr":"172.21.15.187:6831","nonce":4284059445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":4284059445},{"type":"v1","addr":"172.21.15.187:6829","nonce":4284059445}]},"public_addr":"172.21.15.187:6825/4284059445","cluster_addr":"172.21.15.187:6827/4284059445","heartbeat_back_addr":"172.21.15.187:6831/4284059445","heartbeat_front_addr":"172.21.15.187:6829/4284059445","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.819780+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.824193+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.849575+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.824806+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.809540+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.805093+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.866109+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.807372+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T19:57:47.148 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.145+0000 7fed1674c700 1 -- 172.21.15.157:0/4197107316 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fecfc06af00 msgr2=0x7fecfc06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:47.148 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.145+0000 7fed1674c700 1 --2- 172.21.15.157:0/4197107316 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fecfc06af00 0x7fecfc06d3c0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fed100b1300 tx=0x7fed04008030 comp rx=0 tx=0).stop 2023-10-16T19:57:47.148 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.145+0000 7fed1674c700 1 -- 172.21.15.157:0/4197107316 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fed1006af60 msgr2=0x7fed100c64d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:47.148 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.145+0000 7fed1674c700 1 --2- 172.21.15.157:0/4197107316 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fed1006af60 0x7fed100c64d0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fed0000c430 tx=0x7fed0000c7f0 comp rx=0 tx=0).stop 2023-10-16T19:57:47.148 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.145+0000 7fed1674c700 1 -- 172.21.15.157:0/4197107316 shutdown_connections 2023-10-16T19:57:47.149 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.145+0000 7fed1674c700 1 --2- 172.21.15.157:0/4197107316 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fecfc06af00 0x7fecfc06d3c0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:47.149 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.145+0000 7fed1674c700 1 --2- 172.21.15.157:0/4197107316 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fed1015e2f0 0x7fed101f3120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:47.149 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.145+0000 7fed1674c700 1 --2- 172.21.15.157:0/4197107316 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fed1006af60 0x7fed100c64d0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:47.150 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.145+0000 7fed1674c700 1 --2- 172.21.15.157:0/4197107316 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fed1006de00 0x7fed100b36d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:47.150 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.145+0000 7fed1674c700 1 -- 172.21.15.157:0/4197107316 >> 172.21.15.157:0/4197107316 conn(0x7fed100cd4e0 msgr2=0x7fed1006a850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:47.151 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.145+0000 7fed1674c700 1 -- 172.21.15.157:0/4197107316 shutdown_connections 2023-10-16T19:57:47.151 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.145+0000 7fed1674c700 1 -- 172.21.15.157:0/4197107316 wait complete. 2023-10-16T19:57:47.160 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-16T19:56:56.932895+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-16T19:57:04.936105+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-16T19:57:05.335279+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-16T19:57:47.161 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-16T19:57:47.285 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.282+0000 7f3a96bc0700 1 Processor -- start 2023-10-16T19:57:47.285 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.283+0000 7f3a96bc0700 1 -- start start 2023-10-16T19:57:47.289 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.283+0000 7f3a96bc0700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f3a900b0cc0 0x7f3a900cc310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:47.289 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.283+0000 7f3a96bc0700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a900cdc30 con 0x7f3a9015efb0 2023-10-16T19:57:47.289 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.283+0000 7f3a96bc0700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a900b1140 con 0x7f3a900b36b0 2023-10-16T19:57:47.289 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.283+0000 7f3a96bc0700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a900cc850 con 0x7f3a900b0cc0 2023-10-16T19:57:47.290 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.284+0000 7f3a9515d700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f3a9015efb0 0x7f3a9006fa90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:56640/0 (socket says 172.21.15.157:56640) 2023-10-16T19:57:47.290 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.284+0000 7f3a9515d700 1 -- 172.21.15.157:0/2322785096 learned_addr learned my addr 172.21.15.157:0/2322785096 (peer_addr_for_me v1:172.21.15.157:0/0) 2023-10-16T19:57:47.290 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.284+0000 7f3a8ffff700 1 --2- 172.21.15.157:0/2322785096 >> v2:172.21.15.187:3300/0 conn(0x7f3a900b0cc0 0x7f3a900cc310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:47.290 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.284+0000 7f3a8f7fe700 1 -- 172.21.15.157:0/2322785096 <== mon.0 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 113511903 0 0) 0x7f3a900cdc30 con 0x7f3a9015efb0 2023-10-16T19:57:47.290 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.284+0000 7f3a8f7fe700 1 -- 172.21.15.157:0/2322785096 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3a800035b0 con 0x7f3a9015efb0 2023-10-16T19:57:47.291 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.284+0000 7f3a8f7fe700 1 -- 172.21.15.157:0/2322785096 <== mon.0 v1:172.21.15.157:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3552349048 0 0) 0x7f3a800035b0 con 0x7f3a9015efb0 2023-10-16T19:57:47.291 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.284+0000 7f3a8f7fe700 1 -- 172.21.15.157:0/2322785096 >> v2:172.21.15.187:3300/0 conn(0x7f3a900b0cc0 msgr2=0x7f3a900cc310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:57:47.291 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.284+0000 7f3a8f7fe700 1 --2- 172.21.15.157:0/2322785096 >> v2:172.21.15.187:3300/0 conn(0x7f3a900b0cc0 0x7f3a900cc310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:47.291 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.284+0000 7f3a8f7fe700 1 -- 172.21.15.157:0/2322785096 >> v1:172.21.15.187:6789/0 conn(0x7f3a900b36b0 legacy=0x7f3a900b3a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:47.292 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.284+0000 7f3a8f7fe700 1 -- 172.21.15.157:0/2322785096 --> v1:172.21.15.157:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a900cde60 con 0x7f3a9015efb0 2023-10-16T19:57:47.294 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.284+0000 7f3a8f7fe700 1 -- 172.21.15.157:0/2322785096 <== mon.0 v1:172.21.15.157:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4021145519 0 0) 0x7f3a880019f0 con 0x7f3a9015efb0 2023-10-16T19:57:47.294 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.284+0000 7f3a8ffff700 1 --2- 172.21.15.157:0/2322785096 >> v2:172.21.15.187:3300/0 conn(0x7f3a900b0cc0 0x7f3a900cc310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T19:57:47.294 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.284+0000 7f3a8f7fe700 1 -- 172.21.15.157:0/2322785096 >> v1:172.21.15.157:6789/0 conn(0x7f3a9015efb0 legacy=0x7f3a9006fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:47.294 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.284+0000 7f3a8f7fe700 1 --2- 172.21.15.157:0/2322785096 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3a80003a00 0x7f3a80003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:47.294 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.284+0000 7f3a8f7fe700 1 --2- 172.21.15.157:0/2322785096 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3a80004850 0x7f3a80004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:47.295 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.284+0000 7f3a8f7fe700 1 --2- 172.21.15.157:0/2322785096 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3a80005210 0x7f3a8000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:47.295 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.284+0000 7f3a8f7fe700 1 -- 172.21.15.157:0/2322785096 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a900cc850 con 0x7f3a80005210 2023-10-16T19:57:47.295 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.284+0000 7f3a8f7fe700 1 -- 172.21.15.157:0/2322785096 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a8000c0b0 con 0x7f3a80003a00 2023-10-16T19:57:47.295 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.284+0000 7f3a8f7fe700 1 -- 172.21.15.157:0/2322785096 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a8000c270 con 0x7f3a80004850 2023-10-16T19:57:47.295 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.284+0000 7f3a9515d700 1 --2- 172.21.15.157:0/2322785096 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3a80005210 0x7f3a8000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:47.296 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.284+0000 7f3a9495c700 1 --2- 172.21.15.157:0/2322785096 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3a80003a00 0x7f3a80003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:47.296 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.284+0000 7f3a8ffff700 1 --2- 172.21.15.157:0/2322785096 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3a80004850 0x7f3a80004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:47.296 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.285+0000 7f3a9515d700 1 -- 172.21.15.157:0/2322785096 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3a80004850 msgr2=0x7f3a80004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:57:47.296 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.285+0000 7f3a9515d700 1 --2- 172.21.15.157:0/2322785096 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3a80004850 0x7f3a80004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:47.296 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.285+0000 7f3a9515d700 1 -- 172.21.15.157:0/2322785096 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3a80003a00 msgr2=0x7f3a80003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:57:47.296 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.285+0000 7f3a9515d700 1 --2- 172.21.15.157:0/2322785096 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3a80003a00 0x7f3a80003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:47.297 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.285+0000 7f3a9515d700 1 -- 172.21.15.157:0/2322785096 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a800035b0 con 0x7f3a80005210 2023-10-16T19:57:47.297 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.285+0000 7f3a9515d700 1 -- 172.21.15.157:0/2322785096 reap_dead start 2023-10-16T19:57:47.297 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.285+0000 7f3a9515d700 1 --2- 172.21.15.157:0/2322785096 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3a80005210 0x7f3a8000ba10 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f3a8800a830 tx=0x7f3a80005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f50c103701cca264 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:47.297 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.285+0000 7f3a8f7fe700 1 -- 172.21.15.157:0/2322785096 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a8800a2f0 con 0x7f3a80005210 2023-10-16T19:57:47.297 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.285+0000 7f3a8f7fe700 1 -- 172.21.15.157:0/2322785096 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a88012620 con 0x7f3a80005210 2023-10-16T19:57:47.298 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.285+0000 7f3a8f7fe700 1 -- 172.21.15.157:0/2322785096 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a880129d0 con 0x7f3a80005210 2023-10-16T19:57:47.298 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.285+0000 7f3a96bc0700 1 -- 172.21.15.157:0/2322785096 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3a80005210 msgr2=0x7f3a8000ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:47.298 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.285+0000 7f3a96bc0700 1 --2- 172.21.15.157:0/2322785096 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3a80005210 0x7f3a8000ba10 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f3a8800a830 tx=0x7f3a80005880 comp rx=0 tx=0).stop 2023-10-16T19:57:47.298 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.285+0000 7f3a96bc0700 1 -- 172.21.15.157:0/2322785096 shutdown_connections 2023-10-16T19:57:47.298 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.285+0000 7f3a96bc0700 1 --2- 172.21.15.157:0/2322785096 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3a80005210 0x7f3a8000ba10 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:47.299 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.285+0000 7f3a96bc0700 1 -- 172.21.15.157:0/2322785096 >> 172.21.15.157:0/2322785096 conn(0x7f3a900ce6b0 msgr2=0x7f3a900ceac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:47.299 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.286+0000 7f3a96bc0700 1 -- 172.21.15.157:0/2322785096 shutdown_connections 2023-10-16T19:57:47.299 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.286+0000 7f3a96bc0700 1 -- 172.21.15.157:0/2322785096 wait complete. 2023-10-16T19:57:47.299 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.287+0000 7f3a96bc0700 1 Processor -- start 2023-10-16T19:57:47.299 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.287+0000 7f3a96bc0700 1 -- start start 2023-10-16T19:57:47.302 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.288+0000 7f3a96bc0700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3a80005210 0x7f3a901f7e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:47.302 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.288+0000 7f3a96bc0700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3a901e6600 0x7f3a901e4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:47.302 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.288+0000 7f3a96bc0700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3a900b71d0 0x7f3a90155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:47.302 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.288+0000 7f3a96bc0700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a901e5230 con 0x7f3a900b71d0 2023-10-16T19:57:47.303 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.288+0000 7f3a96bc0700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a90156520 con 0x7f3a901e6600 2023-10-16T19:57:47.303 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.288+0000 7f3a96bc0700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a901e6ac0 con 0x7f3a80005210 2023-10-16T19:57:47.303 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.288+0000 7f3a9515d700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3a900b71d0 0x7f3a90155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:47.303 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.288+0000 7f3a9515d700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3a900b71d0 0x7f3a90155fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:46980/0 (socket says 172.21.15.157:46980) 2023-10-16T19:57:47.304 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.288+0000 7f3a9515d700 1 -- 172.21.15.157:0/637476149 learned_addr learned my addr 172.21.15.157:0/637476149 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:57:47.304 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.288+0000 7f3a9495c700 1 --2- 172.21.15.157:0/637476149 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3a80005210 0x7f3a901f7e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:47.304 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.288+0000 7f3a8ffff700 1 --2- 172.21.15.157:0/637476149 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3a901e6600 0x7f3a901e4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:47.305 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.288+0000 7f3a9515d700 1 -- 172.21.15.157:0/637476149 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3a80005210 msgr2=0x7f3a901f7e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:47.305 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.288+0000 7f3a9515d700 1 --2- 172.21.15.157:0/637476149 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3a80005210 0x7f3a901f7e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:47.305 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.288+0000 7f3a9515d700 1 -- 172.21.15.157:0/637476149 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3a901e6600 msgr2=0x7f3a901e4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:47.305 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.288+0000 7f3a9515d700 1 --2- 172.21.15.157:0/637476149 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3a901e6600 0x7f3a901e4cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:47.305 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.288+0000 7f3a9515d700 1 -- 172.21.15.157:0/637476149 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a901e6da0 con 0x7f3a900b71d0 2023-10-16T19:57:47.306 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.288+0000 7f3a9515d700 1 --2- 172.21.15.157:0/637476149 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3a900b71d0 0x7f3a90155fe0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f3a900b1660 tx=0x7f3a88001d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:47.306 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.288+0000 7f3a8d7fa700 1 -- 172.21.15.157:0/637476149 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a88001250 con 0x7f3a900b71d0 2023-10-16T19:57:47.306 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.288+0000 7f3a8d7fa700 1 -- 172.21.15.157:0/637476149 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a880017b0 con 0x7f3a900b71d0 2023-10-16T19:57:47.306 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.288+0000 7f3a96bc0700 1 -- 172.21.15.157:0/637476149 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a901f7380 con 0x7f3a900b71d0 2023-10-16T19:57:47.307 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.288+0000 7f3a8d7fa700 1 -- 172.21.15.157:0/637476149 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a8801e430 con 0x7f3a900b71d0 2023-10-16T19:57:47.307 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.288+0000 7f3a96bc0700 1 -- 172.21.15.157:0/637476149 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a901f7940 con 0x7f3a900b71d0 2023-10-16T19:57:47.307 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.289+0000 7f3a96bc0700 1 -- 172.21.15.157:0/637476149 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a9004f400 con 0x7f3a900b71d0 2023-10-16T19:57:47.307 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.290+0000 7f3a8d7fa700 1 -- 172.21.15.157:0/637476149 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f3a8801e5b0 con 0x7f3a900b71d0 2023-10-16T19:57:47.307 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.290+0000 7f3a8d7fa700 1 --2- 172.21.15.157:0/637476149 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f3a7406af00 0x7f3a7406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:47.308 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.290+0000 7f3a8d7fa700 1 -- 172.21.15.157:0/637476149 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3a8808b520 con 0x7f3a900b71d0 2023-10-16T19:57:47.308 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.290+0000 7f3a9495c700 1 --2- 172.21.15.157:0/637476149 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f3a7406af00 0x7f3a7406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:47.308 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.291+0000 7f3a9495c700 1 --2- 172.21.15.157:0/637476149 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f3a7406af00 0x7f3a7406d3c0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f3a84000c00 tx=0x7f3a84009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:47.308 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.295+0000 7f3a8d7fa700 1 -- 172.21.15.157:0/637476149 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3a880565e0 con 0x7f3a900b71d0 2023-10-16T19:57:47.486 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.483+0000 7f3a96bc0700 1 -- 172.21.15.157:0/637476149 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3a9006b340 con 0x7f3a900b71d0 2023-10-16T19:57:47.486 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.483+0000 7f3a8d7fa700 1 -- 172.21.15.157:0/637476149 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3a88059c00 con 0x7f3a900b71d0 2023-10-16T19:57:47.486 INFO:teuthology.orchestra.run.smithi157.stdout:pg_num: 1 2023-10-16T19:57:47.488 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.486+0000 7f3a96bc0700 1 -- 172.21.15.157:0/637476149 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f3a7406af00 msgr2=0x7f3a7406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:47.489 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.486+0000 7f3a96bc0700 1 --2- 172.21.15.157:0/637476149 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f3a7406af00 0x7f3a7406d3c0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f3a84000c00 tx=0x7f3a84009040 comp rx=0 tx=0).stop 2023-10-16T19:57:47.489 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.486+0000 7f3a96bc0700 1 -- 172.21.15.157:0/637476149 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3a900b71d0 msgr2=0x7f3a90155fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:47.489 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.486+0000 7f3a96bc0700 1 --2- 172.21.15.157:0/637476149 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3a900b71d0 0x7f3a90155fe0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f3a900b1660 tx=0x7f3a88001d80 comp rx=0 tx=0).stop 2023-10-16T19:57:47.489 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.486+0000 7f3a96bc0700 1 -- 172.21.15.157:0/637476149 shutdown_connections 2023-10-16T19:57:47.490 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.486+0000 7f3a96bc0700 1 --2- 172.21.15.157:0/637476149 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3a900b71d0 0x7f3a90155fe0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:47.490 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.486+0000 7f3a96bc0700 1 --2- 172.21.15.157:0/637476149 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3a80005210 0x7f3a901f7e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:47.490 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.486+0000 7f3a96bc0700 1 --2- 172.21.15.157:0/637476149 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f3a7406af00 0x7f3a7406d3c0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:47.490 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.486+0000 7f3a96bc0700 1 --2- 172.21.15.157:0/637476149 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3a901e6600 0x7f3a901e4cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:47.491 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.486+0000 7f3a96bc0700 1 -- 172.21.15.157:0/637476149 >> 172.21.15.157:0/637476149 conn(0x7f3a900ce6b0 msgr2=0x7f3a90156bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:47.491 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.486+0000 7f3a96bc0700 1 -- 172.21.15.157:0/637476149 shutdown_connections 2023-10-16T19:57:47.491 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.486+0000 7f3a96bc0700 1 -- 172.21.15.157:0/637476149 wait complete. 2023-10-16T19:57:47.500 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-16T19:57:47.623 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.621+0000 7fe9054d4700 1 Processor -- start 2023-10-16T19:57:47.624 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.621+0000 7fe9054d4700 1 -- start start 2023-10-16T19:57:47.626 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.622+0000 7fe9054d4700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fe90015e1c0 0x7fe9000cee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:47.626 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.622+0000 7fe9054d4700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe9000d0e90 0x7fe900162530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:47.626 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.622+0000 7fe9054d4700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9000d1f80 con 0x7fe9000b6fc0 2023-10-16T19:57:47.627 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.622+0000 7fe9054d4700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9000d2820 con 0x7fe90015e1c0 2023-10-16T19:57:47.627 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.622+0000 7fe9054d4700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9000cf3f0 con 0x7fe9000d0e90 2023-10-16T19:57:47.627 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.622+0000 7fe8feffd700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fe90015e1c0 0x7fe9000cee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:47.627 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.622+0000 7fe8ff7fe700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe9000d0e90 0x7fe900162530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:47.627 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.622+0000 7fe8fe7fc700 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7fe9000b6fc0 0x7fe9000d0780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.157:40352/0 (socket says 172.21.15.157:40352) 2023-10-16T19:57:47.628 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.622+0000 7fe8fe7fc700 1 -- 172.21.15.157:0/3424348406 learned_addr learned my addr 172.21.15.157:0/3424348406 (peer_addr_for_me v1:172.21.15.157:0/0) 2023-10-16T19:57:47.628 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.622+0000 7fe8feffd700 1 -- 172.21.15.157:0/3424348406 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe9000d0e90 msgr2=0x7fe900162530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:57:47.628 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.622+0000 7fe8feffd700 1 --2- 172.21.15.157:0/3424348406 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe9000d0e90 0x7fe900162530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:47.628 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.622+0000 7fe8feffd700 1 -- 172.21.15.157:0/3424348406 >> v1:172.21.15.187:6789/0 conn(0x7fe9000b6fc0 legacy=0x7fe9000d0780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:47.629 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.622+0000 7fe8feffd700 1 -- 172.21.15.157:0/3424348406 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9000d21d0 con 0x7fe90015e1c0 2023-10-16T19:57:47.629 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.622+0000 7fe8fdffb700 1 -- 172.21.15.157:0/3424348406 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2314458644 0 0) 0x7fe9000d1f80 con 0x7fe9000b6fc0 2023-10-16T19:57:47.629 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.622+0000 7fe8ff7fe700 1 --2- 172.21.15.157:0/3424348406 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe9000d0e90 0x7fe900162530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T19:57:47.629 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.623+0000 7fe8feffd700 1 --2- 172.21.15.157:0/3424348406 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe90015e1c0 0x7fe9000cee10 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fe8f4009840 tx=0x7fe8f4009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9440e77111341d47 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:47.630 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.623+0000 7fe8fdffb700 1 -- 172.21.15.157:0/3424348406 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8f4011830 con 0x7fe90015e1c0 2023-10-16T19:57:47.630 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.623+0000 7fe8fdffb700 1 -- 172.21.15.157:0/3424348406 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8f4011990 con 0x7fe90015e1c0 2023-10-16T19:57:47.630 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.623+0000 7fe8fdffb700 1 -- 172.21.15.157:0/3424348406 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8f4011d20 con 0x7fe90015e1c0 2023-10-16T19:57:47.630 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.623+0000 7fe9054d4700 1 -- 172.21.15.157:0/3424348406 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe90015e1c0 msgr2=0x7fe9000cee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:47.630 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.623+0000 7fe9054d4700 1 --2- 172.21.15.157:0/3424348406 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe90015e1c0 0x7fe9000cee10 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fe8f4009840 tx=0x7fe8f4009b50 comp rx=0 tx=0).stop 2023-10-16T19:57:47.631 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.623+0000 7fe9054d4700 1 -- 172.21.15.157:0/3424348406 shutdown_connections 2023-10-16T19:57:47.631 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.623+0000 7fe9054d4700 1 --2- 172.21.15.157:0/3424348406 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe9000d0e90 0x7fe900162530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:47.631 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.623+0000 7fe9054d4700 1 --2- 172.21.15.157:0/3424348406 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe90015e1c0 0x7fe9000cee10 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:47.631 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.623+0000 7fe9054d4700 1 -- 172.21.15.157:0/3424348406 >> 172.21.15.157:0/3424348406 conn(0x7fe90006c950 msgr2=0x7fe90006cd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:47.631 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.623+0000 7fe9054d4700 1 -- 172.21.15.157:0/3424348406 shutdown_connections 2023-10-16T19:57:47.632 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.623+0000 7fe9054d4700 1 -- 172.21.15.157:0/3424348406 wait complete. 2023-10-16T19:57:47.634 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.625+0000 7fe9054d4700 1 Processor -- start 2023-10-16T19:57:47.635 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.625+0000 7fe9054d4700 1 -- start start 2023-10-16T19:57:47.635 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.625+0000 7fe9054d4700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe9000b6fc0 0x7fe9001f37c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:47.635 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.625+0000 7fe9054d4700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe9000d0e90 0x7fe90015ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:47.635 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.625+0000 7fe9054d4700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe9001f0b40 0x7fe9000aa730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:47.635 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.625+0000 7fe9054d4700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe90015f740 con 0x7fe9001f0b40 2023-10-16T19:57:47.636 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.625+0000 7fe9054d4700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe90015fa20 con 0x7fe9000b6fc0 2023-10-16T19:57:47.636 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.625+0000 7fe9054d4700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe90015fd00 con 0x7fe9000d0e90 2023-10-16T19:57:47.636 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.626+0000 7fe8ff7fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe9001f0b40 0x7fe9000aa730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:47.636 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.626+0000 7fe8ff7fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe9001f0b40 0x7fe9000aa730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:46994/0 (socket says 172.21.15.157:46994) 2023-10-16T19:57:47.636 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.626+0000 7fe8ff7fe700 1 -- 172.21.15.157:0/2389006437 learned_addr learned my addr 172.21.15.157:0/2389006437 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:57:47.637 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.626+0000 7fe8fe7fc700 1 --2- 172.21.15.157:0/2389006437 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe9000d0e90 0x7fe90015ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:47.637 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.626+0000 7fe8feffd700 1 --2- 172.21.15.157:0/2389006437 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe9000b6fc0 0x7fe9001f37c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:47.637 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.626+0000 7fe8ff7fe700 1 -- 172.21.15.157:0/2389006437 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe9000d0e90 msgr2=0x7fe90015ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:47.637 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.626+0000 7fe8ff7fe700 1 --2- 172.21.15.157:0/2389006437 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe9000d0e90 0x7fe90015ef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:47.638 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.626+0000 7fe8ff7fe700 1 -- 172.21.15.157:0/2389006437 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe9000b6fc0 msgr2=0x7fe9001f37c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:47.638 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.626+0000 7fe8ff7fe700 1 --2- 172.21.15.157:0/2389006437 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe9000b6fc0 0x7fe9001f37c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:47.638 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.626+0000 7fe8ff7fe700 1 -- 172.21.15.157:0/2389006437 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8f8009a70 con 0x7fe9001f0b40 2023-10-16T19:57:47.638 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.626+0000 7fe8feffd700 1 --2- 172.21.15.157:0/2389006437 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe9000b6fc0 0x7fe9001f37c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T19:57:47.638 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.626+0000 7fe8ff7fe700 1 --2- 172.21.15.157:0/2389006437 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe9001f0b40 0x7fe9000aa730 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fe8f800efc0 tx=0x7fe8f800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:47.639 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.626+0000 7fe8e77fe700 1 -- 172.21.15.157:0/2389006437 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8f800cb40 con 0x7fe9001f0b40 2023-10-16T19:57:47.639 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.626+0000 7fe8e77fe700 1 -- 172.21.15.157:0/2389006437 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8f800f040 con 0x7fe9001f0b40 2023-10-16T19:57:47.639 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.626+0000 7fe8e77fe700 1 -- 172.21.15.157:0/2389006437 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8f8003a20 con 0x7fe9001f0b40 2023-10-16T19:57:47.639 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.626+0000 7fe9054d4700 1 -- 172.21.15.157:0/2389006437 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8f40094a0 con 0x7fe9001f0b40 2023-10-16T19:57:47.639 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.626+0000 7fe9054d4700 1 -- 172.21.15.157:0/2389006437 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9001602c0 con 0x7fe9001f0b40 2023-10-16T19:57:47.640 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.627+0000 7fe9054d4700 1 -- 172.21.15.157:0/2389006437 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe90004f400 con 0x7fe9001f0b40 2023-10-16T19:57:47.640 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.628+0000 7fe8e77fe700 1 -- 172.21.15.157:0/2389006437 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fe8f8014480 con 0x7fe9001f0b40 2023-10-16T19:57:47.640 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.628+0000 7fe8e77fe700 1 --2- 172.21.15.157:0/2389006437 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fe8ec06af00 0x7fe8ec06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:47.640 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.628+0000 7fe8e77fe700 1 -- 172.21.15.157:0/2389006437 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe8f808a610 con 0x7fe9001f0b40 2023-10-16T19:57:47.640 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.629+0000 7fe8feffd700 1 --2- 172.21.15.157:0/2389006437 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fe8ec06af00 0x7fe8ec06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:47.641 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.629+0000 7fe8feffd700 1 --2- 172.21.15.157:0/2389006437 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fe8ec06af00 0x7fe8ec06d3c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fe8f4009fd0 tx=0x7fe8f401c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:47.641 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.632+0000 7fe8e77fe700 1 -- 172.21.15.157:0/2389006437 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe8f80557a0 con 0x7fe9001f0b40 2023-10-16T19:57:47.820 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.817+0000 7fe9054d4700 1 -- 172.21.15.157:0/2389006437 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe9000cebf0 con 0x7fe9001f0b40 2023-10-16T19:57:47.821 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.817+0000 7fe8e77fe700 1 -- 172.21.15.157:0/2389006437 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe8f8058dc0 con 0x7fe9001f0b40 2023-10-16T19:57:47.821 INFO:teuthology.orchestra.run.smithi157.stdout:pg_num: 32 2023-10-16T19:57:47.823 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.819+0000 7fe9054d4700 1 -- 172.21.15.157:0/2389006437 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fe8ec06af00 msgr2=0x7fe8ec06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:47.823 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.819+0000 7fe9054d4700 1 --2- 172.21.15.157:0/2389006437 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fe8ec06af00 0x7fe8ec06d3c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fe8f4009fd0 tx=0x7fe8f401c040 comp rx=0 tx=0).stop 2023-10-16T19:57:47.824 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.819+0000 7fe9054d4700 1 -- 172.21.15.157:0/2389006437 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe9001f0b40 msgr2=0x7fe9000aa730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:47.824 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.819+0000 7fe9054d4700 1 --2- 172.21.15.157:0/2389006437 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe9001f0b40 0x7fe9000aa730 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fe8f800efc0 tx=0x7fe8f800c3a0 comp rx=0 tx=0).stop 2023-10-16T19:57:47.824 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.819+0000 7fe9054d4700 1 -- 172.21.15.157:0/2389006437 shutdown_connections 2023-10-16T19:57:47.824 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.819+0000 7fe9054d4700 1 --2- 172.21.15.157:0/2389006437 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fe8ec06af00 0x7fe8ec06d3c0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:47.825 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.819+0000 7fe9054d4700 1 --2- 172.21.15.157:0/2389006437 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe9000b6fc0 0x7fe9001f37c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:47.825 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.819+0000 7fe9054d4700 1 --2- 172.21.15.157:0/2389006437 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe9001f0b40 0x7fe9000aa730 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:47.825 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.819+0000 7fe9054d4700 1 --2- 172.21.15.157:0/2389006437 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe9000d0e90 0x7fe90015ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:47.825 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.819+0000 7fe9054d4700 1 -- 172.21.15.157:0/2389006437 >> 172.21.15.157:0/2389006437 conn(0x7fe90006c950 msgr2=0x7fe9000b7470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:47.825 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.819+0000 7fe9054d4700 1 -- 172.21.15.157:0/2389006437 shutdown_connections 2023-10-16T19:57:47.826 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.819+0000 7fe9054d4700 1 -- 172.21.15.157:0/2389006437 wait complete. 2023-10-16T19:57:47.835 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-16T19:57:47.959 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.955+0000 7f3c26c1a700 1 Processor -- start 2023-10-16T19:57:47.960 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.955+0000 7f3c26c1a700 1 -- start start 2023-10-16T19:57:47.965 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.956+0000 7f3c26c1a700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f3c2015e090 0x7f3c2006b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:47.965 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.956+0000 7f3c26c1a700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3c200b0190 0x7f3c2015e470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:47.965 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.956+0000 7f3c26c1a700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c2006b6a0 con 0x7f3c2006ea10 2023-10-16T19:57:47.965 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.956+0000 7f3c26c1a700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c20071b50 con 0x7f3c2015e090 2023-10-16T19:57:47.966 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.956+0000 7f3c26c1a700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c20072320 con 0x7f3c200b0190 2023-10-16T19:57:47.966 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.956+0000 7f3c249b6700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f3c2015e090 0x7f3c2006b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:47.966 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.956+0000 7f3c249b6700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f3c2015e090 0x7f3c2006b160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:46998/0 (socket says 172.21.15.157:46998) 2023-10-16T19:57:47.966 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.956+0000 7f3c249b6700 1 -- 172.21.15.157:0/74799279 learned_addr learned my addr 172.21.15.157:0/74799279 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:57:47.967 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.957+0000 7f3c251b7700 1 --2- 172.21.15.157:0/74799279 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3c200b0190 0x7f3c2015e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:47.967 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.957+0000 7f3c249b6700 1 -- 172.21.15.157:0/74799279 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3c200b0190 msgr2=0x7f3c2015e470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:57:47.967 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.957+0000 7f3c249b6700 1 --2- 172.21.15.157:0/74799279 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3c200b0190 0x7f3c2015e470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:47.968 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.957+0000 7f3c249b6700 1 -- 172.21.15.157:0/74799279 >> v1:172.21.15.187:6789/0 conn(0x7f3c2006ea10 legacy=0x7f3c200afa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:57:47.968 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.957+0000 7f3c249b6700 1 -- 172.21.15.157:0/74799279 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c20071d60 con 0x7f3c2015e090 2023-10-16T19:57:47.969 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.957+0000 7f3c249b6700 1 --2- 172.21.15.157:0/74799279 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3c2015e090 0x7f3c2006b160 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f3c140098f0 tx=0x7f3c14009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=343474596eb42738 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:47.970 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.957+0000 7f3c1f7fe700 1 -- 172.21.15.157:0/74799279 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c14004230 con 0x7f3c2015e090 2023-10-16T19:57:47.970 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.957+0000 7f3c1f7fe700 1 -- 172.21.15.157:0/74799279 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c14004390 con 0x7f3c2015e090 2023-10-16T19:57:47.971 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.957+0000 7f3c1f7fe700 1 -- 172.21.15.157:0/74799279 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c140036a0 con 0x7f3c2015e090 2023-10-16T19:57:47.972 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.957+0000 7f3c26c1a700 1 -- 172.21.15.157:0/74799279 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3c2015e090 msgr2=0x7f3c2006b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:47.972 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.957+0000 7f3c26c1a700 1 --2- 172.21.15.157:0/74799279 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3c2015e090 0x7f3c2006b160 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f3c140098f0 tx=0x7f3c14009c00 comp rx=0 tx=0).stop 2023-10-16T19:57:47.972 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.958+0000 7f3c26c1a700 1 -- 172.21.15.157:0/74799279 shutdown_connections 2023-10-16T19:57:47.972 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.958+0000 7f3c26c1a700 1 --2- 172.21.15.157:0/74799279 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3c200b0190 0x7f3c2015e470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:47.972 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.958+0000 7f3c26c1a700 1 --2- 172.21.15.157:0/74799279 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3c2015e090 0x7f3c2006b160 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:47.973 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.958+0000 7f3c26c1a700 1 -- 172.21.15.157:0/74799279 >> 172.21.15.157:0/74799279 conn(0x7f3c200d0b30 msgr2=0x7f3c200d0f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:47.973 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.958+0000 7f3c26c1a700 1 -- 172.21.15.157:0/74799279 shutdown_connections 2023-10-16T19:57:47.973 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.958+0000 7f3c26c1a700 1 -- 172.21.15.157:0/74799279 wait complete. 2023-10-16T19:57:47.973 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.959+0000 7f3c26c1a700 1 Processor -- start 2023-10-16T19:57:47.973 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.959+0000 7f3c26c1a700 1 -- start start 2023-10-16T19:57:47.974 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.961+0000 7f3c26c1a700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3c2006ea10 0x7f3c200b3c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:47.974 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.961+0000 7f3c26c1a700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3c200b0190 0x7f3c200b1830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:47.974 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.961+0000 7f3c26c1a700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3c2015e090 0x7f3c2014df50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:47.974 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.961+0000 7f3c26c1a700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c200b48b0 con 0x7f3c200b0190 2023-10-16T19:57:47.974 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.961+0000 7f3c26c1a700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c2015a030 con 0x7f3c2006ea10 2023-10-16T19:57:47.975 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.961+0000 7f3c26c1a700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c2015af60 con 0x7f3c2015e090 2023-10-16T19:57:47.975 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.961+0000 7f3c1ffff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3c200b0190 0x7f3c200b1830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:47.975 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.961+0000 7f3c1ffff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3c200b0190 0x7f3c200b1830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:47004/0 (socket says 172.21.15.157:47004) 2023-10-16T19:57:47.975 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.961+0000 7f3c1ffff700 1 -- 172.21.15.157:0/1568257225 learned_addr learned my addr 172.21.15.157:0/1568257225 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:57:47.975 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.961+0000 7f3c251b7700 1 --2- 172.21.15.157:0/1568257225 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3c2015e090 0x7f3c2014df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:47.976 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.961+0000 7f3c249b6700 1 --2- 172.21.15.157:0/1568257225 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3c2006ea10 0x7f3c200b3c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:47.976 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.961+0000 7f3c1ffff700 1 -- 172.21.15.157:0/1568257225 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3c2015e090 msgr2=0x7f3c2014df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:47.976 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.961+0000 7f3c1ffff700 1 --2- 172.21.15.157:0/1568257225 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3c2015e090 0x7f3c2014df50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:47.976 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.961+0000 7f3c1ffff700 1 -- 172.21.15.157:0/1568257225 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3c2006ea10 msgr2=0x7f3c200b3c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:47.976 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.961+0000 7f3c1ffff700 1 --2- 172.21.15.157:0/1568257225 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3c2006ea10 0x7f3c200b3c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:47.977 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.961+0000 7f3c1ffff700 1 -- 172.21.15.157:0/1568257225 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c14009550 con 0x7f3c200b0190 2023-10-16T19:57:47.977 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.961+0000 7f3c1ffff700 1 --2- 172.21.15.157:0/1568257225 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3c200b0190 0x7f3c200b1830 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f3c0c00c4d0 tx=0x7f3c0c00c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:47.977 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.961+0000 7f3c1d7fa700 1 -- 172.21.15.157:0/1568257225 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c0c011790 con 0x7f3c200b0190 2023-10-16T19:57:47.977 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.961+0000 7f3c1d7fa700 1 -- 172.21.15.157:0/1568257225 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c0c0118f0 con 0x7f3c200b0190 2023-10-16T19:57:47.977 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.961+0000 7f3c26c1a700 1 -- 172.21.15.157:0/1568257225 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c2014edb0 con 0x7f3c200b0190 2023-10-16T19:57:47.978 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.961+0000 7f3c1d7fa700 1 -- 172.21.15.157:0/1568257225 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c0c011ca0 con 0x7f3c200b0190 2023-10-16T19:57:47.978 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.961+0000 7f3c26c1a700 1 -- 172.21.15.157:0/1568257225 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c2015a2d0 con 0x7f3c200b0190 2023-10-16T19:57:47.978 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.961+0000 7f3c26c1a700 1 -- 172.21.15.157:0/1568257225 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c20159e90 con 0x7f3c200b0190 2023-10-16T19:57:47.978 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.962+0000 7f3c1d7fa700 1 -- 172.21.15.157:0/1568257225 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f3c0c01c460 con 0x7f3c200b0190 2023-10-16T19:57:47.979 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.962+0000 7f3c1d7fa700 1 --2- 172.21.15.157:0/1568257225 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f3c0406af00 0x7f3c0406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:47.979 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.962+0000 7f3c1d7fa700 1 -- 172.21.15.157:0/1568257225 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3c0c089270 con 0x7f3c200b0190 2023-10-16T19:57:47.980 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.962+0000 7f3c249b6700 1 --2- 172.21.15.157:0/1568257225 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f3c0406af00 0x7f3c0406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:47.980 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.963+0000 7f3c249b6700 1 --2- 172.21.15.157:0/1568257225 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f3c0406af00 0x7f3c0406d3c0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f3c14009130 tx=0x7f3c14008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:47.980 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:47.967+0000 7f3c1d7fa700 1 -- 172.21.15.157:0/1568257225 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3c20159e90 con 0x7f3c200b0190 2023-10-16T19:57:48.159 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:48.155+0000 7f3c26c1a700 1 -- 172.21.15.157:0/1568257225 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3c20159e90 con 0x7f3c200b0190 2023-10-16T19:57:48.159 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:48.155+0000 7f3c1d7fa700 1 -- 172.21.15.157:0/1568257225 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3c20159e90 con 0x7f3c200b0190 2023-10-16T19:57:48.159 INFO:teuthology.orchestra.run.smithi157.stdout:pg_num: 64 2023-10-16T19:57:48.161 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:48.158+0000 7f3c26c1a700 1 -- 172.21.15.157:0/1568257225 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f3c0406af00 msgr2=0x7f3c0406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:48.162 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:48.158+0000 7f3c26c1a700 1 --2- 172.21.15.157:0/1568257225 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f3c0406af00 0x7f3c0406d3c0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f3c14009130 tx=0x7f3c14008030 comp rx=0 tx=0).stop 2023-10-16T19:57:48.162 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:48.158+0000 7f3c26c1a700 1 -- 172.21.15.157:0/1568257225 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3c200b0190 msgr2=0x7f3c200b1830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:48.162 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:48.158+0000 7f3c26c1a700 1 --2- 172.21.15.157:0/1568257225 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3c200b0190 0x7f3c200b1830 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f3c0c00c4d0 tx=0x7f3c0c00c7e0 comp rx=0 tx=0).stop 2023-10-16T19:57:48.162 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:48.158+0000 7f3c26c1a700 1 -- 172.21.15.157:0/1568257225 shutdown_connections 2023-10-16T19:57:48.163 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:48.158+0000 7f3c26c1a700 1 --2- 172.21.15.157:0/1568257225 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f3c0406af00 0x7f3c0406d3c0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:48.163 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:48.158+0000 7f3c26c1a700 1 --2- 172.21.15.157:0/1568257225 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3c2006ea10 0x7f3c200b3c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:48.163 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:48.158+0000 7f3c26c1a700 1 --2- 172.21.15.157:0/1568257225 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3c2015e090 0x7f3c2014df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:48.163 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:48.158+0000 7f3c26c1a700 1 --2- 172.21.15.157:0/1568257225 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3c200b0190 0x7f3c200b1830 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:48.163 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:48.158+0000 7f3c26c1a700 1 -- 172.21.15.157:0/1568257225 >> 172.21.15.157:0/1568257225 conn(0x7f3c200d0b30 msgr2=0x7f3c2015f620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:48.164 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:48.158+0000 7f3c26c1a700 1 -- 172.21.15.157:0/1568257225 shutdown_connections 2023-10-16T19:57:48.164 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:48.158+0000 7f3c26c1a700 1 -- 172.21.15.157:0/1568257225 wait complete. 2023-10-16T19:57:48.173 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-16T19:57:48.296 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:48.292+0000 7fabb3c3b700 1 Processor -- start 2023-10-16T19:57:48.296 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:48.292+0000 7fabb3c3b700 1 -- start start 2023-10-16T19:57:48.298 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:48.293+0000 7fabb3c3b700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fabac15dce0 0x7fabac06d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:48.299 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:48.293+0000 7fabb3c3b700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fabac0b3da0 0x7fabac167b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:48.299 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:48.293+0000 7fabb3c3b700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabac0ce610 con 0x7fabac0d1a90 2023-10-16T19:57:48.299 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:48.293+0000 7fabb3c3b700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabac0b13c0 con 0x7fabac15dce0 2023-10-16T19:57:48.299 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:48.293+0000 7fabb3c3b700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabac0d1f50 con 0x7fabac0b3da0 2023-10-16T19:57:48.299 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:48.294+0000 7fabb21d8700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fabac0b3da0 0x7fabac167b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:48.300 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:48.294+0000 7fabb19d7700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fabac15dce0 0x7fabac06d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:48.300 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:48.294+0000 7fabb21d8700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fabac0b3da0 0x7fabac167b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.157:56320/0 (socket says 172.21.15.157:56320) 2023-10-16T19:57:48.300 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:48.294+0000 7fabb21d8700 1 -- 172.21.15.157:0/3929839238 learned_addr learned my addr 172.21.15.157:0/3929839238 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:57:48.300 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:48.294+0000 7fabb11d6700 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7fabac0d1a90 0x7fabac0b3690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.157:40378/0 (socket says 172.21.15.157:40378) 2023-10-16T19:57:48.300 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:48.294+0000 7fabb21d8700 1 -- 172.21.15.157:0/3929839238 >> v2:172.21.15.187:3300/0 conn(0x7fabac15dce0 msgr2=0x7fabac06d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:57:48.301 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:48.294+0000 7fabb21d8700 1 --2- 172.21.15.157:0/3929839238 >> v2:172.21.15.187:3300/0 conn(0x7fabac15dce0 0x7fabac06d2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:48.301 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:48.294+0000 7fabb21d8700 1 -- 172.21.15.157:0/3929839238 >> v1:172.21.15.187:6789/0 conn(0x7fabac0d1a90 legacy=0x7fabac0b3690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:48.301 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:48.294+0000 7fabb21d8700 1 -- 172.21.15.157:0/3929839238 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabac0d2230 con 0x7fabac0b3da0 2023-10-16T19:57:48.301 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:48.294+0000 7fabb19d7700 1 --2- 172.21.15.157:0/3929839238 >> v2:172.21.15.187:3300/0 conn(0x7fabac15dce0 0x7fabac06d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T19:57:48.301 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:48.294+0000 7fabb21d8700 1 --2- 172.21.15.157:0/3929839238 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fabac0b3da0 0x7fabac167b10 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7faba4009e50 tx=0x7faba400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=712281a8dc54b225 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:48.302 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:48.294+0000 7fabb09d5700 1 -- 172.21.15.157:0/3929839238 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faba400e070 con 0x7fabac0b3da0 2023-10-16T19:57:48.302 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:48.294+0000 7fabb09d5700 1 -- 172.21.15.157:0/3929839238 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faba400b910 con 0x7fabac0b3da0 2023-10-16T19:57:48.303 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:48.294+0000 7fabb09d5700 1 -- 172.21.15.157:0/3929839238 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faba400bcc0 con 0x7fabac0b3da0 2023-10-16T19:57:48.303 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:48.295+0000 7fabb3c3b700 1 -- 172.21.15.157:0/3929839238 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fabac0b3da0 msgr2=0x7fabac167b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:48.303 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:48.295+0000 7fabb3c3b700 1 --2- 172.21.15.157:0/3929839238 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fabac0b3da0 0x7fabac167b10 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7faba4009e50 tx=0x7faba400b330 comp rx=0 tx=0).stop 2023-10-16T19:57:48.303 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:48.295+0000 7fabb3c3b700 1 -- 172.21.15.157:0/3929839238 shutdown_connections 2023-10-16T19:57:48.304 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:48.295+0000 7fabb3c3b700 1 --2- 172.21.15.157:0/3929839238 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fabac0b3da0 0x7fabac167b10 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:48.304 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:48.295+0000 7fabb3c3b700 1 --2- 172.21.15.157:0/3929839238 >> v2:172.21.15.187:3300/0 conn(0x7fabac15dce0 0x7fabac06d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:48.304 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:48.295+0000 7fabb3c3b700 1 -- 172.21.15.157:0/3929839238 >> 172.21.15.157:0/3929839238 conn(0x7fabac06e300 msgr2=0x7fabac06e6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:48.304 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:48.295+0000 7fabb3c3b700 1 -- 172.21.15.157:0/3929839238 shutdown_connections 2023-10-16T19:57:48.304 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:48.295+0000 7fabb3c3b700 1 -- 172.21.15.157:0/3929839238 wait complete. 2023-10-16T19:57:48.307 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:48.296+0000 7fabb3c3b700 1 Processor -- start 2023-10-16T19:57:48.307 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:48.296+0000 7fabb3c3b700 1 -- start start 2023-10-16T19:57:48.307 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:48.297+0000 7fabb3c3b700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fabac0b3da0 0x7fabac15b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:48.308 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:48.297+0000 7fabb3c3b700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fabac0d1a90 0x7fabac15f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:48.308 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:48.297+0000 7fabb3c3b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fabac15dce0 0x7fabac15fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:48.308 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:48.297+0000 7fabb3c3b700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabac1602b0 con 0x7fabac0d1a90 2023-10-16T19:57:48.308 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:48.297+0000 7fabb3c3b700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabac0b7260 con 0x7fabac15dce0 2023-10-16T19:57:48.308 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:48.297+0000 7fabb3c3b700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabac0b57e0 con 0x7fabac0b3da0 2023-10-16T19:57:48.309 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:48.297+0000 7fabb11d6700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fabac0d1a90 0x7fabac15f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:48.309 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:48.297+0000 7fabb11d6700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fabac0d1a90 0x7fabac15f830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:47018/0 (socket says 172.21.15.157:47018) 2023-10-16T19:57:48.309 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:48.297+0000 7fabb11d6700 1 -- 172.21.15.157:0/2816844897 learned_addr learned my addr 172.21.15.157:0/2816844897 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:57:48.309 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:48.297+0000 7fabb19d7700 1 --2- 172.21.15.157:0/2816844897 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fabac0b3da0 0x7fabac15b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:48.309 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:48.297+0000 7fabb21d8700 1 --2- 172.21.15.157:0/2816844897 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fabac15dce0 0x7fabac15fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:48.310 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:48.298+0000 7fabb11d6700 1 -- 172.21.15.157:0/2816844897 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fabac0b3da0 msgr2=0x7fabac15b6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:48.310 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:48.298+0000 7fabb11d6700 1 --2- 172.21.15.157:0/2816844897 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fabac0b3da0 0x7fabac15b6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:48.310 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:48.298+0000 7fabb11d6700 1 -- 172.21.15.157:0/2816844897 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fabac15dce0 msgr2=0x7fabac15fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:48.310 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:48.298+0000 7fabb11d6700 1 --2- 172.21.15.157:0/2816844897 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fabac15dce0 0x7fabac15fd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:48.310 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:48.298+0000 7fabb11d6700 1 -- 172.21.15.157:0/2816844897 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab9c0094a0 con 0x7fabac0d1a90 2023-10-16T19:57:48.311 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:48.298+0000 7fabb11d6700 1 --2- 172.21.15.157:0/2816844897 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fabac0d1a90 0x7fabac15f830 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7faba800c500 tx=0x7faba800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:48.311 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:48.298+0000 7faba27fc700 1 -- 172.21.15.157:0/2816844897 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faba8005cb0 con 0x7fabac0d1a90 2023-10-16T19:57:48.311 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:48.298+0000 7faba27fc700 1 -- 172.21.15.157:0/2816844897 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faba8005e10 con 0x7fabac0d1a90 2023-10-16T19:57:48.311 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:48.298+0000 7fabb3c3b700 1 -- 172.21.15.157:0/2816844897 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faba4009b30 con 0x7fabac0d1a90 2023-10-16T19:57:48.311 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:48.298+0000 7faba27fc700 1 -- 172.21.15.157:0/2816844897 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faba80072f0 con 0x7fabac0d1a90 2023-10-16T19:57:48.311 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:48.298+0000 7fabb3c3b700 1 -- 172.21.15.157:0/2816844897 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabac15bc20 con 0x7fabac0d1a90 2023-10-16T19:57:48.312 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:48.299+0000 7fabb3c3b700 1 -- 172.21.15.157:0/2816844897 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabac0b5fe0 con 0x7fabac0d1a90 2023-10-16T19:57:48.312 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:48.299+0000 7faba27fc700 1 -- 172.21.15.157:0/2816844897 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7faba8007450 con 0x7fabac0d1a90 2023-10-16T19:57:48.312 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:48.300+0000 7faba27fc700 1 --2- 172.21.15.157:0/2816844897 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fab9006af00 0x7fab9006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:48.312 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:48.300+0000 7faba27fc700 1 -- 172.21.15.157:0/2816844897 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7faba8088b10 con 0x7fabac0d1a90 2023-10-16T19:57:48.313 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:48.300+0000 7fabb19d7700 1 --2- 172.21.15.157:0/2816844897 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fab9006af00 0x7fab9006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:48.313 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:48.300+0000 7fabb19d7700 1 --2- 172.21.15.157:0/2816844897 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fab9006af00 0x7fab9006d3c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fab9c009c60 tx=0x7fab9c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:48.313 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:48.304+0000 7faba27fc700 1 -- 172.21.15.157:0/2816844897 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fabac0b5fe0 con 0x7fabac0d1a90 2023-10-16T19:57:48.515 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:48.511+0000 7fabb3c3b700 1 -- 172.21.15.157:0/2816844897 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fabac0b5d00 con 0x7fabac0d1a90 2023-10-16T19:57:48.515 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:48.511+0000 7faba27fc700 1 -- 172.21.15.157:0/2816844897 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) v1 ==== 80+0+0 (secure 0 0 0) 0x7fabac0b5d00 con 0x7fabac0d1a90 2023-10-16T19:57:48.517 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:48.513+0000 7fabb3c3b700 1 -- 172.21.15.157:0/2816844897 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fab9006af00 msgr2=0x7fab9006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:48.518 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:48.514+0000 7fabb3c3b700 1 --2- 172.21.15.157:0/2816844897 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fab9006af00 0x7fab9006d3c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fab9c009c60 tx=0x7fab9c008040 comp rx=0 tx=0).stop 2023-10-16T19:57:48.518 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:48.514+0000 7fabb3c3b700 1 -- 172.21.15.157:0/2816844897 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fabac0d1a90 msgr2=0x7fabac15f830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:48.518 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:48.514+0000 7fabb3c3b700 1 --2- 172.21.15.157:0/2816844897 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fabac0d1a90 0x7fabac15f830 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7faba800c500 tx=0x7faba800c8c0 comp rx=0 tx=0).stop 2023-10-16T19:57:48.518 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:48.514+0000 7fabb3c3b700 1 -- 172.21.15.157:0/2816844897 shutdown_connections 2023-10-16T19:57:48.519 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:48.514+0000 7fabb3c3b700 1 --2- 172.21.15.157:0/2816844897 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fab9006af00 0x7fab9006d3c0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:48.519 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:48.514+0000 7fabb3c3b700 1 --2- 172.21.15.157:0/2816844897 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fabac15dce0 0x7fabac15fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:48.519 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:48.514+0000 7fabb3c3b700 1 --2- 172.21.15.157:0/2816844897 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fabac0b3da0 0x7fabac15b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:48.519 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:48.514+0000 7fabb3c3b700 1 --2- 172.21.15.157:0/2816844897 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fabac0d1a90 0x7fabac15f830 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:48.519 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:48.514+0000 7fabb3c3b700 1 -- 172.21.15.157:0/2816844897 >> 172.21.15.157:0/2816844897 conn(0x7fabac06e300 msgr2=0x7fabac0b1880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:48.520 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:48.514+0000 7fabb3c3b700 1 -- 172.21.15.157:0/2816844897 shutdown_connections 2023-10-16T19:57:48.520 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:48.514+0000 7fabb3c3b700 1 -- 172.21.15.157:0/2816844897 wait complete. 2023-10-16T19:57:48.520 INFO:teuthology.orchestra.run.smithi157.stderr:listed 0 entries 2023-10-16T19:57:48.529 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2023-10-16T19:57:48.530 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T19:57:48.530 DEBUG:teuthology.orchestra.run.smithi157:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2023-10-16T19:57:48.582 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi157.front.sepia.ceph.com 2023-10-16T19:57:48.582 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T19:57:48.583 DEBUG:teuthology.orchestra.run.smithi157:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-10-16T19:57:48.600 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-10-16T19:57:48.601 DEBUG:teuthology.orchestra.run.smithi187:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T19:57:48.622 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-10-16T19:57:48.623 DEBUG:teuthology.orchestra.run.smithi187:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T19:57:48.683 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-10-16T19:57:48.684 DEBUG:teuthology.orchestra.run.smithi187:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T19:57:48.743 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T19:57:48.865 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:48.861+0000 7f55e434e700 1 Processor -- start 2023-10-16T19:57:48.865 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:48.861+0000 7f55e434e700 1 -- start start 2023-10-16T19:57:48.873 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:48.862+0000 7f55e434e700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f55dc15e2f0 0x7f55dc06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:48.873 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:48.862+0000 7f55e434e700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f55dc06af60 0x7f55dc0ce910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:48.874 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:48.862+0000 7f55e434e700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55dc0d08b0 con 0x7f55dc06de00 2023-10-16T19:57:48.874 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:48.862+0000 7f55e434e700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55dc1628f0 con 0x7f55dc15e2f0 2023-10-16T19:57:48.874 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:48.862+0000 7f55e434e700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55dc162bd0 con 0x7f55dc06af60 2023-10-16T19:57:48.875 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:48.863+0000 7f55e20ea700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f55dc15e2f0 0x7f55dc06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:48.875 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:48.863+0000 7f55e20ea700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f55dc15e2f0 0x7f55dc06d0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:47024/0 (socket says 172.21.15.157:47024) 2023-10-16T19:57:48.875 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:48.863+0000 7f55e20ea700 1 -- 172.21.15.157:0/2282854017 learned_addr learned my addr 172.21.15.157:0/2282854017 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:57:48.875 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:48.863+0000 7f55e20ea700 1 -- 172.21.15.157:0/2282854017 >> v2:172.21.15.187:3300/0 conn(0x7f55dc06af60 msgr2=0x7f55dc0ce910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:57:48.876 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:48.863+0000 7f55e28eb700 1 --2- 172.21.15.157:0/2282854017 >> v2:172.21.15.187:3300/0 conn(0x7f55dc06af60 0x7f55dc0ce910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:48.876 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:48.863+0000 7f55e20ea700 1 --2- 172.21.15.157:0/2282854017 >> v2:172.21.15.187:3300/0 conn(0x7f55dc06af60 0x7f55dc0ce910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:48.876 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:48.863+0000 7f55e20ea700 1 -- 172.21.15.157:0/2282854017 >> v1:172.21.15.187:6789/0 conn(0x7f55dc06de00 legacy=0x7f55dc06a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:57:48.877 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:48.863+0000 7f55e20ea700 1 -- 172.21.15.157:0/2282854017 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55dc0d05d0 con 0x7f55dc15e2f0 2023-10-16T19:57:48.877 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:48.863+0000 7f55e20ea700 1 --2- 172.21.15.157:0/2282854017 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f55dc15e2f0 0x7f55dc06d0f0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f55dc06fbf0 tx=0x7f55cc009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccfbe62227974e94 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:48.877 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:48.863+0000 7f55e10e8700 1 -- 172.21.15.157:0/2282854017 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55cc004230 con 0x7f55dc15e2f0 2023-10-16T19:57:48.877 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:48.863+0000 7f55e10e8700 1 -- 172.21.15.157:0/2282854017 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55cc004390 con 0x7f55dc15e2f0 2023-10-16T19:57:48.877 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:48.863+0000 7f55e10e8700 1 -- 172.21.15.157:0/2282854017 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55cc0036a0 con 0x7f55dc15e2f0 2023-10-16T19:57:48.878 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:48.864+0000 7f55e434e700 1 -- 172.21.15.157:0/2282854017 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f55dc15e2f0 msgr2=0x7f55dc06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:48.878 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:48.864+0000 7f55e434e700 1 --2- 172.21.15.157:0/2282854017 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f55dc15e2f0 0x7f55dc06d0f0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f55dc06fbf0 tx=0x7f55cc009bd0 comp rx=0 tx=0).stop 2023-10-16T19:57:48.878 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:48.864+0000 7f55e434e700 1 -- 172.21.15.157:0/2282854017 shutdown_connections 2023-10-16T19:57:48.878 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:48.864+0000 7f55e434e700 1 --2- 172.21.15.157:0/2282854017 >> v2:172.21.15.187:3300/0 conn(0x7f55dc06af60 0x7f55dc0ce910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:48.878 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:48.864+0000 7f55e434e700 1 --2- 172.21.15.157:0/2282854017 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f55dc15e2f0 0x7f55dc06d0f0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:48.879 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:48.864+0000 7f55e434e700 1 -- 172.21.15.157:0/2282854017 >> 172.21.15.157:0/2282854017 conn(0x7f55dc0cd4e0 msgr2=0x7f55dc0cd8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:48.879 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:48.864+0000 7f55e434e700 1 -- 172.21.15.157:0/2282854017 shutdown_connections 2023-10-16T19:57:48.879 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:48.864+0000 7f55e434e700 1 -- 172.21.15.157:0/2282854017 wait complete. 2023-10-16T19:57:48.879 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:48.866+0000 7f55e434e700 1 Processor -- start 2023-10-16T19:57:48.879 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:48.866+0000 7f55e434e700 1 -- start start 2023-10-16T19:57:48.880 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:48.867+0000 7f55e434e700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f55dc06af60 0x7f55dc1f3520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:48.880 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:48.867+0000 7f55e434e700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f55dc06de00 0x7f55dc158190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:48.880 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:48.867+0000 7f55e434e700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f55dc15e2f0 0x7f55dc0b5ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:48.880 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:48.867+0000 7f55e434e700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55dc0b3e30 con 0x7f55dc06af60 2023-10-16T19:57:48.880 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:48.867+0000 7f55e434e700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55dc154a10 con 0x7f55dc06de00 2023-10-16T19:57:48.880 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:48.867+0000 7f55e434e700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55dc0c5cd0 con 0x7f55dc15e2f0 2023-10-16T19:57:48.881 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:48.867+0000 7f55e20ea700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f55dc06af60 0x7f55dc1f3520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:48.881 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:48.867+0000 7f55e20ea700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f55dc06af60 0x7f55dc1f3520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:47030/0 (socket says 172.21.15.157:47030) 2023-10-16T19:57:48.881 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:48.867+0000 7f55e20ea700 1 -- 172.21.15.157:0/1038217382 learned_addr learned my addr 172.21.15.157:0/1038217382 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:57:48.881 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:48.867+0000 7f55e18e9700 1 --2- 172.21.15.157:0/1038217382 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f55dc06de00 0x7f55dc158190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:48.882 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:48.867+0000 7f55e28eb700 1 --2- 172.21.15.157:0/1038217382 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f55dc15e2f0 0x7f55dc0b5ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:48.882 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:48.867+0000 7f55e20ea700 1 -- 172.21.15.157:0/1038217382 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f55dc15e2f0 msgr2=0x7f55dc0b5ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:48.882 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:48.867+0000 7f55e20ea700 1 --2- 172.21.15.157:0/1038217382 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f55dc15e2f0 0x7f55dc0b5ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:48.882 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:48.867+0000 7f55e20ea700 1 -- 172.21.15.157:0/1038217382 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f55dc06de00 msgr2=0x7f55dc158190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:48.883 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:48.867+0000 7f55e20ea700 1 --2- 172.21.15.157:0/1038217382 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f55dc06de00 0x7f55dc158190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:48.883 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:48.867+0000 7f55e20ea700 1 -- 172.21.15.157:0/1038217382 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55cc009550 con 0x7f55dc06af60 2023-10-16T19:57:48.883 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:48.867+0000 7f55e20ea700 1 --2- 172.21.15.157:0/1038217382 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f55dc06af60 0x7f55dc1f3520 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f55dc06c940 tx=0x7f55cc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:48.883 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:48.867+0000 7f55d2ffd700 1 -- 172.21.15.157:0/1038217382 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55cc011630 con 0x7f55dc06af60 2023-10-16T19:57:48.883 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:48.867+0000 7f55d2ffd700 1 -- 172.21.15.157:0/1038217382 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55cc011790 con 0x7f55dc06af60 2023-10-16T19:57:48.884 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:48.867+0000 7f55e434e700 1 -- 172.21.15.157:0/1038217382 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55dc0b3770 con 0x7f55dc06af60 2023-10-16T19:57:48.884 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:48.867+0000 7f55d2ffd700 1 -- 172.21.15.157:0/1038217382 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55cc011b40 con 0x7f55dc06af60 2023-10-16T19:57:48.884 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:48.867+0000 7f55e434e700 1 -- 172.21.15.157:0/1038217382 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55dc0c5fb0 con 0x7f55dc06af60 2023-10-16T19:57:48.884 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:48.868+0000 7f55e434e700 1 -- 172.21.15.157:0/1038217382 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55dc04f400 con 0x7f55dc06af60 2023-10-16T19:57:48.884 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:48.868+0000 7f55d2ffd700 1 -- 172.21.15.157:0/1038217382 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f55cc011ca0 con 0x7f55dc06af60 2023-10-16T19:57:48.885 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:48.868+0000 7f55d2ffd700 1 --2- 172.21.15.157:0/1038217382 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f55c006af00 0x7f55c006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:48.885 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:48.868+0000 7f55d2ffd700 1 -- 172.21.15.157:0/1038217382 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f55cc08ac60 con 0x7f55dc06af60 2023-10-16T19:57:48.885 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:48.869+0000 7f55e18e9700 1 --2- 172.21.15.157:0/1038217382 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f55c006af00 0x7f55c006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:48.885 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:48.869+0000 7f55e18e9700 1 --2- 172.21.15.157:0/1038217382 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f55c006af00 0x7f55c006d3c0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f55dc0cd180 tx=0x7f55d8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:48.886 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:48.873+0000 7f55d2ffd700 1 -- 172.21.15.157:0/1038217382 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f55cc055da0 con 0x7f55dc06af60 2023-10-16T19:57:49.069 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.065+0000 7f55e434e700 1 -- 172.21.15.157:0/1038217382 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f55dc06b650 con 0x7f55dc06af60 2023-10-16T19:57:49.070 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.066+0000 7f55d2ffd700 1 -- 172.21.15.157:0/1038217382 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16517 (secure 0 0 0) 0x7f55cc010380 con 0x7f55dc06af60 2023-10-16T19:57:49.070 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-10-16T19:57:49.071 INFO:teuthology.orchestra.run.smithi157.stdout:{"epoch":21,"fsid":"28199dc9-64d5-479e-83c6-21f097c33d39","created":"2023-10-16T19:56:49.201889+0000","modified":"2023-10-16T19:57:07.988567+0000","last_up_change":"2023-10-16T19:56:54.675673+0000","last_in_change":"2023-10-16T19:56:51.666728+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T19:56:56.932895+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-16T19:57:04.936105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-16T19:57:05.335279+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":335785898},{"type":"v1","addr":"172.21.15.157:6809","nonce":335785898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":335785898},{"type":"v1","addr":"172.21.15.157:6811","nonce":335785898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6815","nonce":335785898},{"type":"v1","addr":"172.21.15.157:6817","nonce":335785898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":335785898},{"type":"v1","addr":"172.21.15.157:6813","nonce":335785898}]},"public_addr":"172.21.15.157:6809/335785898","cluster_addr":"172.21.15.157:6811/335785898","heartbeat_back_addr":"172.21.15.157:6817/335785898","heartbeat_front_addr":"172.21.15.157:6813/335785898","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":3482825047},{"type":"v1","addr":"172.21.15.157:6801","nonce":3482825047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":3482825047},{"type":"v1","addr":"172.21.15.157:6803","nonce":3482825047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":3482825047},{"type":"v1","addr":"172.21.15.157:6807","nonce":3482825047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":3482825047},{"type":"v1","addr":"172.21.15.157:6805","nonce":3482825047}]},"public_addr":"172.21.15.157:6801/3482825047","cluster_addr":"172.21.15.157:6803/3482825047","heartbeat_back_addr":"172.21.15.157:6807/3482825047","heartbeat_front_addr":"172.21.15.157:6805/3482825047","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":1118292389},{"type":"v1","addr":"172.21.15.157:6825","nonce":1118292389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":1118292389},{"type":"v1","addr":"172.21.15.157:6827","nonce":1118292389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":1118292389},{"type":"v1","addr":"172.21.15.157:6831","nonce":1118292389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":1118292389},{"type":"v1","addr":"172.21.15.157:6829","nonce":1118292389}]},"public_addr":"172.21.15.157:6825/1118292389","cluster_addr":"172.21.15.157:6827/1118292389","heartbeat_back_addr":"172.21.15.157:6831/1118292389","heartbeat_front_addr":"172.21.15.157:6829/1118292389","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":989329821},{"type":"v1","addr":"172.21.15.157:6816","nonce":989329821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":989329821},{"type":"v1","addr":"172.21.15.157:6819","nonce":989329821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":989329821},{"type":"v1","addr":"172.21.15.157:6823","nonce":989329821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":989329821},{"type":"v1","addr":"172.21.15.157:6821","nonce":989329821}]},"public_addr":"172.21.15.157:6816/989329821","cluster_addr":"172.21.15.157:6819/989329821","heartbeat_back_addr":"172.21.15.157:6823/989329821","heartbeat_front_addr":"172.21.15.157:6821/989329821","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":3841016811},{"type":"v1","addr":"172.21.15.187:6801","nonce":3841016811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6803","nonce":3841016811},{"type":"v1","addr":"172.21.15.187:6804","nonce":3841016811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6809","nonce":3841016811},{"type":"v1","addr":"172.21.15.187:6811","nonce":3841016811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":3841016811},{"type":"v1","addr":"172.21.15.187:6808","nonce":3841016811}]},"public_addr":"172.21.15.187:6801/3841016811","cluster_addr":"172.21.15.187:6804/3841016811","heartbeat_back_addr":"172.21.15.187:6811/3841016811","heartbeat_front_addr":"172.21.15.187:6808/3841016811","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":915130263},{"type":"v1","addr":"172.21.15.187:6805","nonce":915130263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6807","nonce":915130263},{"type":"v1","addr":"172.21.15.187:6810","nonce":915130263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":915130263},{"type":"v1","addr":"172.21.15.187:6815","nonce":915130263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":915130263},{"type":"v1","addr":"172.21.15.187:6813","nonce":915130263}]},"public_addr":"172.21.15.187:6805/915130263","cluster_addr":"172.21.15.187:6810/915130263","heartbeat_back_addr":"172.21.15.187:6815/915130263","heartbeat_front_addr":"172.21.15.187:6813/915130263","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":654976824},{"type":"v1","addr":"172.21.15.187:6817","nonce":654976824}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":654976824},{"type":"v1","addr":"172.21.15.187:6819","nonce":654976824}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":654976824},{"type":"v1","addr":"172.21.15.187:6823","nonce":654976824}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":654976824},{"type":"v1","addr":"172.21.15.187:6821","nonce":654976824}]},"public_addr":"172.21.15.187:6817/654976824","cluster_addr":"172.21.15.187:6819/654976824","heartbeat_back_addr":"172.21.15.187:6823/654976824","heartbeat_front_addr":"172.21.15.187:6821/654976824","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":4284059445},{"type":"v1","addr":"172.21.15.187:6825","nonce":4284059445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":4284059445},{"type":"v1","addr":"172.21.15.187:6827","nonce":4284059445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":4284059445},{"type":"v1","addr":"172.21.15.187:6831","nonce":4284059445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":4284059445},{"type":"v1","addr":"172.21.15.187:6829","nonce":4284059445}]},"public_addr":"172.21.15.187:6825/4284059445","cluster_addr":"172.21.15.187:6827/4284059445","heartbeat_back_addr":"172.21.15.187:6831/4284059445","heartbeat_front_addr":"172.21.15.187:6829/4284059445","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.819780+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.824193+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.849575+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.824806+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.809540+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.805093+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.866109+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.807372+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T19:57:49.072 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.068+0000 7f55e434e700 1 -- 172.21.15.157:0/1038217382 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f55c006af00 msgr2=0x7f55c006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:49.072 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.068+0000 7f55e434e700 1 --2- 172.21.15.157:0/1038217382 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f55c006af00 0x7f55c006d3c0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f55dc0cd180 tx=0x7f55d8008040 comp rx=0 tx=0).stop 2023-10-16T19:57:49.073 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.068+0000 7f55e434e700 1 -- 172.21.15.157:0/1038217382 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f55dc06af60 msgr2=0x7f55dc1f3520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:49.073 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.068+0000 7f55e434e700 1 --2- 172.21.15.157:0/1038217382 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f55dc06af60 0x7f55dc1f3520 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f55dc06c940 tx=0x7f55cc004750 comp rx=0 tx=0).stop 2023-10-16T19:57:49.073 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.069+0000 7f55e434e700 1 -- 172.21.15.157:0/1038217382 shutdown_connections 2023-10-16T19:57:49.074 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.069+0000 7f55e434e700 1 --2- 172.21.15.157:0/1038217382 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f55dc15e2f0 0x7f55dc0b5ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:49.075 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.069+0000 7f55e434e700 1 --2- 172.21.15.157:0/1038217382 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f55dc06af60 0x7f55dc1f3520 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:49.075 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.069+0000 7f55e434e700 1 --2- 172.21.15.157:0/1038217382 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f55c006af00 0x7f55c006d3c0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:49.075 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.069+0000 7f55e434e700 1 --2- 172.21.15.157:0/1038217382 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f55dc06de00 0x7f55dc158190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:49.075 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.069+0000 7f55e434e700 1 -- 172.21.15.157:0/1038217382 >> 172.21.15.157:0/1038217382 conn(0x7f55dc0cd4e0 msgr2=0x7f55dc0cd8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:49.075 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.069+0000 7f55e434e700 1 -- 172.21.15.157:0/1038217382 shutdown_connections 2023-10-16T19:57:49.076 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.069+0000 7f55e434e700 1 -- 172.21.15.157:0/1038217382 wait complete. 2023-10-16T19:57:49.084 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-16T19:56:56.932895+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-16T19:57:04.936105+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-16T19:57:05.335279+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-16T19:57:49.085 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-16T19:57:49.211 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.207+0000 7f9d0de64700 1 Processor -- start 2023-10-16T19:57:49.211 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.207+0000 7f9d0de64700 1 -- start start 2023-10-16T19:57:49.213 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.208+0000 7f9d0de64700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f9d08143bd0 0x7f9d080cef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:49.213 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.208+0000 7f9d0de64700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9d080b2e20 0x7f9d08071080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:49.214 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.208+0000 7f9d0de64700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d0806e180 con 0x7f9d080cf4c0 2023-10-16T19:57:49.214 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.208+0000 7f9d0de64700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d08143fb0 con 0x7f9d08143bd0 2023-10-16T19:57:49.214 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.208+0000 7f9d0de64700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d08144480 con 0x7f9d080b2e20 2023-10-16T19:57:49.214 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.208+0000 7f9d077fe700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f9d08143bd0 0x7f9d080cef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:49.215 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.208+0000 7f9cfeffd700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f9d080cf4c0 0x7f9d080b2710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:56710/0 (socket says 172.21.15.157:56710) 2023-10-16T19:57:49.215 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.208+0000 7f9d077fe700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f9d08143bd0 0x7f9d080cef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:47038/0 (socket says 172.21.15.157:47038) 2023-10-16T19:57:49.215 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.208+0000 7f9cfeffd700 1 -- 172.21.15.157:0/1419382110 learned_addr learned my addr 172.21.15.157:0/1419382110 (peer_addr_for_me v1:172.21.15.157:0/0) 2023-10-16T19:57:49.215 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.208+0000 7f9d077fe700 1 -- 172.21.15.157:0/1419382110 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9d080b2e20 msgr2=0x7f9d08071080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:57:49.216 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.208+0000 7f9d077fe700 1 --2- 172.21.15.157:0/1419382110 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9d080b2e20 0x7f9d08071080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:49.216 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.208+0000 7f9d077fe700 1 -- 172.21.15.157:0/1419382110 >> v1:172.21.15.157:6789/0 conn(0x7f9d080cf4c0 legacy=0x7f9d080b2710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:49.216 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.208+0000 7f9d077fe700 1 -- 172.21.15.157:0/1419382110 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d08071c60 con 0x7f9d08143bd0 2023-10-16T19:57:49.216 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.208+0000 7f9d06ffd700 1 -- 172.21.15.157:0/1419382110 <== mon.0 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 63492020 0 0) 0x7f9d0806e180 con 0x7f9d080cf4c0 2023-10-16T19:57:49.216 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.209+0000 7f9d077fe700 1 --2- 172.21.15.157:0/1419382110 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9d08143bd0 0x7f9d080cef80 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f9cf8009840 tx=0x7f9cf8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9deb6ceb9eccadc0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:49.217 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.209+0000 7f9d06ffd700 1 -- 172.21.15.157:0/1419382110 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cf8011830 con 0x7f9d08143bd0 2023-10-16T19:57:49.217 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.209+0000 7f9d06ffd700 1 -- 172.21.15.157:0/1419382110 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cf8011990 con 0x7f9d08143bd0 2023-10-16T19:57:49.217 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.209+0000 7f9d06ffd700 1 -- 172.21.15.157:0/1419382110 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cf8011d20 con 0x7f9d08143bd0 2023-10-16T19:57:49.217 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.209+0000 7f9d0de64700 1 -- 172.21.15.157:0/1419382110 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9d08143bd0 msgr2=0x7f9d080cef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:49.217 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.209+0000 7f9d0de64700 1 --2- 172.21.15.157:0/1419382110 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9d08143bd0 0x7f9d080cef80 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f9cf8009840 tx=0x7f9cf8009b50 comp rx=0 tx=0).stop 2023-10-16T19:57:49.218 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.209+0000 7f9d0de64700 1 -- 172.21.15.157:0/1419382110 shutdown_connections 2023-10-16T19:57:49.218 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.209+0000 7f9d0de64700 1 --2- 172.21.15.157:0/1419382110 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9d080b2e20 0x7f9d08071080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:49.218 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.209+0000 7f9d0de64700 1 --2- 172.21.15.157:0/1419382110 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9d08143bd0 0x7f9d080cef80 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:49.218 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.209+0000 7f9d0de64700 1 -- 172.21.15.157:0/1419382110 >> 172.21.15.157:0/1419382110 conn(0x7f9d080d0b30 msgr2=0x7f9d080d0f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:49.218 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.209+0000 7f9d0de64700 1 -- 172.21.15.157:0/1419382110 shutdown_connections 2023-10-16T19:57:49.219 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.209+0000 7f9d0de64700 1 -- 172.21.15.157:0/1419382110 wait complete. 2023-10-16T19:57:49.221 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.211+0000 7f9d0de64700 1 Processor -- start 2023-10-16T19:57:49.221 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.211+0000 7f9d0de64700 1 -- start start 2023-10-16T19:57:49.222 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.213+0000 7f9d0de64700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9d080b2e20 0x7f9d08155d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:49.222 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.213+0000 7f9d0de64700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9d080cf4c0 0x7f9d0806a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:49.222 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.213+0000 7f9d0de64700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9d08143bd0 0x7f9d0806ad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:49.222 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.213+0000 7f9d0de64700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d081f16c0 con 0x7f9d080cf4c0 2023-10-16T19:57:49.222 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.213+0000 7f9d0de64700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d081f2b70 con 0x7f9d080b2e20 2023-10-16T19:57:49.223 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.213+0000 7f9d0de64700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d081f57a0 con 0x7f9d08143bd0 2023-10-16T19:57:49.223 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.213+0000 7f9cfeffd700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9d080cf4c0 0x7f9d0806a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:49.223 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.213+0000 7f9cfeffd700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9d080cf4c0 0x7f9d0806a850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:47046/0 (socket says 172.21.15.157:47046) 2023-10-16T19:57:49.223 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.213+0000 7f9cfeffd700 1 -- 172.21.15.157:0/4221827412 learned_addr learned my addr 172.21.15.157:0/4221827412 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:57:49.223 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.213+0000 7f9d077fe700 1 --2- 172.21.15.157:0/4221827412 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9d080b2e20 0x7f9d08155d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:49.224 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.213+0000 7f9d07fff700 1 --2- 172.21.15.157:0/4221827412 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9d08143bd0 0x7f9d0806ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:49.224 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.213+0000 7f9cfeffd700 1 -- 172.21.15.157:0/4221827412 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9d08143bd0 msgr2=0x7f9d0806ad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:49.224 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.213+0000 7f9cfeffd700 1 --2- 172.21.15.157:0/4221827412 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9d08143bd0 0x7f9d0806ad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:49.224 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.213+0000 7f9cfeffd700 1 -- 172.21.15.157:0/4221827412 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9d080b2e20 msgr2=0x7f9d08155d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:49.224 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.213+0000 7f9cfeffd700 1 --2- 172.21.15.157:0/4221827412 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9d080b2e20 0x7f9d08155d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:49.225 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.213+0000 7f9cfeffd700 1 -- 172.21.15.157:0/4221827412 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cf80094a0 con 0x7f9d080cf4c0 2023-10-16T19:57:49.225 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.213+0000 7f9d07fff700 1 --2- 172.21.15.157:0/4221827412 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9d08143bd0 0x7f9d0806ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T19:57:49.225 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.213+0000 7f9cfeffd700 1 --2- 172.21.15.157:0/4221827412 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9d080cf4c0 0x7f9d0806a850 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f9cf000c580 tx=0x7f9cf000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:49.225 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.213+0000 7f9d04ff9700 1 -- 172.21.15.157:0/4221827412 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cf0004c80 con 0x7f9d080cf4c0 2023-10-16T19:57:49.225 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.213+0000 7f9d04ff9700 1 -- 172.21.15.157:0/4221827412 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cf0004e00 con 0x7f9d080cf4c0 2023-10-16T19:57:49.226 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.213+0000 7f9d0de64700 1 -- 172.21.15.157:0/4221827412 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d08156260 con 0x7f9d080cf4c0 2023-10-16T19:57:49.226 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.213+0000 7f9d04ff9700 1 -- 172.21.15.157:0/4221827412 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cf0007310 con 0x7f9d080cf4c0 2023-10-16T19:57:49.226 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.213+0000 7f9d0de64700 1 -- 172.21.15.157:0/4221827412 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d081f2520 con 0x7f9d080cf4c0 2023-10-16T19:57:49.226 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.214+0000 7f9d0de64700 1 -- 172.21.15.157:0/4221827412 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d0804f400 con 0x7f9d080cf4c0 2023-10-16T19:57:49.226 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.214+0000 7f9d04ff9700 1 -- 172.21.15.157:0/4221827412 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f9cf0007470 con 0x7f9d080cf4c0 2023-10-16T19:57:49.227 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.214+0000 7f9d04ff9700 1 --2- 172.21.15.157:0/4221827412 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f9ce806af00 0x7f9ce806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:49.227 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.215+0000 7f9d04ff9700 1 -- 172.21.15.157:0/4221827412 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9cf0089330 con 0x7f9d080cf4c0 2023-10-16T19:57:49.227 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.215+0000 7f9d077fe700 1 --2- 172.21.15.157:0/4221827412 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f9ce806af00 0x7f9ce806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:49.227 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.215+0000 7f9d077fe700 1 --2- 172.21.15.157:0/4221827412 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f9ce806af00 0x7f9ce806d3c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f9cf8000c00 tx=0x7f9cf8008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:49.229 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.219+0000 7f9d04ff9700 1 -- 172.21.15.157:0/4221827412 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9cf0054340 con 0x7f9d080cf4c0 2023-10-16T19:57:49.409 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.407+0000 7f9d0de64700 1 -- 172.21.15.157:0/4221827412 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9d081f2cb0 con 0x7f9d080cf4c0 2023-10-16T19:57:49.410 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.407+0000 7f9d04ff9700 1 -- 172.21.15.157:0/4221827412 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9cf0057960 con 0x7f9d080cf4c0 2023-10-16T19:57:49.410 INFO:teuthology.orchestra.run.smithi157.stdout:pg_num: 1 2023-10-16T19:57:49.412 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.409+0000 7f9d0de64700 1 -- 172.21.15.157:0/4221827412 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f9ce806af00 msgr2=0x7f9ce806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:49.412 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.409+0000 7f9d0de64700 1 --2- 172.21.15.157:0/4221827412 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f9ce806af00 0x7f9ce806d3c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f9cf8000c00 tx=0x7f9cf8008030 comp rx=0 tx=0).stop 2023-10-16T19:57:49.412 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.409+0000 7f9d0de64700 1 -- 172.21.15.157:0/4221827412 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9d080cf4c0 msgr2=0x7f9d0806a850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:49.413 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.409+0000 7f9d0de64700 1 --2- 172.21.15.157:0/4221827412 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9d080cf4c0 0x7f9d0806a850 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f9cf000c580 tx=0x7f9cf000c890 comp rx=0 tx=0).stop 2023-10-16T19:57:49.413 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.409+0000 7f9d0de64700 1 -- 172.21.15.157:0/4221827412 shutdown_connections 2023-10-16T19:57:49.413 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.409+0000 7f9d0de64700 1 --2- 172.21.15.157:0/4221827412 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f9ce806af00 0x7f9ce806d3c0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:49.413 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.409+0000 7f9d0de64700 1 --2- 172.21.15.157:0/4221827412 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9d080b2e20 0x7f9d08155d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:49.413 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.409+0000 7f9d0de64700 1 --2- 172.21.15.157:0/4221827412 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9d08143bd0 0x7f9d0806ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:49.414 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.409+0000 7f9d0de64700 1 --2- 172.21.15.157:0/4221827412 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9d080cf4c0 0x7f9d0806a850 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:49.414 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.409+0000 7f9d0de64700 1 -- 172.21.15.157:0/4221827412 >> 172.21.15.157:0/4221827412 conn(0x7f9d080d0b30 msgr2=0x7f9d080cd590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:49.414 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.409+0000 7f9d0de64700 1 -- 172.21.15.157:0/4221827412 shutdown_connections 2023-10-16T19:57:49.414 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.410+0000 7f9d0de64700 1 -- 172.21.15.157:0/4221827412 wait complete. 2023-10-16T19:57:49.424 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-16T19:57:49.548 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.546+0000 7fedbd668700 1 Processor -- start 2023-10-16T19:57:49.549 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.546+0000 7fedbd668700 1 -- start start 2023-10-16T19:57:49.551 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.547+0000 7fedbd668700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fedb815b900 0x7fedb815ef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:49.551 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.547+0000 7fedbd668700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedb806dc60 con 0x7fedb806af60 2023-10-16T19:57:49.551 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.547+0000 7fedbd668700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedb806df40 con 0x7fedb806d210 2023-10-16T19:57:49.551 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.547+0000 7fedbd668700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedb815e780 con 0x7fedb815b900 2023-10-16T19:57:49.552 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.547+0000 7fedb77fe700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7fedb806af60 0x7fedb8161a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:56728/0 (socket says 172.21.15.157:56728) 2023-10-16T19:57:49.552 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.547+0000 7fedb77fe700 1 -- 172.21.15.157:0/2415044859 learned_addr learned my addr 172.21.15.157:0/2415044859 (peer_addr_for_me v1:172.21.15.157:0/0) 2023-10-16T19:57:49.552 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.547+0000 7fedb6ffd700 1 --2- 172.21.15.157:0/2415044859 >> v2:172.21.15.187:3300/0 conn(0x7fedb815b900 0x7fedb815ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:49.552 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.547+0000 7fedb5ffb700 1 -- 172.21.15.157:0/2415044859 <== mon.0 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 389492249 0 0) 0x7fedb806dc60 con 0x7fedb806af60 2023-10-16T19:57:49.552 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.547+0000 7fedb5ffb700 1 -- 172.21.15.157:0/2415044859 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feda00035b0 con 0x7fedb806af60 2023-10-16T19:57:49.553 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.547+0000 7fedb6ffd700 1 -- 172.21.15.157:0/2415044859 >> v1:172.21.15.187:6789/0 conn(0x7fedb806d210 legacy=0x7fedb806a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:49.553 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.547+0000 7fedb6ffd700 1 -- 172.21.15.157:0/2415044859 >> v1:172.21.15.157:6789/0 conn(0x7fedb806af60 legacy=0x7fedb8161a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:49.553 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.547+0000 7fedb5ffb700 1 -- 172.21.15.157:0/2415044859 <== mon.0 v1:172.21.15.157:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2119998655 0 0) 0x7feda00035b0 con 0x7fedb806af60 2023-10-16T19:57:49.553 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.547+0000 7fedb6ffd700 1 -- 172.21.15.157:0/2415044859 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedb815ea60 con 0x7fedb815b900 2023-10-16T19:57:49.554 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.548+0000 7fedb6ffd700 1 --2- 172.21.15.157:0/2415044859 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fedb815b900 0x7fedb815ef80 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7feda8009840 tx=0x7feda8009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2dc257c32d16d99a server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:49.554 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.548+0000 7fedb5ffb700 1 -- 172.21.15.157:0/2415044859 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedb00019f0 con 0x7fedb815b900 2023-10-16T19:57:49.554 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.548+0000 7fedb5ffb700 1 -- 172.21.15.157:0/2415044859 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feda8004030 con 0x7fedb815b900 2023-10-16T19:57:49.554 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.548+0000 7fedb5ffb700 1 -- 172.21.15.157:0/2415044859 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feda80043c0 con 0x7fedb815b900 2023-10-16T19:57:49.555 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.548+0000 7fedbd668700 1 -- 172.21.15.157:0/2415044859 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fedb815b900 msgr2=0x7fedb815ef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:49.555 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.548+0000 7fedbd668700 1 --2- 172.21.15.157:0/2415044859 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fedb815b900 0x7fedb815ef80 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7feda8009840 tx=0x7feda8009b50 comp rx=0 tx=0).stop 2023-10-16T19:57:49.555 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.548+0000 7fedbd668700 1 -- 172.21.15.157:0/2415044859 shutdown_connections 2023-10-16T19:57:49.555 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.548+0000 7fedbd668700 1 --2- 172.21.15.157:0/2415044859 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fedb815b900 0x7fedb815ef80 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:49.555 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.548+0000 7fedbd668700 1 -- 172.21.15.157:0/2415044859 >> 172.21.15.157:0/2415044859 conn(0x7fedb806c100 msgr2=0x7fedb80b2780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:49.555 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.548+0000 7fedbd668700 1 -- 172.21.15.157:0/2415044859 shutdown_connections 2023-10-16T19:57:49.556 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.548+0000 7fedbd668700 1 -- 172.21.15.157:0/2415044859 wait complete. 2023-10-16T19:57:49.559 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.550+0000 7fedbd668700 1 Processor -- start 2023-10-16T19:57:49.559 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.550+0000 7fedbd668700 1 -- start start 2023-10-16T19:57:49.559 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.550+0000 7fedbd668700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fedb806af60 0x7fedb8151010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:49.560 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.550+0000 7fedbd668700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fedb806d210 0x7fedb8140750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:49.560 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.550+0000 7fedbd668700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fedb815b900 0x7fedb8159500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:49.560 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.550+0000 7fedbd668700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedb81416e0 con 0x7fedb815b900 2023-10-16T19:57:49.560 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.550+0000 7fedbd668700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedb8151550 con 0x7fedb806d210 2023-10-16T19:57:49.560 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.550+0000 7fedbd668700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedb8150be0 con 0x7fedb806af60 2023-10-16T19:57:49.561 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.551+0000 7fedb77fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fedb815b900 0x7fedb8159500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:49.561 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.551+0000 7fedb77fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fedb815b900 0x7fedb8159500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:47062/0 (socket says 172.21.15.157:47062) 2023-10-16T19:57:49.561 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.551+0000 7fedb77fe700 1 -- 172.21.15.157:0/1097184481 learned_addr learned my addr 172.21.15.157:0/1097184481 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:57:49.561 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.551+0000 7fedb6ffd700 1 --2- 172.21.15.157:0/1097184481 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fedb806af60 0x7fedb8151010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:49.561 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.551+0000 7fedb67fc700 1 --2- 172.21.15.157:0/1097184481 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fedb806d210 0x7fedb8140750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:49.562 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.551+0000 7fedb77fe700 1 -- 172.21.15.157:0/1097184481 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fedb806af60 msgr2=0x7fedb8151010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:49.562 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.551+0000 7fedb77fe700 1 --2- 172.21.15.157:0/1097184481 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fedb806af60 0x7fedb8151010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:49.562 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.551+0000 7fedb77fe700 1 -- 172.21.15.157:0/1097184481 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fedb806d210 msgr2=0x7fedb8140750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:49.562 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.551+0000 7fedb77fe700 1 --2- 172.21.15.157:0/1097184481 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fedb806d210 0x7fedb8140750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:49.563 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.551+0000 7fedb77fe700 1 -- 172.21.15.157:0/1097184481 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feda80094a0 con 0x7fedb815b900 2023-10-16T19:57:49.563 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.551+0000 7fedb77fe700 1 --2- 172.21.15.157:0/1097184481 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fedb815b900 0x7fedb8159500 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fedb000cc90 tx=0x7fedb000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:49.563 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.551+0000 7fed9f7fe700 1 -- 172.21.15.157:0/1097184481 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedb000aad0 con 0x7fedb815b900 2023-10-16T19:57:49.563 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.551+0000 7fed9f7fe700 1 -- 172.21.15.157:0/1097184481 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedb000ac30 con 0x7fedb815b900 2023-10-16T19:57:49.563 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.551+0000 7fed9f7fe700 1 -- 172.21.15.157:0/1097184481 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedb00070d0 con 0x7fedb815b900 2023-10-16T19:57:49.563 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.551+0000 7fedbd668700 1 -- 172.21.15.157:0/1097184481 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedb8150900 con 0x7fedb815b900 2023-10-16T19:57:49.564 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.551+0000 7fedbd668700 1 -- 172.21.15.157:0/1097184481 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedb8141300 con 0x7fedb815b900 2023-10-16T19:57:49.564 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.552+0000 7fedbd668700 1 -- 172.21.15.157:0/1097184481 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedb8141820 con 0x7fedb815b900 2023-10-16T19:57:49.564 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.553+0000 7fed9f7fe700 1 -- 172.21.15.157:0/1097184481 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fedb0007230 con 0x7fedb815b900 2023-10-16T19:57:49.564 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.553+0000 7fed9f7fe700 1 --2- 172.21.15.157:0/1097184481 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7feda406af00 0x7feda406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:49.564 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.553+0000 7fed9f7fe700 1 -- 172.21.15.157:0/1097184481 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fedb0088ff0 con 0x7fedb815b900 2023-10-16T19:57:49.565 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.553+0000 7fedb6ffd700 1 --2- 172.21.15.157:0/1097184481 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7feda406af00 0x7feda406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:49.565 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.554+0000 7fedb6ffd700 1 --2- 172.21.15.157:0/1097184481 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7feda406af00 0x7feda406d3c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7feda80090b0 tx=0x7feda8008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:49.565 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.557+0000 7fed9f7fe700 1 -- 172.21.15.157:0/1097184481 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fedb8141820 con 0x7fedb815b900 2023-10-16T19:57:49.748 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.746+0000 7fedbd668700 1 -- 172.21.15.157:0/1097184481 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fedb8141820 con 0x7fedb815b900 2023-10-16T19:57:49.749 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.746+0000 7fed9f7fe700 1 -- 172.21.15.157:0/1097184481 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7fedb8141820 con 0x7fedb815b900 2023-10-16T19:57:49.749 INFO:teuthology.orchestra.run.smithi157.stdout:pg_num: 32 2023-10-16T19:57:49.751 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.748+0000 7fedbd668700 1 -- 172.21.15.157:0/1097184481 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7feda406af00 msgr2=0x7feda406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:49.751 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.748+0000 7fedbd668700 1 --2- 172.21.15.157:0/1097184481 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7feda406af00 0x7feda406d3c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7feda80090b0 tx=0x7feda8008030 comp rx=0 tx=0).stop 2023-10-16T19:57:49.751 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.748+0000 7fedbd668700 1 -- 172.21.15.157:0/1097184481 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fedb815b900 msgr2=0x7fedb8159500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:49.751 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.748+0000 7fedbd668700 1 --2- 172.21.15.157:0/1097184481 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fedb815b900 0x7fedb8159500 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fedb000cc90 tx=0x7fedb000a060 comp rx=0 tx=0).stop 2023-10-16T19:57:49.752 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.748+0000 7fedbd668700 1 -- 172.21.15.157:0/1097184481 shutdown_connections 2023-10-16T19:57:49.752 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.748+0000 7fedbd668700 1 --2- 172.21.15.157:0/1097184481 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fedb815b900 0x7fedb8159500 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:49.752 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.748+0000 7fedbd668700 1 --2- 172.21.15.157:0/1097184481 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fedb806af60 0x7fedb8151010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:49.752 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.748+0000 7fedbd668700 1 --2- 172.21.15.157:0/1097184481 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7feda406af00 0x7feda406d3c0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:49.752 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.748+0000 7fedbd668700 1 --2- 172.21.15.157:0/1097184481 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fedb806d210 0x7fedb8140750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:49.753 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.748+0000 7fedbd668700 1 -- 172.21.15.157:0/1097184481 >> 172.21.15.157:0/1097184481 conn(0x7fedb806c100 msgr2=0x7fedb815ab10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:49.753 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.748+0000 7fedbd668700 1 -- 172.21.15.157:0/1097184481 shutdown_connections 2023-10-16T19:57:49.753 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.748+0000 7fedbd668700 1 -- 172.21.15.157:0/1097184481 wait complete. 2023-10-16T19:57:49.763 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-16T19:57:49.887 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.884+0000 7fbfa3ec8700 1 Processor -- start 2023-10-16T19:57:49.887 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.884+0000 7fbfa3ec8700 1 -- start start 2023-10-16T19:57:49.890 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.885+0000 7fbfa3ec8700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fbf9c143bd0 0x7fbf9c0cef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:49.890 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.885+0000 7fbfa3ec8700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbf9c0cf4c0 0x7fbf9c0b2710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:49.890 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.885+0000 7fbfa3ec8700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fbf9c0b2c50 0x7fbf9c071080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:49.890 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.885+0000 7fbfa3ec8700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf9c0b3100 con 0x7fbf9c143bd0 2023-10-16T19:57:49.891 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.885+0000 7fbfa3ec8700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf9c143fb0 con 0x7fbf9c0b2c50 2023-10-16T19:57:49.891 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.885+0000 7fbfa3ec8700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf9c06e180 con 0x7fbf9c0cf4c0 2023-10-16T19:57:49.891 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.885+0000 7fbfa1c64700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fbf9c143bd0 0x7fbf9c0cef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:49.891 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.885+0000 7fbfa1c64700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fbf9c143bd0 0x7fbf9c0cef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:47066/0 (socket says 172.21.15.157:47066) 2023-10-16T19:57:49.891 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.885+0000 7fbfa1c64700 1 -- 172.21.15.157:0/2930612627 learned_addr learned my addr 172.21.15.157:0/2930612627 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:57:49.892 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.886+0000 7fbfa1463700 1 --2- 172.21.15.157:0/2930612627 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbf9c0cf4c0 0x7fbf9c0b2710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:49.892 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.886+0000 7fbfa2465700 1 --2- 172.21.15.157:0/2930612627 >> v2:172.21.15.187:3300/0 conn(0x7fbf9c0b2c50 0x7fbf9c071080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:49.892 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.886+0000 7fbfa1c64700 1 -- 172.21.15.157:0/2930612627 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbf9c0cf4c0 msgr2=0x7fbf9c0b2710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:57:49.892 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.886+0000 7fbfa1c64700 1 --2- 172.21.15.157:0/2930612627 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbf9c0cf4c0 0x7fbf9c0b2710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:49.892 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.886+0000 7fbfa1c64700 1 -- 172.21.15.157:0/2930612627 >> v2:172.21.15.187:3300/0 conn(0x7fbf9c0b2c50 msgr2=0x7fbf9c071080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:57:49.893 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.886+0000 7fbfa1c64700 1 --2- 172.21.15.157:0/2930612627 >> v2:172.21.15.187:3300/0 conn(0x7fbf9c0b2c50 0x7fbf9c071080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:49.893 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.886+0000 7fbfa1c64700 1 -- 172.21.15.157:0/2930612627 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf9c144480 con 0x7fbf9c143bd0 2023-10-16T19:57:49.893 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.886+0000 7fbfa1c64700 1 --2- 172.21.15.157:0/2930612627 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbf9c143bd0 0x7fbf9c0cef80 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fbf9c070fd0 tx=0x7fbf8c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e11b5e7e9347c51b server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:49.893 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.886+0000 7fbfa0c62700 1 -- 172.21.15.157:0/2930612627 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf8c00b860 con 0x7fbf9c143bd0 2023-10-16T19:57:49.893 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.886+0000 7fbfa0c62700 1 -- 172.21.15.157:0/2930612627 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf8c00b9c0 con 0x7fbf9c143bd0 2023-10-16T19:57:49.893 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.886+0000 7fbfa0c62700 1 -- 172.21.15.157:0/2930612627 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf8c00bd50 con 0x7fbf9c143bd0 2023-10-16T19:57:49.894 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.886+0000 7fbfa3ec8700 1 -- 172.21.15.157:0/2930612627 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbf9c143bd0 msgr2=0x7fbf9c0cef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:49.894 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.886+0000 7fbfa3ec8700 1 --2- 172.21.15.157:0/2930612627 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbf9c143bd0 0x7fbf9c0cef80 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fbf9c070fd0 tx=0x7fbf8c009c00 comp rx=0 tx=0).stop 2023-10-16T19:57:49.894 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.887+0000 7fbfa3ec8700 1 -- 172.21.15.157:0/2930612627 shutdown_connections 2023-10-16T19:57:49.894 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.887+0000 7fbfa3ec8700 1 --2- 172.21.15.157:0/2930612627 >> v2:172.21.15.187:3300/0 conn(0x7fbf9c0b2c50 0x7fbf9c071080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:49.895 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.887+0000 7fbfa3ec8700 1 --2- 172.21.15.157:0/2930612627 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbf9c143bd0 0x7fbf9c0cef80 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:49.895 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.887+0000 7fbfa3ec8700 1 --2- 172.21.15.157:0/2930612627 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbf9c0cf4c0 0x7fbf9c0b2710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:49.895 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.887+0000 7fbfa3ec8700 1 -- 172.21.15.157:0/2930612627 >> 172.21.15.157:0/2930612627 conn(0x7fbf9c0d0b30 msgr2=0x7fbf9c0d0f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:49.895 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.887+0000 7fbfa3ec8700 1 -- 172.21.15.157:0/2930612627 shutdown_connections 2023-10-16T19:57:49.895 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.887+0000 7fbfa3ec8700 1 -- 172.21.15.157:0/2930612627 wait complete. 2023-10-16T19:57:49.898 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.888+0000 7fbfa3ec8700 1 Processor -- start 2023-10-16T19:57:49.899 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.888+0000 7fbfa3ec8700 1 -- start start 2023-10-16T19:57:49.899 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.889+0000 7fbfa3ec8700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbf9c0b2c50 0x7fbf9c15a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:49.899 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.889+0000 7fbfa3ec8700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbf9c0cf4c0 0x7fbf9c0cb160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:49.899 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.889+0000 7fbfa3ec8700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbf9c143bd0 0x7fbf9c1e7890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:49.899 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.889+0000 7fbfa3ec8700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf9c0b1910 con 0x7fbf9c0b2c50 2023-10-16T19:57:49.900 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.889+0000 7fbfa3ec8700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf9c0b2040 con 0x7fbf9c0cf4c0 2023-10-16T19:57:49.900 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.889+0000 7fbfa3ec8700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf9c0cbd20 con 0x7fbf9c143bd0 2023-10-16T19:57:49.900 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.889+0000 7fbfa1c64700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbf9c0b2c50 0x7fbf9c15a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:49.900 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.889+0000 7fbfa1c64700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbf9c0b2c50 0x7fbf9c15a7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:47072/0 (socket says 172.21.15.157:47072) 2023-10-16T19:57:49.900 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.889+0000 7fbfa1c64700 1 -- 172.21.15.157:0/2621006722 learned_addr learned my addr 172.21.15.157:0/2621006722 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:57:49.901 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.889+0000 7fbfa2465700 1 --2- 172.21.15.157:0/2621006722 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbf9c143bd0 0x7fbf9c1e7890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:49.901 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.889+0000 7fbfa1463700 1 --2- 172.21.15.157:0/2621006722 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbf9c0cf4c0 0x7fbf9c0cb160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:49.901 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.889+0000 7fbfa1c64700 1 -- 172.21.15.157:0/2621006722 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbf9c143bd0 msgr2=0x7fbf9c1e7890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:49.901 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.889+0000 7fbfa1c64700 1 --2- 172.21.15.157:0/2621006722 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbf9c143bd0 0x7fbf9c1e7890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:49.901 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.889+0000 7fbfa1c64700 1 -- 172.21.15.157:0/2621006722 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbf9c0cf4c0 msgr2=0x7fbf9c0cb160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:49.902 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.889+0000 7fbfa1c64700 1 --2- 172.21.15.157:0/2621006722 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbf9c0cf4c0 0x7fbf9c0cb160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:49.902 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.889+0000 7fbfa1c64700 1 -- 172.21.15.157:0/2621006722 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf8c009550 con 0x7fbf9c0b2c50 2023-10-16T19:57:49.902 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.889+0000 7fbfa1c64700 1 --2- 172.21.15.157:0/2621006722 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbf9c0b2c50 0x7fbf9c15a7d0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fbf8c009130 tx=0x7fbf8c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:49.902 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.889+0000 7fbf927fc700 1 -- 172.21.15.157:0/2621006722 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf8c004450 con 0x7fbf9c0b2c50 2023-10-16T19:57:49.902 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.889+0000 7fbf927fc700 1 -- 172.21.15.157:0/2621006722 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf8c01e070 con 0x7fbf9c0b2c50 2023-10-16T19:57:49.903 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.889+0000 7fbfa3ec8700 1 -- 172.21.15.157:0/2621006722 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf9c0b2290 con 0x7fbf9c0b2c50 2023-10-16T19:57:49.903 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.889+0000 7fbf927fc700 1 -- 172.21.15.157:0/2621006722 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf8c0038c0 con 0x7fbf9c0b2c50 2023-10-16T19:57:49.903 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.889+0000 7fbfa3ec8700 1 -- 172.21.15.157:0/2621006722 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf9c0b1b20 con 0x7fbf9c0b2c50 2023-10-16T19:57:49.903 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.890+0000 7fbfa3ec8700 1 -- 172.21.15.157:0/2621006722 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf9c04f400 con 0x7fbf9c0b2c50 2023-10-16T19:57:49.903 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.891+0000 7fbf927fc700 1 -- 172.21.15.157:0/2621006722 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fbf8c003a20 con 0x7fbf9c0b2c50 2023-10-16T19:57:49.903 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.891+0000 7fbf927fc700 1 --2- 172.21.15.157:0/2621006722 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fbf8006af00 0x7fbf8006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:49.904 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.891+0000 7fbf927fc700 1 -- 172.21.15.157:0/2621006722 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbf8c020070 con 0x7fbf9c0b2c50 2023-10-16T19:57:49.904 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.891+0000 7fbfa1463700 1 --2- 172.21.15.157:0/2621006722 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fbf8006af00 0x7fbf8006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:49.904 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.892+0000 7fbfa1463700 1 --2- 172.21.15.157:0/2621006722 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fbf8006af00 0x7fbf8006d3c0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fbf9c06b6e0 tx=0x7fbf98008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:49.904 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:49.896+0000 7fbf927fc700 1 -- 172.21.15.157:0/2621006722 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fbf8c055a40 con 0x7fbf9c0b2c50 2023-10-16T19:57:50.085 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:50.083+0000 7fbfa3ec8700 1 -- 172.21.15.157:0/2621006722 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fbf9c06db00 con 0x7fbf9c0b2c50 2023-10-16T19:57:50.086 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:50.083+0000 7fbf927fc700 1 -- 172.21.15.157:0/2621006722 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7fbf8c015020 con 0x7fbf9c0b2c50 2023-10-16T19:57:50.086 INFO:teuthology.orchestra.run.smithi157.stdout:pg_num: 64 2023-10-16T19:57:50.088 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:50.085+0000 7fbfa3ec8700 1 -- 172.21.15.157:0/2621006722 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fbf8006af00 msgr2=0x7fbf8006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:50.088 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:50.085+0000 7fbfa3ec8700 1 --2- 172.21.15.157:0/2621006722 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fbf8006af00 0x7fbf8006d3c0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fbf9c06b6e0 tx=0x7fbf98008040 comp rx=0 tx=0).stop 2023-10-16T19:57:50.088 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:50.085+0000 7fbfa3ec8700 1 -- 172.21.15.157:0/2621006722 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbf9c0b2c50 msgr2=0x7fbf9c15a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:50.089 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:50.085+0000 7fbfa3ec8700 1 --2- 172.21.15.157:0/2621006722 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbf9c0b2c50 0x7fbf9c15a7d0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fbf8c009130 tx=0x7fbf8c004750 comp rx=0 tx=0).stop 2023-10-16T19:57:50.089 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:50.085+0000 7fbfa3ec8700 1 -- 172.21.15.157:0/2621006722 shutdown_connections 2023-10-16T19:57:50.089 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:50.085+0000 7fbfa3ec8700 1 --2- 172.21.15.157:0/2621006722 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbf9c143bd0 0x7fbf9c1e7890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:50.089 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:50.085+0000 7fbfa3ec8700 1 --2- 172.21.15.157:0/2621006722 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbf9c0b2c50 0x7fbf9c15a7d0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:50.089 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:50.085+0000 7fbfa3ec8700 1 --2- 172.21.15.157:0/2621006722 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fbf8006af00 0x7fbf8006d3c0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:50.090 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:50.085+0000 7fbfa3ec8700 1 --2- 172.21.15.157:0/2621006722 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbf9c0cf4c0 0x7fbf9c0cb160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:50.090 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:50.085+0000 7fbfa3ec8700 1 -- 172.21.15.157:0/2621006722 >> 172.21.15.157:0/2621006722 conn(0x7fbf9c0d0b30 msgr2=0x7fbf9c06ea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:50.090 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:50.085+0000 7fbfa3ec8700 1 -- 172.21.15.157:0/2621006722 shutdown_connections 2023-10-16T19:57:50.090 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:50.085+0000 7fbfa3ec8700 1 -- 172.21.15.157:0/2621006722 wait complete. 2023-10-16T19:57:50.100 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-16T19:57:50.223 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:50.220+0000 7f1701c9c700 1 Processor -- start 2023-10-16T19:57:50.223 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:50.221+0000 7f1701c9c700 1 -- start start 2023-10-16T19:57:50.226 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:50.221+0000 7f1701c9c700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f16fc0cbaf0 0x7f16fc0cfad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:50.226 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:50.221+0000 7f1701c9c700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f16fc15e7c0 0x7f16fc15ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:50.226 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:50.221+0000 7f1701c9c700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16fc072d50 con 0x7f16fc071c10 2023-10-16T19:57:50.227 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:50.221+0000 7f1701c9c700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16fc0d0010 con 0x7f16fc15e7c0 2023-10-16T19:57:50.227 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:50.221+0000 7f1701c9c700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16fc15f180 con 0x7f16fc0cbaf0 2023-10-16T19:57:50.227 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:50.222+0000 7f16faffd700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f16fc15e7c0 0x7f16fc15ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:50.227 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:50.222+0000 7f16fb7fe700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f16fc0cbaf0 0x7f16fc0cfad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:50.227 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:50.222+0000 7f16faffd700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f16fc15e7c0 0x7f16fc15ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.157:42188/0 (socket says 172.21.15.157:42188) 2023-10-16T19:57:50.228 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:50.222+0000 7f16fbfff700 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7f16fc071c10 0x7f16fc0ca810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.157:40448/0 (socket says 172.21.15.157:40448) 2023-10-16T19:57:50.228 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:50.222+0000 7f16faffd700 1 -- 172.21.15.157:0/549741507 learned_addr learned my addr 172.21.15.157:0/549741507 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:57:50.228 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:50.222+0000 7f16faffd700 1 -- 172.21.15.157:0/549741507 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f16fc0cbaf0 msgr2=0x7f16fc0cfad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:57:50.228 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:50.222+0000 7f16faffd700 1 --2- 172.21.15.157:0/549741507 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f16fc0cbaf0 0x7f16fc0cfad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:50.228 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:50.222+0000 7f16faffd700 1 -- 172.21.15.157:0/549741507 >> v1:172.21.15.187:6789/0 conn(0x7f16fc071c10 legacy=0x7f16fc0ca810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:50.229 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:50.222+0000 7f16faffd700 1 -- 172.21.15.157:0/549741507 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16fc0cf640 con 0x7f16fc15e7c0 2023-10-16T19:57:50.229 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:50.222+0000 7f16fb7fe700 1 --2- 172.21.15.157:0/549741507 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f16fc0cbaf0 0x7f16fc0cfad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T19:57:50.229 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:50.222+0000 7f16faffd700 1 --2- 172.21.15.157:0/549741507 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f16fc15e7c0 0x7f16fc15ec40 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f16ec00bb90 tx=0x7f16ec00bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=720ffc3226ae39b2 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:50.229 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:50.222+0000 7f16fa7fc700 1 -- 172.21.15.157:0/549741507 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16ec00dd30 con 0x7f16fc15e7c0 2023-10-16T19:57:50.229 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:50.222+0000 7f16fa7fc700 1 -- 172.21.15.157:0/549741507 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16ec00de90 con 0x7f16fc15e7c0 2023-10-16T19:57:50.229 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:50.223+0000 7f16fa7fc700 1 -- 172.21.15.157:0/549741507 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16ec010690 con 0x7f16fc15e7c0 2023-10-16T19:57:50.230 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:50.223+0000 7f1701c9c700 1 -- 172.21.15.157:0/549741507 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f16fc15e7c0 msgr2=0x7f16fc15ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:50.230 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:50.223+0000 7f1701c9c700 1 --2- 172.21.15.157:0/549741507 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f16fc15e7c0 0x7f16fc15ec40 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f16ec00bb90 tx=0x7f16ec00bea0 comp rx=0 tx=0).stop 2023-10-16T19:57:50.230 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:50.223+0000 7f1701c9c700 1 -- 172.21.15.157:0/549741507 shutdown_connections 2023-10-16T19:57:50.230 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:50.223+0000 7f1701c9c700 1 --2- 172.21.15.157:0/549741507 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f16fc0cbaf0 0x7f16fc0cfad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:50.230 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:50.223+0000 7f1701c9c700 1 --2- 172.21.15.157:0/549741507 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f16fc15e7c0 0x7f16fc15ec40 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:50.231 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:50.223+0000 7f1701c9c700 1 -- 172.21.15.157:0/549741507 >> 172.21.15.157:0/549741507 conn(0x7f16fc0cceb0 msgr2=0x7f16fc0cd290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:50.231 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:50.223+0000 7f1701c9c700 1 -- 172.21.15.157:0/549741507 shutdown_connections 2023-10-16T19:57:50.231 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:50.223+0000 7f1701c9c700 1 -- 172.21.15.157:0/549741507 wait complete. 2023-10-16T19:57:50.234 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:50.224+0000 7f1701c9c700 1 Processor -- start 2023-10-16T19:57:50.234 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:50.224+0000 7f1701c9c700 1 -- start start 2023-10-16T19:57:50.235 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:50.225+0000 7f1701c9c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f16fc071c10 0x7f16fc14f990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:50.235 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:50.225+0000 7f1701c9c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f16fc0cbaf0 0x7f16fc0c3cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:50.235 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:50.225+0000 7f1701c9c700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f16fc15e7c0 0x7f16fc150120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:50.235 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:50.225+0000 7f1701c9c700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16fc14fed0 con 0x7f16fc071c10 2023-10-16T19:57:50.236 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:50.225+0000 7f1701c9c700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16fc154c40 con 0x7f16fc0cbaf0 2023-10-16T19:57:50.236 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:50.225+0000 7f1701c9c700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16fc154f20 con 0x7f16fc15e7c0 2023-10-16T19:57:50.236 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:50.225+0000 7f16fb7fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f16fc071c10 0x7f16fc14f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:50.236 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:50.225+0000 7f16fb7fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f16fc071c10 0x7f16fc14f990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:47084/0 (socket says 172.21.15.157:47084) 2023-10-16T19:57:50.237 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:50.225+0000 7f16fb7fe700 1 -- 172.21.15.157:0/3694252158 learned_addr learned my addr 172.21.15.157:0/3694252158 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:57:50.237 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:50.226+0000 7f16faffd700 1 --2- 172.21.15.157:0/3694252158 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f16fc0cbaf0 0x7f16fc0c3cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:50.237 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:50.226+0000 7f16fbfff700 1 --2- 172.21.15.157:0/3694252158 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f16fc15e7c0 0x7f16fc150120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:50.237 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:50.226+0000 7f16fb7fe700 1 -- 172.21.15.157:0/3694252158 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f16fc15e7c0 msgr2=0x7f16fc150120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:50.237 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:50.226+0000 7f16fb7fe700 1 --2- 172.21.15.157:0/3694252158 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f16fc15e7c0 0x7f16fc150120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:50.237 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:50.226+0000 7f16fb7fe700 1 -- 172.21.15.157:0/3694252158 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f16fc0cbaf0 msgr2=0x7f16fc0c3cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:50.238 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:50.226+0000 7f16fb7fe700 1 --2- 172.21.15.157:0/3694252158 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f16fc0cbaf0 0x7f16fc0c3cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:50.238 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:50.226+0000 7f16fb7fe700 1 -- 172.21.15.157:0/3694252158 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16e40094a0 con 0x7f16fc071c10 2023-10-16T19:57:50.238 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:50.226+0000 7f16faffd700 1 --2- 172.21.15.157:0/3694252158 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f16fc0cbaf0 0x7f16fc0c3cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T19:57:50.238 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:50.226+0000 7f16fbfff700 1 --2- 172.21.15.157:0/3694252158 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f16fc15e7c0 0x7f16fc150120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T19:57:50.239 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:50.226+0000 7f16fb7fe700 1 --2- 172.21.15.157:0/3694252158 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f16fc071c10 0x7f16fc14f990 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f16e400ebe0 tx=0x7f16e4009ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:50.239 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:50.226+0000 7f16f3fff700 1 -- 172.21.15.157:0/3694252158 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16e400c910 con 0x7f16fc071c10 2023-10-16T19:57:50.239 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:50.226+0000 7f16f3fff700 1 -- 172.21.15.157:0/3694252158 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16e400ca70 con 0x7f16fc071c10 2023-10-16T19:57:50.239 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:50.226+0000 7f1701c9c700 1 -- 172.21.15.157:0/3694252158 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16ec00b7f0 con 0x7f16fc071c10 2023-10-16T19:57:50.239 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:50.226+0000 7f16f3fff700 1 -- 172.21.15.157:0/3694252158 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16e400cde0 con 0x7f16fc071c10 2023-10-16T19:57:50.239 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:50.226+0000 7f1701c9c700 1 -- 172.21.15.157:0/3694252158 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16fc1554e0 con 0x7f16fc071c10 2023-10-16T19:57:50.240 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:50.227+0000 7f1701c9c700 1 -- 172.21.15.157:0/3694252158 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16fc04f400 con 0x7f16fc071c10 2023-10-16T19:57:50.240 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:50.227+0000 7f16f3fff700 1 -- 172.21.15.157:0/3694252158 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f16e4013470 con 0x7f16fc071c10 2023-10-16T19:57:50.240 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:50.228+0000 7f16f3fff700 1 --2- 172.21.15.157:0/3694252158 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f16dc06af00 0x7f16dc06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:50.240 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:50.228+0000 7f16f3fff700 1 -- 172.21.15.157:0/3694252158 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f16e4089840 con 0x7f16fc071c10 2023-10-16T19:57:50.240 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:50.228+0000 7f16faffd700 1 --2- 172.21.15.157:0/3694252158 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f16dc06af00 0x7f16dc06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:50.241 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:50.228+0000 7f16faffd700 1 --2- 172.21.15.157:0/3694252158 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f16dc06af00 0x7f16dc06d3c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f16fc0ca740 tx=0x7f16ec013000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:50.241 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:50.232+0000 7f16f3fff700 1 -- 172.21.15.157:0/3694252158 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f16e4054870 con 0x7f16fc071c10 2023-10-16T19:57:50.439 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:50.436+0000 7f1701c9c700 1 -- 172.21.15.157:0/3694252158 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f16fc0b2b20 con 0x7f16fc071c10 2023-10-16T19:57:50.439 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:50.437+0000 7f16f3fff700 1 -- 172.21.15.157:0/3694252158 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) v1 ==== 80+0+0 (secure 0 0 0) 0x7f16e4057e90 con 0x7f16fc071c10 2023-10-16T19:57:50.441 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:50.439+0000 7f1701c9c700 1 -- 172.21.15.157:0/3694252158 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f16dc06af00 msgr2=0x7f16dc06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:50.442 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:50.439+0000 7f1701c9c700 1 --2- 172.21.15.157:0/3694252158 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f16dc06af00 0x7f16dc06d3c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f16fc0ca740 tx=0x7f16ec013000 comp rx=0 tx=0).stop 2023-10-16T19:57:50.442 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:50.439+0000 7f1701c9c700 1 -- 172.21.15.157:0/3694252158 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f16fc071c10 msgr2=0x7f16fc14f990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:50.442 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:50.439+0000 7f1701c9c700 1 --2- 172.21.15.157:0/3694252158 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f16fc071c10 0x7f16fc14f990 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f16e400ebe0 tx=0x7f16e4009ec0 comp rx=0 tx=0).stop 2023-10-16T19:57:50.442 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:50.439+0000 7f1701c9c700 1 -- 172.21.15.157:0/3694252158 shutdown_connections 2023-10-16T19:57:50.442 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:50.439+0000 7f1701c9c700 1 --2- 172.21.15.157:0/3694252158 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f16fc15e7c0 0x7f16fc150120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:50.443 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:50.439+0000 7f1701c9c700 1 --2- 172.21.15.157:0/3694252158 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f16fc071c10 0x7f16fc14f990 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:50.443 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:50.439+0000 7f1701c9c700 1 --2- 172.21.15.157:0/3694252158 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f16dc06af00 0x7f16dc06d3c0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:50.443 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:50.439+0000 7f1701c9c700 1 --2- 172.21.15.157:0/3694252158 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f16fc0cbaf0 0x7f16fc0c3cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:50.443 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:50.439+0000 7f1701c9c700 1 -- 172.21.15.157:0/3694252158 >> 172.21.15.157:0/3694252158 conn(0x7f16fc0cceb0 msgr2=0x7f16fc06b8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:50.443 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:50.439+0000 7f1701c9c700 1 -- 172.21.15.157:0/3694252158 shutdown_connections 2023-10-16T19:57:50.444 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:50.439+0000 7f1701c9c700 1 -- 172.21.15.157:0/3694252158 wait complete. 2023-10-16T19:57:50.444 INFO:teuthology.orchestra.run.smithi157.stderr:listed 0 entries 2023-10-16T19:57:50.453 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2023-10-16T19:57:50.453 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T19:57:50.454 DEBUG:teuthology.orchestra.run.smithi187:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2023-10-16T19:57:50.500 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi187.front.sepia.ceph.com 2023-10-16T19:57:50.500 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T19:57:50.501 DEBUG:teuthology.orchestra.run.smithi187:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-10-16T19:57:50.519 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-16T19:57:50.520 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-16T19:57:50.640 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:50.638+0000 7f383d715700 1 Processor -- start 2023-10-16T19:57:50.640 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:50.638+0000 7f383d715700 1 -- start start 2023-10-16T19:57:50.642 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:50.638+0000 7f383d715700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f38380727e0 0x7f383806b260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:50.643 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:50.638+0000 7f383d715700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f3838070880 0x7f38380cae10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:50.643 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:50.638+0000 7f383d715700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38380ca980 con 0x7f383815f3b0 2023-10-16T19:57:50.643 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:50.638+0000 7f383d715700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38380b61d0 con 0x7f3838070880 2023-10-16T19:57:50.643 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:50.638+0000 7f383d715700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f383806b840 con 0x7f38380727e0 2023-10-16T19:57:50.644 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:50.639+0000 7f3836ffd700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f383815f3b0 0x7f38380720d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:56764/0 (socket says 172.21.15.157:56764) 2023-10-16T19:57:50.644 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:50.639+0000 7f3836ffd700 1 -- 172.21.15.157:0/1602001119 learned_addr learned my addr 172.21.15.157:0/1602001119 (peer_addr_for_me v1:172.21.15.157:0/0) 2023-10-16T19:57:50.644 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:50.639+0000 7f38377fe700 1 --2- 172.21.15.157:0/1602001119 >> v2:172.21.15.157:3300/0 conn(0x7f3838070880 0x7f38380cae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:50.644 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:50.639+0000 7f38367fc700 1 --2- 172.21.15.157:0/1602001119 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f38380727e0 0x7f383806b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:50.644 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:50.639+0000 7f38377fe700 1 -- 172.21.15.157:0/1602001119 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f38380727e0 msgr2=0x7f383806b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:57:50.645 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:50.639+0000 7f38377fe700 1 --2- 172.21.15.157:0/1602001119 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f38380727e0 0x7f383806b260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:50.645 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:50.639+0000 7f3835ffb700 1 -- 172.21.15.157:0/1602001119 <== mon.0 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3362592423 0 0) 0x7f38380ca980 con 0x7f383815f3b0 2023-10-16T19:57:50.645 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:50.639+0000 7f38377fe700 1 -- 172.21.15.157:0/1602001119 >> v1:172.21.15.157:6789/0 conn(0x7f383815f3b0 legacy=0x7f38380720d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:50.645 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:50.639+0000 7f38377fe700 1 -- 172.21.15.157:0/1602001119 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f383806bb20 con 0x7f3838070880 2023-10-16T19:57:50.645 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:50.639+0000 7f38377fe700 1 --2- 172.21.15.157:0/1602001119 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3838070880 0x7f38380cae10 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f3830009d90 tx=0x7f383000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4f8ce404179b908 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:50.646 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:50.639+0000 7f3835ffb700 1 -- 172.21.15.157:0/1602001119 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f383000e070 con 0x7f3838070880 2023-10-16T19:57:50.646 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:50.639+0000 7f3835ffb700 1 -- 172.21.15.157:0/1602001119 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f383000bbd0 con 0x7f3838070880 2023-10-16T19:57:50.646 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:50.639+0000 7f3835ffb700 1 -- 172.21.15.157:0/1602001119 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3830012430 con 0x7f3838070880 2023-10-16T19:57:50.646 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:50.640+0000 7f383d715700 1 -- 172.21.15.157:0/1602001119 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3838070880 msgr2=0x7f38380cae10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:50.646 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:50.640+0000 7f383d715700 1 --2- 172.21.15.157:0/1602001119 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3838070880 0x7f38380cae10 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f3830009d90 tx=0x7f383000b330 comp rx=0 tx=0).stop 2023-10-16T19:57:50.647 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:50.640+0000 7f383d715700 1 -- 172.21.15.157:0/1602001119 shutdown_connections 2023-10-16T19:57:50.647 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:50.640+0000 7f383d715700 1 --2- 172.21.15.157:0/1602001119 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3838070880 0x7f38380cae10 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:50.647 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:50.640+0000 7f383d715700 1 --2- 172.21.15.157:0/1602001119 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f38380727e0 0x7f383806b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:50.647 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:50.640+0000 7f383d715700 1 -- 172.21.15.157:0/1602001119 >> 172.21.15.157:0/1602001119 conn(0x7f383806c790 msgr2=0x7f383806cba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:50.648 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:50.640+0000 7f383d715700 1 -- 172.21.15.157:0/1602001119 shutdown_connections 2023-10-16T19:57:50.648 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:50.640+0000 7f383d715700 1 -- 172.21.15.157:0/1602001119 wait complete. 2023-10-16T19:57:50.650 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:50.641+0000 7f383d715700 1 Processor -- start 2023-10-16T19:57:50.651 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:50.641+0000 7f383d715700 1 -- start start 2023-10-16T19:57:50.651 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:50.642+0000 7f383d715700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3838070880 0x7f383815b150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:50.651 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:50.642+0000 7f383d715700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f38380727e0 0x7f3838150e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:50.651 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:50.642+0000 7f383d715700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f383815f3b0 0x7f3838159160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:50.651 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:50.642+0000 7f383d715700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f383815c520 con 0x7f38380727e0 2023-10-16T19:57:50.652 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:50.642+0000 7f383d715700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38380723f0 con 0x7f383815f3b0 2023-10-16T19:57:50.652 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:50.642+0000 7f383d715700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f383815b9a0 con 0x7f3838070880 2023-10-16T19:57:50.652 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:50.642+0000 7f38367fc700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f38380727e0 0x7f3838150e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:50.652 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:50.642+0000 7f38367fc700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f38380727e0 0x7f3838150e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:47100/0 (socket says 172.21.15.157:47100) 2023-10-16T19:57:50.652 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:50.642+0000 7f38367fc700 1 -- 172.21.15.157:0/2411077699 learned_addr learned my addr 172.21.15.157:0/2411077699 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:57:50.653 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:50.642+0000 7f3836ffd700 1 --2- 172.21.15.157:0/2411077699 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3838070880 0x7f383815b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:50.655 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:50.642+0000 7f38377fe700 1 --2- 172.21.15.157:0/2411077699 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f383815f3b0 0x7f3838159160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:50.655 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:50.642+0000 7f38367fc700 1 -- 172.21.15.157:0/2411077699 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3838070880 msgr2=0x7f383815b150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:50.655 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:50.642+0000 7f38367fc700 1 --2- 172.21.15.157:0/2411077699 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3838070880 0x7f383815b150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:50.655 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:50.642+0000 7f38367fc700 1 -- 172.21.15.157:0/2411077699 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f383815f3b0 msgr2=0x7f3838159160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:50.655 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:50.642+0000 7f38367fc700 1 --2- 172.21.15.157:0/2411077699 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f383815f3b0 0x7f3838159160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:50.656 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:50.642+0000 7f38367fc700 1 -- 172.21.15.157:0/2411077699 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3830009a70 con 0x7f38380727e0 2023-10-16T19:57:50.656 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:50.642+0000 7f38367fc700 1 --2- 172.21.15.157:0/2411077699 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f38380727e0 0x7f3838150e80 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f382000c7f0 tx=0x7f382000cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:50.656 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:50.643+0000 7f382f7fe700 1 -- 172.21.15.157:0/2411077699 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3820011800 con 0x7f38380727e0 2023-10-16T19:57:50.656 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:50.643+0000 7f382f7fe700 1 -- 172.21.15.157:0/2411077699 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3820011960 con 0x7f38380727e0 2023-10-16T19:57:50.656 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:50.643+0000 7f382f7fe700 1 -- 172.21.15.157:0/2411077699 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3820011d10 con 0x7f38380727e0 2023-10-16T19:57:50.657 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:50.643+0000 7f383d715700 1 -- 172.21.15.157:0/2411077699 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f383815bc80 con 0x7f38380727e0 2023-10-16T19:57:50.657 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:50.643+0000 7f383d715700 1 -- 172.21.15.157:0/2411077699 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f383815c240 con 0x7f38380727e0 2023-10-16T19:57:50.657 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:50.644+0000 7f383d715700 1 -- 172.21.15.157:0/2411077699 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f383804f400 con 0x7f38380727e0 2023-10-16T19:57:50.657 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:50.644+0000 7f382f7fe700 1 -- 172.21.15.157:0/2411077699 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f3820018360 con 0x7f38380727e0 2023-10-16T19:57:50.657 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:50.644+0000 7f382f7fe700 1 --2- 172.21.15.157:0/2411077699 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f381806af00 0x7f381806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:50.658 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:50.644+0000 7f382f7fe700 1 -- 172.21.15.157:0/2411077699 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f38200895f0 con 0x7f38380727e0 2023-10-16T19:57:50.659 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:50.645+0000 7f3836ffd700 1 --2- 172.21.15.157:0/2411077699 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f381806af00 0x7f381806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:50.659 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:50.645+0000 7f3836ffd700 1 --2- 172.21.15.157:0/2411077699 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f381806af00 0x7f381806d3c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f3828000f60 tx=0x7f3828007c90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:50.659 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:50.649+0000 7f382f7fe700 1 -- 172.21.15.157:0/2411077699 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f38200546a0 con 0x7f38380727e0 2023-10-16T19:57:50.881 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:50.878+0000 7f383d715700 1 -- 172.21.15.157:0/2411077699 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f383806d610 con 0x7f38380727e0 2023-10-16T19:57:50.881 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:50.879+0000 7f382f7fe700 1 -- 172.21.15.157:0/2411077699 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4913 (secure 0 0 0) 0x7f3820057cc0 con 0x7f38380727e0 2023-10-16T19:57:50.882 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-10-16T19:57:50.882 INFO:teuthology.orchestra.run.smithi157.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/1319816297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6834","nonce":1319816297},{"type":"v1","addr":"172.21.15.187:6835","nonce":1319816297}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4242,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6834/3219992837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6832","nonce":3219992837},{"type":"v1","addr":"172.21.15.157:6834","nonce":3219992837}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4245,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6835/1675699874","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6833","nonce":1675699874},{"type":"v1","addr":"172.21.15.157:6835","nonce":1675699874}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-16T19:57:06.364669+0000","modified":"2023-10-16T19:57:09.412706+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4282":{"gid":4282,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.187:6837/68705029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6836","nonce":68705029},{"type":"v1","addr":"172.21.15.187:6837","nonce":68705029}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-16T19:57:50.884 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:50.881+0000 7f383d715700 1 -- 172.21.15.157:0/2411077699 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f381806af00 msgr2=0x7f381806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:50.884 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:50.881+0000 7f383d715700 1 --2- 172.21.15.157:0/2411077699 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f381806af00 0x7f381806d3c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f3828000f60 tx=0x7f3828007c90 comp rx=0 tx=0).stop 2023-10-16T19:57:50.884 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:50.881+0000 7f383d715700 1 -- 172.21.15.157:0/2411077699 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f38380727e0 msgr2=0x7f3838150e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:50.885 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:50.881+0000 7f383d715700 1 --2- 172.21.15.157:0/2411077699 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f38380727e0 0x7f3838150e80 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f382000c7f0 tx=0x7f382000cbb0 comp rx=0 tx=0).stop 2023-10-16T19:57:50.885 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:50.881+0000 7f383d715700 1 -- 172.21.15.157:0/2411077699 shutdown_connections 2023-10-16T19:57:50.885 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:50.881+0000 7f383d715700 1 --2- 172.21.15.157:0/2411077699 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f381806af00 0x7f381806d3c0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:50.885 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:50.881+0000 7f383d715700 1 --2- 172.21.15.157:0/2411077699 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f383815f3b0 0x7f3838159160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:50.885 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:50.881+0000 7f383d715700 1 --2- 172.21.15.157:0/2411077699 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3838070880 0x7f383815b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:50.886 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:50.881+0000 7f383d715700 1 --2- 172.21.15.157:0/2411077699 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f38380727e0 0x7f3838150e80 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:50.886 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:50.881+0000 7f383d715700 1 -- 172.21.15.157:0/2411077699 >> 172.21.15.157:0/2411077699 conn(0x7f383806c790 msgr2=0x7f38380cc340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:50.886 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:50.882+0000 7f383d715700 1 -- 172.21.15.157:0/2411077699 shutdown_connections 2023-10-16T19:57:50.886 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:50.882+0000 7f383d715700 1 -- 172.21.15.157:0/2411077699 wait complete. 2023-10-16T19:57:50.887 INFO:teuthology.orchestra.run.smithi157.stderr:dumped fsmap epoch 8 2023-10-16T19:57:50.896 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T19:57:51.017 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.014+0000 7fad64110700 1 Processor -- start 2023-10-16T19:57:51.017 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.015+0000 7fad64110700 1 -- start start 2023-10-16T19:57:51.019 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.015+0000 7fad64110700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fad5c15b130 0x7fad5c071f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:51.020 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.015+0000 7fad64110700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fad5c06d0f0 0x7fad5c0cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:51.020 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.015+0000 7fad64110700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fad5c0cbeb0 0x7fad5c06eb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:51.020 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.015+0000 7fad64110700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad5c0b0050 con 0x7fad5c06d0f0 2023-10-16T19:57:51.020 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.015+0000 7fad64110700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad5c0cefc0 con 0x7fad5c15b130 2023-10-16T19:57:51.020 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.015+0000 7fad64110700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad5c06e090 con 0x7fad5c0cbeb0 2023-10-16T19:57:51.021 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.016+0000 7fad616ab700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fad5c06d0f0 0x7fad5c0cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:51.021 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.016+0000 7fad616ab700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fad5c06d0f0 0x7fad5c0cb970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:47106/0 (socket says 172.21.15.157:47106) 2023-10-16T19:57:51.021 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.016+0000 7fad616ab700 1 -- 172.21.15.157:0/374844323 learned_addr learned my addr 172.21.15.157:0/374844323 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:57:51.021 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.016+0000 7fad61eac700 1 --2- 172.21.15.157:0/374844323 >> v2:172.21.15.187:3300/0 conn(0x7fad5c15b130 0x7fad5c071f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:51.021 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.016+0000 7fad626ad700 1 --2- 172.21.15.157:0/374844323 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fad5c0cbeb0 0x7fad5c06eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:51.022 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.016+0000 7fad616ab700 1 -- 172.21.15.157:0/374844323 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fad5c0cbeb0 msgr2=0x7fad5c06eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:57:51.022 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.016+0000 7fad616ab700 1 --2- 172.21.15.157:0/374844323 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fad5c0cbeb0 0x7fad5c06eb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:51.022 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.016+0000 7fad616ab700 1 -- 172.21.15.157:0/374844323 >> v2:172.21.15.187:3300/0 conn(0x7fad5c15b130 msgr2=0x7fad5c071f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:57:51.022 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.016+0000 7fad616ab700 1 --2- 172.21.15.157:0/374844323 >> v2:172.21.15.187:3300/0 conn(0x7fad5c15b130 0x7fad5c071f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:51.022 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.016+0000 7fad616ab700 1 -- 172.21.15.157:0/374844323 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad5c06d570 con 0x7fad5c06d0f0 2023-10-16T19:57:51.023 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.016+0000 7fad616ab700 1 --2- 172.21.15.157:0/374844323 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fad5c06d0f0 0x7fad5c0cb970 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fad5c06cb70 tx=0x7fad58009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4903811e66173fcf server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:51.023 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.016+0000 7fad60eaa700 1 -- 172.21.15.157:0/374844323 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad58011830 con 0x7fad5c06d0f0 2023-10-16T19:57:51.023 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.016+0000 7fad60eaa700 1 -- 172.21.15.157:0/374844323 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad58011990 con 0x7fad5c06d0f0 2023-10-16T19:57:51.023 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.016+0000 7fad60eaa700 1 -- 172.21.15.157:0/374844323 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad58011d20 con 0x7fad5c06d0f0 2023-10-16T19:57:51.023 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.017+0000 7fad64110700 1 -- 172.21.15.157:0/374844323 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fad5c06d0f0 msgr2=0x7fad5c0cb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:51.024 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.017+0000 7fad64110700 1 --2- 172.21.15.157:0/374844323 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fad5c06d0f0 0x7fad5c0cb970 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fad5c06cb70 tx=0x7fad58009bd0 comp rx=0 tx=0).stop 2023-10-16T19:57:51.024 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.017+0000 7fad64110700 1 -- 172.21.15.157:0/374844323 shutdown_connections 2023-10-16T19:57:51.024 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.017+0000 7fad64110700 1 --2- 172.21.15.157:0/374844323 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fad5c0cbeb0 0x7fad5c06eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:51.024 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.017+0000 7fad64110700 1 --2- 172.21.15.157:0/374844323 >> v2:172.21.15.187:3300/0 conn(0x7fad5c15b130 0x7fad5c071f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:51.024 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.017+0000 7fad64110700 1 --2- 172.21.15.157:0/374844323 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fad5c06d0f0 0x7fad5c0cb970 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:51.024 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.017+0000 7fad64110700 1 -- 172.21.15.157:0/374844323 >> 172.21.15.157:0/374844323 conn(0x7fad5c0cd4e0 msgr2=0x7fad5c0cd8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:51.025 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.017+0000 7fad64110700 1 -- 172.21.15.157:0/374844323 shutdown_connections 2023-10-16T19:57:51.025 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.017+0000 7fad64110700 1 -- 172.21.15.157:0/374844323 wait complete. 2023-10-16T19:57:51.028 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.018+0000 7fad64110700 1 Processor -- start 2023-10-16T19:57:51.029 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.018+0000 7fad64110700 1 -- start start 2023-10-16T19:57:51.029 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.019+0000 7fad64110700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fad5c06d0f0 0x7fad5c1f3470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:51.029 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.019+0000 7fad64110700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fad5c0cbeb0 0x7fad5c1f70f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:51.029 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.019+0000 7fad64110700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fad5c15b130 0x7fad5c15d520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:51.029 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.019+0000 7fad64110700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad5c0ae160 con 0x7fad5c15b130 2023-10-16T19:57:51.030 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.019+0000 7fad64110700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad5c1f7fb0 con 0x7fad5c06d0f0 2023-10-16T19:57:51.030 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.019+0000 7fad64110700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad5c1f79f0 con 0x7fad5c0cbeb0 2023-10-16T19:57:51.030 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.019+0000 7fad626ad700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fad5c15b130 0x7fad5c15d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:51.030 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.019+0000 7fad626ad700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fad5c15b130 0x7fad5c15d520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:47114/0 (socket says 172.21.15.157:47114) 2023-10-16T19:57:51.031 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.019+0000 7fad626ad700 1 -- 172.21.15.157:0/1402191302 learned_addr learned my addr 172.21.15.157:0/1402191302 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:57:51.031 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.019+0000 7fad61eac700 1 --2- 172.21.15.157:0/1402191302 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fad5c06d0f0 0x7fad5c1f3470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:51.031 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.019+0000 7fad616ab700 1 --2- 172.21.15.157:0/1402191302 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fad5c0cbeb0 0x7fad5c1f70f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:51.031 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.019+0000 7fad626ad700 1 -- 172.21.15.157:0/1402191302 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fad5c0cbeb0 msgr2=0x7fad5c1f70f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:51.031 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.019+0000 7fad626ad700 1 --2- 172.21.15.157:0/1402191302 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fad5c0cbeb0 0x7fad5c1f70f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:51.031 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.019+0000 7fad626ad700 1 -- 172.21.15.157:0/1402191302 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fad5c06d0f0 msgr2=0x7fad5c1f3470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:51.032 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.019+0000 7fad626ad700 1 --2- 172.21.15.157:0/1402191302 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fad5c06d0f0 0x7fad5c1f3470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:51.032 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.019+0000 7fad626ad700 1 -- 172.21.15.157:0/1402191302 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad58009550 con 0x7fad5c15b130 2023-10-16T19:57:51.032 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.019+0000 7fad61eac700 1 --2- 172.21.15.157:0/1402191302 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fad5c06d0f0 0x7fad5c1f3470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T19:57:51.032 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.019+0000 7fad616ab700 1 --2- 172.21.15.157:0/1402191302 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fad5c0cbeb0 0x7fad5c1f70f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T19:57:51.032 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.019+0000 7fad626ad700 1 --2- 172.21.15.157:0/1402191302 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fad5c15b130 0x7fad5c15d520 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fad5400eed0 tx=0x7fad5400b0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:51.033 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.020+0000 7fad527fc700 1 -- 172.21.15.157:0/1402191302 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad54010040 con 0x7fad5c15b130 2023-10-16T19:57:51.033 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.020+0000 7fad527fc700 1 -- 172.21.15.157:0/1402191302 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad5400bb70 con 0x7fad5c15b130 2023-10-16T19:57:51.033 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.020+0000 7fad64110700 1 -- 172.21.15.157:0/1402191302 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad5c1f7cd0 con 0x7fad5c15b130 2023-10-16T19:57:51.033 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.020+0000 7fad527fc700 1 -- 172.21.15.157:0/1402191302 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad54014400 con 0x7fad5c15b130 2023-10-16T19:57:51.033 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.020+0000 7fad64110700 1 -- 172.21.15.157:0/1402191302 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad5c1f39b0 con 0x7fad5c15b130 2023-10-16T19:57:51.034 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.021+0000 7fad64110700 1 -- 172.21.15.157:0/1402191302 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad5c0ae2d0 con 0x7fad5c15b130 2023-10-16T19:57:51.034 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.021+0000 7fad527fc700 1 -- 172.21.15.157:0/1402191302 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fad54014560 con 0x7fad5c15b130 2023-10-16T19:57:51.034 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.021+0000 7fad527fc700 1 --2- 172.21.15.157:0/1402191302 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fad4006af00 0x7fad4006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:51.034 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.021+0000 7fad527fc700 1 -- 172.21.15.157:0/1402191302 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fad54089a80 con 0x7fad5c15b130 2023-10-16T19:57:51.034 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.022+0000 7fad61eac700 1 --2- 172.21.15.157:0/1402191302 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fad4006af00 0x7fad4006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:51.035 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.022+0000 7fad61eac700 1 --2- 172.21.15.157:0/1402191302 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fad4006af00 0x7fad4006d3c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fad5c0c8430 tx=0x7fad4c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:51.035 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.026+0000 7fad527fc700 1 -- 172.21.15.157:0/1402191302 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fad54054bc0 con 0x7fad5c15b130 2023-10-16T19:57:51.216 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.214+0000 7fad64110700 1 -- 172.21.15.157:0/1402191302 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fad5c04f400 con 0x7fad5c15b130 2023-10-16T19:57:51.218 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.215+0000 7fad527fc700 1 -- 172.21.15.157:0/1402191302 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16517 (secure 0 0 0) 0x7fad54018090 con 0x7fad5c15b130 2023-10-16T19:57:51.218 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-10-16T19:57:51.218 INFO:teuthology.orchestra.run.smithi157.stdout:{"epoch":21,"fsid":"28199dc9-64d5-479e-83c6-21f097c33d39","created":"2023-10-16T19:56:49.201889+0000","modified":"2023-10-16T19:57:07.988567+0000","last_up_change":"2023-10-16T19:56:54.675673+0000","last_in_change":"2023-10-16T19:56:51.666728+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T19:56:56.932895+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-16T19:57:04.936105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-16T19:57:05.335279+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":335785898},{"type":"v1","addr":"172.21.15.157:6809","nonce":335785898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":335785898},{"type":"v1","addr":"172.21.15.157:6811","nonce":335785898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6815","nonce":335785898},{"type":"v1","addr":"172.21.15.157:6817","nonce":335785898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":335785898},{"type":"v1","addr":"172.21.15.157:6813","nonce":335785898}]},"public_addr":"172.21.15.157:6809/335785898","cluster_addr":"172.21.15.157:6811/335785898","heartbeat_back_addr":"172.21.15.157:6817/335785898","heartbeat_front_addr":"172.21.15.157:6813/335785898","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":3482825047},{"type":"v1","addr":"172.21.15.157:6801","nonce":3482825047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":3482825047},{"type":"v1","addr":"172.21.15.157:6803","nonce":3482825047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":3482825047},{"type":"v1","addr":"172.21.15.157:6807","nonce":3482825047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":3482825047},{"type":"v1","addr":"172.21.15.157:6805","nonce":3482825047}]},"public_addr":"172.21.15.157:6801/3482825047","cluster_addr":"172.21.15.157:6803/3482825047","heartbeat_back_addr":"172.21.15.157:6807/3482825047","heartbeat_front_addr":"172.21.15.157:6805/3482825047","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":1118292389},{"type":"v1","addr":"172.21.15.157:6825","nonce":1118292389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":1118292389},{"type":"v1","addr":"172.21.15.157:6827","nonce":1118292389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":1118292389},{"type":"v1","addr":"172.21.15.157:6831","nonce":1118292389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":1118292389},{"type":"v1","addr":"172.21.15.157:6829","nonce":1118292389}]},"public_addr":"172.21.15.157:6825/1118292389","cluster_addr":"172.21.15.157:6827/1118292389","heartbeat_back_addr":"172.21.15.157:6831/1118292389","heartbeat_front_addr":"172.21.15.157:6829/1118292389","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":989329821},{"type":"v1","addr":"172.21.15.157:6816","nonce":989329821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":989329821},{"type":"v1","addr":"172.21.15.157:6819","nonce":989329821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":989329821},{"type":"v1","addr":"172.21.15.157:6823","nonce":989329821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":989329821},{"type":"v1","addr":"172.21.15.157:6821","nonce":989329821}]},"public_addr":"172.21.15.157:6816/989329821","cluster_addr":"172.21.15.157:6819/989329821","heartbeat_back_addr":"172.21.15.157:6823/989329821","heartbeat_front_addr":"172.21.15.157:6821/989329821","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":3841016811},{"type":"v1","addr":"172.21.15.187:6801","nonce":3841016811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6803","nonce":3841016811},{"type":"v1","addr":"172.21.15.187:6804","nonce":3841016811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6809","nonce":3841016811},{"type":"v1","addr":"172.21.15.187:6811","nonce":3841016811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":3841016811},{"type":"v1","addr":"172.21.15.187:6808","nonce":3841016811}]},"public_addr":"172.21.15.187:6801/3841016811","cluster_addr":"172.21.15.187:6804/3841016811","heartbeat_back_addr":"172.21.15.187:6811/3841016811","heartbeat_front_addr":"172.21.15.187:6808/3841016811","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":915130263},{"type":"v1","addr":"172.21.15.187:6805","nonce":915130263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6807","nonce":915130263},{"type":"v1","addr":"172.21.15.187:6810","nonce":915130263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":915130263},{"type":"v1","addr":"172.21.15.187:6815","nonce":915130263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":915130263},{"type":"v1","addr":"172.21.15.187:6813","nonce":915130263}]},"public_addr":"172.21.15.187:6805/915130263","cluster_addr":"172.21.15.187:6810/915130263","heartbeat_back_addr":"172.21.15.187:6815/915130263","heartbeat_front_addr":"172.21.15.187:6813/915130263","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":654976824},{"type":"v1","addr":"172.21.15.187:6817","nonce":654976824}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":654976824},{"type":"v1","addr":"172.21.15.187:6819","nonce":654976824}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":654976824},{"type":"v1","addr":"172.21.15.187:6823","nonce":654976824}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":654976824},{"type":"v1","addr":"172.21.15.187:6821","nonce":654976824}]},"public_addr":"172.21.15.187:6817/654976824","cluster_addr":"172.21.15.187:6819/654976824","heartbeat_back_addr":"172.21.15.187:6823/654976824","heartbeat_front_addr":"172.21.15.187:6821/654976824","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":4284059445},{"type":"v1","addr":"172.21.15.187:6825","nonce":4284059445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":4284059445},{"type":"v1","addr":"172.21.15.187:6827","nonce":4284059445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":4284059445},{"type":"v1","addr":"172.21.15.187:6831","nonce":4284059445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":4284059445},{"type":"v1","addr":"172.21.15.187:6829","nonce":4284059445}]},"public_addr":"172.21.15.187:6825/4284059445","cluster_addr":"172.21.15.187:6827/4284059445","heartbeat_back_addr":"172.21.15.187:6831/4284059445","heartbeat_front_addr":"172.21.15.187:6829/4284059445","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.819780+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.824193+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.849575+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.824806+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.809540+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.805093+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.866109+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.807372+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T19:57:51.220 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.217+0000 7fad64110700 1 -- 172.21.15.157:0/1402191302 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fad4006af00 msgr2=0x7fad4006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:51.220 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.217+0000 7fad64110700 1 --2- 172.21.15.157:0/1402191302 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fad4006af00 0x7fad4006d3c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fad5c0c8430 tx=0x7fad4c008040 comp rx=0 tx=0).stop 2023-10-16T19:57:51.220 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.217+0000 7fad64110700 1 -- 172.21.15.157:0/1402191302 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fad5c15b130 msgr2=0x7fad5c15d520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:51.220 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.217+0000 7fad64110700 1 --2- 172.21.15.157:0/1402191302 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fad5c15b130 0x7fad5c15d520 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fad5400eed0 tx=0x7fad5400b0b0 comp rx=0 tx=0).stop 2023-10-16T19:57:51.221 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.217+0000 7fad64110700 1 -- 172.21.15.157:0/1402191302 shutdown_connections 2023-10-16T19:57:51.221 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.217+0000 7fad64110700 1 --2- 172.21.15.157:0/1402191302 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fad4006af00 0x7fad4006d3c0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:51.221 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.217+0000 7fad64110700 1 --2- 172.21.15.157:0/1402191302 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fad5c06d0f0 0x7fad5c1f3470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:51.221 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.217+0000 7fad64110700 1 --2- 172.21.15.157:0/1402191302 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fad5c15b130 0x7fad5c15d520 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:51.221 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.217+0000 7fad64110700 1 --2- 172.21.15.157:0/1402191302 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fad5c0cbeb0 0x7fad5c1f70f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:51.222 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.217+0000 7fad64110700 1 -- 172.21.15.157:0/1402191302 >> 172.21.15.157:0/1402191302 conn(0x7fad5c0cd4e0 msgr2=0x7fad5c15a0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:51.222 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.217+0000 7fad64110700 1 -- 172.21.15.157:0/1402191302 shutdown_connections 2023-10-16T19:57:51.222 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.217+0000 7fad64110700 1 -- 172.21.15.157:0/1402191302 wait complete. 2023-10-16T19:57:51.232 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-16T19:56:56.932895+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-16T19:57:04.936105+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-16T19:57:05.335279+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-16T19:57:51.233 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-16T19:57:51.356 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.353+0000 7fb767516700 1 Processor -- start 2023-10-16T19:57:51.356 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.353+0000 7fb767516700 1 -- start start 2023-10-16T19:57:51.358 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.354+0000 7fb767516700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb7600b2710 0x7fb7600b2b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:51.358 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.354+0000 7fb767516700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb76006e180 con 0x7fb760143bd0 2023-10-16T19:57:51.359 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.354+0000 7fb767516700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb760144480 con 0x7fb760071080 2023-10-16T19:57:51.359 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.354+0000 7fb767516700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7600b30d0 con 0x7fb7600b2710 2023-10-16T19:57:51.359 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.354+0000 7fb7652b2700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7fb760143bd0 0x7fb7600cef80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:56790/0 (socket says 172.21.15.157:56790) 2023-10-16T19:57:51.359 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.354+0000 7fb7652b2700 1 -- 172.21.15.157:0/2258965470 learned_addr learned my addr 172.21.15.157:0/2258965470 (peer_addr_for_me v1:172.21.15.157:0/0) 2023-10-16T19:57:51.360 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.355+0000 7fb764ab1700 1 --2- 172.21.15.157:0/2258965470 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb7600b2710 0x7fb7600b2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:51.360 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.355+0000 7fb757fff700 1 -- 172.21.15.157:0/2258965470 <== mon.0 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2677534755 0 0) 0x7fb76006e180 con 0x7fb760143bd0 2023-10-16T19:57:51.360 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.355+0000 7fb757fff700 1 -- 172.21.15.157:0/2258965470 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb74c0035b0 con 0x7fb760143bd0 2023-10-16T19:57:51.360 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.355+0000 7fb757fff700 1 -- 172.21.15.157:0/2258965470 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1219702212 0 0) 0x7fb760144480 con 0x7fb760071080 2023-10-16T19:57:51.360 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.355+0000 7fb757fff700 1 -- 172.21.15.157:0/2258965470 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb76006e180 con 0x7fb760071080 2023-10-16T19:57:51.360 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.355+0000 7fb757fff700 1 -- 172.21.15.157:0/2258965470 <== mon.0 v1:172.21.15.157:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 678548224 0 0) 0x7fb74c0035b0 con 0x7fb760143bd0 2023-10-16T19:57:51.361 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.355+0000 7fb764ab1700 1 -- 172.21.15.157:0/2258965470 >> v1:172.21.15.187:6789/0 conn(0x7fb760071080 legacy=0x7fb76006e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:51.361 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.355+0000 7fb764ab1700 1 -- 172.21.15.157:0/2258965470 >> v1:172.21.15.157:6789/0 conn(0x7fb760143bd0 legacy=0x7fb7600cef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:51.361 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.355+0000 7fb764ab1700 1 -- 172.21.15.157:0/2258965470 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb760071c60 con 0x7fb7600b2710 2023-10-16T19:57:51.361 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.355+0000 7fb764ab1700 1 --2- 172.21.15.157:0/2258965470 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb7600b2710 0x7fb7600b2b90 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fb750009870 tx=0x7fb750009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cca17c8ac96c41ec server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:51.361 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.355+0000 7fb757fff700 1 -- 172.21.15.157:0/2258965470 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7580019f0 con 0x7fb7600b2710 2023-10-16T19:57:51.362 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.355+0000 7fb757fff700 1 -- 172.21.15.157:0/2258965470 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb750004030 con 0x7fb7600b2710 2023-10-16T19:57:51.362 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.355+0000 7fb757fff700 1 -- 172.21.15.157:0/2258965470 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7500043c0 con 0x7fb7600b2710 2023-10-16T19:57:51.362 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.356+0000 7fb767516700 1 -- 172.21.15.157:0/2258965470 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb7600b2710 msgr2=0x7fb7600b2b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:51.362 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.356+0000 7fb767516700 1 --2- 172.21.15.157:0/2258965470 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb7600b2710 0x7fb7600b2b90 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fb750009870 tx=0x7fb750009b80 comp rx=0 tx=0).stop 2023-10-16T19:57:51.363 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.356+0000 7fb767516700 1 -- 172.21.15.157:0/2258965470 shutdown_connections 2023-10-16T19:57:51.363 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.356+0000 7fb767516700 1 --2- 172.21.15.157:0/2258965470 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb7600b2710 0x7fb7600b2b90 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:51.363 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.356+0000 7fb767516700 1 -- 172.21.15.157:0/2258965470 >> 172.21.15.157:0/2258965470 conn(0x7fb7600d0b30 msgr2=0x7fb7600d0f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:51.363 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.356+0000 7fb767516700 1 -- 172.21.15.157:0/2258965470 shutdown_connections 2023-10-16T19:57:51.363 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.356+0000 7fb767516700 1 -- 172.21.15.157:0/2258965470 wait complete. 2023-10-16T19:57:51.366 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.357+0000 7fb767516700 1 Processor -- start 2023-10-16T19:57:51.366 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.357+0000 7fb767516700 1 -- start start 2023-10-16T19:57:51.366 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.358+0000 7fb767516700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb760071080 0x7fb7600b59c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:51.366 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.358+0000 7fb767516700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb7600b2710 0x7fb76013f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:51.367 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.358+0000 7fb767516700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb760143bd0 0x7fb760140960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:51.367 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.358+0000 7fb767516700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7600b3d70 con 0x7fb760071080 2023-10-16T19:57:51.367 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.358+0000 7fb767516700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7600b4050 con 0x7fb7600b2710 2023-10-16T19:57:51.367 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.358+0000 7fb767516700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7600b4330 con 0x7fb760143bd0 2023-10-16T19:57:51.367 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.358+0000 7fb7652b2700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb760071080 0x7fb7600b59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:51.368 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.359+0000 7fb7652b2700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb760071080 0x7fb7600b59c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:47124/0 (socket says 172.21.15.157:47124) 2023-10-16T19:57:51.368 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.359+0000 7fb7652b2700 1 -- 172.21.15.157:0/3264150890 learned_addr learned my addr 172.21.15.157:0/3264150890 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:57:51.368 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.359+0000 7fb764ab1700 1 --2- 172.21.15.157:0/3264150890 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb7600b2710 0x7fb76013f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:51.368 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.359+0000 7fb765ab3700 1 --2- 172.21.15.157:0/3264150890 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb760143bd0 0x7fb760140960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:51.368 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.359+0000 7fb7652b2700 1 -- 172.21.15.157:0/3264150890 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb760143bd0 msgr2=0x7fb760140960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:51.369 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.359+0000 7fb7652b2700 1 --2- 172.21.15.157:0/3264150890 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb760143bd0 0x7fb760140960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:51.369 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.359+0000 7fb7652b2700 1 -- 172.21.15.157:0/3264150890 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb7600b2710 msgr2=0x7fb76013f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:51.369 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.359+0000 7fb7652b2700 1 --2- 172.21.15.157:0/3264150890 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb7600b2710 0x7fb76013f500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:51.369 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.359+0000 7fb7652b2700 1 -- 172.21.15.157:0/3264150890 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7500094a0 con 0x7fb760071080 2023-10-16T19:57:51.369 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.359+0000 7fb765ab3700 1 --2- 172.21.15.157:0/3264150890 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb760143bd0 0x7fb760140960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T19:57:51.369 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.359+0000 7fb764ab1700 1 --2- 172.21.15.157:0/3264150890 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb7600b2710 0x7fb76013f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T19:57:51.370 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.359+0000 7fb7652b2700 1 --2- 172.21.15.157:0/3264150890 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb760071080 0x7fb7600b59c0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fb758001fc0 tx=0x7fb75800a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:51.370 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.359+0000 7fb755ffb700 1 -- 172.21.15.157:0/3264150890 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb75800ad80 con 0x7fb760071080 2023-10-16T19:57:51.370 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.359+0000 7fb755ffb700 1 -- 172.21.15.157:0/3264150890 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7580070d0 con 0x7fb760071080 2023-10-16T19:57:51.370 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.359+0000 7fb767516700 1 -- 172.21.15.157:0/3264150890 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7600b4610 con 0x7fb760071080 2023-10-16T19:57:51.370 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.359+0000 7fb755ffb700 1 -- 172.21.15.157:0/3264150890 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb758007480 con 0x7fb760071080 2023-10-16T19:57:51.371 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.359+0000 7fb767516700 1 -- 172.21.15.157:0/3264150890 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb76013fa40 con 0x7fb760071080 2023-10-16T19:57:51.371 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.360+0000 7fb767516700 1 -- 172.21.15.157:0/3264150890 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb76004f400 con 0x7fb760071080 2023-10-16T19:57:51.371 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.361+0000 7fb755ffb700 1 -- 172.21.15.157:0/3264150890 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fb7580075e0 con 0x7fb760071080 2023-10-16T19:57:51.371 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.361+0000 7fb755ffb700 1 --2- 172.21.15.157:0/3264150890 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fb74406af00 0x7fb74406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:51.371 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.361+0000 7fb755ffb700 1 -- 172.21.15.157:0/3264150890 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb758089600 con 0x7fb760071080 2023-10-16T19:57:51.372 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.361+0000 7fb764ab1700 1 --2- 172.21.15.157:0/3264150890 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fb74406af00 0x7fb74406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:51.372 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.362+0000 7fb764ab1700 1 --2- 172.21.15.157:0/3264150890 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fb74406af00 0x7fb74406d3c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fb7600b5950 tx=0x7fb750008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:51.372 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.365+0000 7fb755ffb700 1 -- 172.21.15.157:0/3264150890 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb7580546b0 con 0x7fb760071080 2023-10-16T19:57:51.557 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.554+0000 7fb767516700 1 -- 172.21.15.157:0/3264150890 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb76006d430 con 0x7fb760071080 2023-10-16T19:57:51.557 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.555+0000 7fb755ffb700 1 -- 172.21.15.157:0/3264150890 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb758057cd0 con 0x7fb760071080 2023-10-16T19:57:51.558 INFO:teuthology.orchestra.run.smithi157.stdout:pg_num: 1 2023-10-16T19:57:51.559 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.557+0000 7fb767516700 1 -- 172.21.15.157:0/3264150890 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fb74406af00 msgr2=0x7fb74406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:51.560 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.557+0000 7fb767516700 1 --2- 172.21.15.157:0/3264150890 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fb74406af00 0x7fb74406d3c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fb7600b5950 tx=0x7fb750008030 comp rx=0 tx=0).stop 2023-10-16T19:57:51.560 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.557+0000 7fb767516700 1 -- 172.21.15.157:0/3264150890 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb760071080 msgr2=0x7fb7600b59c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:51.560 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.557+0000 7fb767516700 1 --2- 172.21.15.157:0/3264150890 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb760071080 0x7fb7600b59c0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fb758001fc0 tx=0x7fb75800a340 comp rx=0 tx=0).stop 2023-10-16T19:57:51.560 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.557+0000 7fb767516700 1 -- 172.21.15.157:0/3264150890 shutdown_connections 2023-10-16T19:57:51.560 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.557+0000 7fb767516700 1 --2- 172.21.15.157:0/3264150890 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb760143bd0 0x7fb760140960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:51.561 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.557+0000 7fb767516700 1 --2- 172.21.15.157:0/3264150890 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb760071080 0x7fb7600b59c0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:51.561 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.557+0000 7fb767516700 1 --2- 172.21.15.157:0/3264150890 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fb74406af00 0x7fb74406d3c0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:51.561 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.557+0000 7fb767516700 1 --2- 172.21.15.157:0/3264150890 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb7600b2710 0x7fb76013f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:51.561 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.557+0000 7fb767516700 1 -- 172.21.15.157:0/3264150890 >> 172.21.15.157:0/3264150890 conn(0x7fb7600d0b30 msgr2=0x7fb7600b06d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:51.562 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.557+0000 7fb767516700 1 -- 172.21.15.157:0/3264150890 shutdown_connections 2023-10-16T19:57:51.562 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.557+0000 7fb767516700 1 -- 172.21.15.157:0/3264150890 wait complete. 2023-10-16T19:57:51.571 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-16T19:57:51.696 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.693+0000 7f15a3716700 1 Processor -- start 2023-10-16T19:57:51.696 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.694+0000 7f15a3716700 1 -- start start 2023-10-16T19:57:51.698 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.694+0000 7f15a3716700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f159c0b36b0 0x7f159c0b0cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:51.699 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.694+0000 7f15a3716700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f159c15efb0 0x7f159c06fa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:51.699 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.694+0000 7f15a3716700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f159c0cdc30 con 0x7f159c0cc310 2023-10-16T19:57:51.699 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.694+0000 7f15a3716700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f159c0b1200 con 0x7f159c0b36b0 2023-10-16T19:57:51.699 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.694+0000 7f15a3716700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f159c0cc790 con 0x7f159c15efb0 2023-10-16T19:57:51.699 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.695+0000 7f15a14b2700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f159c0b36b0 0x7f159c0b0cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:51.700 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.695+0000 7f15a0cb1700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f159c0cc310 0x7f159c0b3a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:56806/0 (socket says 172.21.15.157:56806) 2023-10-16T19:57:51.700 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.695+0000 7f15a14b2700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f159c0b36b0 0x7f159c0b0cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:47132/0 (socket says 172.21.15.157:47132) 2023-10-16T19:57:51.700 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.695+0000 7f15a0cb1700 1 -- 172.21.15.157:0/2130711279 learned_addr learned my addr 172.21.15.157:0/2130711279 (peer_addr_for_me v1:172.21.15.157:0/0) 2023-10-16T19:57:51.700 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.695+0000 7f15a1cb3700 1 --2- 172.21.15.157:0/2130711279 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f159c15efb0 0x7f159c06fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:51.700 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.695+0000 7f15a14b2700 1 -- 172.21.15.157:0/2130711279 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f159c15efb0 msgr2=0x7f159c06fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:57:51.701 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.695+0000 7f15a14b2700 1 --2- 172.21.15.157:0/2130711279 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f159c15efb0 0x7f159c06fa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:51.701 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.695+0000 7f15a14b2700 1 -- 172.21.15.157:0/2130711279 >> v1:172.21.15.157:6789/0 conn(0x7f159c0cc310 legacy=0x7f159c0b3a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:51.701 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.695+0000 7f1593fff700 1 -- 172.21.15.157:0/2130711279 <== mon.0 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2652491323 0 0) 0x7f159c0cdc30 con 0x7f159c0cc310 2023-10-16T19:57:51.701 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.695+0000 7f15a14b2700 1 -- 172.21.15.157:0/2130711279 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f159c0cde60 con 0x7f159c0b36b0 2023-10-16T19:57:51.701 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.695+0000 7f15a14b2700 1 --2- 172.21.15.157:0/2130711279 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f159c0b36b0 0x7f159c0b0cc0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f158c009840 tx=0x7f158c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b48cbf4db696fcf0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:51.702 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.695+0000 7f1593fff700 1 -- 172.21.15.157:0/2130711279 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f158c011830 con 0x7f159c0b36b0 2023-10-16T19:57:51.702 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.695+0000 7f1593fff700 1 -- 172.21.15.157:0/2130711279 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f158c011990 con 0x7f159c0b36b0 2023-10-16T19:57:51.702 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.695+0000 7f1593fff700 1 -- 172.21.15.157:0/2130711279 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f158c011d20 con 0x7f159c0b36b0 2023-10-16T19:57:51.702 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.696+0000 7f15a3716700 1 -- 172.21.15.157:0/2130711279 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f159c0b36b0 msgr2=0x7f159c0b0cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:51.702 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.696+0000 7f15a3716700 1 --2- 172.21.15.157:0/2130711279 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f159c0b36b0 0x7f159c0b0cc0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f158c009840 tx=0x7f158c009b50 comp rx=0 tx=0).stop 2023-10-16T19:57:51.703 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.696+0000 7f15a3716700 1 -- 172.21.15.157:0/2130711279 shutdown_connections 2023-10-16T19:57:51.703 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.696+0000 7f15a3716700 1 --2- 172.21.15.157:0/2130711279 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f159c15efb0 0x7f159c06fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:51.703 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.696+0000 7f15a3716700 1 --2- 172.21.15.157:0/2130711279 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f159c0b36b0 0x7f159c0b0cc0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:51.703 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.696+0000 7f15a3716700 1 -- 172.21.15.157:0/2130711279 >> 172.21.15.157:0/2130711279 conn(0x7f159c0ce6b0 msgr2=0x7f159c0ceac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:51.703 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.696+0000 7f15a3716700 1 -- 172.21.15.157:0/2130711279 shutdown_connections 2023-10-16T19:57:51.703 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.696+0000 7f15a3716700 1 -- 172.21.15.157:0/2130711279 wait complete. 2023-10-16T19:57:51.706 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.697+0000 7f15a3716700 1 Processor -- start 2023-10-16T19:57:51.706 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.697+0000 7f15a3716700 1 -- start start 2023-10-16T19:57:51.707 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.698+0000 7f15a3716700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f159c0b36b0 0x7f159c1f4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:51.707 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.698+0000 7f15a3716700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f159c0cc310 0x7f159c15e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:51.707 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.698+0000 7f15a3716700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f159c15efb0 0x7f159c0b1700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:51.707 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.698+0000 7f15a3716700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f159c0caa60 con 0x7f159c0cc310 2023-10-16T19:57:51.707 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.698+0000 7f15a3716700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f159c15e5a0 con 0x7f159c0b36b0 2023-10-16T19:57:51.708 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.698+0000 7f15a3716700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f159c1f4b50 con 0x7f159c15efb0 2023-10-16T19:57:51.708 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.698+0000 7f15a0cb1700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f159c0cc310 0x7f159c15e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:51.708 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.698+0000 7f15a0cb1700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f159c0cc310 0x7f159c15e060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:47140/0 (socket says 172.21.15.157:47140) 2023-10-16T19:57:51.708 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.698+0000 7f15a0cb1700 1 -- 172.21.15.157:0/4213740223 learned_addr learned my addr 172.21.15.157:0/4213740223 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:57:51.708 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.698+0000 7f15a1cb3700 1 --2- 172.21.15.157:0/4213740223 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f159c15efb0 0x7f159c0b1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:51.708 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.698+0000 7f15a14b2700 1 --2- 172.21.15.157:0/4213740223 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f159c0b36b0 0x7f159c1f4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:51.709 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.698+0000 7f15a0cb1700 1 -- 172.21.15.157:0/4213740223 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f159c15efb0 msgr2=0x7f159c0b1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:51.709 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.698+0000 7f15a0cb1700 1 --2- 172.21.15.157:0/4213740223 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f159c15efb0 0x7f159c0b1700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:51.709 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.698+0000 7f15a0cb1700 1 -- 172.21.15.157:0/4213740223 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f159c0b36b0 msgr2=0x7f159c1f4d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:51.709 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.698+0000 7f15a0cb1700 1 --2- 172.21.15.157:0/4213740223 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f159c0b36b0 0x7f159c1f4d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:51.709 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.698+0000 7f15a0cb1700 1 -- 172.21.15.157:0/4213740223 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f158c0094a0 con 0x7f159c0cc310 2023-10-16T19:57:51.710 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.698+0000 7f15a14b2700 1 --2- 172.21.15.157:0/4213740223 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f159c0b36b0 0x7f159c1f4d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T19:57:51.710 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.698+0000 7f15a1cb3700 1 --2- 172.21.15.157:0/4213740223 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f159c15efb0 0x7f159c0b1700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T19:57:51.710 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.698+0000 7f15a0cb1700 1 --2- 172.21.15.157:0/4213740223 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f159c0cc310 0x7f159c15e060 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f159800c750 tx=0x7f159800cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:51.710 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.698+0000 7f1591ffb700 1 -- 172.21.15.157:0/4213740223 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1598004c80 con 0x7f159c0cc310 2023-10-16T19:57:51.710 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.698+0000 7f1591ffb700 1 -- 172.21.15.157:0/4213740223 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1598004e00 con 0x7f159c0cc310 2023-10-16T19:57:51.711 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.698+0000 7f15a3716700 1 -- 172.21.15.157:0/4213740223 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f159c0ca130 con 0x7f159c0cc310 2023-10-16T19:57:51.711 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.698+0000 7f1591ffb700 1 -- 172.21.15.157:0/4213740223 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1598007310 con 0x7f159c0cc310 2023-10-16T19:57:51.711 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.699+0000 7f15a3716700 1 -- 172.21.15.157:0/4213740223 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f159c0ca6f0 con 0x7f159c0cc310 2023-10-16T19:57:51.711 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.700+0000 7f15a3716700 1 -- 172.21.15.157:0/4213740223 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f159c0cabd0 con 0x7f159c0cc310 2023-10-16T19:57:51.711 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.700+0000 7f1591ffb700 1 -- 172.21.15.157:0/4213740223 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f1598007470 con 0x7f159c0cc310 2023-10-16T19:57:51.712 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.700+0000 7f1591ffb700 1 --2- 172.21.15.157:0/4213740223 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f158006af00 0x7f158006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:51.712 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.700+0000 7f1591ffb700 1 -- 172.21.15.157:0/4213740223 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1598089330 con 0x7f159c0cc310 2023-10-16T19:57:51.712 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.700+0000 7f15a14b2700 1 --2- 172.21.15.157:0/4213740223 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f158006af00 0x7f158006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:51.712 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.701+0000 7f15a14b2700 1 --2- 172.21.15.157:0/4213740223 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f158006af00 0x7f158006d3c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f158c000c00 tx=0x7f158c01c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:51.713 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.705+0000 7f1591ffb700 1 -- 172.21.15.157:0/4213740223 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f15980543e0 con 0x7f159c0cc310 2023-10-16T19:57:51.894 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.892+0000 7f15a3716700 1 -- 172.21.15.157:0/4213740223 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f159c04f400 con 0x7f159c0cc310 2023-10-16T19:57:51.895 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.893+0000 7f1591ffb700 1 -- 172.21.15.157:0/4213740223 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1598057a00 con 0x7f159c0cc310 2023-10-16T19:57:51.896 INFO:teuthology.orchestra.run.smithi157.stdout:pg_num: 32 2023-10-16T19:57:51.897 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.895+0000 7f15a3716700 1 -- 172.21.15.157:0/4213740223 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f158006af00 msgr2=0x7f158006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:51.897 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.895+0000 7f15a3716700 1 --2- 172.21.15.157:0/4213740223 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f158006af00 0x7f158006d3c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f158c000c00 tx=0x7f158c01c040 comp rx=0 tx=0).stop 2023-10-16T19:57:51.898 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.895+0000 7f15a3716700 1 -- 172.21.15.157:0/4213740223 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f159c0cc310 msgr2=0x7f159c15e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:51.898 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.895+0000 7f15a3716700 1 --2- 172.21.15.157:0/4213740223 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f159c0cc310 0x7f159c15e060 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f159800c750 tx=0x7f159800cb10 comp rx=0 tx=0).stop 2023-10-16T19:57:51.898 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.895+0000 7f15a3716700 1 -- 172.21.15.157:0/4213740223 shutdown_connections 2023-10-16T19:57:51.898 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.895+0000 7f15a3716700 1 --2- 172.21.15.157:0/4213740223 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f158006af00 0x7f158006d3c0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:51.899 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.895+0000 7f15a3716700 1 --2- 172.21.15.157:0/4213740223 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f159c0b36b0 0x7f159c1f4d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:51.899 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.895+0000 7f15a3716700 1 --2- 172.21.15.157:0/4213740223 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f159c15efb0 0x7f159c0b1700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:51.899 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.895+0000 7f15a3716700 1 --2- 172.21.15.157:0/4213740223 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f159c0cc310 0x7f159c15e060 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:51.899 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.895+0000 7f15a3716700 1 -- 172.21.15.157:0/4213740223 >> 172.21.15.157:0/4213740223 conn(0x7f159c0ce6b0 msgr2=0x7f159c06b700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:51.899 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.895+0000 7f15a3716700 1 -- 172.21.15.157:0/4213740223 shutdown_connections 2023-10-16T19:57:51.900 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:51.895+0000 7f15a3716700 1 -- 172.21.15.157:0/4213740223 wait complete. 2023-10-16T19:57:51.909 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-16T19:57:52.032 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.029+0000 7ff09658f700 1 Processor -- start 2023-10-16T19:57:52.032 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.030+0000 7ff09658f700 1 -- start start 2023-10-16T19:57:52.035 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.030+0000 7ff09658f700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7ff09015e090 0x7ff09006b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:52.035 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.030+0000 7ff09658f700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7ff09006ea10 0x7ff0900afa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:52.036 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.030+0000 7ff09658f700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff0900affc0 0x7ff09015e470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:52.036 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.030+0000 7ff09658f700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff090071b50 con 0x7ff09015e090 2023-10-16T19:57:52.036 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.030+0000 7ff09658f700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0900b0410 con 0x7ff09006ea10 2023-10-16T19:57:52.036 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.030+0000 7ff09658f700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff09006b6a0 con 0x7ff0900affc0 2023-10-16T19:57:52.036 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.031+0000 7ff08ffff700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7ff09015e090 0x7ff09006b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:52.037 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.031+0000 7ff08ffff700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7ff09015e090 0x7ff09006b160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:47146/0 (socket says 172.21.15.157:47146) 2023-10-16T19:57:52.037 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.031+0000 7ff08ffff700 1 -- 172.21.15.157:0/2246414341 learned_addr learned my addr 172.21.15.157:0/2246414341 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:57:52.037 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.031+0000 7ff094b2c700 1 --2- 172.21.15.157:0/2246414341 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff0900affc0 0x7ff09015e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:52.037 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.031+0000 7ff08f7fe700 1 --2- 172.21.15.157:0/2246414341 >> v2:172.21.15.187:3300/0 conn(0x7ff09006ea10 0x7ff0900afa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:52.037 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.031+0000 7ff08ffff700 1 -- 172.21.15.157:0/2246414341 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff0900affc0 msgr2=0x7ff09015e470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:57:52.038 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.031+0000 7ff08ffff700 1 --2- 172.21.15.157:0/2246414341 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff0900affc0 0x7ff09015e470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:52.038 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.031+0000 7ff08ffff700 1 -- 172.21.15.157:0/2246414341 >> v2:172.21.15.187:3300/0 conn(0x7ff09006ea10 msgr2=0x7ff0900afa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:57:52.038 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.031+0000 7ff08ffff700 1 --2- 172.21.15.157:0/2246414341 >> v2:172.21.15.187:3300/0 conn(0x7ff09006ea10 0x7ff0900afa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:52.038 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.031+0000 7ff08ffff700 1 -- 172.21.15.157:0/2246414341 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff090072320 con 0x7ff09015e090 2023-10-16T19:57:52.038 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.031+0000 7ff08f7fe700 1 --2- 172.21.15.157:0/2246414341 >> v2:172.21.15.187:3300/0 conn(0x7ff09006ea10 0x7ff0900afa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T19:57:52.038 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.031+0000 7ff08ffff700 1 --2- 172.21.15.157:0/2246414341 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff09015e090 0x7ff09006b160 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7ff0900c70c0 tx=0x7ff080009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6e5f91b6cf6d36e server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:52.039 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.031+0000 7ff08effd700 1 -- 172.21.15.157:0/2246414341 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff08000b870 con 0x7ff09015e090 2023-10-16T19:57:52.039 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.031+0000 7ff08effd700 1 -- 172.21.15.157:0/2246414341 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff08000b9d0 con 0x7ff09015e090 2023-10-16T19:57:52.039 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.031+0000 7ff08effd700 1 -- 172.21.15.157:0/2246414341 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff08000bd60 con 0x7ff09015e090 2023-10-16T19:57:52.039 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.032+0000 7ff09658f700 1 -- 172.21.15.157:0/2246414341 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff09015e090 msgr2=0x7ff09006b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:52.039 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.032+0000 7ff09658f700 1 --2- 172.21.15.157:0/2246414341 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff09015e090 0x7ff09006b160 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7ff0900c70c0 tx=0x7ff080009bd0 comp rx=0 tx=0).stop 2023-10-16T19:57:52.040 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.032+0000 7ff09658f700 1 -- 172.21.15.157:0/2246414341 shutdown_connections 2023-10-16T19:57:52.040 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.032+0000 7ff09658f700 1 --2- 172.21.15.157:0/2246414341 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff0900affc0 0x7ff09015e470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:52.040 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.032+0000 7ff09658f700 1 --2- 172.21.15.157:0/2246414341 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff09015e090 0x7ff09006b160 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:52.040 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.032+0000 7ff09658f700 1 --2- 172.21.15.157:0/2246414341 >> v2:172.21.15.187:3300/0 conn(0x7ff09006ea10 0x7ff0900afa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:52.040 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.032+0000 7ff09658f700 1 -- 172.21.15.157:0/2246414341 >> 172.21.15.157:0/2246414341 conn(0x7ff0900d0b30 msgr2=0x7ff0900d0f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:52.041 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.032+0000 7ff09658f700 1 -- 172.21.15.157:0/2246414341 shutdown_connections 2023-10-16T19:57:52.041 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.032+0000 7ff09658f700 1 -- 172.21.15.157:0/2246414341 wait complete. 2023-10-16T19:57:52.041 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.033+0000 7ff09658f700 1 Processor -- start 2023-10-16T19:57:52.041 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.033+0000 7ff09658f700 1 -- start start 2023-10-16T19:57:52.044 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.034+0000 7ff09658f700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff09006ea10 0x7ff0901f6360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:52.044 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.034+0000 7ff09658f700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff0900affc0 0x7ff090161c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:52.044 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.034+0000 7ff09658f700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff09015e090 0x7ff090162150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:52.044 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.034+0000 7ff09658f700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff090158780 con 0x7ff09006ea10 2023-10-16T19:57:52.044 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.034+0000 7ff09658f700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff090158a60 con 0x7ff0900affc0 2023-10-16T19:57:52.045 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.034+0000 7ff09658f700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff090158d40 con 0x7ff09015e090 2023-10-16T19:57:52.045 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.034+0000 7ff08ffff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff09006ea10 0x7ff0901f6360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:52.045 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.034+0000 7ff08ffff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff09006ea10 0x7ff0901f6360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:47152/0 (socket says 172.21.15.157:47152) 2023-10-16T19:57:52.045 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.034+0000 7ff08ffff700 1 -- 172.21.15.157:0/3442823667 learned_addr learned my addr 172.21.15.157:0/3442823667 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:57:52.045 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.034+0000 7ff094b2c700 1 --2- 172.21.15.157:0/3442823667 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff09015e090 0x7ff090162150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:52.046 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.034+0000 7ff08f7fe700 1 --2- 172.21.15.157:0/3442823667 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff0900affc0 0x7ff090161c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:52.046 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.034+0000 7ff08ffff700 1 -- 172.21.15.157:0/3442823667 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff09015e090 msgr2=0x7ff090162150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:52.046 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.034+0000 7ff08ffff700 1 --2- 172.21.15.157:0/3442823667 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff09015e090 0x7ff090162150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:52.046 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.034+0000 7ff08ffff700 1 -- 172.21.15.157:0/3442823667 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff0900affc0 msgr2=0x7ff090161c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:52.046 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.034+0000 7ff08ffff700 1 --2- 172.21.15.157:0/3442823667 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff0900affc0 0x7ff090161c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:52.047 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.034+0000 7ff08ffff700 1 -- 172.21.15.157:0/3442823667 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff080009550 con 0x7ff09006ea10 2023-10-16T19:57:52.047 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.034+0000 7ff094b2c700 1 --2- 172.21.15.157:0/3442823667 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff09015e090 0x7ff090162150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T19:57:52.047 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.034+0000 7ff08f7fe700 1 --2- 172.21.15.157:0/3442823667 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff0900affc0 0x7ff090161c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T19:57:52.047 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.034+0000 7ff08ffff700 1 --2- 172.21.15.157:0/3442823667 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff09006ea10 0x7ff0901f6360 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7ff080000c00 tx=0x7ff080004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:52.047 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.034+0000 7ff08cff9700 1 -- 172.21.15.157:0/3442823667 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff080004540 con 0x7ff09006ea10 2023-10-16T19:57:52.048 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.034+0000 7ff08cff9700 1 -- 172.21.15.157:0/3442823667 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0800036a0 con 0x7ff09006ea10 2023-10-16T19:57:52.048 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.034+0000 7ff09658f700 1 -- 172.21.15.157:0/3442823667 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff090159020 con 0x7ff09006ea10 2023-10-16T19:57:52.048 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.035+0000 7ff08cff9700 1 -- 172.21.15.157:0/3442823667 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff080003a50 con 0x7ff09006ea10 2023-10-16T19:57:52.048 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.035+0000 7ff09658f700 1 -- 172.21.15.157:0/3442823667 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff09015bc70 con 0x7ff09006ea10 2023-10-16T19:57:52.048 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.036+0000 7ff09658f700 1 -- 172.21.15.157:0/3442823667 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff09015be00 con 0x7ff09006ea10 2023-10-16T19:57:52.049 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.036+0000 7ff08cff9700 1 -- 172.21.15.157:0/3442823667 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7ff080021070 con 0x7ff09006ea10 2023-10-16T19:57:52.049 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.036+0000 7ff08cff9700 1 --2- 172.21.15.157:0/3442823667 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7ff07c06af00 0x7ff07c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:52.049 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.036+0000 7ff08cff9700 1 -- 172.21.15.157:0/3442823667 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff08008acb0 con 0x7ff09006ea10 2023-10-16T19:57:52.049 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.036+0000 7ff08f7fe700 1 --2- 172.21.15.157:0/3442823667 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7ff07c06af00 0x7ff07c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:52.049 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.037+0000 7ff08f7fe700 1 --2- 172.21.15.157:0/3442823667 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7ff07c06af00 0x7ff07c06d3c0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ff08400aa50 tx=0x7ff084008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:52.050 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.041+0000 7ff08cff9700 1 -- 172.21.15.157:0/3442823667 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff080055df0 con 0x7ff09006ea10 2023-10-16T19:57:52.230 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.228+0000 7ff09658f700 1 -- 172.21.15.157:0/3442823667 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff09004f400 con 0x7ff09006ea10 2023-10-16T19:57:52.231 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.228+0000 7ff08cff9700 1 -- 172.21.15.157:0/3442823667 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff080015020 con 0x7ff09006ea10 2023-10-16T19:57:52.231 INFO:teuthology.orchestra.run.smithi157.stdout:pg_num: 64 2023-10-16T19:57:52.233 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.230+0000 7ff09658f700 1 -- 172.21.15.157:0/3442823667 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7ff07c06af00 msgr2=0x7ff07c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:52.233 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.230+0000 7ff09658f700 1 --2- 172.21.15.157:0/3442823667 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7ff07c06af00 0x7ff07c06d3c0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ff08400aa50 tx=0x7ff084008040 comp rx=0 tx=0).stop 2023-10-16T19:57:52.233 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.230+0000 7ff09658f700 1 -- 172.21.15.157:0/3442823667 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff09006ea10 msgr2=0x7ff0901f6360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:52.233 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.230+0000 7ff09658f700 1 --2- 172.21.15.157:0/3442823667 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff09006ea10 0x7ff0901f6360 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7ff080000c00 tx=0x7ff080004750 comp rx=0 tx=0).stop 2023-10-16T19:57:52.234 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.230+0000 7ff09658f700 1 -- 172.21.15.157:0/3442823667 shutdown_connections 2023-10-16T19:57:52.234 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.230+0000 7ff09658f700 1 --2- 172.21.15.157:0/3442823667 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff09015e090 0x7ff090162150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:52.234 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.230+0000 7ff09658f700 1 --2- 172.21.15.157:0/3442823667 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff09006ea10 0x7ff0901f6360 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:52.234 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.230+0000 7ff09658f700 1 --2- 172.21.15.157:0/3442823667 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7ff07c06af00 0x7ff07c06d3c0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:52.234 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.230+0000 7ff09658f700 1 --2- 172.21.15.157:0/3442823667 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff0900affc0 0x7ff090161c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:52.235 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.230+0000 7ff09658f700 1 -- 172.21.15.157:0/3442823667 >> 172.21.15.157:0/3442823667 conn(0x7ff0900d0b30 msgr2=0x7ff090073ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:52.235 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.230+0000 7ff09658f700 1 -- 172.21.15.157:0/3442823667 shutdown_connections 2023-10-16T19:57:52.235 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.230+0000 7ff09658f700 1 -- 172.21.15.157:0/3442823667 wait complete. 2023-10-16T19:57:52.245 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-16T19:57:52.368 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.363+0000 7f60a32c9700 1 Processor -- start 2023-10-16T19:57:52.368 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.363+0000 7f60a32c9700 1 -- start start 2023-10-16T19:57:52.368 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.364+0000 7f60a32c9700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f609c15e2f0 0x7f609c06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:52.368 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.364+0000 7f60a32c9700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f609c06de00 0x7f609c0ce910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:52.369 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.364+0000 7f60a32c9700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f609c0d08b0 con 0x7f609c06a850 2023-10-16T19:57:52.369 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.364+0000 7f60a32c9700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f609c1628f0 con 0x7f609c15e2f0 2023-10-16T19:57:52.369 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.364+0000 7f60a32c9700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f609c162bd0 con 0x7f609c06de00 2023-10-16T19:57:52.369 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.364+0000 7f60a0864700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f609c06de00 0x7f609c0ce910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:52.369 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.364+0000 7f60a0864700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f609c06de00 0x7f609c0ce910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.157:56466/0 (socket says 172.21.15.157:56466) 2023-10-16T19:57:52.370 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.364+0000 7f60a0864700 1 -- 172.21.15.157:0/738521768 learned_addr learned my addr 172.21.15.157:0/738521768 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:57:52.370 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.364+0000 7f60a1065700 1 --2- 172.21.15.157:0/738521768 >> v2:172.21.15.187:3300/0 conn(0x7f609c15e2f0 0x7f609c06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:52.370 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.364+0000 7f60a1065700 1 -- 172.21.15.157:0/738521768 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f609c06de00 msgr2=0x7f609c0ce910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:57:52.370 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.364+0000 7f60a1065700 1 --2- 172.21.15.157:0/738521768 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f609c06de00 0x7f609c0ce910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:52.370 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.364+0000 7f60a1065700 1 -- 172.21.15.157:0/738521768 >> v1:172.21.15.187:6789/0 conn(0x7f609c06a850 legacy=0x7f609c070f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:52.371 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.364+0000 7f60a1065700 1 -- 172.21.15.157:0/738521768 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f609c0d05d0 con 0x7f609c15e2f0 2023-10-16T19:57:52.371 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.364+0000 7f6093fff700 1 -- 172.21.15.157:0/738521768 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 309043830 0 0) 0x7f609c0d08b0 con 0x7f609c06a850 2023-10-16T19:57:52.371 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.364+0000 7f60a0864700 1 --2- 172.21.15.157:0/738521768 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f609c06de00 0x7f609c0ce910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T19:57:52.371 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.365+0000 7f60a1065700 1 --2- 172.21.15.157:0/738521768 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f609c15e2f0 0x7f609c06d0f0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f6098009840 tx=0x7f6098009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d8d9b327159e2d32 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:52.371 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.365+0000 7f6093fff700 1 -- 172.21.15.157:0/738521768 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6098011830 con 0x7f609c15e2f0 2023-10-16T19:57:52.372 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.365+0000 7f6093fff700 1 -- 172.21.15.157:0/738521768 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6098011990 con 0x7f609c15e2f0 2023-10-16T19:57:52.372 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.365+0000 7f6093fff700 1 -- 172.21.15.157:0/738521768 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6098011d20 con 0x7f609c15e2f0 2023-10-16T19:57:52.372 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.365+0000 7f60a32c9700 1 -- 172.21.15.157:0/738521768 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f609c15e2f0 msgr2=0x7f609c06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:52.372 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.365+0000 7f60a32c9700 1 --2- 172.21.15.157:0/738521768 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f609c15e2f0 0x7f609c06d0f0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f6098009840 tx=0x7f6098009b50 comp rx=0 tx=0).stop 2023-10-16T19:57:52.372 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.365+0000 7f60a32c9700 1 -- 172.21.15.157:0/738521768 shutdown_connections 2023-10-16T19:57:52.373 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.365+0000 7f60a32c9700 1 --2- 172.21.15.157:0/738521768 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f609c15e2f0 0x7f609c06d0f0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:52.373 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.365+0000 7f60a32c9700 1 --2- 172.21.15.157:0/738521768 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f609c06de00 0x7f609c0ce910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:52.373 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.365+0000 7f60a32c9700 1 -- 172.21.15.157:0/738521768 >> 172.21.15.157:0/738521768 conn(0x7f609c0cd4e0 msgr2=0x7f609c0cd8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:52.373 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.365+0000 7f60a32c9700 1 -- 172.21.15.157:0/738521768 shutdown_connections 2023-10-16T19:57:52.373 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.365+0000 7f60a32c9700 1 -- 172.21.15.157:0/738521768 wait complete. 2023-10-16T19:57:52.376 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.367+0000 7f60a32c9700 1 Processor -- start 2023-10-16T19:57:52.376 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.367+0000 7f60a32c9700 1 -- start start 2023-10-16T19:57:52.377 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.367+0000 7f60a32c9700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f609c06a850 0x7f609c1f7a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:52.377 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.367+0000 7f60a32c9700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f609c06de00 0x7f609c1f3440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:52.377 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.367+0000 7f60a32c9700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f609c15e2f0 0x7f609c0c6580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:52.377 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.367+0000 7f60a32c9700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f609c155a20 con 0x7f609c06de00 2023-10-16T19:57:52.377 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.367+0000 7f60a32c9700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f609c1f75d0 con 0x7f609c06a850 2023-10-16T19:57:52.378 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.367+0000 7f60a32c9700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f609c0c6e60 con 0x7f609c15e2f0 2023-10-16T19:57:52.378 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.367+0000 7f60a0864700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f609c06de00 0x7f609c1f3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:52.378 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.368+0000 7f60a0864700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f609c06de00 0x7f609c1f3440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:47168/0 (socket says 172.21.15.157:47168) 2023-10-16T19:57:52.378 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.368+0000 7f60a0864700 1 -- 172.21.15.157:0/3537699364 learned_addr learned my addr 172.21.15.157:0/3537699364 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:57:52.379 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.368+0000 7f60a1065700 1 --2- 172.21.15.157:0/3537699364 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f609c06a850 0x7f609c1f7a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:52.379 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.368+0000 7f60a1866700 1 --2- 172.21.15.157:0/3537699364 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f609c15e2f0 0x7f609c0c6580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:52.379 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.368+0000 7f60a0864700 1 -- 172.21.15.157:0/3537699364 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f609c15e2f0 msgr2=0x7f609c0c6580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:52.379 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.368+0000 7f60a0864700 1 --2- 172.21.15.157:0/3537699364 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f609c15e2f0 0x7f609c0c6580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:52.379 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.368+0000 7f60a0864700 1 -- 172.21.15.157:0/3537699364 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f609c06a850 msgr2=0x7f609c1f7a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:52.380 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.368+0000 7f60a0864700 1 --2- 172.21.15.157:0/3537699364 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f609c06a850 0x7f609c1f7a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:52.380 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.368+0000 7f60a0864700 1 -- 172.21.15.157:0/3537699364 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f608c009550 con 0x7f609c06de00 2023-10-16T19:57:52.380 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.368+0000 7f60a0864700 1 --2- 172.21.15.157:0/3537699364 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f609c06de00 0x7f609c1f3440 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f608c00e9b0 tx=0x7f608c00ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:52.380 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.368+0000 7f6091ffb700 1 -- 172.21.15.157:0/3537699364 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f608c00ee50 con 0x7f609c06de00 2023-10-16T19:57:52.380 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.368+0000 7f6091ffb700 1 -- 172.21.15.157:0/3537699364 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f608c00c850 con 0x7f609c06de00 2023-10-16T19:57:52.381 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.368+0000 7f60a32c9700 1 -- 172.21.15.157:0/3537699364 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60980094a0 con 0x7f609c06de00 2023-10-16T19:57:52.381 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.368+0000 7f6091ffb700 1 -- 172.21.15.157:0/3537699364 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f608c00cbc0 con 0x7f609c06de00 2023-10-16T19:57:52.381 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.368+0000 7f60a32c9700 1 -- 172.21.15.157:0/3537699364 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f609c1f6f80 con 0x7f609c06de00 2023-10-16T19:57:52.381 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.369+0000 7f60a32c9700 1 -- 172.21.15.157:0/3537699364 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f609c1f7740 con 0x7f609c06de00 2023-10-16T19:57:52.381 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.370+0000 7f6091ffb700 1 -- 172.21.15.157:0/3537699364 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f608c00cd20 con 0x7f609c06de00 2023-10-16T19:57:52.382 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.370+0000 7f6091ffb700 1 --2- 172.21.15.157:0/3537699364 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f608006af00 0x7f608006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:52.382 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.370+0000 7f6091ffb700 1 -- 172.21.15.157:0/3537699364 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f608c089590 con 0x7f609c06de00 2023-10-16T19:57:52.382 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.370+0000 7f60a1065700 1 --2- 172.21.15.157:0/3537699364 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f608006af00 0x7f608006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:52.382 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.371+0000 7f60a1065700 1 --2- 172.21.15.157:0/3537699364 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f608006af00 0x7f608006d3c0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f60980090b0 tx=0x7f6098008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:52.383 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.375+0000 7f6091ffb700 1 -- 172.21.15.157:0/3537699364 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f608c054630 con 0x7f609c06de00 2023-10-16T19:57:52.606 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.604+0000 7f60a32c9700 1 -- 172.21.15.157:0/3537699364 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f609c04f400 con 0x7f609c06de00 2023-10-16T19:57:52.607 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.605+0000 7f6091ffb700 1 -- 172.21.15.157:0/3537699364 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4913 (secure 0 0 0) 0x7f608c057c50 con 0x7f609c06de00 2023-10-16T19:57:52.607 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-10-16T19:57:52.608 INFO:teuthology.orchestra.run.smithi157.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/1319816297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6834","nonce":1319816297},{"type":"v1","addr":"172.21.15.187:6835","nonce":1319816297}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4242,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6834/3219992837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6832","nonce":3219992837},{"type":"v1","addr":"172.21.15.157:6834","nonce":3219992837}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4245,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6835/1675699874","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6833","nonce":1675699874},{"type":"v1","addr":"172.21.15.157:6835","nonce":1675699874}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-16T19:57:06.364669+0000","modified":"2023-10-16T19:57:09.412706+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4282":{"gid":4282,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.187:6837/68705029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6836","nonce":68705029},{"type":"v1","addr":"172.21.15.187:6837","nonce":68705029}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-16T19:57:52.609 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.607+0000 7f60a32c9700 1 -- 172.21.15.157:0/3537699364 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f608006af00 msgr2=0x7f608006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:52.609 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.607+0000 7f60a32c9700 1 --2- 172.21.15.157:0/3537699364 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f608006af00 0x7f608006d3c0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f60980090b0 tx=0x7f6098008030 comp rx=0 tx=0).stop 2023-10-16T19:57:52.610 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.607+0000 7f60a32c9700 1 -- 172.21.15.157:0/3537699364 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f609c06de00 msgr2=0x7f609c1f3440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:52.610 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.607+0000 7f60a32c9700 1 --2- 172.21.15.157:0/3537699364 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f609c06de00 0x7f609c1f3440 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f608c00e9b0 tx=0x7f608c00ecc0 comp rx=0 tx=0).stop 2023-10-16T19:57:52.610 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.607+0000 7f60a32c9700 1 -- 172.21.15.157:0/3537699364 shutdown_connections 2023-10-16T19:57:52.610 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.607+0000 7f60a32c9700 1 --2- 172.21.15.157:0/3537699364 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f608006af00 0x7f608006d3c0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:52.611 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.607+0000 7f60a32c9700 1 --2- 172.21.15.157:0/3537699364 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f609c06a850 0x7f609c1f7a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:52.611 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.607+0000 7f60a32c9700 1 --2- 172.21.15.157:0/3537699364 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f609c15e2f0 0x7f609c0c6580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:52.611 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.607+0000 7f60a32c9700 1 --2- 172.21.15.157:0/3537699364 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f609c06de00 0x7f609c1f3440 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:52.611 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.607+0000 7f60a32c9700 1 -- 172.21.15.157:0/3537699364 >> 172.21.15.157:0/3537699364 conn(0x7f609c0cd4e0 msgr2=0x7f609c0b19a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:52.611 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.607+0000 7f60a32c9700 1 -- 172.21.15.157:0/3537699364 shutdown_connections 2023-10-16T19:57:52.612 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.607+0000 7f60a32c9700 1 -- 172.21.15.157:0/3537699364 wait complete. 2023-10-16T19:57:52.612 INFO:teuthology.orchestra.run.smithi157.stderr:dumped fsmap epoch 8 2023-10-16T19:57:52.621 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T19:57:52.741 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.739+0000 7fdb2e5c1700 1 Processor -- start 2023-10-16T19:57:52.742 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.739+0000 7fdb2e5c1700 1 -- start start 2023-10-16T19:57:52.744 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.740+0000 7fdb2e5c1700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fdb2815bf50 0x7fdb280cef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:52.744 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.740+0000 7fdb2e5c1700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fdb280cdf80 0x7fdb280d0e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:52.744 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.740+0000 7fdb2e5c1700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb280cf920 con 0x7fdb280b76e0 2023-10-16T19:57:52.744 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.740+0000 7fdb2e5c1700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb280cc4b0 con 0x7fdb2815bf50 2023-10-16T19:57:52.745 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.740+0000 7fdb2e5c1700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb280cfc00 con 0x7fdb280cdf80 2023-10-16T19:57:52.745 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.740+0000 7fdb27fff700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fdb2815bf50 0x7fdb280cef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:52.745 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.740+0000 7fdb277fe700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7fdb280b76e0 0x7fdb280cd870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:56846/0 (socket says 172.21.15.157:56846) 2023-10-16T19:57:52.745 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.740+0000 7fdb277fe700 1 -- 172.21.15.157:0/2372647708 learned_addr learned my addr 172.21.15.157:0/2372647708 (peer_addr_for_me v1:172.21.15.157:0/0) 2023-10-16T19:57:52.745 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.740+0000 7fdb2cb5e700 1 --2- 172.21.15.157:0/2372647708 >> v2:172.21.15.187:3300/0 conn(0x7fdb280cdf80 0x7fdb280d0e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:52.745 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.740+0000 7fdb27fff700 1 -- 172.21.15.157:0/2372647708 >> v2:172.21.15.187:3300/0 conn(0x7fdb280cdf80 msgr2=0x7fdb280d0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:57:52.746 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.740+0000 7fdb27fff700 1 --2- 172.21.15.157:0/2372647708 >> v2:172.21.15.187:3300/0 conn(0x7fdb280cdf80 0x7fdb280d0e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:52.746 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.740+0000 7fdb27fff700 1 -- 172.21.15.157:0/2372647708 >> v1:172.21.15.157:6789/0 conn(0x7fdb280b76e0 legacy=0x7fdb280cd870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:52.746 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.740+0000 7fdb26ffd700 1 -- 172.21.15.157:0/2372647708 <== mon.0 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2856469411 0 0) 0x7fdb280cf920 con 0x7fdb280b76e0 2023-10-16T19:57:52.746 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.740+0000 7fdb27fff700 1 -- 172.21.15.157:0/2372647708 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb280cfee0 con 0x7fdb2815bf50 2023-10-16T19:57:52.746 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.740+0000 7fdb2cb5e700 1 --2- 172.21.15.157:0/2372647708 >> v2:172.21.15.187:3300/0 conn(0x7fdb280cdf80 0x7fdb280d0e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T19:57:52.747 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.740+0000 7fdb27fff700 1 --2- 172.21.15.157:0/2372647708 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdb2815bf50 0x7fdb280cef80 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fdb280cd640 tx=0x7fdb18009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e2a42097803ac7e server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:52.747 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.740+0000 7fdb26ffd700 1 -- 172.21.15.157:0/2372647708 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb18011830 con 0x7fdb2815bf50 2023-10-16T19:57:52.748 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.740+0000 7fdb26ffd700 1 -- 172.21.15.157:0/2372647708 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb18011990 con 0x7fdb2815bf50 2023-10-16T19:57:52.748 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.740+0000 7fdb26ffd700 1 -- 172.21.15.157:0/2372647708 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb18011d20 con 0x7fdb2815bf50 2023-10-16T19:57:52.748 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.741+0000 7fdb2e5c1700 1 -- 172.21.15.157:0/2372647708 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdb2815bf50 msgr2=0x7fdb280cef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:52.748 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.741+0000 7fdb2e5c1700 1 --2- 172.21.15.157:0/2372647708 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdb2815bf50 0x7fdb280cef80 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fdb280cd640 tx=0x7fdb18009b20 comp rx=0 tx=0).stop 2023-10-16T19:57:52.749 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.741+0000 7fdb2e5c1700 1 -- 172.21.15.157:0/2372647708 shutdown_connections 2023-10-16T19:57:52.749 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.741+0000 7fdb2e5c1700 1 --2- 172.21.15.157:0/2372647708 >> v2:172.21.15.187:3300/0 conn(0x7fdb280cdf80 0x7fdb280d0e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:52.749 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.741+0000 7fdb2e5c1700 1 --2- 172.21.15.157:0/2372647708 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdb2815bf50 0x7fdb280cef80 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:52.749 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.741+0000 7fdb2e5c1700 1 -- 172.21.15.157:0/2372647708 >> 172.21.15.157:0/2372647708 conn(0x7fdb2806e300 msgr2=0x7fdb2806e6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:52.749 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.741+0000 7fdb2e5c1700 1 -- 172.21.15.157:0/2372647708 shutdown_connections 2023-10-16T19:57:52.750 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.741+0000 7fdb2e5c1700 1 -- 172.21.15.157:0/2372647708 wait complete. 2023-10-16T19:57:52.752 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.742+0000 7fdb2e5c1700 1 Processor -- start 2023-10-16T19:57:52.752 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.742+0000 7fdb2e5c1700 1 -- start start 2023-10-16T19:57:52.752 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.743+0000 7fdb2e5c1700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdb280b76e0 0x7fdb281f2190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:52.753 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.743+0000 7fdb2e5c1700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdb280cdf80 0x7fdb280cb540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:52.753 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.743+0000 7fdb2e5c1700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdb280c7990 0x7fdb280c7e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:52.753 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.743+0000 7fdb2e5c1700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb280c8360 con 0x7fdb280c7990 2023-10-16T19:57:52.753 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.743+0000 7fdb2e5c1700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb281f26d0 con 0x7fdb280cdf80 2023-10-16T19:57:52.753 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.743+0000 7fdb2e5c1700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb280c6660 con 0x7fdb280b76e0 2023-10-16T19:57:52.754 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.743+0000 7fdb2cb5e700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdb280c7990 0x7fdb280c7e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:52.754 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.743+0000 7fdb2cb5e700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdb280c7990 0x7fdb280c7e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:47184/0 (socket says 172.21.15.157:47184) 2023-10-16T19:57:52.754 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.743+0000 7fdb2cb5e700 1 -- 172.21.15.157:0/2749149740 learned_addr learned my addr 172.21.15.157:0/2749149740 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:57:52.754 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.743+0000 7fdb27fff700 1 --2- 172.21.15.157:0/2749149740 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdb280b76e0 0x7fdb281f2190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:52.754 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.743+0000 7fdb277fe700 1 --2- 172.21.15.157:0/2749149740 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdb280cdf80 0x7fdb280cb540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:52.755 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.743+0000 7fdb2cb5e700 1 -- 172.21.15.157:0/2749149740 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdb280b76e0 msgr2=0x7fdb281f2190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:52.755 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.743+0000 7fdb2cb5e700 1 --2- 172.21.15.157:0/2749149740 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdb280b76e0 0x7fdb281f2190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:52.755 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.743+0000 7fdb2cb5e700 1 -- 172.21.15.157:0/2749149740 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdb280cdf80 msgr2=0x7fdb280cb540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:52.755 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.743+0000 7fdb2cb5e700 1 --2- 172.21.15.157:0/2749149740 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdb280cdf80 0x7fdb280cb540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:52.755 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.744+0000 7fdb2cb5e700 1 -- 172.21.15.157:0/2749149740 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb180094a0 con 0x7fdb280c7990 2023-10-16T19:57:52.755 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.744+0000 7fdb2cb5e700 1 --2- 172.21.15.157:0/2749149740 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdb280c7990 0x7fdb280c7e20 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fdb2000cca0 tx=0x7fdb2000a280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:52.756 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.744+0000 7fdb24ff9700 1 -- 172.21.15.157:0/2749149740 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb2000ad50 con 0x7fdb280c7990 2023-10-16T19:57:52.756 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.744+0000 7fdb24ff9700 1 -- 172.21.15.157:0/2749149740 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb2000f480 con 0x7fdb280c7990 2023-10-16T19:57:52.756 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.744+0000 7fdb2e5c1700 1 -- 172.21.15.157:0/2749149740 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb280c5a50 con 0x7fdb280c7990 2023-10-16T19:57:52.756 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.744+0000 7fdb24ff9700 1 -- 172.21.15.157:0/2749149740 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb2000f830 con 0x7fdb280c7990 2023-10-16T19:57:52.756 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.744+0000 7fdb2e5c1700 1 -- 172.21.15.157:0/2749149740 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb280c6010 con 0x7fdb280c7990 2023-10-16T19:57:52.757 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.745+0000 7fdb2e5c1700 1 -- 172.21.15.157:0/2749149740 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb280c67d0 con 0x7fdb280c7990 2023-10-16T19:57:52.757 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.745+0000 7fdb24ff9700 1 -- 172.21.15.157:0/2749149740 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fdb2000b040 con 0x7fdb280c7990 2023-10-16T19:57:52.757 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.746+0000 7fdb24ff9700 1 --2- 172.21.15.157:0/2749149740 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fdb1406af00 0x7fdb1406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:52.757 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.746+0000 7fdb24ff9700 1 -- 172.21.15.157:0/2749149740 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdb20089c50 con 0x7fdb280c7990 2023-10-16T19:57:52.757 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.746+0000 7fdb27fff700 1 --2- 172.21.15.157:0/2749149740 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fdb1406af00 0x7fdb1406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:52.758 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.746+0000 7fdb27fff700 1 --2- 172.21.15.157:0/2749149740 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fdb1406af00 0x7fdb1406d3c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fdb280ce580 tx=0x7fdb18008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:52.758 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.750+0000 7fdb24ff9700 1 -- 172.21.15.157:0/2749149740 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fdb2008f020 con 0x7fdb280c7990 2023-10-16T19:57:52.941 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.939+0000 7fdb2e5c1700 1 -- 172.21.15.157:0/2749149740 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdb2804f400 con 0x7fdb280c7990 2023-10-16T19:57:52.942 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.940+0000 7fdb24ff9700 1 -- 172.21.15.157:0/2749149740 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16517 (secure 0 0 0) 0x7fdb20054d00 con 0x7fdb280c7990 2023-10-16T19:57:52.943 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-10-16T19:57:52.943 INFO:teuthology.orchestra.run.smithi157.stdout:{"epoch":21,"fsid":"28199dc9-64d5-479e-83c6-21f097c33d39","created":"2023-10-16T19:56:49.201889+0000","modified":"2023-10-16T19:57:07.988567+0000","last_up_change":"2023-10-16T19:56:54.675673+0000","last_in_change":"2023-10-16T19:56:51.666728+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T19:56:56.932895+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-16T19:57:04.936105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-16T19:57:05.335279+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":335785898},{"type":"v1","addr":"172.21.15.157:6809","nonce":335785898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":335785898},{"type":"v1","addr":"172.21.15.157:6811","nonce":335785898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6815","nonce":335785898},{"type":"v1","addr":"172.21.15.157:6817","nonce":335785898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":335785898},{"type":"v1","addr":"172.21.15.157:6813","nonce":335785898}]},"public_addr":"172.21.15.157:6809/335785898","cluster_addr":"172.21.15.157:6811/335785898","heartbeat_back_addr":"172.21.15.157:6817/335785898","heartbeat_front_addr":"172.21.15.157:6813/335785898","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":3482825047},{"type":"v1","addr":"172.21.15.157:6801","nonce":3482825047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":3482825047},{"type":"v1","addr":"172.21.15.157:6803","nonce":3482825047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":3482825047},{"type":"v1","addr":"172.21.15.157:6807","nonce":3482825047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":3482825047},{"type":"v1","addr":"172.21.15.157:6805","nonce":3482825047}]},"public_addr":"172.21.15.157:6801/3482825047","cluster_addr":"172.21.15.157:6803/3482825047","heartbeat_back_addr":"172.21.15.157:6807/3482825047","heartbeat_front_addr":"172.21.15.157:6805/3482825047","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":1118292389},{"type":"v1","addr":"172.21.15.157:6825","nonce":1118292389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":1118292389},{"type":"v1","addr":"172.21.15.157:6827","nonce":1118292389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":1118292389},{"type":"v1","addr":"172.21.15.157:6831","nonce":1118292389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":1118292389},{"type":"v1","addr":"172.21.15.157:6829","nonce":1118292389}]},"public_addr":"172.21.15.157:6825/1118292389","cluster_addr":"172.21.15.157:6827/1118292389","heartbeat_back_addr":"172.21.15.157:6831/1118292389","heartbeat_front_addr":"172.21.15.157:6829/1118292389","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":989329821},{"type":"v1","addr":"172.21.15.157:6816","nonce":989329821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":989329821},{"type":"v1","addr":"172.21.15.157:6819","nonce":989329821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":989329821},{"type":"v1","addr":"172.21.15.157:6823","nonce":989329821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":989329821},{"type":"v1","addr":"172.21.15.157:6821","nonce":989329821}]},"public_addr":"172.21.15.157:6816/989329821","cluster_addr":"172.21.15.157:6819/989329821","heartbeat_back_addr":"172.21.15.157:6823/989329821","heartbeat_front_addr":"172.21.15.157:6821/989329821","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":3841016811},{"type":"v1","addr":"172.21.15.187:6801","nonce":3841016811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6803","nonce":3841016811},{"type":"v1","addr":"172.21.15.187:6804","nonce":3841016811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6809","nonce":3841016811},{"type":"v1","addr":"172.21.15.187:6811","nonce":3841016811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":3841016811},{"type":"v1","addr":"172.21.15.187:6808","nonce":3841016811}]},"public_addr":"172.21.15.187:6801/3841016811","cluster_addr":"172.21.15.187:6804/3841016811","heartbeat_back_addr":"172.21.15.187:6811/3841016811","heartbeat_front_addr":"172.21.15.187:6808/3841016811","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":915130263},{"type":"v1","addr":"172.21.15.187:6805","nonce":915130263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6807","nonce":915130263},{"type":"v1","addr":"172.21.15.187:6810","nonce":915130263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":915130263},{"type":"v1","addr":"172.21.15.187:6815","nonce":915130263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":915130263},{"type":"v1","addr":"172.21.15.187:6813","nonce":915130263}]},"public_addr":"172.21.15.187:6805/915130263","cluster_addr":"172.21.15.187:6810/915130263","heartbeat_back_addr":"172.21.15.187:6815/915130263","heartbeat_front_addr":"172.21.15.187:6813/915130263","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":654976824},{"type":"v1","addr":"172.21.15.187:6817","nonce":654976824}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":654976824},{"type":"v1","addr":"172.21.15.187:6819","nonce":654976824}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":654976824},{"type":"v1","addr":"172.21.15.187:6823","nonce":654976824}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":654976824},{"type":"v1","addr":"172.21.15.187:6821","nonce":654976824}]},"public_addr":"172.21.15.187:6817/654976824","cluster_addr":"172.21.15.187:6819/654976824","heartbeat_back_addr":"172.21.15.187:6823/654976824","heartbeat_front_addr":"172.21.15.187:6821/654976824","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":4284059445},{"type":"v1","addr":"172.21.15.187:6825","nonce":4284059445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":4284059445},{"type":"v1","addr":"172.21.15.187:6827","nonce":4284059445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":4284059445},{"type":"v1","addr":"172.21.15.187:6831","nonce":4284059445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":4284059445},{"type":"v1","addr":"172.21.15.187:6829","nonce":4284059445}]},"public_addr":"172.21.15.187:6825/4284059445","cluster_addr":"172.21.15.187:6827/4284059445","heartbeat_back_addr":"172.21.15.187:6831/4284059445","heartbeat_front_addr":"172.21.15.187:6829/4284059445","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.819780+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.824193+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.849575+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.824806+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.809540+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.805093+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.866109+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.807372+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T19:57:52.944 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.942+0000 7fdb2e5c1700 1 -- 172.21.15.157:0/2749149740 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fdb1406af00 msgr2=0x7fdb1406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:52.945 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.942+0000 7fdb2e5c1700 1 --2- 172.21.15.157:0/2749149740 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fdb1406af00 0x7fdb1406d3c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fdb280ce580 tx=0x7fdb18008030 comp rx=0 tx=0).stop 2023-10-16T19:57:52.945 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.942+0000 7fdb2e5c1700 1 -- 172.21.15.157:0/2749149740 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdb280c7990 msgr2=0x7fdb280c7e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:52.945 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.942+0000 7fdb2e5c1700 1 --2- 172.21.15.157:0/2749149740 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdb280c7990 0x7fdb280c7e20 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fdb2000cca0 tx=0x7fdb2000a280 comp rx=0 tx=0).stop 2023-10-16T19:57:52.945 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.942+0000 7fdb2e5c1700 1 -- 172.21.15.157:0/2749149740 shutdown_connections 2023-10-16T19:57:52.946 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.942+0000 7fdb2e5c1700 1 --2- 172.21.15.157:0/2749149740 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdb280c7990 0x7fdb280c7e20 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:52.946 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.942+0000 7fdb2e5c1700 1 --2- 172.21.15.157:0/2749149740 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdb280b76e0 0x7fdb281f2190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:52.946 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.942+0000 7fdb2e5c1700 1 --2- 172.21.15.157:0/2749149740 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fdb1406af00 0x7fdb1406d3c0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:52.946 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.942+0000 7fdb2e5c1700 1 --2- 172.21.15.157:0/2749149740 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdb280cdf80 0x7fdb280cb540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:52.946 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.942+0000 7fdb2e5c1700 1 -- 172.21.15.157:0/2749149740 >> 172.21.15.157:0/2749149740 conn(0x7fdb2806e300 msgr2=0x7fdb280b1670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:52.947 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.942+0000 7fdb2e5c1700 1 -- 172.21.15.157:0/2749149740 shutdown_connections 2023-10-16T19:57:52.947 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:52.942+0000 7fdb2e5c1700 1 -- 172.21.15.157:0/2749149740 wait complete. 2023-10-16T19:57:52.957 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-16T19:57:52.958 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-16T19:57:53.078 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.076+0000 7fb01f659700 1 Processor -- start 2023-10-16T19:57:53.079 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.076+0000 7fb01f659700 1 -- start start 2023-10-16T19:57:53.084 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.077+0000 7fb01f659700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fb01815de80 0x7fb0180cf2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:53.085 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.077+0000 7fb01f659700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0180cee50 con 0x7fb0180b5f20 2023-10-16T19:57:53.085 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.077+0000 7fb01f659700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0180cf820 con 0x7fb01815e260 2023-10-16T19:57:53.085 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.077+0000 7fb01f659700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0180ce5f0 con 0x7fb01815de80 2023-10-16T19:57:53.086 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.077+0000 7fb01dbf6700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7fb0180b5f20 0x7fb018161cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:56862/0 (socket says 172.21.15.157:56862) 2023-10-16T19:57:53.086 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.077+0000 7fb01dbf6700 1 -- 172.21.15.157:0/2239839837 learned_addr learned my addr 172.21.15.157:0/2239839837 (peer_addr_for_me v1:172.21.15.157:0/0) 2023-10-16T19:57:53.086 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.077+0000 7fb01d3f5700 1 --2- 172.21.15.157:0/2239839837 >> v2:172.21.15.187:3300/0 conn(0x7fb01815de80 0x7fb0180cf2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:53.087 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.077+0000 7fb00ffff700 1 -- 172.21.15.157:0/2239839837 <== mon.0 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3480144469 0 0) 0x7fb0180cee50 con 0x7fb0180b5f20 2023-10-16T19:57:53.087 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.077+0000 7fb00ffff700 1 -- 172.21.15.157:0/2239839837 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb0040035b0 con 0x7fb0180b5f20 2023-10-16T19:57:53.087 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.077+0000 7fb00ffff700 1 -- 172.21.15.157:0/2239839837 <== mon.0 v1:172.21.15.157:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1196023542 0 0) 0x7fb0040035b0 con 0x7fb0180b5f20 2023-10-16T19:57:53.087 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.077+0000 7fb00ffff700 1 -- 172.21.15.157:0/2239839837 >> v2:172.21.15.187:3300/0 conn(0x7fb01815de80 msgr2=0x7fb0180cf2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:57:53.087 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.077+0000 7fb00ffff700 1 --2- 172.21.15.157:0/2239839837 >> v2:172.21.15.187:3300/0 conn(0x7fb01815de80 0x7fb0180cf2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:53.088 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.077+0000 7fb00ffff700 1 -- 172.21.15.157:0/2239839837 >> v1:172.21.15.187:6789/0 conn(0x7fb01815e260 legacy=0x7fb0180b5810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:53.088 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.077+0000 7fb00ffff700 1 -- 172.21.15.157:0/2239839837 --> v1:172.21.15.157:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb018162a40 con 0x7fb0180b5f20 2023-10-16T19:57:53.088 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.077+0000 7fb00ffff700 1 -- 172.21.15.157:0/2239839837 <== mon.0 v1:172.21.15.157:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4021145519 0 0) 0x7fb0100019f0 con 0x7fb0180b5f20 2023-10-16T19:57:53.088 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.077+0000 7fb01d3f5700 1 --2- 172.21.15.157:0/2239839837 >> v2:172.21.15.187:3300/0 conn(0x7fb01815de80 0x7fb0180cf2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T19:57:53.088 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.077+0000 7fb00ffff700 1 -- 172.21.15.157:0/2239839837 >> v1:172.21.15.157:6789/0 conn(0x7fb0180b5f20 legacy=0x7fb018161cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:53.089 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.077+0000 7fb00ffff700 1 --2- 172.21.15.157:0/2239839837 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb004003a00 0x7fb004003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:53.089 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.077+0000 7fb00ffff700 1 --2- 172.21.15.157:0/2239839837 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb004004850 0x7fb004004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:53.089 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.077+0000 7fb00ffff700 1 --2- 172.21.15.157:0/2239839837 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb004005210 0x7fb00400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:53.089 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.077+0000 7fb00ffff700 1 -- 172.21.15.157:0/2239839837 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0180ce5f0 con 0x7fb004005210 2023-10-16T19:57:53.089 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.077+0000 7fb00ffff700 1 -- 172.21.15.157:0/2239839837 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb00400c0e0 con 0x7fb004003a00 2023-10-16T19:57:53.090 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.077+0000 7fb00ffff700 1 -- 172.21.15.157:0/2239839837 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb00400c2a0 con 0x7fb004004850 2023-10-16T19:57:53.090 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.077+0000 7fb01dbf6700 1 --2- 172.21.15.157:0/2239839837 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb004005210 0x7fb00400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:53.090 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.078+0000 7fb01d3f5700 1 --2- 172.21.15.157:0/2239839837 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb004003a00 0x7fb004003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:53.090 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.078+0000 7fb01cbf4700 1 --2- 172.21.15.157:0/2239839837 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb004004850 0x7fb004004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:53.090 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.078+0000 7fb01dbf6700 1 -- 172.21.15.157:0/2239839837 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb004004850 msgr2=0x7fb004004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:57:53.091 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.078+0000 7fb01dbf6700 1 --2- 172.21.15.157:0/2239839837 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb004004850 0x7fb004004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:53.091 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.078+0000 7fb01dbf6700 1 -- 172.21.15.157:0/2239839837 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb004003a00 msgr2=0x7fb004003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:57:53.091 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.078+0000 7fb01dbf6700 1 --2- 172.21.15.157:0/2239839837 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb004003a00 0x7fb004003e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:53.091 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.078+0000 7fb01dbf6700 1 -- 172.21.15.157:0/2239839837 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0040035b0 con 0x7fb004005210 2023-10-16T19:57:53.091 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.078+0000 7fb01cbf4700 1 --2- 172.21.15.157:0/2239839837 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb004004850 0x7fb004004cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T19:57:53.091 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.078+0000 7fb01dbf6700 1 -- 172.21.15.157:0/2239839837 reap_dead start 2023-10-16T19:57:53.092 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.078+0000 7fb01dbf6700 1 --2- 172.21.15.157:0/2239839837 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb004005210 0x7fb00400ba10 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fb01000a830 tx=0x7fb004005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9fb007353cc59e9 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:53.092 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.078+0000 7fb00ffff700 1 -- 172.21.15.157:0/2239839837 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb01000a2f0 con 0x7fb004005210 2023-10-16T19:57:53.092 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.078+0000 7fb00ffff700 1 -- 172.21.15.157:0/2239839837 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb010012620 con 0x7fb004005210 2023-10-16T19:57:53.092 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.078+0000 7fb00ffff700 1 -- 172.21.15.157:0/2239839837 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0100129d0 con 0x7fb004005210 2023-10-16T19:57:53.092 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.079+0000 7fb01f659700 1 -- 172.21.15.157:0/2239839837 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb004005210 msgr2=0x7fb00400ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:53.093 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.079+0000 7fb01f659700 1 --2- 172.21.15.157:0/2239839837 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb004005210 0x7fb00400ba10 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fb01000a830 tx=0x7fb004005880 comp rx=0 tx=0).stop 2023-10-16T19:57:53.093 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.079+0000 7fb01f659700 1 -- 172.21.15.157:0/2239839837 shutdown_connections 2023-10-16T19:57:53.093 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.079+0000 7fb01f659700 1 --2- 172.21.15.157:0/2239839837 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb004005210 0x7fb00400ba10 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:53.093 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.079+0000 7fb01f659700 1 -- 172.21.15.157:0/2239839837 >> 172.21.15.157:0/2239839837 conn(0x7fb0180d0810 msgr2=0x7fb0180d0bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:53.094 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.079+0000 7fb01f659700 1 -- 172.21.15.157:0/2239839837 shutdown_connections 2023-10-16T19:57:53.094 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.079+0000 7fb01f659700 1 -- 172.21.15.157:0/2239839837 wait complete. 2023-10-16T19:57:53.094 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.080+0000 7fb01f659700 1 Processor -- start 2023-10-16T19:57:53.095 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.080+0000 7fb01f659700 1 -- start start 2023-10-16T19:57:53.095 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.081+0000 7fb01f659700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb004005210 0x7fb01815fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:53.096 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.081+0000 7fb01f659700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb0180cc260 0x7fb0180b81b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:53.097 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.081+0000 7fb01f659700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb01814ed90 0x7fb0180b86f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:53.097 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.081+0000 7fb01f659700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0181f7020 con 0x7fb01814ed90 2023-10-16T19:57:53.097 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.081+0000 7fb01f659700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0180ccf60 con 0x7fb004005210 2023-10-16T19:57:53.097 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.081+0000 7fb01f659700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0180cd240 con 0x7fb0180cc260 2023-10-16T19:57:53.097 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.081+0000 7fb01dbf6700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb01814ed90 0x7fb0180b86f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:53.098 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.081+0000 7fb01dbf6700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb01814ed90 0x7fb0180b86f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:47204/0 (socket says 172.21.15.157:47204) 2023-10-16T19:57:53.098 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.081+0000 7fb01dbf6700 1 -- 172.21.15.157:0/1019717047 learned_addr learned my addr 172.21.15.157:0/1019717047 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:57:53.098 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.081+0000 7fb01cbf4700 1 --2- 172.21.15.157:0/1019717047 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb0180cc260 0x7fb0180b81b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:53.098 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.081+0000 7fb01d3f5700 1 --2- 172.21.15.157:0/1019717047 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb004005210 0x7fb01815fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:53.099 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.081+0000 7fb01dbf6700 1 -- 172.21.15.157:0/1019717047 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb0180cc260 msgr2=0x7fb0180b81b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:53.099 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.081+0000 7fb01dbf6700 1 --2- 172.21.15.157:0/1019717047 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb0180cc260 0x7fb0180b81b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:53.099 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.081+0000 7fb01dbf6700 1 -- 172.21.15.157:0/1019717047 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb004005210 msgr2=0x7fb01815fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:53.099 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.081+0000 7fb01dbf6700 1 --2- 172.21.15.157:0/1019717047 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb004005210 0x7fb01815fac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:53.100 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.081+0000 7fb01dbf6700 1 -- 172.21.15.157:0/1019717047 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0180cd520 con 0x7fb01814ed90 2023-10-16T19:57:53.100 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.081+0000 7fb01dbf6700 1 --2- 172.21.15.157:0/1019717047 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb01814ed90 0x7fb0180b86f0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fb0180d01e0 tx=0x7fb010001d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:53.100 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.081+0000 7fb00dffb700 1 -- 172.21.15.157:0/1019717047 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb010012ba0 con 0x7fb01814ed90 2023-10-16T19:57:53.100 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.081+0000 7fb00dffb700 1 -- 172.21.15.157:0/1019717047 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb010012d00 con 0x7fb01814ed90 2023-10-16T19:57:53.100 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.081+0000 7fb01f659700 1 -- 172.21.15.157:0/1019717047 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0180cd800 con 0x7fb01814ed90 2023-10-16T19:57:53.101 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.081+0000 7fb00dffb700 1 -- 172.21.15.157:0/1019717047 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb01001d660 con 0x7fb01814ed90 2023-10-16T19:57:53.101 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.081+0000 7fb01f659700 1 -- 172.21.15.157:0/1019717047 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0180ccb80 con 0x7fb01814ed90 2023-10-16T19:57:53.101 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.082+0000 7fb01f659700 1 -- 172.21.15.157:0/1019717047 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb01804f400 con 0x7fb01814ed90 2023-10-16T19:57:53.102 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.083+0000 7fb00dffb700 1 -- 172.21.15.157:0/1019717047 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fb01001d7c0 con 0x7fb01814ed90 2023-10-16T19:57:53.102 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.083+0000 7fb00dffb700 1 --2- 172.21.15.157:0/1019717047 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7faffc06af00 0x7faffc06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:53.102 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.083+0000 7fb00dffb700 1 -- 172.21.15.157:0/1019717047 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb01008b560 con 0x7fb01814ed90 2023-10-16T19:57:53.102 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.083+0000 7fb01d3f5700 1 --2- 172.21.15.157:0/1019717047 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7faffc06af00 0x7faffc06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:53.103 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.084+0000 7fb01d3f5700 1 --2- 172.21.15.157:0/1019717047 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7faffc06af00 0x7faffc06d3c0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fb014009470 tx=0x7fb014009210 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:53.103 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.088+0000 7fb00dffb700 1 -- 172.21.15.157:0/1019717047 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb0100566a0 con 0x7fb01814ed90 2023-10-16T19:57:53.322 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.319+0000 7fb01f659700 1 -- 172.21.15.157:0/1019717047 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb01804f400 con 0x7fb01814ed90 2023-10-16T19:57:53.323 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.320+0000 7fb00dffb700 1 -- 172.21.15.157:0/1019717047 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4913 (secure 0 0 0) 0x7fb010059cc0 con 0x7fb01814ed90 2023-10-16T19:57:53.323 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-10-16T19:57:53.323 INFO:teuthology.orchestra.run.smithi157.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/1319816297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6834","nonce":1319816297},{"type":"v1","addr":"172.21.15.187:6835","nonce":1319816297}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4242,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6834/3219992837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6832","nonce":3219992837},{"type":"v1","addr":"172.21.15.157:6834","nonce":3219992837}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4245,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6835/1675699874","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6833","nonce":1675699874},{"type":"v1","addr":"172.21.15.157:6835","nonce":1675699874}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-16T19:57:06.364669+0000","modified":"2023-10-16T19:57:09.412706+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4282":{"gid":4282,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.187:6837/68705029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6836","nonce":68705029},{"type":"v1","addr":"172.21.15.187:6837","nonce":68705029}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-16T19:57:53.325 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.322+0000 7fb01f659700 1 -- 172.21.15.157:0/1019717047 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7faffc06af00 msgr2=0x7faffc06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:53.325 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.322+0000 7fb01f659700 1 --2- 172.21.15.157:0/1019717047 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7faffc06af00 0x7faffc06d3c0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fb014009470 tx=0x7fb014009210 comp rx=0 tx=0).stop 2023-10-16T19:57:53.325 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.322+0000 7fb01f659700 1 -- 172.21.15.157:0/1019717047 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb01814ed90 msgr2=0x7fb0180b86f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:53.325 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.322+0000 7fb01f659700 1 --2- 172.21.15.157:0/1019717047 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb01814ed90 0x7fb0180b86f0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fb0180d01e0 tx=0x7fb010001d80 comp rx=0 tx=0).stop 2023-10-16T19:57:53.325 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.322+0000 7fb01f659700 1 -- 172.21.15.157:0/1019717047 shutdown_connections 2023-10-16T19:57:53.326 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.322+0000 7fb01f659700 1 --2- 172.21.15.157:0/1019717047 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7faffc06af00 0x7faffc06d3c0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:53.326 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.322+0000 7fb01f659700 1 --2- 172.21.15.157:0/1019717047 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb004005210 0x7fb01815fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:53.326 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.322+0000 7fb01f659700 1 --2- 172.21.15.157:0/1019717047 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb01814ed90 0x7fb0180b86f0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:53.326 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.322+0000 7fb01f659700 1 --2- 172.21.15.157:0/1019717047 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb0180cc260 0x7fb0180b81b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:53.326 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.322+0000 7fb01f659700 1 -- 172.21.15.157:0/1019717047 >> 172.21.15.157:0/1019717047 conn(0x7fb0180d0810 msgr2=0x7fb0180b4070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:53.327 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.322+0000 7fb01f659700 1 -- 172.21.15.157:0/1019717047 shutdown_connections 2023-10-16T19:57:53.327 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.322+0000 7fb01f659700 1 -- 172.21.15.157:0/1019717047 wait complete. 2023-10-16T19:57:53.327 INFO:teuthology.orchestra.run.smithi157.stderr:dumped fsmap epoch 8 2023-10-16T19:57:53.337 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-16T19:57:53.457 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.455+0000 7fe4e431d700 1 Processor -- start 2023-10-16T19:57:53.457 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.455+0000 7fe4e431d700 1 -- start start 2023-10-16T19:57:53.460 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.456+0000 7fe4e431d700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe4dc15b130 0x7fe4dc071f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:53.460 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.456+0000 7fe4e431d700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fe4dc06eb20 0x7fe4dc06efb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:53.460 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.456+0000 7fe4e431d700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4dc0cefc0 con 0x7fe4dc06d0f0 2023-10-16T19:57:53.460 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.456+0000 7fe4e431d700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4dc0b0050 con 0x7fe4dc06eb20 2023-10-16T19:57:53.461 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.456+0000 7fe4e431d700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4dc06f4f0 con 0x7fe4dc15b130 2023-10-16T19:57:53.461 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.456+0000 7fe4e28ba700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fe4dc06eb20 0x7fe4dc06efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:53.461 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.456+0000 7fe4e20b9700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe4dc15b130 0x7fe4dc071f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:53.461 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.456+0000 7fe4e28ba700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fe4dc06eb20 0x7fe4dc06efb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.157:42318/0 (socket says 172.21.15.157:42318) 2023-10-16T19:57:53.461 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.456+0000 7fe4e28ba700 1 -- 172.21.15.157:0/1820221361 learned_addr learned my addr 172.21.15.157:0/1820221361 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:57:53.462 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.456+0000 7fe4e20b9700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe4dc15b130 0x7fe4dc071f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.157:56514/0 (socket says 172.21.15.157:56514) 2023-10-16T19:57:53.462 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.456+0000 7fe4e20b9700 1 -- 172.21.15.157:0/1820221361 >> v2:172.21.15.187:3300/0 conn(0x7fe4dc06eb20 msgr2=0x7fe4dc06efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:57:53.462 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.456+0000 7fe4e20b9700 1 --2- 172.21.15.157:0/1820221361 >> v2:172.21.15.187:3300/0 conn(0x7fe4dc06eb20 0x7fe4dc06efb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:53.462 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.456+0000 7fe4e20b9700 1 -- 172.21.15.157:0/1820221361 >> v1:172.21.15.187:6789/0 conn(0x7fe4dc06d0f0 legacy=0x7fe4dc0cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:53.462 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.456+0000 7fe4e20b9700 1 -- 172.21.15.157:0/1820221361 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4dc06e090 con 0x7fe4dc15b130 2023-10-16T19:57:53.462 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.456+0000 7fe4e28ba700 1 --2- 172.21.15.157:0/1820221361 >> v2:172.21.15.187:3300/0 conn(0x7fe4dc06eb20 0x7fe4dc06efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T19:57:53.463 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.457+0000 7fe4e20b9700 1 --2- 172.21.15.157:0/1820221361 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe4dc15b130 0x7fe4dc071f60 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fe4d8009840 tx=0x7fe4d8009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a5376be89e3fe15e server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:53.463 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.457+0000 7fe4e10b7700 1 -- 172.21.15.157:0/1820221361 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4d8011830 con 0x7fe4dc15b130 2023-10-16T19:57:53.463 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.457+0000 7fe4e10b7700 1 -- 172.21.15.157:0/1820221361 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4d8011990 con 0x7fe4dc15b130 2023-10-16T19:57:53.463 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.457+0000 7fe4e10b7700 1 -- 172.21.15.157:0/1820221361 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4d8011d20 con 0x7fe4dc15b130 2023-10-16T19:57:53.463 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.457+0000 7fe4e431d700 1 -- 172.21.15.157:0/1820221361 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe4dc15b130 msgr2=0x7fe4dc071f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:53.464 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.457+0000 7fe4e431d700 1 --2- 172.21.15.157:0/1820221361 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe4dc15b130 0x7fe4dc071f60 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fe4d8009840 tx=0x7fe4d8009b50 comp rx=0 tx=0).stop 2023-10-16T19:57:53.464 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.457+0000 7fe4e431d700 1 -- 172.21.15.157:0/1820221361 shutdown_connections 2023-10-16T19:57:53.464 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.457+0000 7fe4e431d700 1 --2- 172.21.15.157:0/1820221361 >> v2:172.21.15.187:3300/0 conn(0x7fe4dc06eb20 0x7fe4dc06efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:53.464 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.457+0000 7fe4e431d700 1 --2- 172.21.15.157:0/1820221361 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe4dc15b130 0x7fe4dc071f60 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:53.464 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.457+0000 7fe4e431d700 1 -- 172.21.15.157:0/1820221361 >> 172.21.15.157:0/1820221361 conn(0x7fe4dc0cd4e0 msgr2=0x7fe4dc0cd8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:53.465 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.457+0000 7fe4e431d700 1 -- 172.21.15.157:0/1820221361 shutdown_connections 2023-10-16T19:57:53.465 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.457+0000 7fe4e431d700 1 -- 172.21.15.157:0/1820221361 wait complete. 2023-10-16T19:57:53.467 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.459+0000 7fe4e431d700 1 Processor -- start 2023-10-16T19:57:53.468 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.459+0000 7fe4e431d700 1 -- start start 2023-10-16T19:57:53.468 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.459+0000 7fe4e431d700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe4dc06d0f0 0x7fe4dc14bef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:53.468 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.459+0000 7fe4e431d700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe4dc06eb20 0x7fe4dc1504c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:53.468 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.459+0000 7fe4e431d700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe4dc15b130 0x7fe4dc150a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:53.468 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.459+0000 7fe4e431d700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4dc14d110 con 0x7fe4dc06d0f0 2023-10-16T19:57:53.469 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.459+0000 7fe4e431d700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4dc14c900 con 0x7fe4dc15b130 2023-10-16T19:57:53.469 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.459+0000 7fe4e431d700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4dc167f00 con 0x7fe4dc06eb20 2023-10-16T19:57:53.469 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.459+0000 7fe4e20b9700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe4dc06d0f0 0x7fe4dc14bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:53.469 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.460+0000 7fe4e20b9700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe4dc06d0f0 0x7fe4dc14bef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:47212/0 (socket says 172.21.15.157:47212) 2023-10-16T19:57:53.469 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.460+0000 7fe4e20b9700 1 -- 172.21.15.157:0/1455716726 learned_addr learned my addr 172.21.15.157:0/1455716726 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:57:53.470 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.460+0000 7fe4e28ba700 1 --2- 172.21.15.157:0/1455716726 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe4dc15b130 0x7fe4dc150a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:53.470 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.460+0000 7fe4e18b8700 1 --2- 172.21.15.157:0/1455716726 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe4dc06eb20 0x7fe4dc1504c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:53.470 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.460+0000 7fe4e20b9700 1 -- 172.21.15.157:0/1455716726 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe4dc06eb20 msgr2=0x7fe4dc1504c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:53.470 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.460+0000 7fe4e20b9700 1 --2- 172.21.15.157:0/1455716726 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe4dc06eb20 0x7fe4dc1504c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:53.470 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.460+0000 7fe4e20b9700 1 -- 172.21.15.157:0/1455716726 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe4dc15b130 msgr2=0x7fe4dc150a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:53.471 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.460+0000 7fe4e20b9700 1 --2- 172.21.15.157:0/1455716726 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe4dc15b130 0x7fe4dc150a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:53.471 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.460+0000 7fe4e20b9700 1 -- 172.21.15.157:0/1455716726 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4d4009b30 con 0x7fe4dc06d0f0 2023-10-16T19:57:53.471 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.460+0000 7fe4e20b9700 1 --2- 172.21.15.157:0/1455716726 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe4dc06d0f0 0x7fe4dc14bef0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fe4d8000c00 tx=0x7fe4d8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:53.471 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.460+0000 7fe4d2ffd700 1 -- 172.21.15.157:0/1455716726 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4d8004480 con 0x7fe4dc06d0f0 2023-10-16T19:57:53.471 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.460+0000 7fe4d2ffd700 1 -- 172.21.15.157:0/1455716726 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4d801f070 con 0x7fe4dc06d0f0 2023-10-16T19:57:53.471 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.460+0000 7fe4e431d700 1 -- 172.21.15.157:0/1455716726 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4d80094a0 con 0x7fe4dc06d0f0 2023-10-16T19:57:53.472 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.460+0000 7fe4d2ffd700 1 -- 172.21.15.157:0/1455716726 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4d80038c0 con 0x7fe4dc06d0f0 2023-10-16T19:57:53.472 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.460+0000 7fe4e431d700 1 -- 172.21.15.157:0/1455716726 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4dc14ce30 con 0x7fe4dc06d0f0 2023-10-16T19:57:53.472 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.461+0000 7fe4e431d700 1 -- 172.21.15.157:0/1455716726 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4dc04f400 con 0x7fe4dc06d0f0 2023-10-16T19:57:53.472 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.461+0000 7fe4d2ffd700 1 -- 172.21.15.157:0/1455716726 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fe4d8021030 con 0x7fe4dc06d0f0 2023-10-16T19:57:53.472 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.462+0000 7fe4d2ffd700 1 --2- 172.21.15.157:0/1455716726 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fe4c006af00 0x7fe4c006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:53.473 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.462+0000 7fe4d2ffd700 1 -- 172.21.15.157:0/1455716726 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe4d808a6d0 con 0x7fe4dc06d0f0 2023-10-16T19:57:53.473 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.462+0000 7fe4e18b8700 1 --2- 172.21.15.157:0/1455716726 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fe4c006af00 0x7fe4c006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:53.473 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.462+0000 7fe4e18b8700 1 --2- 172.21.15.157:0/1455716726 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fe4c006af00 0x7fe4c006d3c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fe4dc0cae90 tx=0x7fe4cc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:53.473 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.466+0000 7fe4d2ffd700 1 -- 172.21.15.157:0/1455716726 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe4d80559e0 con 0x7fe4dc06d0f0 2023-10-16T19:57:53.700 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.698+0000 7fe4e431d700 1 -- 172.21.15.157:0/1455716726 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe4dc0c7780 con 0x7fe4dc06d0f0 2023-10-16T19:57:53.701 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.698+0000 7fe4d2ffd700 1 -- 172.21.15.157:0/1455716726 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4913 (secure 0 0 0) 0x7fe4d8059000 con 0x7fe4dc06d0f0 2023-10-16T19:57:53.702 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-10-16T19:57:53.702 INFO:teuthology.orchestra.run.smithi157.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/1319816297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6834","nonce":1319816297},{"type":"v1","addr":"172.21.15.187:6835","nonce":1319816297}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4242,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6834/3219992837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6832","nonce":3219992837},{"type":"v1","addr":"172.21.15.157:6834","nonce":3219992837}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4245,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6835/1675699874","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6833","nonce":1675699874},{"type":"v1","addr":"172.21.15.157:6835","nonce":1675699874}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-16T19:57:06.364669+0000","modified":"2023-10-16T19:57:09.412706+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4282":{"gid":4282,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.187:6837/68705029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6836","nonce":68705029},{"type":"v1","addr":"172.21.15.187:6837","nonce":68705029}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-16T19:57:53.704 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.700+0000 7fe4e431d700 1 -- 172.21.15.157:0/1455716726 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fe4c006af00 msgr2=0x7fe4c006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:53.705 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.700+0000 7fe4e431d700 1 --2- 172.21.15.157:0/1455716726 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fe4c006af00 0x7fe4c006d3c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fe4dc0cae90 tx=0x7fe4cc009040 comp rx=0 tx=0).stop 2023-10-16T19:57:53.705 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.700+0000 7fe4e431d700 1 -- 172.21.15.157:0/1455716726 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe4dc06d0f0 msgr2=0x7fe4dc14bef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:53.705 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.700+0000 7fe4e431d700 1 --2- 172.21.15.157:0/1455716726 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe4dc06d0f0 0x7fe4dc14bef0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fe4d8000c00 tx=0x7fe4d8004750 comp rx=0 tx=0).stop 2023-10-16T19:57:53.706 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.700+0000 7fe4e431d700 1 -- 172.21.15.157:0/1455716726 shutdown_connections 2023-10-16T19:57:53.706 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.700+0000 7fe4e431d700 1 --2- 172.21.15.157:0/1455716726 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fe4c006af00 0x7fe4c006d3c0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:53.706 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.700+0000 7fe4e431d700 1 --2- 172.21.15.157:0/1455716726 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe4dc15b130 0x7fe4dc150a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:53.707 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.700+0000 7fe4e431d700 1 --2- 172.21.15.157:0/1455716726 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe4dc06d0f0 0x7fe4dc14bef0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:53.707 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.700+0000 7fe4e431d700 1 --2- 172.21.15.157:0/1455716726 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe4dc06eb20 0x7fe4dc1504c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:53.708 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.700+0000 7fe4e431d700 1 -- 172.21.15.157:0/1455716726 >> 172.21.15.157:0/1455716726 conn(0x7fe4dc0cd4e0 msgr2=0x7fe4dc1518c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:53.708 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.700+0000 7fe4e431d700 1 -- 172.21.15.157:0/1455716726 shutdown_connections 2023-10-16T19:57:53.708 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.700+0000 7fe4e431d700 1 -- 172.21.15.157:0/1455716726 wait complete. 2023-10-16T19:57:53.708 INFO:teuthology.orchestra.run.smithi157.stderr:dumped fsmap epoch 8 2023-10-16T19:57:53.715 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T19:57:53.835 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.832+0000 7f71ef8d1700 1 Processor -- start 2023-10-16T19:57:53.835 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.832+0000 7f71ef8d1700 1 -- start start 2023-10-16T19:57:53.838 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.833+0000 7f71ef8d1700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f71e815b130 0x7f71e8071f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:53.838 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.833+0000 7f71ef8d1700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71e80cefc0 con 0x7f71e806d0f0 2023-10-16T19:57:53.839 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.833+0000 7f71ef8d1700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71e806e090 con 0x7f71e806eb20 2023-10-16T19:57:53.839 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.833+0000 7f71ef8d1700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71e80b0050 con 0x7f71e815b130 2023-10-16T19:57:53.839 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.833+0000 7f71ece6c700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f71e806d0f0 0x7f71e80cb970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:56892/0 (socket says 172.21.15.157:56892) 2023-10-16T19:57:53.839 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.833+0000 7f71ece6c700 1 -- 172.21.15.157:0/2348004704 learned_addr learned my addr 172.21.15.157:0/2348004704 (peer_addr_for_me v1:172.21.15.157:0/0) 2023-10-16T19:57:53.839 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.834+0000 7f71ed66d700 1 --2- 172.21.15.157:0/2348004704 >> v2:172.21.15.187:3300/0 conn(0x7f71e815b130 0x7f71e8071f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:53.840 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.834+0000 7f71dffff700 1 -- 172.21.15.157:0/2348004704 <== mon.0 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1402134048 0 0) 0x7f71e80cefc0 con 0x7f71e806d0f0 2023-10-16T19:57:53.840 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.834+0000 7f71dffff700 1 -- 172.21.15.157:0/2348004704 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f71d40057c0 con 0x7f71e806d0f0 2023-10-16T19:57:53.840 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.834+0000 7f71dffff700 1 -- 172.21.15.157:0/2348004704 <== mon.0 v1:172.21.15.157:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2644825165 0 0) 0x7f71d40057c0 con 0x7f71e806d0f0 2023-10-16T19:57:53.840 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.834+0000 7f71dffff700 1 -- 172.21.15.157:0/2348004704 >> v2:172.21.15.187:3300/0 conn(0x7f71e815b130 msgr2=0x7f71e8071f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:57:53.840 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.834+0000 7f71dffff700 1 --2- 172.21.15.157:0/2348004704 >> v2:172.21.15.187:3300/0 conn(0x7f71e815b130 0x7f71e8071f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:53.841 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.834+0000 7f71dffff700 1 -- 172.21.15.157:0/2348004704 >> v1:172.21.15.187:6789/0 conn(0x7f71e806eb20 legacy=0x7f71e80cf450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:53.841 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.834+0000 7f71dffff700 1 -- 172.21.15.157:0/2348004704 --> v1:172.21.15.157:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71e806d570 con 0x7f71e806d0f0 2023-10-16T19:57:53.841 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.834+0000 7f71dffff700 1 -- 172.21.15.157:0/2348004704 <== mon.0 v1:172.21.15.157:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4021145519 0 0) 0x7f71e4001670 con 0x7f71e806d0f0 2023-10-16T19:57:53.841 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.834+0000 7f71dffff700 1 -- 172.21.15.157:0/2348004704 >> v1:172.21.15.157:6789/0 conn(0x7f71e806d0f0 legacy=0x7f71e80cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:53.841 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.834+0000 7f71dffff700 1 --2- 172.21.15.157:0/2348004704 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f71d4005c10 0x7f71d4006030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:53.842 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.834+0000 7f71dffff700 1 --2- 172.21.15.157:0/2348004704 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f71d4006a60 0x7f71d4006ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:53.842 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.834+0000 7f71dffff700 1 --2- 172.21.15.157:0/2348004704 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f71d4007540 0x7f71d400dc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:53.842 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.834+0000 7f71dffff700 1 -- 172.21.15.157:0/2348004704 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71d400e3e0 con 0x7f71d4005c10 2023-10-16T19:57:53.842 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.834+0000 7f71dffff700 1 -- 172.21.15.157:0/2348004704 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71d400e550 con 0x7f71d4007540 2023-10-16T19:57:53.842 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.834+0000 7f71dffff700 1 -- 172.21.15.157:0/2348004704 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71d400e710 con 0x7f71d4006a60 2023-10-16T19:57:53.843 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.834+0000 7f71ed66d700 1 --2- 172.21.15.157:0/2348004704 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f71d4005c10 0x7f71d4006030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:53.843 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.834+0000 7f71ece6c700 1 --2- 172.21.15.157:0/2348004704 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f71d4006a60 0x7f71d4006ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:53.843 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.834+0000 7f71ede6e700 1 --2- 172.21.15.157:0/2348004704 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f71d4007540 0x7f71d400dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:53.843 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.834+0000 7f71ed66d700 1 -- 172.21.15.157:0/2348004704 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f71d4006a60 msgr2=0x7f71d4006ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:57:53.843 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.834+0000 7f71ed66d700 1 --2- 172.21.15.157:0/2348004704 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f71d4006a60 0x7f71d4006ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:53.844 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.834+0000 7f71ed66d700 1 -- 172.21.15.157:0/2348004704 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f71d4007540 msgr2=0x7f71d400dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:57:53.844 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.834+0000 7f71ed66d700 1 --2- 172.21.15.157:0/2348004704 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f71d4007540 0x7f71d400dc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:53.844 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.834+0000 7f71ed66d700 1 -- 172.21.15.157:0/2348004704 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71d40057c0 con 0x7f71d4005c10 2023-10-16T19:57:53.844 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.834+0000 7f71ede6e700 1 --2- 172.21.15.157:0/2348004704 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f71d4007540 0x7f71d400dc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T19:57:53.844 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.834+0000 7f71ece6c700 1 --2- 172.21.15.157:0/2348004704 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f71d4006a60 0x7f71d4006ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T19:57:53.845 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.834+0000 7f71ede6e700 1 -- 172.21.15.157:0/2348004704 reap_dead start 2023-10-16T19:57:53.845 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.835+0000 7f71ed66d700 1 --2- 172.21.15.157:0/2348004704 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f71d4005c10 0x7f71d4006030 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f71d8009b30 tx=0x7f71d4007a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=235a230c57fded07 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:53.845 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.835+0000 7f71dffff700 1 -- 172.21.15.157:0/2348004704 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71d800e6c0 con 0x7f71d4005c10 2023-10-16T19:57:53.845 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.835+0000 7f71dffff700 1 -- 172.21.15.157:0/2348004704 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71d800e820 con 0x7f71d4005c10 2023-10-16T19:57:53.845 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.835+0000 7f71dffff700 1 -- 172.21.15.157:0/2348004704 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71d800eb90 con 0x7f71d4005c10 2023-10-16T19:57:53.845 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.835+0000 7f71ef8d1700 1 -- 172.21.15.157:0/2348004704 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f71d4005c10 msgr2=0x7f71d4006030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:53.846 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.835+0000 7f71ef8d1700 1 --2- 172.21.15.157:0/2348004704 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f71d4005c10 0x7f71d4006030 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f71d8009b30 tx=0x7f71d4007a90 comp rx=0 tx=0).stop 2023-10-16T19:57:53.846 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.835+0000 7f71ef8d1700 1 -- 172.21.15.157:0/2348004704 shutdown_connections 2023-10-16T19:57:53.846 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.835+0000 7f71ef8d1700 1 --2- 172.21.15.157:0/2348004704 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f71d4005c10 0x7f71d4006030 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:53.846 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.835+0000 7f71ef8d1700 1 -- 172.21.15.157:0/2348004704 >> 172.21.15.157:0/2348004704 conn(0x7f71e80cd4e0 msgr2=0x7f71e80cd8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:53.846 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.835+0000 7f71ef8d1700 1 -- 172.21.15.157:0/2348004704 shutdown_connections 2023-10-16T19:57:53.847 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.835+0000 7f71ef8d1700 1 -- 172.21.15.157:0/2348004704 wait complete. 2023-10-16T19:57:53.849 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.837+0000 7f71ef8d1700 1 Processor -- start 2023-10-16T19:57:53.850 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.837+0000 7f71ef8d1700 1 -- start start 2023-10-16T19:57:53.850 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.837+0000 7f71ef8d1700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f71d4005c10 0x7f71e8153040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:53.850 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.837+0000 7f71ef8d1700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f71e80b5dd0 0x7f71e80b0da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:53.850 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.837+0000 7f71ef8d1700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f71e80b12e0 0x7f71e8159fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:53.851 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.837+0000 7f71ef8d1700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71e80b59b0 con 0x7f71d4005c10 2023-10-16T19:57:53.851 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.837+0000 7f71ef8d1700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71e80b4b40 con 0x7f71e80b5dd0 2023-10-16T19:57:53.851 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.837+0000 7f71ef8d1700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71e80b4d70 con 0x7f71e80b12e0 2023-10-16T19:57:53.851 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.837+0000 7f71ed66d700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f71d4005c10 0x7f71e8153040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:53.852 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.837+0000 7f71ed66d700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f71d4005c10 0x7f71e8153040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:47232/0 (socket says 172.21.15.157:47232) 2023-10-16T19:57:53.852 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.837+0000 7f71ed66d700 1 -- 172.21.15.157:0/1223453829 learned_addr learned my addr 172.21.15.157:0/1223453829 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:57:53.852 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.838+0000 7f71ece6c700 1 --2- 172.21.15.157:0/1223453829 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f71e80b5dd0 0x7f71e80b0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:53.852 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.838+0000 7f71ede6e700 1 --2- 172.21.15.157:0/1223453829 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f71e80b12e0 0x7f71e8159fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:53.853 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.838+0000 7f71ed66d700 1 -- 172.21.15.157:0/1223453829 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f71e80b12e0 msgr2=0x7f71e8159fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:53.853 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.838+0000 7f71ed66d700 1 --2- 172.21.15.157:0/1223453829 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f71e80b12e0 0x7f71e8159fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:53.853 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.838+0000 7f71ed66d700 1 -- 172.21.15.157:0/1223453829 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f71e80b5dd0 msgr2=0x7f71e80b0da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:53.853 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.838+0000 7f71ed66d700 1 --2- 172.21.15.157:0/1223453829 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f71e80b5dd0 0x7f71e80b0da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:53.853 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.838+0000 7f71ed66d700 1 -- 172.21.15.157:0/1223453829 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71e8153580 con 0x7f71d4005c10 2023-10-16T19:57:53.854 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.838+0000 7f71ece6c700 1 --2- 172.21.15.157:0/1223453829 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f71e80b5dd0 0x7f71e80b0da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T19:57:53.854 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.838+0000 7f71ed66d700 1 --2- 172.21.15.157:0/1223453829 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f71d4005c10 0x7f71e8153040 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f71d400e520 tx=0x7f71d80047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:53.854 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.838+0000 7f71ddffb700 1 -- 172.21.15.157:0/1223453829 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71d800e6c0 con 0x7f71d4005c10 2023-10-16T19:57:53.854 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.838+0000 7f71ddffb700 1 -- 172.21.15.157:0/1223453829 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71d8003af0 con 0x7f71d4005c10 2023-10-16T19:57:53.854 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.838+0000 7f71ef8d1700 1 -- 172.21.15.157:0/1223453829 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71e80b5010 con 0x7f71d4005c10 2023-10-16T19:57:53.855 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.838+0000 7f71ddffb700 1 -- 172.21.15.157:0/1223453829 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71d8003ea0 con 0x7f71d4005c10 2023-10-16T19:57:53.855 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.838+0000 7f71ef8d1700 1 -- 172.21.15.157:0/1223453829 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71e80b55d0 con 0x7f71d4005c10 2023-10-16T19:57:53.855 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.839+0000 7f71ef8d1700 1 -- 172.21.15.157:0/1223453829 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71e804f400 con 0x7f71d4005c10 2023-10-16T19:57:53.855 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.840+0000 7f71ddffb700 1 -- 172.21.15.157:0/1223453829 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f71d8013470 con 0x7f71d4005c10 2023-10-16T19:57:53.855 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.840+0000 7f71ddffb700 1 --2- 172.21.15.157:0/1223453829 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f71cc06af00 0x7f71cc06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:53.856 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.840+0000 7f71ddffb700 1 -- 172.21.15.157:0/1223453829 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f71d808aea0 con 0x7f71d4005c10 2023-10-16T19:57:53.856 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.840+0000 7f71ece6c700 1 --2- 172.21.15.157:0/1223453829 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f71cc06af00 0x7f71cc06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:53.856 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.841+0000 7f71ece6c700 1 --2- 172.21.15.157:0/1223453829 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f71cc06af00 0x7f71cc06d3c0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f71e4001eb0 tx=0x7f71e4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:53.856 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:53.845+0000 7f71ddffb700 1 -- 172.21.15.157:0/1223453829 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f71d8056100 con 0x7f71d4005c10 2023-10-16T19:57:54.039 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:54.037+0000 7f71ef8d1700 1 -- 172.21.15.157:0/1223453829 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f71e806f720 con 0x7f71d4005c10 2023-10-16T19:57:54.040 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:54.038+0000 7f71ddffb700 1 -- 172.21.15.157:0/1223453829 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16517 (secure 0 0 0) 0x7f71d8059720 con 0x7f71d4005c10 2023-10-16T19:57:54.041 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-10-16T19:57:54.041 INFO:teuthology.orchestra.run.smithi157.stdout:{"epoch":21,"fsid":"28199dc9-64d5-479e-83c6-21f097c33d39","created":"2023-10-16T19:56:49.201889+0000","modified":"2023-10-16T19:57:07.988567+0000","last_up_change":"2023-10-16T19:56:54.675673+0000","last_in_change":"2023-10-16T19:56:51.666728+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T19:56:56.932895+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-16T19:57:04.936105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-16T19:57:05.335279+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":335785898},{"type":"v1","addr":"172.21.15.157:6809","nonce":335785898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":335785898},{"type":"v1","addr":"172.21.15.157:6811","nonce":335785898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6815","nonce":335785898},{"type":"v1","addr":"172.21.15.157:6817","nonce":335785898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":335785898},{"type":"v1","addr":"172.21.15.157:6813","nonce":335785898}]},"public_addr":"172.21.15.157:6809/335785898","cluster_addr":"172.21.15.157:6811/335785898","heartbeat_back_addr":"172.21.15.157:6817/335785898","heartbeat_front_addr":"172.21.15.157:6813/335785898","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":3482825047},{"type":"v1","addr":"172.21.15.157:6801","nonce":3482825047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":3482825047},{"type":"v1","addr":"172.21.15.157:6803","nonce":3482825047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":3482825047},{"type":"v1","addr":"172.21.15.157:6807","nonce":3482825047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":3482825047},{"type":"v1","addr":"172.21.15.157:6805","nonce":3482825047}]},"public_addr":"172.21.15.157:6801/3482825047","cluster_addr":"172.21.15.157:6803/3482825047","heartbeat_back_addr":"172.21.15.157:6807/3482825047","heartbeat_front_addr":"172.21.15.157:6805/3482825047","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":1118292389},{"type":"v1","addr":"172.21.15.157:6825","nonce":1118292389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":1118292389},{"type":"v1","addr":"172.21.15.157:6827","nonce":1118292389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":1118292389},{"type":"v1","addr":"172.21.15.157:6831","nonce":1118292389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":1118292389},{"type":"v1","addr":"172.21.15.157:6829","nonce":1118292389}]},"public_addr":"172.21.15.157:6825/1118292389","cluster_addr":"172.21.15.157:6827/1118292389","heartbeat_back_addr":"172.21.15.157:6831/1118292389","heartbeat_front_addr":"172.21.15.157:6829/1118292389","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":989329821},{"type":"v1","addr":"172.21.15.157:6816","nonce":989329821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":989329821},{"type":"v1","addr":"172.21.15.157:6819","nonce":989329821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":989329821},{"type":"v1","addr":"172.21.15.157:6823","nonce":989329821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":989329821},{"type":"v1","addr":"172.21.15.157:6821","nonce":989329821}]},"public_addr":"172.21.15.157:6816/989329821","cluster_addr":"172.21.15.157:6819/989329821","heartbeat_back_addr":"172.21.15.157:6823/989329821","heartbeat_front_addr":"172.21.15.157:6821/989329821","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":3841016811},{"type":"v1","addr":"172.21.15.187:6801","nonce":3841016811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6803","nonce":3841016811},{"type":"v1","addr":"172.21.15.187:6804","nonce":3841016811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6809","nonce":3841016811},{"type":"v1","addr":"172.21.15.187:6811","nonce":3841016811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":3841016811},{"type":"v1","addr":"172.21.15.187:6808","nonce":3841016811}]},"public_addr":"172.21.15.187:6801/3841016811","cluster_addr":"172.21.15.187:6804/3841016811","heartbeat_back_addr":"172.21.15.187:6811/3841016811","heartbeat_front_addr":"172.21.15.187:6808/3841016811","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":915130263},{"type":"v1","addr":"172.21.15.187:6805","nonce":915130263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6807","nonce":915130263},{"type":"v1","addr":"172.21.15.187:6810","nonce":915130263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":915130263},{"type":"v1","addr":"172.21.15.187:6815","nonce":915130263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":915130263},{"type":"v1","addr":"172.21.15.187:6813","nonce":915130263}]},"public_addr":"172.21.15.187:6805/915130263","cluster_addr":"172.21.15.187:6810/915130263","heartbeat_back_addr":"172.21.15.187:6815/915130263","heartbeat_front_addr":"172.21.15.187:6813/915130263","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":654976824},{"type":"v1","addr":"172.21.15.187:6817","nonce":654976824}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":654976824},{"type":"v1","addr":"172.21.15.187:6819","nonce":654976824}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":654976824},{"type":"v1","addr":"172.21.15.187:6823","nonce":654976824}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":654976824},{"type":"v1","addr":"172.21.15.187:6821","nonce":654976824}]},"public_addr":"172.21.15.187:6817/654976824","cluster_addr":"172.21.15.187:6819/654976824","heartbeat_back_addr":"172.21.15.187:6823/654976824","heartbeat_front_addr":"172.21.15.187:6821/654976824","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":4284059445},{"type":"v1","addr":"172.21.15.187:6825","nonce":4284059445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":4284059445},{"type":"v1","addr":"172.21.15.187:6827","nonce":4284059445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":4284059445},{"type":"v1","addr":"172.21.15.187:6831","nonce":4284059445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":4284059445},{"type":"v1","addr":"172.21.15.187:6829","nonce":4284059445}]},"public_addr":"172.21.15.187:6825/4284059445","cluster_addr":"172.21.15.187:6827/4284059445","heartbeat_back_addr":"172.21.15.187:6831/4284059445","heartbeat_front_addr":"172.21.15.187:6829/4284059445","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.819780+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.824193+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.849575+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.824806+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.809540+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.805093+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.866109+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.807372+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T19:57:54.043 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:54.040+0000 7f71ef8d1700 1 -- 172.21.15.157:0/1223453829 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f71cc06af00 msgr2=0x7f71cc06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:54.043 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:54.040+0000 7f71ef8d1700 1 --2- 172.21.15.157:0/1223453829 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f71cc06af00 0x7f71cc06d3c0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f71e4001eb0 tx=0x7f71e4009040 comp rx=0 tx=0).stop 2023-10-16T19:57:54.043 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:54.040+0000 7f71ef8d1700 1 -- 172.21.15.157:0/1223453829 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f71d4005c10 msgr2=0x7f71e8153040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:54.043 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:54.040+0000 7f71ef8d1700 1 --2- 172.21.15.157:0/1223453829 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f71d4005c10 0x7f71e8153040 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f71d400e520 tx=0x7f71d80047c0 comp rx=0 tx=0).stop 2023-10-16T19:57:54.044 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:54.040+0000 7f71ef8d1700 1 -- 172.21.15.157:0/1223453829 shutdown_connections 2023-10-16T19:57:54.044 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:54.040+0000 7f71ef8d1700 1 --2- 172.21.15.157:0/1223453829 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f71e80b12e0 0x7f71e8159fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:54.044 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:54.040+0000 7f71ef8d1700 1 --2- 172.21.15.157:0/1223453829 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f71d4005c10 0x7f71e8153040 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:54.044 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:54.040+0000 7f71ef8d1700 1 --2- 172.21.15.157:0/1223453829 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f71cc06af00 0x7f71cc06d3c0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:54.044 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:54.040+0000 7f71ef8d1700 1 --2- 172.21.15.157:0/1223453829 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f71e80b5dd0 0x7f71e80b0da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:54.045 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:54.040+0000 7f71ef8d1700 1 -- 172.21.15.157:0/1223453829 >> 172.21.15.157:0/1223453829 conn(0x7f71e80cd4e0 msgr2=0x7f71e80ccc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:54.045 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:54.040+0000 7f71ef8d1700 1 -- 172.21.15.157:0/1223453829 shutdown_connections 2023-10-16T19:57:54.045 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:54.040+0000 7f71ef8d1700 1 -- 172.21.15.157:0/1223453829 wait complete. 2023-10-16T19:57:54.056 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-16T19:57:54.178 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:54.176+0000 7fc105eea700 1 Processor -- start 2023-10-16T19:57:54.179 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:54.176+0000 7fc105eea700 1 -- start start 2023-10-16T19:57:54.181 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:54.177+0000 7fc105eea700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fc10006af60 0x7fc100071fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:54.182 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:54.177+0000 7fc105eea700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fc1000cd0a0 0x7fc10015fe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:54.182 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:54.177+0000 7fc105eea700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc10006f530 con 0x7fc10015c1d0 2023-10-16T19:57:54.182 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:54.177+0000 7fc105eea700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc10006fab0 con 0x7fc1000cd0a0 2023-10-16T19:57:54.182 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:54.177+0000 7fc105eea700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc10006f7d0 con 0x7fc10006af60 2023-10-16T19:57:54.182 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:54.177+0000 7fc0fffff700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fc1000cd0a0 0x7fc10015fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:54.183 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:54.177+0000 7fc0fffff700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fc1000cd0a0 0x7fc10015fe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:47244/0 (socket says 172.21.15.157:47244) 2023-10-16T19:57:54.183 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:54.177+0000 7fc0fffff700 1 -- 172.21.15.157:0/1748713012 learned_addr learned my addr 172.21.15.157:0/1748713012 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:57:54.183 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:54.177+0000 7fc0fffff700 1 -- 172.21.15.157:0/1748713012 >> v2:172.21.15.187:3300/0 conn(0x7fc10006af60 msgr2=0x7fc100071fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:57:54.183 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:54.177+0000 7fc0fffff700 1 --2- 172.21.15.157:0/1748713012 >> v2:172.21.15.187:3300/0 conn(0x7fc10006af60 0x7fc100071fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:54.184 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:54.177+0000 7fc0fffff700 1 -- 172.21.15.157:0/1748713012 >> v1:172.21.15.187:6789/0 conn(0x7fc10015c1d0 legacy=0x7fc10006a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:57:54.184 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:54.177+0000 7fc0fffff700 1 -- 172.21.15.157:0/1748713012 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1000cb1a0 con 0x7fc1000cd0a0 2023-10-16T19:57:54.184 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:54.177+0000 7fc0fffff700 1 --2- 172.21.15.157:0/1748713012 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc1000cd0a0 0x7fc10015fe50 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fc1000cc900 tx=0x7fc0f800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30f0af2e4f382471 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:54.184 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:54.177+0000 7fc0fe7fc700 1 -- 172.21.15.157:0/1748713012 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0f800e070 con 0x7fc1000cd0a0 2023-10-16T19:57:54.184 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:54.178+0000 7fc0fe7fc700 1 -- 172.21.15.157:0/1748713012 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0f8003a70 con 0x7fc1000cd0a0 2023-10-16T19:57:54.185 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:54.178+0000 7fc0fe7fc700 1 -- 172.21.15.157:0/1748713012 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0f8003e20 con 0x7fc1000cd0a0 2023-10-16T19:57:54.185 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:54.178+0000 7fc105eea700 1 -- 172.21.15.157:0/1748713012 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc1000cd0a0 msgr2=0x7fc10015fe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:54.185 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:54.178+0000 7fc105eea700 1 --2- 172.21.15.157:0/1748713012 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc1000cd0a0 0x7fc10015fe50 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fc1000cc900 tx=0x7fc0f800b330 comp rx=0 tx=0).stop 2023-10-16T19:57:54.185 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:54.178+0000 7fc105eea700 1 -- 172.21.15.157:0/1748713012 shutdown_connections 2023-10-16T19:57:54.186 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:54.178+0000 7fc105eea700 1 --2- 172.21.15.157:0/1748713012 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc1000cd0a0 0x7fc10015fe50 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:54.186 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:54.178+0000 7fc105eea700 1 --2- 172.21.15.157:0/1748713012 >> v2:172.21.15.187:3300/0 conn(0x7fc10006af60 0x7fc100071fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:54.186 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:54.178+0000 7fc105eea700 1 -- 172.21.15.157:0/1748713012 >> 172.21.15.157:0/1748713012 conn(0x7fc1000cd4e0 msgr2=0x7fc1000cd8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:54.187 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:54.178+0000 7fc105eea700 1 -- 172.21.15.157:0/1748713012 shutdown_connections 2023-10-16T19:57:54.187 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:54.178+0000 7fc105eea700 1 -- 172.21.15.157:0/1748713012 wait complete. 2023-10-16T19:57:54.187 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:54.179+0000 7fc105eea700 1 Processor -- start 2023-10-16T19:57:54.190 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:54.179+0000 7fc105eea700 1 -- start start 2023-10-16T19:57:54.190 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:54.180+0000 7fc105eea700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc10006af60 0x7fc100153f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:54.190 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:54.180+0000 7fc105eea700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc1000cd0a0 0x7fc10015ad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:54.190 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:54.180+0000 7fc105eea700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc10015c1d0 0x7fc10015b260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:54.191 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:54.180+0000 7fc105eea700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1001544c0 con 0x7fc10015c1d0 2023-10-16T19:57:54.191 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:54.180+0000 7fc105eea700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1000b58f0 con 0x7fc10006af60 2023-10-16T19:57:54.191 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:54.180+0000 7fc105eea700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1000b5bd0 con 0x7fc1000cd0a0 2023-10-16T19:57:54.191 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:54.180+0000 7fc0fffff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc10015c1d0 0x7fc10015b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:54.191 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:54.180+0000 7fc0fffff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc10015c1d0 0x7fc10015b260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:47250/0 (socket says 172.21.15.157:47250) 2023-10-16T19:57:54.192 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:54.180+0000 7fc0fffff700 1 -- 172.21.15.157:0/2150333989 learned_addr learned my addr 172.21.15.157:0/2150333989 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:57:54.192 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:54.181+0000 7fc0ff7fe700 1 --2- 172.21.15.157:0/2150333989 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc10006af60 0x7fc100153f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:54.192 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:54.181+0000 7fc0feffd700 1 --2- 172.21.15.157:0/2150333989 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc1000cd0a0 0x7fc10015ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:54.192 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:54.181+0000 7fc0fffff700 1 -- 172.21.15.157:0/2150333989 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc1000cd0a0 msgr2=0x7fc10015ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:54.192 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:54.181+0000 7fc0fffff700 1 --2- 172.21.15.157:0/2150333989 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc1000cd0a0 0x7fc10015ad20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:54.193 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:54.181+0000 7fc0fffff700 1 -- 172.21.15.157:0/2150333989 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc10006af60 msgr2=0x7fc100153f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:54.193 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:54.181+0000 7fc0fffff700 1 --2- 172.21.15.157:0/2150333989 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc10006af60 0x7fc100153f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:54.193 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:54.181+0000 7fc0fffff700 1 -- 172.21.15.157:0/2150333989 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0f8009b30 con 0x7fc10015c1d0 2023-10-16T19:57:54.193 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:54.181+0000 7fc0ff7fe700 1 --2- 172.21.15.157:0/2150333989 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc10006af60 0x7fc100153f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T19:57:54.193 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:54.181+0000 7fc0feffd700 1 --2- 172.21.15.157:0/2150333989 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc1000cd0a0 0x7fc10015ad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T19:57:54.194 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:54.181+0000 7fc0fffff700 1 --2- 172.21.15.157:0/2150333989 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc10015c1d0 0x7fc10015b260 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fc0f8009fd0 tx=0x7fc0f8004b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:54.194 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:54.181+0000 7fc0e7fff700 1 -- 172.21.15.157:0/2150333989 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0f8004440 con 0x7fc10015c1d0 2023-10-16T19:57:54.194 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:54.181+0000 7fc0e7fff700 1 -- 172.21.15.157:0/2150333989 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0f80045c0 con 0x7fc10015c1d0 2023-10-16T19:57:54.194 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:54.181+0000 7fc105eea700 1 -- 172.21.15.157:0/2150333989 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1000b5eb0 con 0x7fc10015c1d0 2023-10-16T19:57:54.194 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:54.181+0000 7fc0e7fff700 1 -- 172.21.15.157:0/2150333989 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0f8004970 con 0x7fc10015c1d0 2023-10-16T19:57:54.195 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:54.181+0000 7fc105eea700 1 -- 172.21.15.157:0/2150333989 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1000c7aa0 con 0x7fc10015c1d0 2023-10-16T19:57:54.195 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:54.182+0000 7fc105eea700 1 -- 172.21.15.157:0/2150333989 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1000b66b0 con 0x7fc10015c1d0 2023-10-16T19:57:54.195 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:54.182+0000 7fc0e7fff700 1 -- 172.21.15.157:0/2150333989 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fc0f8012430 con 0x7fc10015c1d0 2023-10-16T19:57:54.195 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:54.183+0000 7fc0e7fff700 1 --2- 172.21.15.157:0/2150333989 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fc0ec06af00 0x7fc0ec06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:54.195 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:54.183+0000 7fc0e7fff700 1 -- 172.21.15.157:0/2150333989 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc0f808ab20 con 0x7fc10015c1d0 2023-10-16T19:57:54.196 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:54.183+0000 7fc0ff7fe700 1 --2- 172.21.15.157:0/2150333989 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fc0ec06af00 0x7fc0ec06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:54.196 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:54.183+0000 7fc0ff7fe700 1 --2- 172.21.15.157:0/2150333989 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fc0ec06af00 0x7fc0ec06d3c0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fc0f4006fd0 tx=0x7fc0f4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:54.196 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:54.187+0000 7fc0e7fff700 1 -- 172.21.15.157:0/2150333989 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc1000b66b0 con 0x7fc10015c1d0 2023-10-16T19:57:54.420 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:54.418+0000 7fc105eea700 1 -- 172.21.15.157:0/2150333989 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fc1000b66b0 con 0x7fc10015c1d0 2023-10-16T19:57:54.421 INFO:tasks.ceph.mon.a.smithi157.stderr:2023-10-16T19:57:54.418+0000 7ff316f0a700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-16T19:57:54.422 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:54.420+0000 7fc0e7fff700 1 -- 172.21.15.157:0/2150333989 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) v1 ==== 161+0+0 (secure 0 0 0) 0x7fc1000b66b0 con 0x7fc10015c1d0 2023-10-16T19:57:54.426 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:54.423+0000 7fc105eea700 1 -- 172.21.15.157:0/2150333989 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fc0ec06af00 msgr2=0x7fc0ec06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:54.426 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:54.423+0000 7fc105eea700 1 --2- 172.21.15.157:0/2150333989 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fc0ec06af00 0x7fc0ec06d3c0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fc0f4006fd0 tx=0x7fc0f4008040 comp rx=0 tx=0).stop 2023-10-16T19:57:54.426 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:54.423+0000 7fc105eea700 1 -- 172.21.15.157:0/2150333989 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc10015c1d0 msgr2=0x7fc10015b260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:54.426 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:54.423+0000 7fc105eea700 1 --2- 172.21.15.157:0/2150333989 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc10015c1d0 0x7fc10015b260 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fc0f8009fd0 tx=0x7fc0f8004b20 comp rx=0 tx=0).stop 2023-10-16T19:57:54.427 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:54.423+0000 7fc105eea700 1 -- 172.21.15.157:0/2150333989 shutdown_connections 2023-10-16T19:57:54.427 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:54.423+0000 7fc105eea700 1 --2- 172.21.15.157:0/2150333989 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fc0ec06af00 0x7fc0ec06d3c0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:54.427 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:54.423+0000 7fc105eea700 1 --2- 172.21.15.157:0/2150333989 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc10006af60 0x7fc100153f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:54.427 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:54.423+0000 7fc105eea700 1 --2- 172.21.15.157:0/2150333989 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc10015c1d0 0x7fc10015b260 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:54.427 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:54.423+0000 7fc105eea700 1 --2- 172.21.15.157:0/2150333989 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc1000cd0a0 0x7fc10015ad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:54.427 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:54.423+0000 7fc105eea700 1 -- 172.21.15.157:0/2150333989 >> 172.21.15.157:0/2150333989 conn(0x7fc1000cd4e0 msgr2=0x7fc100071df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:54.428 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:54.423+0000 7fc105eea700 1 -- 172.21.15.157:0/2150333989 shutdown_connections 2023-10-16T19:57:54.428 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:54.423+0000 7fc105eea700 1 -- 172.21.15.157:0/2150333989 wait complete. 2023-10-16T19:57:54.428 INFO:teuthology.orchestra.run.smithi157.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-16T19:57:54.438 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-16T19:57:54.464 INFO:tasks.ceph.mds.d.smithi187.stdout:starting mds.d at 2023-10-16T19:57:54.570 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:54.558+0000 7f7d22dd1700 1 Processor -- start 2023-10-16T19:57:54.571 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:54.558+0000 7f7d22dd1700 1 -- start start 2023-10-16T19:57:54.571 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:54.559+0000 7f7d22dd1700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f7d1c15e090 0x7f7d1c06b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:54.571 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:54.559+0000 7f7d22dd1700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7d1c0b0190 0x7f7d1c15e470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:54.572 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:54.559+0000 7f7d22dd1700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d1c06b6a0 con 0x7f7d1c06ea10 2023-10-16T19:57:54.572 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:54.559+0000 7f7d22dd1700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d1c071b50 con 0x7f7d1c15e090 2023-10-16T19:57:54.572 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:54.559+0000 7f7d22dd1700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d1c072320 con 0x7f7d1c0b0190 2023-10-16T19:57:54.573 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:54.559+0000 7f7d20b6d700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f7d1c15e090 0x7f7d1c06b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:54.573 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:54.559+0000 7f7d1bfff700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f7d1c06ea10 0x7f7d1c0afa80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:56926/0 (socket says 172.21.15.157:56926) 2023-10-16T19:57:54.573 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:54.559+0000 7f7d1bfff700 1 -- 172.21.15.157:0/63312077 learned_addr learned my addr 172.21.15.157:0/63312077 (peer_addr_for_me v1:172.21.15.157:0/0) 2023-10-16T19:57:54.573 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:54.559+0000 7f7d2136e700 1 --2- 172.21.15.157:0/63312077 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7d1c0b0190 0x7f7d1c15e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:54.574 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:54.559+0000 7f7d20b6d700 1 -- 172.21.15.157:0/63312077 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7d1c0b0190 msgr2=0x7f7d1c15e470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:57:54.574 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:54.559+0000 7f7d20b6d700 1 --2- 172.21.15.157:0/63312077 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7d1c0b0190 0x7f7d1c15e470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:54.574 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:54.559+0000 7f7d20b6d700 1 -- 172.21.15.157:0/63312077 >> v1:172.21.15.157:6789/0 conn(0x7f7d1c06ea10 legacy=0x7f7d1c0afa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:54.574 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:54.559+0000 7f7d20b6d700 1 -- 172.21.15.157:0/63312077 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d1c071d60 con 0x7f7d1c15e090 2023-10-16T19:57:54.574 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:54.559+0000 7f7d1b7fe700 1 -- 172.21.15.157:0/63312077 <== mon.0 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3986536567 0 0) 0x7f7d1c06b6a0 con 0x7f7d1c06ea10 2023-10-16T19:57:54.575 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:54.560+0000 7f7d20b6d700 1 --2- 172.21.15.157:0/63312077 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7d1c15e090 0x7f7d1c06b160 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f7d10009840 tx=0x7f7d10009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bd4fee50a0241fd server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:54.575 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:54.560+0000 7f7d1b7fe700 1 -- 172.21.15.157:0/63312077 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d10011830 con 0x7f7d1c15e090 2023-10-16T19:57:54.575 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:54.560+0000 7f7d1b7fe700 1 -- 172.21.15.157:0/63312077 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d10011990 con 0x7f7d1c15e090 2023-10-16T19:57:54.575 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:54.560+0000 7f7d1b7fe700 1 -- 172.21.15.157:0/63312077 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d10011d20 con 0x7f7d1c15e090 2023-10-16T19:57:54.576 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:54.560+0000 7f7d22dd1700 1 -- 172.21.15.157:0/63312077 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7d1c15e090 msgr2=0x7f7d1c06b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:54.576 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:54.560+0000 7f7d22dd1700 1 --2- 172.21.15.157:0/63312077 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7d1c15e090 0x7f7d1c06b160 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f7d10009840 tx=0x7f7d10009b50 comp rx=0 tx=0).stop 2023-10-16T19:57:54.576 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:54.560+0000 7f7d22dd1700 1 -- 172.21.15.157:0/63312077 shutdown_connections 2023-10-16T19:57:54.576 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:54.560+0000 7f7d22dd1700 1 --2- 172.21.15.157:0/63312077 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7d1c0b0190 0x7f7d1c15e470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:54.576 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:54.560+0000 7f7d22dd1700 1 --2- 172.21.15.157:0/63312077 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7d1c15e090 0x7f7d1c06b160 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:54.577 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:54.560+0000 7f7d22dd1700 1 -- 172.21.15.157:0/63312077 >> 172.21.15.157:0/63312077 conn(0x7f7d1c0d0b30 msgr2=0x7f7d1c0d0f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:54.577 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:54.560+0000 7f7d22dd1700 1 -- 172.21.15.157:0/63312077 shutdown_connections 2023-10-16T19:57:54.577 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:54.560+0000 7f7d22dd1700 1 -- 172.21.15.157:0/63312077 wait complete. 2023-10-16T19:57:54.578 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:54.561+0000 7f7d22dd1700 1 Processor -- start 2023-10-16T19:57:54.578 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:54.562+0000 7f7d22dd1700 1 -- start start 2023-10-16T19:57:54.578 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:54.562+0000 7f7d22dd1700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7d1c06ea10 0x7f7d1c1f33a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:54.579 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:54.562+0000 7f7d22dd1700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7d1c0b0190 0x7f7d1c14ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:54.579 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:54.562+0000 7f7d22dd1700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7d1c15e090 0x7f7d1c0b1f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:54.579 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:54.562+0000 7f7d22dd1700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d1c14f2b0 con 0x7f7d1c15e090 2023-10-16T19:57:54.580 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:54.562+0000 7f7d22dd1700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d1c1520f0 con 0x7f7d1c0b0190 2023-10-16T19:57:54.580 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:54.562+0000 7f7d22dd1700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d1c0b0e80 con 0x7f7d1c06ea10 2023-10-16T19:57:54.580 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:54.563+0000 7f7d2136e700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7d1c15e090 0x7f7d1c0b1f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:54.580 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:54.563+0000 7f7d2136e700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7d1c15e090 0x7f7d1c0b1f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:47262/0 (socket says 172.21.15.157:47262) 2023-10-16T19:57:54.580 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:54.563+0000 7f7d20b6d700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7d1c06ea10 0x7f7d1c1f33a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:54.581 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:54.563+0000 7f7d2136e700 1 -- 172.21.15.157:0/2052283144 learned_addr learned my addr 172.21.15.157:0/2052283144 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:57:54.581 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:54.563+0000 7f7d1bfff700 1 --2- 172.21.15.157:0/2052283144 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7d1c0b0190 0x7f7d1c14ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:54.581 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:54.563+0000 7f7d2136e700 1 -- 172.21.15.157:0/2052283144 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7d1c06ea10 msgr2=0x7f7d1c1f33a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:54.581 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:54.563+0000 7f7d2136e700 1 --2- 172.21.15.157:0/2052283144 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7d1c06ea10 0x7f7d1c1f33a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:54.581 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:54.563+0000 7f7d2136e700 1 -- 172.21.15.157:0/2052283144 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7d1c0b0190 msgr2=0x7f7d1c14ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:54.582 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:54.563+0000 7f7d2136e700 1 --2- 172.21.15.157:0/2052283144 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7d1c0b0190 0x7f7d1c14ed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:54.582 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:54.563+0000 7f7d2136e700 1 -- 172.21.15.157:0/2052283144 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d100094a0 con 0x7f7d1c15e090 2023-10-16T19:57:54.582 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:54.563+0000 7f7d2136e700 1 --2- 172.21.15.157:0/2052283144 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7d1c15e090 0x7f7d1c0b1f20 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f7d1400efc0 tx=0x7f7d1400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:54.582 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:54.563+0000 7f7d197fa700 1 -- 172.21.15.157:0/2052283144 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d1400cc90 con 0x7f7d1c15e090 2023-10-16T19:57:54.582 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:54.563+0000 7f7d197fa700 1 -- 172.21.15.157:0/2052283144 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d1400f040 con 0x7f7d1c15e090 2023-10-16T19:57:54.583 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:54.563+0000 7f7d22dd1700 1 -- 172.21.15.157:0/2052283144 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d1c0b1160 con 0x7f7d1c15e090 2023-10-16T19:57:54.583 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:54.563+0000 7f7d197fa700 1 -- 172.21.15.157:0/2052283144 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d140146c0 con 0x7f7d1c15e090 2023-10-16T19:57:54.583 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:54.563+0000 7f7d22dd1700 1 -- 172.21.15.157:0/2052283144 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d1c0b1720 con 0x7f7d1c15e090 2023-10-16T19:57:54.583 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:54.564+0000 7f7d22dd1700 1 -- 172.21.15.157:0/2052283144 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d1c04f400 con 0x7f7d1c15e090 2023-10-16T19:57:54.584 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:54.565+0000 7f7d197fa700 1 -- 172.21.15.157:0/2052283144 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f7d14014820 con 0x7f7d1c15e090 2023-10-16T19:57:54.584 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:54.565+0000 7f7d197fa700 1 --2- 172.21.15.157:0/2052283144 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f7d0006af00 0x7f7d0006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:54.584 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:54.565+0000 7f7d197fa700 1 -- 172.21.15.157:0/2052283144 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f7d1408a190 con 0x7f7d1c15e090 2023-10-16T19:57:54.584 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:54.565+0000 7f7d20b6d700 1 --2- 172.21.15.157:0/2052283144 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f7d0006af00 0x7f7d0006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:54.584 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:54.566+0000 7f7d20b6d700 1 --2- 172.21.15.157:0/2052283144 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f7d0006af00 0x7f7d0006d3c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f7d10000c00 tx=0x7f7d10008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:54.585 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:54.569+0000 7f7d197fa700 1 -- 172.21.15.157:0/2052283144 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7d140551e0 con 0x7f7d1c15e090 2023-10-16T19:57:54.810 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:54.807+0000 7f7d22dd1700 1 -- 172.21.15.157:0/2052283144 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f7d1c071700 con 0x7f7d1c15e090 2023-10-16T19:57:55.426 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:55.424+0000 7f7d197fa700 1 -- 172.21.15.157:0/2052283144 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) v1 ==== 104+0+0 (secure 0 0 0) 0x7f7d14009ca0 con 0x7f7d1c15e090 2023-10-16T19:57:55.430 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:55.427+0000 7f7d22dd1700 1 -- 172.21.15.157:0/2052283144 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f7d0006af00 msgr2=0x7f7d0006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:55.430 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:55.427+0000 7f7d22dd1700 1 --2- 172.21.15.157:0/2052283144 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f7d0006af00 0x7f7d0006d3c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f7d10000c00 tx=0x7f7d10008030 comp rx=0 tx=0).stop 2023-10-16T19:57:55.430 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:55.427+0000 7f7d22dd1700 1 -- 172.21.15.157:0/2052283144 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7d1c15e090 msgr2=0x7f7d1c0b1f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:55.430 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:55.427+0000 7f7d22dd1700 1 --2- 172.21.15.157:0/2052283144 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7d1c15e090 0x7f7d1c0b1f20 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f7d1400efc0 tx=0x7f7d1400c3a0 comp rx=0 tx=0).stop 2023-10-16T19:57:55.431 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:55.428+0000 7f7d22dd1700 1 -- 172.21.15.157:0/2052283144 shutdown_connections 2023-10-16T19:57:55.431 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:55.428+0000 7f7d22dd1700 1 --2- 172.21.15.157:0/2052283144 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7d1c15e090 0x7f7d1c0b1f20 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:55.432 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:55.428+0000 7f7d22dd1700 1 --2- 172.21.15.157:0/2052283144 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7d1c06ea10 0x7f7d1c1f33a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:55.432 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:55.428+0000 7f7d22dd1700 1 --2- 172.21.15.157:0/2052283144 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f7d0006af00 0x7f7d0006d3c0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:55.432 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:55.428+0000 7f7d22dd1700 1 --2- 172.21.15.157:0/2052283144 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7d1c0b0190 0x7f7d1c14ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:55.432 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:55.428+0000 7f7d22dd1700 1 -- 172.21.15.157:0/2052283144 >> 172.21.15.157:0/2052283144 conn(0x7f7d1c0d0b30 msgr2=0x7f7d1c1608d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:55.432 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:55.429+0000 7f7d22dd1700 1 -- 172.21.15.157:0/2052283144 shutdown_connections 2023-10-16T19:57:55.433 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:55.429+0000 7f7d22dd1700 1 -- 172.21.15.157:0/2052283144 wait complete. 2023-10-16T19:57:55.445 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-16T19:57:55.571 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:55.568+0000 7fc569a8b700 1 Processor -- start 2023-10-16T19:57:55.571 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:55.568+0000 7fc569a8b700 1 -- start start 2023-10-16T19:57:55.573 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:55.569+0000 7fc569a8b700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc56415ded0 0x7fc5640d2140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:55.573 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:55.569+0000 7fc569a8b700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fc5640cf150 0x7fc5640b6ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:55.574 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:55.569+0000 7fc569a8b700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5640b9d10 con 0x7fc5640b9890 2023-10-16T19:57:55.574 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:55.569+0000 7fc569a8b700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5640d2840 con 0x7fc5640cf150 2023-10-16T19:57:55.574 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:55.569+0000 7fc569a8b700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5640d2b20 con 0x7fc56415ded0 2023-10-16T19:57:55.574 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:55.569+0000 7fc563fff700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fc5640cf150 0x7fc5640b6ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:55.574 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:55.569+0000 7fc562ffd700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7fc5640b9890 0x7fc5640cea40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:56938/0 (socket says 172.21.15.157:56938) 2023-10-16T19:57:55.575 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:55.569+0000 7fc562ffd700 1 -- 172.21.15.157:0/1194431278 learned_addr learned my addr 172.21.15.157:0/1194431278 (peer_addr_for_me v1:172.21.15.157:0/0) 2023-10-16T19:57:55.575 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:55.569+0000 7fc5637fe700 1 --2- 172.21.15.157:0/1194431278 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc56415ded0 0x7fc5640d2140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:55.575 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:55.569+0000 7fc563fff700 1 -- 172.21.15.157:0/1194431278 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc56415ded0 msgr2=0x7fc5640d2140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:57:55.576 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:55.569+0000 7fc563fff700 1 --2- 172.21.15.157:0/1194431278 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc56415ded0 0x7fc5640d2140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:55.576 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:55.569+0000 7fc563fff700 1 -- 172.21.15.157:0/1194431278 >> v1:172.21.15.157:6789/0 conn(0x7fc5640b9890 legacy=0x7fc5640cea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:55.576 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:55.569+0000 7fc5627fc700 1 -- 172.21.15.157:0/1194431278 <== mon.0 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 493266340 0 0) 0x7fc5640b9d10 con 0x7fc5640b9890 2023-10-16T19:57:55.576 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:55.569+0000 7fc563fff700 1 -- 172.21.15.157:0/1194431278 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5640d2e00 con 0x7fc5640cf150 2023-10-16T19:57:55.576 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:55.569+0000 7fc563fff700 1 --2- 172.21.15.157:0/1194431278 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc5640cf150 0x7fc5640b6ea0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fc55c009d90 tx=0x7fc55c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48f516988169e304 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:55.577 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:55.570+0000 7fc5627fc700 1 -- 172.21.15.157:0/1194431278 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc55c00e070 con 0x7fc5640cf150 2023-10-16T19:57:55.577 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:55.570+0000 7fc5627fc700 1 -- 172.21.15.157:0/1194431278 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc55c00bbd0 con 0x7fc5640cf150 2023-10-16T19:57:55.577 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:55.570+0000 7fc5627fc700 1 -- 172.21.15.157:0/1194431278 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc55c012430 con 0x7fc5640cf150 2023-10-16T19:57:55.577 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:55.570+0000 7fc569a8b700 1 -- 172.21.15.157:0/1194431278 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc5640cf150 msgr2=0x7fc5640b6ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:55.577 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:55.570+0000 7fc569a8b700 1 --2- 172.21.15.157:0/1194431278 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc5640cf150 0x7fc5640b6ea0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fc55c009d90 tx=0x7fc55c00b330 comp rx=0 tx=0).stop 2023-10-16T19:57:55.578 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:55.570+0000 7fc569a8b700 1 -- 172.21.15.157:0/1194431278 shutdown_connections 2023-10-16T19:57:55.578 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:55.570+0000 7fc569a8b700 1 --2- 172.21.15.157:0/1194431278 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc5640cf150 0x7fc5640b6ea0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:55.578 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:55.570+0000 7fc569a8b700 1 --2- 172.21.15.157:0/1194431278 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc56415ded0 0x7fc5640d2140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:55.578 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:55.570+0000 7fc569a8b700 1 -- 172.21.15.157:0/1194431278 >> 172.21.15.157:0/1194431278 conn(0x7fc56406aeb0 msgr2=0x7fc56406b2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:55.578 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:55.570+0000 7fc569a8b700 1 -- 172.21.15.157:0/1194431278 shutdown_connections 2023-10-16T19:57:55.579 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:55.570+0000 7fc569a8b700 1 -- 172.21.15.157:0/1194431278 wait complete. 2023-10-16T19:57:55.582 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:55.572+0000 7fc569a8b700 1 Processor -- start 2023-10-16T19:57:55.582 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:55.572+0000 7fc569a8b700 1 -- start start 2023-10-16T19:57:55.582 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:55.573+0000 7fc569a8b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc5640b9890 0x7fc564154630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:55.582 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:55.573+0000 7fc569a8b700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc5640cf150 0x7fc5640cb010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:55.582 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:55.573+0000 7fc569a8b700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc56415ded0 0x7fc5640b7950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:55.585 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:55.573+0000 7fc569a8b700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc564154b70 con 0x7fc5640cf150 2023-10-16T19:57:55.585 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:55.573+0000 7fc569a8b700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5640cb9f0 con 0x7fc5640b9890 2023-10-16T19:57:55.585 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:55.573+0000 7fc569a8b700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5640cbcd0 con 0x7fc56415ded0 2023-10-16T19:57:55.586 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:55.573+0000 7fc562ffd700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc5640cf150 0x7fc5640cb010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:55.586 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:55.573+0000 7fc562ffd700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc5640cf150 0x7fc5640cb010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:47272/0 (socket says 172.21.15.157:47272) 2023-10-16T19:57:55.586 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:55.573+0000 7fc562ffd700 1 -- 172.21.15.157:0/3425044241 learned_addr learned my addr 172.21.15.157:0/3425044241 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:57:55.586 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:55.573+0000 7fc5637fe700 1 --2- 172.21.15.157:0/3425044241 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc5640b9890 0x7fc564154630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:55.586 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:55.573+0000 7fc563fff700 1 --2- 172.21.15.157:0/3425044241 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc56415ded0 0x7fc5640b7950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:55.587 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:55.573+0000 7fc562ffd700 1 -- 172.21.15.157:0/3425044241 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc56415ded0 msgr2=0x7fc5640b7950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:55.587 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:55.573+0000 7fc562ffd700 1 --2- 172.21.15.157:0/3425044241 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc56415ded0 0x7fc5640b7950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:55.587 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:55.573+0000 7fc562ffd700 1 -- 172.21.15.157:0/3425044241 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc5640b9890 msgr2=0x7fc564154630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:55.587 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:55.573+0000 7fc562ffd700 1 --2- 172.21.15.157:0/3425044241 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc5640b9890 0x7fc564154630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:55.587 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:55.573+0000 7fc562ffd700 1 -- 172.21.15.157:0/3425044241 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc55c009a70 con 0x7fc5640cf150 2023-10-16T19:57:55.588 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:55.573+0000 7fc5637fe700 1 --2- 172.21.15.157:0/3425044241 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc5640b9890 0x7fc564154630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T19:57:55.588 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:55.573+0000 7fc562ffd700 1 --2- 172.21.15.157:0/3425044241 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc5640cf150 0x7fc5640cb010 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fc5540011e0 tx=0x7fc55400ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:55.588 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:55.574+0000 7fc54bfff700 1 -- 172.21.15.157:0/3425044241 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc554004c80 con 0x7fc5640cf150 2023-10-16T19:57:55.588 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:55.574+0000 7fc54bfff700 1 -- 172.21.15.157:0/3425044241 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc554004de0 con 0x7fc5640cf150 2023-10-16T19:57:55.588 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:55.574+0000 7fc569a8b700 1 -- 172.21.15.157:0/3425044241 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5640cbfb0 con 0x7fc5640cf150 2023-10-16T19:57:55.589 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:55.574+0000 7fc54bfff700 1 -- 172.21.15.157:0/3425044241 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc554007310 con 0x7fc5640cf150 2023-10-16T19:57:55.589 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:55.574+0000 7fc569a8b700 1 -- 172.21.15.157:0/3425044241 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5640cc570 con 0x7fc5640cf150 2023-10-16T19:57:55.589 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:55.575+0000 7fc569a8b700 1 -- 172.21.15.157:0/3425044241 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc56404f400 con 0x7fc5640cf150 2023-10-16T19:57:55.589 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:55.575+0000 7fc54bfff700 1 -- 172.21.15.157:0/3425044241 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fc554007470 con 0x7fc5640cf150 2023-10-16T19:57:55.589 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:55.575+0000 7fc54bfff700 1 --2- 172.21.15.157:0/3425044241 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fc55006af00 0x7fc55006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:55.590 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:55.575+0000 7fc54bfff700 1 -- 172.21.15.157:0/3425044241 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5911+0+0 (secure 0 0 0) 0x7fc5540892e0 con 0x7fc5640cf150 2023-10-16T19:57:55.590 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:55.576+0000 7fc5637fe700 1 --2- 172.21.15.157:0/3425044241 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fc55006af00 0x7fc55006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:55.590 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:55.576+0000 7fc5637fe700 1 --2- 172.21.15.157:0/3425044241 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fc55006af00 0x7fc55006d3c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fc5640ca2d0 tx=0x7fc558008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:55.591 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:55.580+0000 7fc54bfff700 1 -- 172.21.15.157:0/3425044241 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc554054350 con 0x7fc5640cf150 2023-10-16T19:57:55.771 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:55.769+0000 7fc569a8b700 1 -- 172.21.15.157:0/3425044241 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fc564158ff0 con 0x7fc5640cf150 2023-10-16T19:57:56.428 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:56.425+0000 7fc54bfff700 1 -- 172.21.15.157:0/3425044241 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v24) v1 ==== 181+0+0 (secure 0 0 0) 0x7fc554057970 con 0x7fc5640cf150 2023-10-16T19:57:56.432 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:56.429+0000 7fc569a8b700 1 -- 172.21.15.157:0/3425044241 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fc55006af00 msgr2=0x7fc55006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:56.432 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:56.429+0000 7fc569a8b700 1 --2- 172.21.15.157:0/3425044241 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fc55006af00 0x7fc55006d3c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fc5640ca2d0 tx=0x7fc558008040 comp rx=0 tx=0).stop 2023-10-16T19:57:56.432 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:56.429+0000 7fc569a8b700 1 -- 172.21.15.157:0/3425044241 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc5640cf150 msgr2=0x7fc5640cb010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:56.433 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:56.429+0000 7fc569a8b700 1 --2- 172.21.15.157:0/3425044241 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc5640cf150 0x7fc5640cb010 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fc5540011e0 tx=0x7fc55400ca30 comp rx=0 tx=0).stop 2023-10-16T19:57:56.433 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:56.429+0000 7fc569a8b700 1 -- 172.21.15.157:0/3425044241 shutdown_connections 2023-10-16T19:57:56.433 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:56.429+0000 7fc569a8b700 1 --2- 172.21.15.157:0/3425044241 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fc55006af00 0x7fc55006d3c0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:56.433 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:56.429+0000 7fc569a8b700 1 --2- 172.21.15.157:0/3425044241 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc5640b9890 0x7fc564154630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:56.433 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:56.429+0000 7fc569a8b700 1 --2- 172.21.15.157:0/3425044241 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc56415ded0 0x7fc5640b7950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:56.434 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:56.429+0000 7fc569a8b700 1 --2- 172.21.15.157:0/3425044241 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc5640cf150 0x7fc5640cb010 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:56.434 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:56.429+0000 7fc569a8b700 1 -- 172.21.15.157:0/3425044241 >> 172.21.15.157:0/3425044241 conn(0x7fc56406aeb0 msgr2=0x7fc5640b8b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:56.434 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:56.429+0000 7fc569a8b700 1 -- 172.21.15.157:0/3425044241 shutdown_connections 2023-10-16T19:57:56.434 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:56.429+0000 7fc569a8b700 1 -- 172.21.15.157:0/3425044241 wait complete. 2023-10-16T19:57:56.434 INFO:teuthology.orchestra.run.smithi157.stderr:pool 'cephfs_metadata' removed 2023-10-16T19:57:56.445 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-16T19:57:56.571 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:56.569+0000 7f18d3c2f700 1 Processor -- start 2023-10-16T19:57:56.571 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:56.569+0000 7f18d3c2f700 1 -- start start 2023-10-16T19:57:56.574 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:56.570+0000 7f18d3c2f700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f18cc0b2e20 0x7f18cc160410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:56.575 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:56.570+0000 7f18d3c2f700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18cc06d210 con 0x7f18cc0cb0f0 2023-10-16T19:57:56.575 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:56.570+0000 7f18d3c2f700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18cc0c7960 con 0x7f18cc145610 2023-10-16T19:57:56.575 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:56.570+0000 7f18d3c2f700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18cc06e940 con 0x7f18cc0b2e20 2023-10-16T19:57:56.575 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:56.570+0000 7f18d11ca700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f18cc0cb0f0 0x7f18cc0b2710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:56954/0 (socket says 172.21.15.157:56954) 2023-10-16T19:57:56.575 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:56.570+0000 7f18d11ca700 1 -- 172.21.15.157:0/3993252508 learned_addr learned my addr 172.21.15.157:0/3993252508 (peer_addr_for_me v1:172.21.15.157:0/0) 2023-10-16T19:57:56.576 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:56.570+0000 7f18d09c9700 1 -- 172.21.15.157:0/3993252508 <== mon.0 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 199274570 0 0) 0x7f18cc06d210 con 0x7f18cc0cb0f0 2023-10-16T19:57:56.576 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:56.570+0000 7f18d09c9700 1 -- 172.21.15.157:0/3993252508 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f18b80035b0 con 0x7f18cc0cb0f0 2023-10-16T19:57:56.576 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:56.570+0000 7f18d21cc700 1 --2- 172.21.15.157:0/3993252508 >> v2:172.21.15.187:3300/0 conn(0x7f18cc0b2e20 0x7f18cc160410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:56.576 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:56.570+0000 7f18d09c9700 1 -- 172.21.15.157:0/3993252508 <== mon.0 v1:172.21.15.157:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1792400528 0 0) 0x7f18b80035b0 con 0x7f18cc0cb0f0 2023-10-16T19:57:56.576 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:56.570+0000 7f18d09c9700 1 -- 172.21.15.157:0/3993252508 >> v2:172.21.15.187:3300/0 conn(0x7f18cc0b2e20 msgr2=0x7f18cc160410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:57:56.577 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:56.570+0000 7f18d09c9700 1 --2- 172.21.15.157:0/3993252508 >> v2:172.21.15.187:3300/0 conn(0x7f18cc0b2e20 0x7f18cc160410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:56.577 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:56.570+0000 7f18d09c9700 1 -- 172.21.15.157:0/3993252508 >> v1:172.21.15.187:6789/0 conn(0x7f18cc145610 legacy=0x7f18cc0c7160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:56.577 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:56.570+0000 7f18d09c9700 1 -- 172.21.15.157:0/3993252508 --> v1:172.21.15.157:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18cc06ebe0 con 0x7f18cc0cb0f0 2023-10-16T19:57:56.577 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:56.570+0000 7f18d09c9700 1 -- 172.21.15.157:0/3993252508 <== mon.0 v1:172.21.15.157:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4021145519 0 0) 0x7f18c8001670 con 0x7f18cc0cb0f0 2023-10-16T19:57:56.577 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:56.570+0000 7f18d09c9700 1 -- 172.21.15.157:0/3993252508 >> v1:172.21.15.157:6789/0 conn(0x7f18cc0cb0f0 legacy=0x7f18cc0b2710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:56.578 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:56.570+0000 7f18d09c9700 1 --2- 172.21.15.157:0/3993252508 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f18b8003a00 0x7f18b8003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:56.578 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:56.570+0000 7f18d09c9700 1 --2- 172.21.15.157:0/3993252508 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f18b8004850 0x7f18b8004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:56.578 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:56.570+0000 7f18d09c9700 1 --2- 172.21.15.157:0/3993252508 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f18b8005210 0x7f18b800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:56.578 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:56.570+0000 7f18d09c9700 1 -- 172.21.15.157:0/3993252508 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18cc06e940 con 0x7f18b8005210 2023-10-16T19:57:56.578 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:56.570+0000 7f18d09c9700 1 -- 172.21.15.157:0/3993252508 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18b800c1b0 con 0x7f18b8003a00 2023-10-16T19:57:56.579 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:56.570+0000 7f18d09c9700 1 -- 172.21.15.157:0/3993252508 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18b800c370 con 0x7f18b8004850 2023-10-16T19:57:56.579 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:56.571+0000 7f18d21cc700 1 --2- 172.21.15.157:0/3993252508 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f18b8005210 0x7f18b800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:56.579 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:56.571+0000 7f18d19cb700 1 --2- 172.21.15.157:0/3993252508 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f18b8003a00 0x7f18b8003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:56.579 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:56.571+0000 7f18d11ca700 1 --2- 172.21.15.157:0/3993252508 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f18b8004850 0x7f18b8004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:56.579 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:56.571+0000 7f18d21cc700 1 -- 172.21.15.157:0/3993252508 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f18b8004850 msgr2=0x7f18b8004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:57:56.580 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:56.571+0000 7f18d21cc700 1 --2- 172.21.15.157:0/3993252508 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f18b8004850 0x7f18b8004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:56.580 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:56.571+0000 7f18d21cc700 1 -- 172.21.15.157:0/3993252508 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f18b8003a00 msgr2=0x7f18b8003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:57:56.580 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:56.571+0000 7f18d21cc700 1 --2- 172.21.15.157:0/3993252508 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f18b8003a00 0x7f18b8003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:56.580 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:56.571+0000 7f18d21cc700 1 -- 172.21.15.157:0/3993252508 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18b80035b0 con 0x7f18b8005210 2023-10-16T19:57:56.580 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:56.571+0000 7f18d21cc700 1 -- 172.21.15.157:0/3993252508 reap_dead start 2023-10-16T19:57:56.581 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:56.571+0000 7f18d21cc700 1 --2- 172.21.15.157:0/3993252508 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f18b8005210 0x7f18b800ba10 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f18c4009fc0 tx=0x7f18b8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a97fba055b33102 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:56.581 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:56.571+0000 7f18d09c9700 1 -- 172.21.15.157:0/3993252508 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18c4003a20 con 0x7f18b8005210 2023-10-16T19:57:56.581 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:56.571+0000 7f18d09c9700 1 -- 172.21.15.157:0/3993252508 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18c400f040 con 0x7f18b8005210 2023-10-16T19:57:56.581 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:56.571+0000 7f18d09c9700 1 -- 172.21.15.157:0/3993252508 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18c4003de0 con 0x7f18b8005210 2023-10-16T19:57:56.581 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:56.572+0000 7f18d3c2f700 1 -- 172.21.15.157:0/3993252508 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f18b8005210 msgr2=0x7f18b800ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:56.581 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:56.572+0000 7f18d3c2f700 1 --2- 172.21.15.157:0/3993252508 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f18b8005210 0x7f18b800ba10 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f18c4009fc0 tx=0x7f18b8005880 comp rx=0 tx=0).stop 2023-10-16T19:57:56.582 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:56.572+0000 7f18d3c2f700 1 -- 172.21.15.157:0/3993252508 shutdown_connections 2023-10-16T19:57:56.582 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:56.572+0000 7f18d3c2f700 1 --2- 172.21.15.157:0/3993252508 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f18b8005210 0x7f18b800ba10 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:56.582 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:56.572+0000 7f18d3c2f700 1 -- 172.21.15.157:0/3993252508 >> 172.21.15.157:0/3993252508 conn(0x7f18cc0d0b30 msgr2=0x7f18cc0d0f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:56.582 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:56.572+0000 7f18d3c2f700 1 -- 172.21.15.157:0/3993252508 shutdown_connections 2023-10-16T19:57:56.582 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:56.572+0000 7f18d3c2f700 1 -- 172.21.15.157:0/3993252508 wait complete. 2023-10-16T19:57:56.585 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:56.573+0000 7f18d3c2f700 1 Processor -- start 2023-10-16T19:57:56.585 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:56.573+0000 7f18d3c2f700 1 -- start start 2023-10-16T19:57:56.586 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:56.574+0000 7f18d3c2f700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f18b8005210 0x7f18cc15b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:56.586 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:56.574+0000 7f18d3c2f700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f18cc0b3870 0x7f18cc0b3cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:56.586 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:56.574+0000 7f18d3c2f700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f18cc0cfa20 0x7f18cc0cfea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:56.586 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:56.574+0000 7f18d3c2f700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18cc0b4230 con 0x7f18b8005210 2023-10-16T19:57:56.586 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:56.574+0000 7f18d3c2f700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18cc0d03e0 con 0x7f18cc0b3870 2023-10-16T19:57:56.589 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:56.574+0000 7f18d3c2f700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18cc1f2c10 con 0x7f18cc0cfa20 2023-10-16T19:57:56.589 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:56.574+0000 7f18d19cb700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f18b8005210 0x7f18cc15b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:56.589 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:56.574+0000 7f18d19cb700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f18b8005210 0x7f18cc15b940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:47292/0 (socket says 172.21.15.157:47292) 2023-10-16T19:57:56.589 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:56.574+0000 7f18d19cb700 1 -- 172.21.15.157:0/3536150804 learned_addr learned my addr 172.21.15.157:0/3536150804 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:57:56.589 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:56.574+0000 7f18d21cc700 1 --2- 172.21.15.157:0/3536150804 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f18cc0cfa20 0x7f18cc0cfea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:56.590 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:56.574+0000 7f18d11ca700 1 --2- 172.21.15.157:0/3536150804 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f18cc0b3870 0x7f18cc0b3cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:56.590 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:56.574+0000 7f18d19cb700 1 -- 172.21.15.157:0/3536150804 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f18cc0cfa20 msgr2=0x7f18cc0cfea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:56.590 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:56.574+0000 7f18d19cb700 1 --2- 172.21.15.157:0/3536150804 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f18cc0cfa20 0x7f18cc0cfea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:56.590 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:56.574+0000 7f18d19cb700 1 -- 172.21.15.157:0/3536150804 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f18cc0b3870 msgr2=0x7f18cc0b3cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:56.590 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:56.574+0000 7f18d19cb700 1 --2- 172.21.15.157:0/3536150804 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f18cc0b3870 0x7f18cc0b3cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:56.591 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:56.574+0000 7f18d19cb700 1 -- 172.21.15.157:0/3536150804 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18cc1f2ef0 con 0x7f18b8005210 2023-10-16T19:57:56.591 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:56.574+0000 7f18d21cc700 1 --2- 172.21.15.157:0/3536150804 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f18cc0cfa20 0x7f18cc0cfea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T19:57:56.591 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:56.574+0000 7f18d19cb700 1 --2- 172.21.15.157:0/3536150804 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f18b8005210 0x7f18cc15b940 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f18bc001940 tx=0x7f18bc001d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:56.591 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:56.574+0000 7f18c27fc700 1 -- 172.21.15.157:0/3536150804 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18bc015040 con 0x7f18b8005210 2023-10-16T19:57:56.591 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:56.574+0000 7f18c27fc700 1 -- 172.21.15.157:0/3536150804 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18bc0054e0 con 0x7f18b8005210 2023-10-16T19:57:56.592 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:56.575+0000 7f18d3c2f700 1 -- 172.21.15.157:0/3536150804 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18cc1f31d0 con 0x7f18b8005210 2023-10-16T19:57:56.592 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:56.575+0000 7f18c27fc700 1 -- 172.21.15.157:0/3536150804 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18bc0038c0 con 0x7f18b8005210 2023-10-16T19:57:56.592 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:56.575+0000 7f18d3c2f700 1 -- 172.21.15.157:0/3536150804 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18cc1f3790 con 0x7f18b8005210 2023-10-16T19:57:56.592 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:56.576+0000 7f18d3c2f700 1 -- 172.21.15.157:0/3536150804 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18cc04f400 con 0x7f18b8005210 2023-10-16T19:57:56.592 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:56.576+0000 7f18c27fc700 1 -- 172.21.15.157:0/3536150804 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f18bc003a20 con 0x7f18b8005210 2023-10-16T19:57:56.593 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:56.576+0000 7f18c27fc700 1 --2- 172.21.15.157:0/3536150804 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f18b006af00 0x7f18b006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:56.593 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:56.576+0000 7f18c27fc700 1 -- 172.21.15.157:0/3536150804 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5473+0+0 (secure 0 0 0) 0x7f18bc08cf80 con 0x7f18b8005210 2023-10-16T19:57:56.593 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:56.577+0000 7f18d11ca700 1 --2- 172.21.15.157:0/3536150804 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f18b006af00 0x7f18b006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:56.593 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:56.577+0000 7f18d11ca700 1 --2- 172.21.15.157:0/3536150804 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f18b006af00 0x7f18b006d3c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f18c8000fb0 tx=0x7f18c8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:56.593 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:56.581+0000 7f18c27fc700 1 -- 172.21.15.157:0/3536150804 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f18bc0bfca0 con 0x7f18b8005210 2023-10-16T19:57:56.774 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:56.771+0000 7f18d3c2f700 1 -- 172.21.15.157:0/3536150804 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f18cc0c5c20 con 0x7f18b8005210 2023-10-16T19:57:57.435 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:57.433+0000 7f18c27fc700 1 -- 172.21.15.157:0/3536150804 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v25) v1 ==== 169+0+0 (secure 0 0 0) 0x7f18bc0581c0 con 0x7f18b8005210 2023-10-16T19:57:57.439 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:57.436+0000 7f18d3c2f700 1 -- 172.21.15.157:0/3536150804 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f18b006af00 msgr2=0x7f18b006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:57.439 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:57.436+0000 7f18d3c2f700 1 --2- 172.21.15.157:0/3536150804 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f18b006af00 0x7f18b006d3c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f18c8000fb0 tx=0x7f18c8009040 comp rx=0 tx=0).stop 2023-10-16T19:57:57.439 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:57.436+0000 7f18d3c2f700 1 -- 172.21.15.157:0/3536150804 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f18b8005210 msgr2=0x7f18cc15b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:57.439 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:57.436+0000 7f18d3c2f700 1 --2- 172.21.15.157:0/3536150804 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f18b8005210 0x7f18cc15b940 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f18bc001940 tx=0x7f18bc001d00 comp rx=0 tx=0).stop 2023-10-16T19:57:57.440 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:57.436+0000 7f18d3c2f700 1 -- 172.21.15.157:0/3536150804 shutdown_connections 2023-10-16T19:57:57.440 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:57.436+0000 7f18d3c2f700 1 --2- 172.21.15.157:0/3536150804 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f18cc0cfa20 0x7f18cc0cfea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:57.440 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:57.436+0000 7f18d3c2f700 1 --2- 172.21.15.157:0/3536150804 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f18b8005210 0x7f18cc15b940 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:57.440 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:57.436+0000 7f18d3c2f700 1 --2- 172.21.15.157:0/3536150804 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f18b006af00 0x7f18b006d3c0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:57.440 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:57.436+0000 7f18d3c2f700 1 --2- 172.21.15.157:0/3536150804 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f18cc0b3870 0x7f18cc0b3cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:57.441 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:57.436+0000 7f18d3c2f700 1 -- 172.21.15.157:0/3536150804 >> 172.21.15.157:0/3536150804 conn(0x7f18cc0d0b30 msgr2=0x7f18cc13e440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:57.441 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:57.436+0000 7f18d3c2f700 1 -- 172.21.15.157:0/3536150804 shutdown_connections 2023-10-16T19:57:57.441 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:57.436+0000 7f18d3c2f700 1 -- 172.21.15.157:0/3536150804 wait complete. 2023-10-16T19:57:57.441 INFO:teuthology.orchestra.run.smithi157.stderr:pool 'cephfs_data' removed 2023-10-16T19:57:57.452 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-16T19:57:57.453 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-16T19:57:57.453 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-16T19:57:57.453 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T19:57:57.453 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-16T19:57:57.454 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-16T19:57:57.454 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-16T19:57:57.454 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T19:57:57.455 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-16T19:57:57.455 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-16T19:57:57.455 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-16T19:57:57.456 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T19:57:57.456 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-16T19:57:57.456 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-16T19:57:57.456 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-16T19:57:57.457 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T19:57:57.462 INFO:tasks.ceph.mds.a:Stopped 2023-10-16T19:57:57.462 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-16T19:57:57.463 INFO:tasks.ceph.mds.c:Stopped 2023-10-16T19:57:57.464 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-16T19:57:57.465 INFO:tasks.ceph.mds.b:Stopped 2023-10-16T19:57:57.466 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-16T19:57:57.467 INFO:tasks.ceph.mds.d:Stopped 2023-10-16T19:57:57.467 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-16T19:57:57.506 INFO:tasks.ceph.mds.a:Started 2023-10-16T19:57:57.507 DEBUG:teuthology.parallel:result is None 2023-10-16T19:57:57.508 INFO:tasks.ceph.mds.c:Started 2023-10-16T19:57:57.508 DEBUG:teuthology.parallel:result is None 2023-10-16T19:57:57.509 INFO:tasks.ceph.mds.b:Started 2023-10-16T19:57:57.510 DEBUG:teuthology.parallel:result is None 2023-10-16T19:57:57.511 INFO:tasks.ceph.mds.d:Started 2023-10-16T19:57:57.512 DEBUG:teuthology.parallel:result is None 2023-10-16T19:57:57.512 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-16T19:57:57.586 INFO:tasks.ceph.mds.c.smithi157.stdout:starting mds.c at 2023-10-16T19:57:57.587 INFO:tasks.ceph.mds.a.smithi157.stdout:starting mds.a at 2023-10-16T19:57:57.598 INFO:tasks.ceph.mds.b.smithi187.stdout:starting mds.b at 2023-10-16T19:57:57.599 INFO:tasks.ceph.mds.d.smithi187.stdout:starting mds.d at 2023-10-16T19:57:57.649 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:57.646+0000 7f6acd8a9700 1 Processor -- start 2023-10-16T19:57:57.649 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:57.646+0000 7f6acd8a9700 1 -- start start 2023-10-16T19:57:57.651 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:57.647+0000 7f6acd8a9700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f6ac80cfb30 0x7f6ac80cdc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:57.652 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:57.647+0000 7f6acd8a9700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f6ac8161c40 0x7f6ac81620d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:57.652 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:57.647+0000 7f6acd8a9700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ac815e6b0 con 0x7f6ac80cff10 2023-10-16T19:57:57.652 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:57.647+0000 7f6acd8a9700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ac815f330 con 0x7f6ac80cfb30 2023-10-16T19:57:57.652 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:57.647+0000 7f6acd8a9700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ac80d19f0 con 0x7f6ac8161c40 2023-10-16T19:57:57.652 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:57.647+0000 7f6ac6ffd700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f6ac80cfb30 0x7f6ac80cdc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:57.653 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:57.647+0000 7f6ac67fc700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f6ac80cff10 0x7f6ac80b3e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:57002/0 (socket says 172.21.15.157:57002) 2023-10-16T19:57:57.653 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:57.647+0000 7f6ac67fc700 1 -- 172.21.15.157:0/752873444 learned_addr learned my addr 172.21.15.157:0/752873444 (peer_addr_for_me v1:172.21.15.157:0/0) 2023-10-16T19:57:57.653 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:57.647+0000 7f6ac77fe700 1 --2- 172.21.15.157:0/752873444 >> v2:172.21.15.187:3300/0 conn(0x7f6ac8161c40 0x7f6ac81620d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:57.653 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:57.647+0000 7f6ac6ffd700 1 -- 172.21.15.157:0/752873444 >> v2:172.21.15.187:3300/0 conn(0x7f6ac8161c40 msgr2=0x7f6ac81620d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:57:57.653 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:57.647+0000 7f6ac6ffd700 1 --2- 172.21.15.157:0/752873444 >> v2:172.21.15.187:3300/0 conn(0x7f6ac8161c40 0x7f6ac81620d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:57.654 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:57.647+0000 7f6ac6ffd700 1 -- 172.21.15.157:0/752873444 >> v1:172.21.15.157:6789/0 conn(0x7f6ac80cff10 legacy=0x7f6ac80b3e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:57.654 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:57.647+0000 7f6ac6ffd700 1 -- 172.21.15.157:0/752873444 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ac815e990 con 0x7f6ac80cfb30 2023-10-16T19:57:57.654 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:57.647+0000 7f6ac5ffb700 1 -- 172.21.15.157:0/752873444 <== mon.0 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1624417754 0 0) 0x7f6ac815e6b0 con 0x7f6ac80cff10 2023-10-16T19:57:57.654 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:57.647+0000 7f6ac6ffd700 1 --2- 172.21.15.157:0/752873444 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6ac80cfb30 0x7f6ac80cdc90 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f6ac8071ed0 tx=0x7f6abc009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ac12af5d4d30cad server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:57.654 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:57.647+0000 7f6ac5ffb700 1 -- 172.21.15.157:0/752873444 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6abc011830 con 0x7f6ac80cfb30 2023-10-16T19:57:57.655 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:57.647+0000 7f6ac5ffb700 1 -- 172.21.15.157:0/752873444 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6abc011990 con 0x7f6ac80cfb30 2023-10-16T19:57:57.655 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:57.647+0000 7f6ac5ffb700 1 -- 172.21.15.157:0/752873444 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6abc011d20 con 0x7f6ac80cfb30 2023-10-16T19:57:57.655 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:57.648+0000 7f6acd8a9700 1 -- 172.21.15.157:0/752873444 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6ac80cfb30 msgr2=0x7f6ac80cdc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:57.655 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:57.648+0000 7f6acd8a9700 1 --2- 172.21.15.157:0/752873444 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6ac80cfb30 0x7f6ac80cdc90 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f6ac8071ed0 tx=0x7f6abc009b20 comp rx=0 tx=0).stop 2023-10-16T19:57:57.655 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:57.648+0000 7f6acd8a9700 1 -- 172.21.15.157:0/752873444 shutdown_connections 2023-10-16T19:57:57.656 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:57.648+0000 7f6acd8a9700 1 --2- 172.21.15.157:0/752873444 >> v2:172.21.15.187:3300/0 conn(0x7f6ac8161c40 0x7f6ac81620d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:57.656 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:57.648+0000 7f6acd8a9700 1 --2- 172.21.15.157:0/752873444 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6ac80cfb30 0x7f6ac80cdc90 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:57.656 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:57.648+0000 7f6acd8a9700 1 -- 172.21.15.157:0/752873444 >> 172.21.15.157:0/752873444 conn(0x7f6ac806e2e0 msgr2=0x7f6ac806e6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:57.656 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:57.648+0000 7f6acd8a9700 1 -- 172.21.15.157:0/752873444 shutdown_connections 2023-10-16T19:57:57.656 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:57.648+0000 7f6acd8a9700 1 -- 172.21.15.157:0/752873444 wait complete. 2023-10-16T19:57:57.656 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:57.649+0000 7f6acd8a9700 1 Processor -- start 2023-10-16T19:57:57.659 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:57.649+0000 7f6acd8a9700 1 -- start start 2023-10-16T19:57:57.660 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:57.650+0000 7f6acd8a9700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6ac80cfb30 0x7f6ac815bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:57.660 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:57.650+0000 7f6acd8a9700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6ac80cff10 0x7f6ac8157ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:57.660 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:57.650+0000 7f6acd8a9700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6ac8161c40 0x7f6ac80c9060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:57.660 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:57.650+0000 7f6acd8a9700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ac80b7670 con 0x7f6ac80cfb30 2023-10-16T19:57:57.661 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:57.650+0000 7f6acd8a9700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ac80c9c40 con 0x7f6ac80cff10 2023-10-16T19:57:57.661 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:57.650+0000 7f6acd8a9700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ac80c9960 con 0x7f6ac8161c40 2023-10-16T19:57:57.661 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:57.650+0000 7f6ac6ffd700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6ac80cfb30 0x7f6ac815bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:57.661 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:57.650+0000 7f6ac6ffd700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6ac80cfb30 0x7f6ac815bfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:47338/0 (socket says 172.21.15.157:47338) 2023-10-16T19:57:57.661 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:57.650+0000 7f6ac6ffd700 1 -- 172.21.15.157:0/1009529894 learned_addr learned my addr 172.21.15.157:0/1009529894 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:57:57.662 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:57.651+0000 7f6ac67fc700 1 --2- 172.21.15.157:0/1009529894 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6ac80cff10 0x7f6ac8157ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:57.662 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:57.651+0000 7f6ac6ffd700 1 -- 172.21.15.157:0/1009529894 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6ac8161c40 msgr2=0x7f6ac80c9060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:57.662 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:57.651+0000 7f6ac77fe700 1 --2- 172.21.15.157:0/1009529894 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6ac8161c40 0x7f6ac80c9060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:57.662 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:57.651+0000 7f6ac6ffd700 1 --2- 172.21.15.157:0/1009529894 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6ac8161c40 0x7f6ac80c9060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:57.662 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:57.651+0000 7f6ac6ffd700 1 -- 172.21.15.157:0/1009529894 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6ac80cff10 msgr2=0x7f6ac8157ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:57.663 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:57.651+0000 7f6ac6ffd700 1 --2- 172.21.15.157:0/1009529894 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6ac80cff10 0x7f6ac8157ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:57.663 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:57.651+0000 7f6ac6ffd700 1 -- 172.21.15.157:0/1009529894 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6abc0094a0 con 0x7f6ac80cfb30 2023-10-16T19:57:57.663 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:57.651+0000 7f6ac77fe700 1 --2- 172.21.15.157:0/1009529894 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6ac8161c40 0x7f6ac80c9060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T19:57:57.663 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:57.651+0000 7f6ac67fc700 1 --2- 172.21.15.157:0/1009529894 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6ac80cff10 0x7f6ac8157ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T19:57:57.663 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:57.651+0000 7f6ac6ffd700 1 --2- 172.21.15.157:0/1009529894 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6ac80cfb30 0x7f6ac815bfc0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f6abc0090b0 tx=0x7f6abc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:57.664 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:57.651+0000 7f6aaffff700 1 -- 172.21.15.157:0/1009529894 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6abc0038a0 con 0x7f6ac80cfb30 2023-10-16T19:57:57.664 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:57.651+0000 7f6aaffff700 1 -- 172.21.15.157:0/1009529894 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6abc01f070 con 0x7f6ac80cfb30 2023-10-16T19:57:57.664 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:57.651+0000 7f6acd8a9700 1 -- 172.21.15.157:0/1009529894 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ac80ae3f0 con 0x7f6ac80cfb30 2023-10-16T19:57:57.664 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:57.651+0000 7f6aaffff700 1 -- 172.21.15.157:0/1009529894 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6abc003c20 con 0x7f6ac80cfb30 2023-10-16T19:57:57.664 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:57.651+0000 7f6acd8a9700 1 -- 172.21.15.157:0/1009529894 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ac80ae9b0 con 0x7f6ac80cfb30 2023-10-16T19:57:57.664 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:57.652+0000 7f6acd8a9700 1 -- 172.21.15.157:0/1009529894 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ac80ae250 con 0x7f6ac80cfb30 2023-10-16T19:57:57.665 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:57.652+0000 7f6aaffff700 1 -- 172.21.15.157:0/1009529894 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f6abc01a430 con 0x7f6ac80cfb30 2023-10-16T19:57:57.665 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:57.653+0000 7f6aaffff700 1 --2- 172.21.15.157:0/1009529894 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f6ab406af00 0x7f6ab406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:57.665 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:57.653+0000 7f6aaffff700 1 -- 172.21.15.157:0/1009529894 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f6abc021070 con 0x7f6ac80cfb30 2023-10-16T19:57:57.665 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:57.653+0000 7f6ac67fc700 1 --2- 172.21.15.157:0/1009529894 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f6ab406af00 0x7f6ab406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:57.665 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:57.653+0000 7f6ac67fc700 1 --2- 172.21.15.157:0/1009529894 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f6ab406af00 0x7f6ab406d3c0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f6ac81f8280 tx=0x7f6ab8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:57.666 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:57.657+0000 7f6aaffff700 1 -- 172.21.15.157:0/1009529894 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6ac80ae250 con 0x7f6ac80cfb30 2023-10-16T19:57:57.670 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~0s 2023-10-16T19:57:57.670 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~0s 2023-10-16T19:57:57.671 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~0s 2023-10-16T19:57:57.671 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~0s 2023-10-16T19:57:57.863 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:57.861+0000 7f6acd8a9700 1 -- 172.21.15.157:0/1009529894 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f6ac80ae250 con 0x7f6ac80cfb30 2023-10-16T19:57:58.453 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:58.450+0000 7f6aaffff700 1 -- 172.21.15.157:0/1009529894 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v27) v1 ==== 97+0+0 (secure 0 0 0) 0x7f6ac80ae250 con 0x7f6ac80cfb30 2023-10-16T19:57:58.455 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:58.453+0000 7f6acd8a9700 1 -- 172.21.15.157:0/1009529894 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f6ab406af00 msgr2=0x7f6ab406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:58.456 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:58.453+0000 7f6acd8a9700 1 --2- 172.21.15.157:0/1009529894 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f6ab406af00 0x7f6ab406d3c0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f6ac81f8280 tx=0x7f6ab8009040 comp rx=0 tx=0).stop 2023-10-16T19:57:58.456 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:58.453+0000 7f6acd8a9700 1 -- 172.21.15.157:0/1009529894 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6ac80cfb30 msgr2=0x7f6ac815bfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:58.456 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:58.453+0000 7f6acd8a9700 1 --2- 172.21.15.157:0/1009529894 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6ac80cfb30 0x7f6ac815bfc0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f6abc0090b0 tx=0x7f6abc004750 comp rx=0 tx=0).stop 2023-10-16T19:57:58.456 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:58.453+0000 7f6acd8a9700 1 -- 172.21.15.157:0/1009529894 shutdown_connections 2023-10-16T19:57:58.456 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:58.453+0000 7f6acd8a9700 1 --2- 172.21.15.157:0/1009529894 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6ac8161c40 0x7f6ac80c9060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:58.457 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:58.453+0000 7f6acd8a9700 1 --2- 172.21.15.157:0/1009529894 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6ac80cfb30 0x7f6ac815bfc0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:58.457 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:58.453+0000 7f6acd8a9700 1 --2- 172.21.15.157:0/1009529894 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f6ab406af00 0x7f6ab406d3c0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:58.457 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:58.453+0000 7f6acd8a9700 1 --2- 172.21.15.157:0/1009529894 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6ac80cff10 0x7f6ac8157ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:58.457 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:58.453+0000 7f6acd8a9700 1 -- 172.21.15.157:0/1009529894 >> 172.21.15.157:0/1009529894 conn(0x7f6ac806e2e0 msgr2=0x7f6ac8066c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:58.458 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:58.453+0000 7f6acd8a9700 1 -- 172.21.15.157:0/1009529894 shutdown_connections 2023-10-16T19:57:58.458 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:58.453+0000 7f6acd8a9700 1 -- 172.21.15.157:0/1009529894 wait complete. 2023-10-16T19:57:58.458 INFO:teuthology.orchestra.run.smithi157.stderr: removed all blocklist entries 2023-10-16T19:57:58.469 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-16T19:57:58.592 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:58.588+0000 7f077dfbb700 1 Processor -- start 2023-10-16T19:57:58.593 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:58.588+0000 7f077dfbb700 1 -- start start 2023-10-16T19:57:58.593 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:58.588+0000 7f077dfbb700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f077815dce0 0x7f077806d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:58.593 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:58.588+0000 7f077dfbb700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f07780d1a90 0x7f07780b3690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:58.594 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:58.588+0000 7f077dfbb700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f077815e0c0 0x7f07780b3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:58.594 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:58.588+0000 7f077dfbb700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07780b13c0 con 0x7f077815dce0 2023-10-16T19:57:58.594 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:58.588+0000 7f077dfbb700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07780ce610 con 0x7f07780d1a90 2023-10-16T19:57:58.594 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:58.588+0000 7f077dfbb700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07780d1f50 con 0x7f077815e0c0 2023-10-16T19:57:58.594 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:58.589+0000 7f07777fe700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f077815dce0 0x7f077806d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:58.595 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:58.589+0000 7f07777fe700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f077815dce0 0x7f077806d2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:47346/0 (socket says 172.21.15.157:47346) 2023-10-16T19:57:58.595 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:58.589+0000 7f07777fe700 1 -- 172.21.15.157:0/1045838252 learned_addr learned my addr 172.21.15.157:0/1045838252 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:57:58.595 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:58.589+0000 7f0776ffd700 1 --2- 172.21.15.157:0/1045838252 >> v2:172.21.15.187:3300/0 conn(0x7f07780d1a90 0x7f07780b3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:58.595 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:58.589+0000 7f0777fff700 1 --2- 172.21.15.157:0/1045838252 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f077815e0c0 0x7f07780b3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:58.595 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:58.589+0000 7f07777fe700 1 -- 172.21.15.157:0/1045838252 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f077815e0c0 msgr2=0x7f07780b3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:57:58.596 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:58.589+0000 7f07777fe700 1 --2- 172.21.15.157:0/1045838252 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f077815e0c0 0x7f07780b3bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:58.596 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:58.589+0000 7f07777fe700 1 -- 172.21.15.157:0/1045838252 >> v2:172.21.15.187:3300/0 conn(0x7f07780d1a90 msgr2=0x7f07780b3690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:57:58.596 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:58.589+0000 7f07777fe700 1 --2- 172.21.15.157:0/1045838252 >> v2:172.21.15.187:3300/0 conn(0x7f07780d1a90 0x7f07780b3690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:58.596 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:58.589+0000 7f07777fe700 1 -- 172.21.15.157:0/1045838252 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07780d2230 con 0x7f077815dce0 2023-10-16T19:57:58.596 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:58.589+0000 7f0776ffd700 1 --2- 172.21.15.157:0/1045838252 >> v2:172.21.15.187:3300/0 conn(0x7f07780d1a90 0x7f07780b3690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T19:57:58.596 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:58.589+0000 7f0777fff700 1 --2- 172.21.15.157:0/1045838252 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f077815e0c0 0x7f07780b3bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T19:57:58.597 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:58.589+0000 7f07777fe700 1 --2- 172.21.15.157:0/1045838252 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f077815dce0 0x7f077806d2b0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f07780d0530 tx=0x7f0768009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7aaf64fd37990d6 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:58.597 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:58.589+0000 7f07767fc700 1 -- 172.21.15.157:0/1045838252 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f076800b870 con 0x7f077815dce0 2023-10-16T19:57:58.597 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:58.589+0000 7f07767fc700 1 -- 172.21.15.157:0/1045838252 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f076800b9d0 con 0x7f077815dce0 2023-10-16T19:57:58.597 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:58.589+0000 7f07767fc700 1 -- 172.21.15.157:0/1045838252 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f076800bd60 con 0x7f077815dce0 2023-10-16T19:57:58.597 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:58.590+0000 7f077dfbb700 1 -- 172.21.15.157:0/1045838252 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f077815dce0 msgr2=0x7f077806d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:58.598 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:58.590+0000 7f077dfbb700 1 --2- 172.21.15.157:0/1045838252 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f077815dce0 0x7f077806d2b0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f07780d0530 tx=0x7f0768009bd0 comp rx=0 tx=0).stop 2023-10-16T19:57:58.598 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:58.590+0000 7f077dfbb700 1 -- 172.21.15.157:0/1045838252 shutdown_connections 2023-10-16T19:57:58.598 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:58.590+0000 7f077dfbb700 1 --2- 172.21.15.157:0/1045838252 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f077815e0c0 0x7f07780b3bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:58.598 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:58.590+0000 7f077dfbb700 1 --2- 172.21.15.157:0/1045838252 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f077815dce0 0x7f077806d2b0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:58.598 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:58.590+0000 7f077dfbb700 1 --2- 172.21.15.157:0/1045838252 >> v2:172.21.15.187:3300/0 conn(0x7f07780d1a90 0x7f07780b3690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:58.599 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:58.590+0000 7f077dfbb700 1 -- 172.21.15.157:0/1045838252 >> 172.21.15.157:0/1045838252 conn(0x7f077806e300 msgr2=0x7f077806e6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:58.599 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:58.590+0000 7f077dfbb700 1 -- 172.21.15.157:0/1045838252 shutdown_connections 2023-10-16T19:57:58.599 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:58.590+0000 7f077dfbb700 1 -- 172.21.15.157:0/1045838252 wait complete. 2023-10-16T19:57:58.602 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:58.591+0000 7f077dfbb700 1 Processor -- start 2023-10-16T19:57:58.602 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:58.591+0000 7f077dfbb700 1 -- start start 2023-10-16T19:57:58.603 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:58.592+0000 7f077dfbb700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f07780d1a90 0x7f07780cbac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:58.603 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:58.592+0000 7f077dfbb700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f077815dce0 0x7f07780b5930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:58.603 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:58.592+0000 7f077dfbb700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f077815e0c0 0x7f07781f3e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:58.603 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:58.592+0000 7f077dfbb700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07780cc000 con 0x7f077815e0c0 2023-10-16T19:57:58.603 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:58.592+0000 7f077dfbb700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07780ca130 con 0x7f077815dce0 2023-10-16T19:57:58.604 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:58.592+0000 7f077dfbb700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07781f39e0 con 0x7f07780d1a90 2023-10-16T19:57:58.604 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:58.592+0000 7f0777fff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f077815e0c0 0x7f07781f3e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:58.604 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:58.592+0000 7f0777fff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f077815e0c0 0x7f07781f3e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:47356/0 (socket says 172.21.15.157:47356) 2023-10-16T19:57:58.604 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:58.592+0000 7f0777fff700 1 -- 172.21.15.157:0/1788249200 learned_addr learned my addr 172.21.15.157:0/1788249200 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:57:58.604 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:58.592+0000 7f07777fe700 1 --2- 172.21.15.157:0/1788249200 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f07780d1a90 0x7f07780cbac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:58.604 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:58.592+0000 7f0776ffd700 1 --2- 172.21.15.157:0/1788249200 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f077815dce0 0x7f07780b5930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:58.605 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:58.592+0000 7f0777fff700 1 -- 172.21.15.157:0/1788249200 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f07780d1a90 msgr2=0x7f07780cbac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:58.605 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:58.592+0000 7f0777fff700 1 --2- 172.21.15.157:0/1788249200 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f07780d1a90 0x7f07780cbac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:58.605 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:58.592+0000 7f0777fff700 1 -- 172.21.15.157:0/1788249200 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f077815dce0 msgr2=0x7f07780b5930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:58.605 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:58.592+0000 7f0777fff700 1 --2- 172.21.15.157:0/1788249200 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f077815dce0 0x7f07780b5930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:58.605 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:58.592+0000 7f0777fff700 1 -- 172.21.15.157:0/1788249200 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0768009550 con 0x7f077815e0c0 2023-10-16T19:57:58.606 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:58.592+0000 7f07777fe700 1 --2- 172.21.15.157:0/1788249200 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f07780d1a90 0x7f07780cbac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T19:57:58.606 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:58.592+0000 7f0776ffd700 1 --2- 172.21.15.157:0/1788249200 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f077815dce0 0x7f07780b5930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T19:57:58.606 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:58.592+0000 7f0777fff700 1 --2- 172.21.15.157:0/1788249200 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f077815e0c0 0x7f07781f3e70 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f077000cca0 tx=0x7f077000a560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:58.606 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:58.592+0000 7f075ffff700 1 -- 172.21.15.157:0/1788249200 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f077000cea0 con 0x7f077815e0c0 2023-10-16T19:57:58.606 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:58.592+0000 7f075ffff700 1 -- 172.21.15.157:0/1788249200 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f077000f480 con 0x7f077815e0c0 2023-10-16T19:57:58.607 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:58.592+0000 7f077dfbb700 1 -- 172.21.15.157:0/1788249200 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07781f3680 con 0x7f077815e0c0 2023-10-16T19:57:58.607 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:58.593+0000 7f075ffff700 1 -- 172.21.15.157:0/1788249200 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f077000f810 con 0x7f077815e0c0 2023-10-16T19:57:58.607 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:58.593+0000 7f077dfbb700 1 -- 172.21.15.157:0/1788249200 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07780c9890 con 0x7f077815e0c0 2023-10-16T19:57:58.607 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:58.593+0000 7f077dfbb700 1 -- 172.21.15.157:0/1788249200 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07781f3b50 con 0x7f077815e0c0 2023-10-16T19:57:58.607 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:58.594+0000 7f075ffff700 1 -- 172.21.15.157:0/1788249200 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f077000b040 con 0x7f077815e0c0 2023-10-16T19:57:58.608 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:58.594+0000 7f075ffff700 1 --2- 172.21.15.157:0/1788249200 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f076406af00 0x7f076406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:58.608 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:58.594+0000 7f075ffff700 1 -- 172.21.15.157:0/1788249200 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f0770089920 con 0x7f077815e0c0 2023-10-16T19:57:58.608 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:58.595+0000 7f07777fe700 1 --2- 172.21.15.157:0/1788249200 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f076406af00 0x7f076406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:58.608 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:58.595+0000 7f07777fe700 1 --2- 172.21.15.157:0/1788249200 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f076406af00 0x7f076406d3c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f0768009130 tx=0x7f0768008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:58.608 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:58.599+0000 7f075ffff700 1 -- 172.21.15.157:0/1788249200 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0770054db0 con 0x7f077815e0c0 2023-10-16T19:57:58.865 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:58.861+0000 7f077dfbb700 1 -- 172.21.15.157:0/1788249200 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f07780d24e0 con 0x7f077815e0c0 2023-10-16T19:57:58.866 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:58.861+0000 7f075ffff700 1 -- 172.21.15.157:0/1788249200 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v8) v1 ==== 80+0+6645 (secure 0 0 0) 0x7f07700583d0 con 0x7f077815e0c0 2023-10-16T19:57:58.866 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-10-16T19:57:58.867 INFO:teuthology.orchestra.run.smithi157.stdout:{ 2023-10-16T19:57:58.867 INFO:teuthology.orchestra.run.smithi157.stdout: "auth_dump": [ 2023-10-16T19:57:58.867 INFO:teuthology.orchestra.run.smithi157.stdout: { 2023-10-16T19:57:58.867 INFO:teuthology.orchestra.run.smithi157.stdout: "entity": "mds.a", 2023-10-16T19:57:58.867 INFO:teuthology.orchestra.run.smithi157.stdout: "key": "AQB3lS1lg7HmIxAAzjktpvL1qdxxP736JQ/B0A==", 2023-10-16T19:57:58.868 INFO:teuthology.orchestra.run.smithi157.stdout: "caps": { 2023-10-16T19:57:58.868 INFO:teuthology.orchestra.run.smithi157.stdout: "mds": "allow", 2023-10-16T19:57:58.868 INFO:teuthology.orchestra.run.smithi157.stdout: "mgr": "allow *", 2023-10-16T19:57:58.868 INFO:teuthology.orchestra.run.smithi157.stdout: "mon": "allow *", 2023-10-16T19:57:58.868 INFO:teuthology.orchestra.run.smithi157.stdout: "osd": "allow *" 2023-10-16T19:57:58.869 INFO:teuthology.orchestra.run.smithi157.stdout: } 2023-10-16T19:57:58.869 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-16T19:57:58.869 INFO:teuthology.orchestra.run.smithi157.stdout: { 2023-10-16T19:57:58.869 INFO:teuthology.orchestra.run.smithi157.stdout: "entity": "mds.b", 2023-10-16T19:57:58.869 INFO:teuthology.orchestra.run.smithi157.stdout: "key": "AQB3lS1lhtZiMBAADscNDtPmUIViU0gQIvx7pQ==", 2023-10-16T19:57:58.870 INFO:teuthology.orchestra.run.smithi157.stdout: "caps": { 2023-10-16T19:57:58.870 INFO:teuthology.orchestra.run.smithi157.stdout: "mds": "allow", 2023-10-16T19:57:58.870 INFO:teuthology.orchestra.run.smithi157.stdout: "mgr": "allow *", 2023-10-16T19:57:58.870 INFO:teuthology.orchestra.run.smithi157.stdout: "mon": "allow *", 2023-10-16T19:57:58.870 INFO:teuthology.orchestra.run.smithi157.stdout: "osd": "allow *" 2023-10-16T19:57:58.870 INFO:teuthology.orchestra.run.smithi157.stdout: } 2023-10-16T19:57:58.871 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-16T19:57:58.871 INFO:teuthology.orchestra.run.smithi157.stdout: { 2023-10-16T19:57:58.871 INFO:teuthology.orchestra.run.smithi157.stdout: "entity": "mds.c", 2023-10-16T19:57:58.871 INFO:teuthology.orchestra.run.smithi157.stdout: "key": "AQB3lS1lEdo+KxAAg6zuFpNBTBGWZbxZToJZDw==", 2023-10-16T19:57:58.871 INFO:teuthology.orchestra.run.smithi157.stdout: "caps": { 2023-10-16T19:57:58.872 INFO:teuthology.orchestra.run.smithi157.stdout: "mds": "allow", 2023-10-16T19:57:58.872 INFO:teuthology.orchestra.run.smithi157.stdout: "mgr": "allow *", 2023-10-16T19:57:58.872 INFO:teuthology.orchestra.run.smithi157.stdout: "mon": "allow *", 2023-10-16T19:57:58.872 INFO:teuthology.orchestra.run.smithi157.stdout: "osd": "allow *" 2023-10-16T19:57:58.872 INFO:teuthology.orchestra.run.smithi157.stdout: } 2023-10-16T19:57:58.873 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-16T19:57:58.873 INFO:teuthology.orchestra.run.smithi157.stdout: { 2023-10-16T19:57:58.873 INFO:teuthology.orchestra.run.smithi157.stdout: "entity": "mds.d", 2023-10-16T19:57:58.873 INFO:teuthology.orchestra.run.smithi157.stdout: "key": "AQB3lS1lj4qxNxAAb70WUiRoKTkx896oK0nwHg==", 2023-10-16T19:57:58.873 INFO:teuthology.orchestra.run.smithi157.stdout: "caps": { 2023-10-16T19:57:58.874 INFO:teuthology.orchestra.run.smithi157.stdout: "mds": "allow", 2023-10-16T19:57:58.874 INFO:teuthology.orchestra.run.smithi157.stdout: "mgr": "allow *", 2023-10-16T19:57:58.874 INFO:teuthology.orchestra.run.smithi157.stdout: "mon": "allow *", 2023-10-16T19:57:58.874 INFO:teuthology.orchestra.run.smithi157.stdout: "osd": "allow *" 2023-10-16T19:57:58.874 INFO:teuthology.orchestra.run.smithi157.stdout: } 2023-10-16T19:57:58.875 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-16T19:57:58.875 INFO:teuthology.orchestra.run.smithi157.stdout: { 2023-10-16T19:57:58.875 INFO:teuthology.orchestra.run.smithi157.stdout: "entity": "osd.0", 2023-10-16T19:57:58.875 INFO:teuthology.orchestra.run.smithi157.stdout: "key": "AQB5lS1lmL7jKxAAM+VgKsIpDnnAwCe9ezIGFQ==", 2023-10-16T19:57:58.875 INFO:teuthology.orchestra.run.smithi157.stdout: "caps": { 2023-10-16T19:57:58.876 INFO:teuthology.orchestra.run.smithi157.stdout: "mgr": "allow profile osd", 2023-10-16T19:57:58.876 INFO:teuthology.orchestra.run.smithi157.stdout: "mon": "allow profile osd", 2023-10-16T19:57:58.876 INFO:teuthology.orchestra.run.smithi157.stdout: "osd": "allow *" 2023-10-16T19:57:58.876 INFO:teuthology.orchestra.run.smithi157.stdout: } 2023-10-16T19:57:58.876 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-16T19:57:58.877 INFO:teuthology.orchestra.run.smithi157.stdout: { 2023-10-16T19:57:58.877 INFO:teuthology.orchestra.run.smithi157.stdout: "entity": "osd.1", 2023-10-16T19:57:58.877 INFO:teuthology.orchestra.run.smithi157.stdout: "key": "AQB5lS1lH+QGMxAAOfeAzFe+r8lGhw8r66GGFw==", 2023-10-16T19:57:58.877 INFO:teuthology.orchestra.run.smithi157.stdout: "caps": { 2023-10-16T19:57:58.877 INFO:teuthology.orchestra.run.smithi157.stdout: "mgr": "allow profile osd", 2023-10-16T19:57:58.878 INFO:teuthology.orchestra.run.smithi157.stdout: "mon": "allow profile osd", 2023-10-16T19:57:58.878 INFO:teuthology.orchestra.run.smithi157.stdout: "osd": "allow *" 2023-10-16T19:57:58.878 INFO:teuthology.orchestra.run.smithi157.stdout: } 2023-10-16T19:57:58.878 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-16T19:57:58.878 INFO:teuthology.orchestra.run.smithi157.stdout: { 2023-10-16T19:57:58.879 INFO:teuthology.orchestra.run.smithi157.stdout: "entity": "osd.2", 2023-10-16T19:57:58.879 INFO:teuthology.orchestra.run.smithi157.stdout: "key": "AQB5lS1lfiI3OhAAgdf82Usxjk0dRac2WV8f/w==", 2023-10-16T19:57:58.879 INFO:teuthology.orchestra.run.smithi157.stdout: "caps": { 2023-10-16T19:57:58.879 INFO:teuthology.orchestra.run.smithi157.stdout: "mgr": "allow profile osd", 2023-10-16T19:57:58.879 INFO:teuthology.orchestra.run.smithi157.stdout: "mon": "allow profile osd", 2023-10-16T19:57:58.879 INFO:teuthology.orchestra.run.smithi157.stdout: "osd": "allow *" 2023-10-16T19:57:58.880 INFO:teuthology.orchestra.run.smithi157.stdout: } 2023-10-16T19:57:58.880 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-16T19:57:58.880 INFO:teuthology.orchestra.run.smithi157.stdout: { 2023-10-16T19:57:58.880 INFO:teuthology.orchestra.run.smithi157.stdout: "entity": "osd.3", 2023-10-16T19:57:58.880 INFO:teuthology.orchestra.run.smithi157.stdout: "key": "AQB6lS1lOPeqBRAAuNRDLPQUWrQ+WwgkaDJ5Zw==", 2023-10-16T19:57:58.881 INFO:teuthology.orchestra.run.smithi157.stdout: "caps": { 2023-10-16T19:57:58.881 INFO:teuthology.orchestra.run.smithi157.stdout: "mgr": "allow profile osd", 2023-10-16T19:57:58.881 INFO:teuthology.orchestra.run.smithi157.stdout: "mon": "allow profile osd", 2023-10-16T19:57:58.881 INFO:teuthology.orchestra.run.smithi157.stdout: "osd": "allow *" 2023-10-16T19:57:58.881 INFO:teuthology.orchestra.run.smithi157.stdout: } 2023-10-16T19:57:58.882 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-16T19:57:58.882 INFO:teuthology.orchestra.run.smithi157.stdout: { 2023-10-16T19:57:58.882 INFO:teuthology.orchestra.run.smithi157.stdout: "entity": "osd.4", 2023-10-16T19:57:58.882 INFO:teuthology.orchestra.run.smithi157.stdout: "key": "AQB9lS1l1zRsDBAAAljtwEGSG9IwA1BxkbjciQ==", 2023-10-16T19:57:58.882 INFO:teuthology.orchestra.run.smithi157.stdout: "caps": { 2023-10-16T19:57:58.883 INFO:teuthology.orchestra.run.smithi157.stdout: "mgr": "allow profile osd", 2023-10-16T19:57:58.883 INFO:teuthology.orchestra.run.smithi157.stdout: "mon": "allow profile osd", 2023-10-16T19:57:58.883 INFO:teuthology.orchestra.run.smithi157.stdout: "osd": "allow *" 2023-10-16T19:57:58.883 INFO:teuthology.orchestra.run.smithi157.stdout: } 2023-10-16T19:57:58.883 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-16T19:57:58.884 INFO:teuthology.orchestra.run.smithi157.stdout: { 2023-10-16T19:57:58.884 INFO:teuthology.orchestra.run.smithi157.stdout: "entity": "osd.5", 2023-10-16T19:57:58.884 INFO:teuthology.orchestra.run.smithi157.stdout: "key": "AQB9lS1lopEQFRAApkT4aNUF8lbz766O65ZjMQ==", 2023-10-16T19:57:58.884 INFO:teuthology.orchestra.run.smithi157.stdout: "caps": { 2023-10-16T19:57:58.884 INFO:teuthology.orchestra.run.smithi157.stdout: "mgr": "allow profile osd", 2023-10-16T19:57:58.884 INFO:teuthology.orchestra.run.smithi157.stdout: "mon": "allow profile osd", 2023-10-16T19:57:58.885 INFO:teuthology.orchestra.run.smithi157.stdout: "osd": "allow *" 2023-10-16T19:57:58.885 INFO:teuthology.orchestra.run.smithi157.stdout: } 2023-10-16T19:57:58.885 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-16T19:57:58.885 INFO:teuthology.orchestra.run.smithi157.stdout: { 2023-10-16T19:57:58.885 INFO:teuthology.orchestra.run.smithi157.stdout: "entity": "osd.6", 2023-10-16T19:57:58.886 INFO:teuthology.orchestra.run.smithi157.stdout: "key": "AQB9lS1leeUaHRAAtcKqYz0FmFZIhJ10sBzVfA==", 2023-10-16T19:57:58.886 INFO:teuthology.orchestra.run.smithi157.stdout: "caps": { 2023-10-16T19:57:58.886 INFO:teuthology.orchestra.run.smithi157.stdout: "mgr": "allow profile osd", 2023-10-16T19:57:58.886 INFO:teuthology.orchestra.run.smithi157.stdout: "mon": "allow profile osd", 2023-10-16T19:57:58.886 INFO:teuthology.orchestra.run.smithi157.stdout: "osd": "allow *" 2023-10-16T19:57:58.887 INFO:teuthology.orchestra.run.smithi157.stdout: } 2023-10-16T19:57:58.887 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-16T19:57:58.887 INFO:teuthology.orchestra.run.smithi157.stdout: { 2023-10-16T19:57:58.887 INFO:teuthology.orchestra.run.smithi157.stdout: "entity": "osd.7", 2023-10-16T19:57:58.887 INFO:teuthology.orchestra.run.smithi157.stdout: "key": "AQB9lS1lkUZZJBAAB7glunBFU7rYChfDb1Ex8g==", 2023-10-16T19:57:58.888 INFO:teuthology.orchestra.run.smithi157.stdout: "caps": { 2023-10-16T19:57:58.888 INFO:teuthology.orchestra.run.smithi157.stdout: "mgr": "allow profile osd", 2023-10-16T19:57:58.888 INFO:teuthology.orchestra.run.smithi157.stdout: "mon": "allow profile osd", 2023-10-16T19:57:58.888 INFO:teuthology.orchestra.run.smithi157.stdout: "osd": "allow *" 2023-10-16T19:57:58.888 INFO:teuthology.orchestra.run.smithi157.stdout: } 2023-10-16T19:57:58.888 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-16T19:57:58.889 INFO:teuthology.orchestra.run.smithi157.stdout: { 2023-10-16T19:57:58.889 INFO:teuthology.orchestra.run.smithi157.stdout: "entity": "client.0", 2023-10-16T19:57:58.889 INFO:teuthology.orchestra.run.smithi157.stdout: "key": "AQB4lS1lDEZnABAAgwyj245ITd68cbde9kGXLg==", 2023-10-16T19:57:58.889 INFO:teuthology.orchestra.run.smithi157.stdout: "caps": { 2023-10-16T19:57:58.889 INFO:teuthology.orchestra.run.smithi157.stdout: "mds": "allow", 2023-10-16T19:57:58.890 INFO:teuthology.orchestra.run.smithi157.stdout: "mgr": "allow r", 2023-10-16T19:57:58.890 INFO:teuthology.orchestra.run.smithi157.stdout: "mon": "allow rw", 2023-10-16T19:57:58.890 INFO:teuthology.orchestra.run.smithi157.stdout: "osd": "allow rwx" 2023-10-16T19:57:58.890 INFO:teuthology.orchestra.run.smithi157.stdout: } 2023-10-16T19:57:58.890 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-16T19:57:58.891 INFO:teuthology.orchestra.run.smithi157.stdout: { 2023-10-16T19:57:58.891 INFO:teuthology.orchestra.run.smithi157.stdout: "entity": "client.1", 2023-10-16T19:57:58.891 INFO:teuthology.orchestra.run.smithi157.stdout: "key": "AQB4lS1ltpqBCRAAyIq5zPLOOlOBOB4m946UIQ==", 2023-10-16T19:57:58.891 INFO:teuthology.orchestra.run.smithi157.stdout: "caps": { 2023-10-16T19:57:58.891 INFO:teuthology.orchestra.run.smithi157.stdout: "mds": "allow", 2023-10-16T19:57:58.892 INFO:teuthology.orchestra.run.smithi157.stdout: "mgr": "allow r", 2023-10-16T19:57:58.892 INFO:teuthology.orchestra.run.smithi157.stdout: "mon": "allow rw", 2023-10-16T19:57:58.892 INFO:teuthology.orchestra.run.smithi157.stdout: "osd": "allow rwx" 2023-10-16T19:57:58.892 INFO:teuthology.orchestra.run.smithi157.stdout: } 2023-10-16T19:57:58.892 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-16T19:57:58.892 INFO:teuthology.orchestra.run.smithi157.stdout: { 2023-10-16T19:57:58.893 INFO:teuthology.orchestra.run.smithi157.stdout: "entity": "client.2", 2023-10-16T19:57:58.893 INFO:teuthology.orchestra.run.smithi157.stdout: "key": "AQB4lS1lf98kBhAAxq6Iriv7Zfp6ExayRb4L2w==", 2023-10-16T19:57:58.893 INFO:teuthology.orchestra.run.smithi157.stdout: "caps": { 2023-10-16T19:57:58.893 INFO:teuthology.orchestra.run.smithi157.stdout: "mds": "allow", 2023-10-16T19:57:58.893 INFO:teuthology.orchestra.run.smithi157.stdout: "mgr": "allow r", 2023-10-16T19:57:58.894 INFO:teuthology.orchestra.run.smithi157.stdout: "mon": "allow rw", 2023-10-16T19:57:58.894 INFO:teuthology.orchestra.run.smithi157.stdout: "osd": "allow rwx" 2023-10-16T19:57:58.894 INFO:teuthology.orchestra.run.smithi157.stdout: } 2023-10-16T19:57:58.894 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-16T19:57:58.894 INFO:teuthology.orchestra.run.smithi157.stdout: { 2023-10-16T19:57:58.895 INFO:teuthology.orchestra.run.smithi157.stdout: "entity": "client.3", 2023-10-16T19:57:58.895 INFO:teuthology.orchestra.run.smithi157.stdout: "key": "AQB4lS1lMVA2DxAA3k8Muyp1xzRDV1J/eMcGWw==", 2023-10-16T19:57:58.895 INFO:teuthology.orchestra.run.smithi157.stdout: "caps": { 2023-10-16T19:57:58.895 INFO:teuthology.orchestra.run.smithi157.stdout: "mds": "allow", 2023-10-16T19:57:58.895 INFO:teuthology.orchestra.run.smithi157.stdout: "mgr": "allow r", 2023-10-16T19:57:58.896 INFO:teuthology.orchestra.run.smithi157.stdout: "mon": "allow rw", 2023-10-16T19:57:58.896 INFO:teuthology.orchestra.run.smithi157.stdout: "osd": "allow rwx" 2023-10-16T19:57:58.896 INFO:teuthology.orchestra.run.smithi157.stdout: } 2023-10-16T19:57:58.896 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-16T19:57:58.896 INFO:teuthology.orchestra.run.smithi157.stdout: { 2023-10-16T19:57:58.897 INFO:teuthology.orchestra.run.smithi157.stdout: "entity": "client.admin", 2023-10-16T19:57:58.897 INFO:teuthology.orchestra.run.smithi157.stdout: "key": "AQB3lS1lgafABRAAJLPyexQXhECFQYfOPr3txg==", 2023-10-16T19:57:58.897 INFO:teuthology.orchestra.run.smithi157.stdout: "caps": { 2023-10-16T19:57:58.897 INFO:teuthology.orchestra.run.smithi157.stdout: "mds": "allow *", 2023-10-16T19:57:58.897 INFO:teuthology.orchestra.run.smithi157.stdout: "mgr": "allow *", 2023-10-16T19:57:58.898 INFO:teuthology.orchestra.run.smithi157.stdout: "mon": "allow *", 2023-10-16T19:57:58.898 INFO:teuthology.orchestra.run.smithi157.stdout: "osd": "allow *" 2023-10-16T19:57:58.898 INFO:teuthology.orchestra.run.smithi157.stdout: } 2023-10-16T19:57:58.898 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-16T19:57:58.899 INFO:teuthology.orchestra.run.smithi157.stdout: { 2023-10-16T19:57:58.899 INFO:teuthology.orchestra.run.smithi157.stdout: "entity": "client.bootstrap-mds", 2023-10-16T19:57:58.899 INFO:teuthology.orchestra.run.smithi157.stdout: "key": "AQCBlS1lryIQDBAANN+7pwA758beVMeJIMPr0g==", 2023-10-16T19:57:58.899 INFO:teuthology.orchestra.run.smithi157.stdout: "caps": { 2023-10-16T19:57:58.899 INFO:teuthology.orchestra.run.smithi157.stdout: "mon": "allow profile bootstrap-mds" 2023-10-16T19:57:58.900 INFO:teuthology.orchestra.run.smithi157.stdout: } 2023-10-16T19:57:58.900 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-16T19:57:58.900 INFO:teuthology.orchestra.run.smithi157.stdout: { 2023-10-16T19:57:58.900 INFO:teuthology.orchestra.run.smithi157.stdout: "entity": "client.bootstrap-mgr", 2023-10-16T19:57:58.900 INFO:teuthology.orchestra.run.smithi157.stdout: "key": "AQCBlS1lXi0QDBAATtf9b+5RpBkFFiBDlpZsrA==", 2023-10-16T19:57:58.900 INFO:teuthology.orchestra.run.smithi157.stdout: "caps": { 2023-10-16T19:57:58.901 INFO:teuthology.orchestra.run.smithi157.stdout: "mon": "allow profile bootstrap-mgr" 2023-10-16T19:57:58.901 INFO:teuthology.orchestra.run.smithi157.stdout: } 2023-10-16T19:57:58.901 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-16T19:57:58.901 INFO:teuthology.orchestra.run.smithi157.stdout: { 2023-10-16T19:57:58.901 INFO:teuthology.orchestra.run.smithi157.stdout: "entity": "client.bootstrap-osd", 2023-10-16T19:57:58.902 INFO:teuthology.orchestra.run.smithi157.stdout: "key": "AQCBlS1lujQQDBAAeK2m4AFfza88qDClbosQFg==", 2023-10-16T19:57:58.902 INFO:teuthology.orchestra.run.smithi157.stdout: "caps": { 2023-10-16T19:57:58.902 INFO:teuthology.orchestra.run.smithi157.stdout: "mon": "allow profile bootstrap-osd" 2023-10-16T19:57:58.902 INFO:teuthology.orchestra.run.smithi157.stdout: } 2023-10-16T19:57:58.902 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-16T19:57:58.903 INFO:teuthology.orchestra.run.smithi157.stdout: { 2023-10-16T19:57:58.903 INFO:teuthology.orchestra.run.smithi157.stdout: "entity": "client.bootstrap-rbd", 2023-10-16T19:57:58.903 INFO:teuthology.orchestra.run.smithi157.stdout: "key": "AQCBlS1lDzwQDBAAYAqzJwr9Nt0YWy1ORb3tMA==", 2023-10-16T19:57:58.903 INFO:teuthology.orchestra.run.smithi157.stdout: "caps": { 2023-10-16T19:57:58.904 INFO:teuthology.orchestra.run.smithi157.stdout: "mon": "allow profile bootstrap-rbd" 2023-10-16T19:57:58.904 INFO:teuthology.orchestra.run.smithi157.stdout: } 2023-10-16T19:57:58.904 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-16T19:57:58.904 INFO:teuthology.orchestra.run.smithi157.stdout: { 2023-10-16T19:57:58.904 INFO:teuthology.orchestra.run.smithi157.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-10-16T19:57:58.905 INFO:teuthology.orchestra.run.smithi157.stdout: "key": "AQCBlS1lYkMQDBAANs4tsARmehwtioTXHlalMA==", 2023-10-16T19:57:58.905 INFO:teuthology.orchestra.run.smithi157.stdout: "caps": { 2023-10-16T19:57:58.905 INFO:teuthology.orchestra.run.smithi157.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-10-16T19:57:58.905 INFO:teuthology.orchestra.run.smithi157.stdout: } 2023-10-16T19:57:58.905 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-16T19:57:58.906 INFO:teuthology.orchestra.run.smithi157.stdout: { 2023-10-16T19:57:58.906 INFO:teuthology.orchestra.run.smithi157.stdout: "entity": "client.bootstrap-rgw", 2023-10-16T19:57:58.906 INFO:teuthology.orchestra.run.smithi157.stdout: "key": "AQCBlS1lv0oQDBAAZYnPKu9X61P39S+r7MDIzA==", 2023-10-16T19:57:58.906 INFO:teuthology.orchestra.run.smithi157.stdout: "caps": { 2023-10-16T19:57:58.906 INFO:teuthology.orchestra.run.smithi157.stdout: "mon": "allow profile bootstrap-rgw" 2023-10-16T19:57:58.907 INFO:teuthology.orchestra.run.smithi157.stdout: } 2023-10-16T19:57:58.907 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-16T19:57:58.907 INFO:teuthology.orchestra.run.smithi157.stdout: { 2023-10-16T19:57:58.907 INFO:teuthology.orchestra.run.smithi157.stdout: "entity": "mgr.x", 2023-10-16T19:57:58.907 INFO:teuthology.orchestra.run.smithi157.stdout: "key": "AQB3lS1lmnp9IBAAnnnk+mwDhlku9vubS/Hkaw==", 2023-10-16T19:57:58.908 INFO:teuthology.orchestra.run.smithi157.stdout: "caps": { 2023-10-16T19:57:58.908 INFO:teuthology.orchestra.run.smithi157.stdout: "mds": "allow *", 2023-10-16T19:57:58.908 INFO:teuthology.orchestra.run.smithi157.stdout: "mon": "allow profile mgr", 2023-10-16T19:57:58.908 INFO:teuthology.orchestra.run.smithi157.stdout: "osd": "allow *" 2023-10-16T19:57:58.908 INFO:teuthology.orchestra.run.smithi157.stdout: } 2023-10-16T19:57:58.909 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-16T19:57:58.909 INFO:teuthology.orchestra.run.smithi157.stdout: { 2023-10-16T19:57:58.909 INFO:teuthology.orchestra.run.smithi157.stdout: "entity": "mgr.y", 2023-10-16T19:57:58.909 INFO:teuthology.orchestra.run.smithi157.stdout: "key": "AQB3lS1lC6nDGxAAPKV8NiSzXbhI8JZzSScWFg==", 2023-10-16T19:57:58.909 INFO:teuthology.orchestra.run.smithi157.stdout: "caps": { 2023-10-16T19:57:58.909 INFO:teuthology.orchestra.run.smithi157.stdout: "mds": "allow *", 2023-10-16T19:57:58.910 INFO:teuthology.orchestra.run.smithi157.stdout: "mon": "allow profile mgr", 2023-10-16T19:57:58.910 INFO:teuthology.orchestra.run.smithi157.stdout: "osd": "allow *" 2023-10-16T19:57:58.910 INFO:teuthology.orchestra.run.smithi157.stdout: } 2023-10-16T19:57:58.910 INFO:teuthology.orchestra.run.smithi157.stdout: } 2023-10-16T19:57:58.910 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2023-10-16T19:57:58.911 INFO:teuthology.orchestra.run.smithi157.stdout:} 2023-10-16T19:57:58.912 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:58.864+0000 7f077dfbb700 1 -- 172.21.15.157:0/1788249200 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f076406af00 msgr2=0x7f076406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:58.913 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:58.864+0000 7f077dfbb700 1 --2- 172.21.15.157:0/1788249200 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f076406af00 0x7f076406d3c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f0768009130 tx=0x7f0768008030 comp rx=0 tx=0).stop 2023-10-16T19:57:58.913 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:58.864+0000 7f077dfbb700 1 -- 172.21.15.157:0/1788249200 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f077815e0c0 msgr2=0x7f07781f3e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:58.913 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:58.864+0000 7f077dfbb700 1 --2- 172.21.15.157:0/1788249200 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f077815e0c0 0x7f07781f3e70 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f077000cca0 tx=0x7f077000a560 comp rx=0 tx=0).stop 2023-10-16T19:57:58.913 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:58.864+0000 7f077dfbb700 1 -- 172.21.15.157:0/1788249200 shutdown_connections 2023-10-16T19:57:58.913 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:58.864+0000 7f077dfbb700 1 --2- 172.21.15.157:0/1788249200 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f077815e0c0 0x7f07781f3e70 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:58.914 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:58.864+0000 7f077dfbb700 1 --2- 172.21.15.157:0/1788249200 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f07780d1a90 0x7f07780cbac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:58.914 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:58.864+0000 7f077dfbb700 1 --2- 172.21.15.157:0/1788249200 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f076406af00 0x7f076406d3c0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:58.914 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:58.864+0000 7f077dfbb700 1 --2- 172.21.15.157:0/1788249200 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f077815dce0 0x7f07780b5930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:58.914 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:58.864+0000 7f077dfbb700 1 -- 172.21.15.157:0/1788249200 >> 172.21.15.157:0/1788249200 conn(0x7f077806e300 msgr2=0x7f077806b960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:58.914 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:58.864+0000 7f077dfbb700 1 -- 172.21.15.157:0/1788249200 shutdown_connections 2023-10-16T19:57:58.915 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:58.864+0000 7f077dfbb700 1 -- 172.21.15.157:0/1788249200 wait complete. 2023-10-16T19:57:58.915 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-10-16T19:57:59.037 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.035+0000 7fc952083700 1 Processor -- start 2023-10-16T19:57:59.038 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.035+0000 7fc952083700 1 -- start start 2023-10-16T19:57:59.040 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.036+0000 7fc952083700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fc94c0af710 0x7fc94c0cdd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:59.041 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.036+0000 7fc952083700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc94c15f100 0x7fc94c06c670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:59.041 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.036+0000 7fc952083700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fc94c06cbb0 0x7fc94c0ad860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:59.041 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.036+0000 7fc952083700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc94c06d040 con 0x7fc94c06cbb0 2023-10-16T19:57:59.041 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.036+0000 7fc952083700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc94c162640 con 0x7fc94c0af710 2023-10-16T19:57:59.041 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.036+0000 7fc952083700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc94c0afaf0 con 0x7fc94c15f100 2023-10-16T19:57:59.042 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.036+0000 7fc94bfff700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fc94c06cbb0 0x7fc94c0ad860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:59.042 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.036+0000 7fc94bfff700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fc94c06cbb0 0x7fc94c0ad860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:47364/0 (socket says 172.21.15.157:47364) 2023-10-16T19:57:59.042 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.036+0000 7fc94bfff700 1 -- 172.21.15.157:0/546154161 learned_addr learned my addr 172.21.15.157:0/546154161 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:57:59.042 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.036+0000 7fc94bfff700 1 -- 172.21.15.157:0/546154161 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc94c15f100 msgr2=0x7fc94c06c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:57:59.042 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.036+0000 7fc94b7fe700 1 --2- 172.21.15.157:0/546154161 >> v2:172.21.15.187:3300/0 conn(0x7fc94c0af710 0x7fc94c0cdd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:59.043 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.036+0000 7fc94affd700 1 --2- 172.21.15.157:0/546154161 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc94c15f100 0x7fc94c06c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:59.043 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.036+0000 7fc94bfff700 1 --2- 172.21.15.157:0/546154161 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc94c15f100 0x7fc94c06c670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:59.043 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.036+0000 7fc94bfff700 1 -- 172.21.15.157:0/546154161 >> v2:172.21.15.187:3300/0 conn(0x7fc94c0af710 msgr2=0x7fc94c0cdd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:57:59.043 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.036+0000 7fc94bfff700 1 --2- 172.21.15.157:0/546154161 >> v2:172.21.15.187:3300/0 conn(0x7fc94c0af710 0x7fc94c0cdd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:59.043 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.036+0000 7fc94bfff700 1 -- 172.21.15.157:0/546154161 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc94c161a30 con 0x7fc94c06cbb0 2023-10-16T19:57:59.044 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.036+0000 7fc94b7fe700 1 --2- 172.21.15.157:0/546154161 >> v2:172.21.15.187:3300/0 conn(0x7fc94c0af710 0x7fc94c0cdd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T19:57:59.044 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.037+0000 7fc94bfff700 1 --2- 172.21.15.157:0/546154161 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc94c06cbb0 0x7fc94c0ad860 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fc94c0b2e40 tx=0x7fc944009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9db0ec5b1e19923f server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:59.044 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.037+0000 7fc94a7fc700 1 -- 172.21.15.157:0/546154161 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc94400b870 con 0x7fc94c06cbb0 2023-10-16T19:57:59.044 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.037+0000 7fc94a7fc700 1 -- 172.21.15.157:0/546154161 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc94400b9d0 con 0x7fc94c06cbb0 2023-10-16T19:57:59.044 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.037+0000 7fc94a7fc700 1 -- 172.21.15.157:0/546154161 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc94400bd60 con 0x7fc94c06cbb0 2023-10-16T19:57:59.045 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.037+0000 7fc952083700 1 -- 172.21.15.157:0/546154161 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc94c06cbb0 msgr2=0x7fc94c0ad860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:59.045 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.037+0000 7fc952083700 1 --2- 172.21.15.157:0/546154161 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc94c06cbb0 0x7fc94c0ad860 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fc94c0b2e40 tx=0x7fc944009bd0 comp rx=0 tx=0).stop 2023-10-16T19:57:59.045 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.037+0000 7fc952083700 1 -- 172.21.15.157:0/546154161 shutdown_connections 2023-10-16T19:57:59.045 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.037+0000 7fc952083700 1 --2- 172.21.15.157:0/546154161 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc94c06cbb0 0x7fc94c0ad860 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:59.045 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.037+0000 7fc952083700 1 --2- 172.21.15.157:0/546154161 >> v2:172.21.15.187:3300/0 conn(0x7fc94c0af710 0x7fc94c0cdd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:59.046 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.037+0000 7fc952083700 1 --2- 172.21.15.157:0/546154161 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc94c15f100 0x7fc94c06c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:59.046 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.037+0000 7fc952083700 1 -- 172.21.15.157:0/546154161 >> 172.21.15.157:0/546154161 conn(0x7fc94c0cceb0 msgr2=0x7fc94c0cd290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:59.046 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.037+0000 7fc952083700 1 -- 172.21.15.157:0/546154161 shutdown_connections 2023-10-16T19:57:59.047 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.037+0000 7fc952083700 1 -- 172.21.15.157:0/546154161 wait complete. 2023-10-16T19:57:59.049 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.039+0000 7fc952083700 1 Processor -- start 2023-10-16T19:57:59.049 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.039+0000 7fc952083700 1 -- start start 2023-10-16T19:57:59.050 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.039+0000 7fc952083700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc94c06cbb0 0x7fc94c0c6700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:59.050 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.039+0000 7fc952083700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc94c0af710 0x7fc94c1f77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:59.050 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.039+0000 7fc952083700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc94c15f100 0x7fc94c15a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:59.050 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.039+0000 7fc952083700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc94c0c4830 con 0x7fc94c0af710 2023-10-16T19:57:59.051 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.039+0000 7fc952083700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc94c0c4df0 con 0x7fc94c06cbb0 2023-10-16T19:57:59.051 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.040+0000 7fc952083700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc94c0c82f0 con 0x7fc94c15f100 2023-10-16T19:57:59.051 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.040+0000 7fc94affd700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc94c0af710 0x7fc94c1f77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:59.051 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.040+0000 7fc94affd700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc94c0af710 0x7fc94c1f77a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:47368/0 (socket says 172.21.15.157:47368) 2023-10-16T19:57:59.051 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.040+0000 7fc94affd700 1 -- 172.21.15.157:0/2640242494 learned_addr learned my addr 172.21.15.157:0/2640242494 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:57:59.051 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.040+0000 7fc94affd700 1 -- 172.21.15.157:0/2640242494 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc94c15f100 msgr2=0x7fc94c15a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:59.052 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.040+0000 7fc94b7fe700 1 --2- 172.21.15.157:0/2640242494 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc94c06cbb0 0x7fc94c0c6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:59.052 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.040+0000 7fc94bfff700 1 --2- 172.21.15.157:0/2640242494 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc94c15f100 0x7fc94c15a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:59.052 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.040+0000 7fc94affd700 1 --2- 172.21.15.157:0/2640242494 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc94c15f100 0x7fc94c15a720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:59.052 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.040+0000 7fc94affd700 1 -- 172.21.15.157:0/2640242494 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc94c06cbb0 msgr2=0x7fc94c0c6700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:59.052 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.040+0000 7fc94affd700 1 --2- 172.21.15.157:0/2640242494 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc94c06cbb0 0x7fc94c0c6700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:59.053 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.040+0000 7fc94affd700 1 -- 172.21.15.157:0/2640242494 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc944009550 con 0x7fc94c0af710 2023-10-16T19:57:59.053 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.040+0000 7fc94affd700 1 --2- 172.21.15.157:0/2640242494 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc94c0af710 0x7fc94c1f77a0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fc93400c820 tx=0x7fc93400cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:59.053 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.040+0000 7fc943fff700 1 -- 172.21.15.157:0/2640242494 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc934011800 con 0x7fc94c0af710 2023-10-16T19:57:59.053 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.040+0000 7fc943fff700 1 -- 172.21.15.157:0/2640242494 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc934011960 con 0x7fc94c0af710 2023-10-16T19:57:59.053 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.040+0000 7fc952083700 1 -- 172.21.15.157:0/2640242494 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc94c0c7d30 con 0x7fc94c0af710 2023-10-16T19:57:59.054 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.040+0000 7fc943fff700 1 -- 172.21.15.157:0/2640242494 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc934011cf0 con 0x7fc94c0af710 2023-10-16T19:57:59.054 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.040+0000 7fc952083700 1 -- 172.21.15.157:0/2640242494 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc94c0c4a10 con 0x7fc94c0af710 2023-10-16T19:57:59.054 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.041+0000 7fc952083700 1 -- 172.21.15.157:0/2640242494 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc94c04f400 con 0x7fc94c0af710 2023-10-16T19:57:59.054 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.042+0000 7fc943fff700 1 -- 172.21.15.157:0/2640242494 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fc934018360 con 0x7fc94c0af710 2023-10-16T19:57:59.054 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.042+0000 7fc943fff700 1 --2- 172.21.15.157:0/2640242494 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fc92c06af00 0x7fc92c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:59.055 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.042+0000 7fc943fff700 1 -- 172.21.15.157:0/2640242494 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fc934089190 con 0x7fc94c0af710 2023-10-16T19:57:59.055 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.042+0000 7fc94b7fe700 1 --2- 172.21.15.157:0/2640242494 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fc92c06af00 0x7fc92c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:59.055 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.043+0000 7fc94b7fe700 1 --2- 172.21.15.157:0/2640242494 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fc92c06af00 0x7fc92c06d3c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fc93c008f10 tx=0x7fc93c008460 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:59.055 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.046+0000 7fc943fff700 1 -- 172.21.15.157:0/2640242494 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc9340545a0 con 0x7fc94c0af710 2023-10-16T19:57:59.313 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.311+0000 7fc952083700 1 -- 172.21.15.157:0/2640242494 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7fc94c06bbe0 con 0x7fc94c0af710 2023-10-16T19:57:59.315 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.313+0000 7fc943fff700 1 -- 172.21.15.157:0/2640242494 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v9) v1 ==== 90+0+0 (secure 0 0 0) 0x7fc934057bc0 con 0x7fc94c0af710 2023-10-16T19:57:59.318 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.315+0000 7fc952083700 1 -- 172.21.15.157:0/2640242494 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fc92c06af00 msgr2=0x7fc92c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:59.319 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.315+0000 7fc952083700 1 --2- 172.21.15.157:0/2640242494 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fc92c06af00 0x7fc92c06d3c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fc93c008f10 tx=0x7fc93c008460 comp rx=0 tx=0).stop 2023-10-16T19:57:59.319 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.315+0000 7fc952083700 1 -- 172.21.15.157:0/2640242494 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc94c0af710 msgr2=0x7fc94c1f77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:59.319 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.315+0000 7fc952083700 1 --2- 172.21.15.157:0/2640242494 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc94c0af710 0x7fc94c1f77a0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fc93400c820 tx=0x7fc93400cbe0 comp rx=0 tx=0).stop 2023-10-16T19:57:59.319 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.315+0000 7fc952083700 1 -- 172.21.15.157:0/2640242494 shutdown_connections 2023-10-16T19:57:59.320 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.315+0000 7fc952083700 1 --2- 172.21.15.157:0/2640242494 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fc92c06af00 0x7fc92c06d3c0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:59.320 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.315+0000 7fc952083700 1 --2- 172.21.15.157:0/2640242494 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc94c06cbb0 0x7fc94c0c6700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:59.320 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.315+0000 7fc952083700 1 --2- 172.21.15.157:0/2640242494 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc94c15f100 0x7fc94c15a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:59.320 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.315+0000 7fc952083700 1 --2- 172.21.15.157:0/2640242494 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc94c0af710 0x7fc94c1f77a0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:59.320 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.315+0000 7fc952083700 1 -- 172.21.15.157:0/2640242494 >> 172.21.15.157:0/2640242494 conn(0x7fc94c0cceb0 msgr2=0x7fc94c15e220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:59.321 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.316+0000 7fc952083700 1 -- 172.21.15.157:0/2640242494 shutdown_connections 2023-10-16T19:57:59.321 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.316+0000 7fc952083700 1 -- 172.21.15.157:0/2640242494 wait complete. 2023-10-16T19:57:59.330 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-10-16T19:57:59.455 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.453+0000 7f5597822700 1 Processor -- start 2023-10-16T19:57:59.455 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.453+0000 7f5597822700 1 -- start start 2023-10-16T19:57:59.457 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.454+0000 7f5597822700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f559015de00 0x7f5590161a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:59.458 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.454+0000 7f5597822700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55900ce870 con 0x7f5590161f50 2023-10-16T19:57:59.458 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.454+0000 7f5597822700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5590162990 con 0x7f55900ced00 2023-10-16T19:57:59.458 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.454+0000 7f5597822700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55901623d0 con 0x7f559015de00 2023-10-16T19:57:59.458 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.454+0000 7f5594dbd700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f5590161f50 0x7f55900d2200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:57050/0 (socket says 172.21.15.157:57050) 2023-10-16T19:57:59.459 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.454+0000 7f5594dbd700 1 -- 172.21.15.157:0/3619950884 learned_addr learned my addr 172.21.15.157:0/3619950884 (peer_addr_for_me v1:172.21.15.157:0/0) 2023-10-16T19:57:59.459 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.454+0000 7f55955be700 1 --2- 172.21.15.157:0/3619950884 >> v2:172.21.15.187:3300/0 conn(0x7f559015de00 0x7f5590161a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:59.459 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.454+0000 7f5587fff700 1 -- 172.21.15.157:0/3619950884 <== mon.0 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2123583042 0 0) 0x7f55900ce870 con 0x7f5590161f50 2023-10-16T19:57:59.459 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.454+0000 7f5587fff700 1 -- 172.21.15.157:0/3619950884 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f557c0035b0 con 0x7f5590161f50 2023-10-16T19:57:59.459 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.454+0000 7f5587fff700 1 -- 172.21.15.157:0/3619950884 <== mon.0 v1:172.21.15.157:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4287647783 0 0) 0x7f557c0035b0 con 0x7f5590161f50 2023-10-16T19:57:59.460 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.454+0000 7f55955be700 1 -- 172.21.15.157:0/3619950884 >> v1:172.21.15.187:6789/0 conn(0x7f55900ced00 legacy=0x7f55900d05b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:59.460 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.454+0000 7f55955be700 1 -- 172.21.15.157:0/3619950884 >> v1:172.21.15.157:6789/0 conn(0x7f5590161f50 legacy=0x7f55900d2200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:59.460 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.454+0000 7f55955be700 1 -- 172.21.15.157:0/3619950884 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55901626b0 con 0x7f559015de00 2023-10-16T19:57:59.460 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.454+0000 7f55955be700 1 --2- 172.21.15.157:0/3619950884 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f559015de00 0x7f5590161a10 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f558c009840 tx=0x7f558c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=34e19ff3be12d213 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:59.460 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.454+0000 7f5587fff700 1 -- 172.21.15.157:0/3619950884 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5580001670 con 0x7f559015de00 2023-10-16T19:57:59.461 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.455+0000 7f5587fff700 1 -- 172.21.15.157:0/3619950884 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f558c004030 con 0x7f559015de00 2023-10-16T19:57:59.461 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.455+0000 7f5587fff700 1 -- 172.21.15.157:0/3619950884 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f558c0043c0 con 0x7f559015de00 2023-10-16T19:57:59.461 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.455+0000 7f5597822700 1 -- 172.21.15.157:0/3619950884 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f559015de00 msgr2=0x7f5590161a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:59.461 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.455+0000 7f5597822700 1 --2- 172.21.15.157:0/3619950884 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f559015de00 0x7f5590161a10 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f558c009840 tx=0x7f558c009b50 comp rx=0 tx=0).stop 2023-10-16T19:57:59.461 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.455+0000 7f5597822700 1 -- 172.21.15.157:0/3619950884 shutdown_connections 2023-10-16T19:57:59.462 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.455+0000 7f5597822700 1 --2- 172.21.15.157:0/3619950884 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f559015de00 0x7f5590161a10 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:59.462 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.455+0000 7f5597822700 1 -- 172.21.15.157:0/3619950884 >> 172.21.15.157:0/3619950884 conn(0x7f55900665a0 msgr2=0x7f5590066980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:59.462 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.455+0000 7f5597822700 1 -- 172.21.15.157:0/3619950884 shutdown_connections 2023-10-16T19:57:59.462 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.455+0000 7f5597822700 1 -- 172.21.15.157:0/3619950884 wait complete. 2023-10-16T19:57:59.465 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.456+0000 7f5597822700 1 Processor -- start 2023-10-16T19:57:59.465 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.456+0000 7f5597822700 1 -- start start 2023-10-16T19:57:59.465 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.457+0000 7f5597822700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f55900ced00 0x7f55900c9f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:59.465 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.457+0000 7f5597822700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5590161f50 0x7f559015c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:59.465 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.457+0000 7f5597822700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f55900ccd00 0x7f559015c900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:59.466 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.457+0000 7f5597822700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55901f4920 con 0x7f55900ced00 2023-10-16T19:57:59.466 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.457+0000 7f5597822700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55900cbf60 con 0x7f5590161f50 2023-10-16T19:57:59.466 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.457+0000 7f5597822700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55900cc240 con 0x7f55900ccd00 2023-10-16T19:57:59.466 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.457+0000 7f55955be700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f55900ced00 0x7f55900c9f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:59.466 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.457+0000 7f55955be700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f55900ced00 0x7f55900c9f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:47382/0 (socket says 172.21.15.157:47382) 2023-10-16T19:57:59.467 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.457+0000 7f55955be700 1 -- 172.21.15.157:0/1553396920 learned_addr learned my addr 172.21.15.157:0/1553396920 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:57:59.467 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.457+0000 7f5594dbd700 1 --2- 172.21.15.157:0/1553396920 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5590161f50 0x7f559015c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:59.467 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.457+0000 7f5595dbf700 1 --2- 172.21.15.157:0/1553396920 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f55900ccd00 0x7f559015c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:59.467 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.457+0000 7f55955be700 1 -- 172.21.15.157:0/1553396920 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f55900ccd00 msgr2=0x7f559015c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:59.467 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.457+0000 7f55955be700 1 --2- 172.21.15.157:0/1553396920 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f55900ccd00 0x7f559015c900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:59.468 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.457+0000 7f55955be700 1 -- 172.21.15.157:0/1553396920 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5590161f50 msgr2=0x7f559015c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:59.468 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.458+0000 7f55955be700 1 --2- 172.21.15.157:0/1553396920 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5590161f50 0x7f559015c3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:59.468 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.458+0000 7f55955be700 1 -- 172.21.15.157:0/1553396920 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f558c0094a0 con 0x7f55900ced00 2023-10-16T19:57:59.468 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.458+0000 7f5595dbf700 1 --2- 172.21.15.157:0/1553396920 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f55900ccd00 0x7f559015c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T19:57:59.468 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.458+0000 7f55955be700 1 --2- 172.21.15.157:0/1553396920 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f55900ced00 0x7f55900c9f90 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f558c009b90 tx=0x7f558c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:59.469 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.458+0000 7f5585ffb700 1 -- 172.21.15.157:0/1553396920 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f558c011830 con 0x7f55900ced00 2023-10-16T19:57:59.469 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.458+0000 7f5597822700 1 -- 172.21.15.157:0/1553396920 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55900cc520 con 0x7f55900ced00 2023-10-16T19:57:59.469 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.458+0000 7f5597822700 1 -- 172.21.15.157:0/1553396920 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55900ca4d0 con 0x7f55900ced00 2023-10-16T19:57:59.469 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.458+0000 7f5585ffb700 1 -- 172.21.15.157:0/1553396920 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f558c01f070 con 0x7f55900ced00 2023-10-16T19:57:59.469 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.458+0000 7f5585ffb700 1 -- 172.21.15.157:0/1553396920 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f558c011b90 con 0x7f55900ced00 2023-10-16T19:57:59.470 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.459+0000 7f557b7fe700 1 -- 172.21.15.157:0/1553396920 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55900ca690 con 0x7f55900ced00 2023-10-16T19:57:59.470 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.460+0000 7f5585ffb700 1 -- 172.21.15.157:0/1553396920 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f558c011cf0 con 0x7f55900ced00 2023-10-16T19:57:59.470 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.460+0000 7f5585ffb700 1 --2- 172.21.15.157:0/1553396920 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f557406af00 0x7f557406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:59.470 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.460+0000 7f5594dbd700 1 --2- 172.21.15.157:0/1553396920 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f557406af00 0x7f557406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:59.470 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.461+0000 7f5585ffb700 1 -- 172.21.15.157:0/1553396920 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f558c021070 con 0x7f55900ced00 2023-10-16T19:57:59.471 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.461+0000 7f5594dbd700 1 --2- 172.21.15.157:0/1553396920 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f557406af00 0x7f557406d3c0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f55900c7840 tx=0x7f5580001be0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:59.471 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.465+0000 7f5585ffb700 1 -- 172.21.15.157:0/1553396920 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f558c0564a0 con 0x7f55900ced00 2023-10-16T19:57:59.732 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.730+0000 7f557b7fe700 1 -- 172.21.15.157:0/1553396920 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7f559004f400 con 0x7f55900ced00 2023-10-16T19:57:59.734 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.732+0000 7f5585ffb700 1 -- 172.21.15.157:0/1553396920 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7f558c059ac0 con 0x7f55900ced00 2023-10-16T19:57:59.737 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.734+0000 7f557b7fe700 1 -- 172.21.15.157:0/1553396920 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f557406af00 msgr2=0x7f557406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:59.737 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.734+0000 7f557b7fe700 1 --2- 172.21.15.157:0/1553396920 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f557406af00 0x7f557406d3c0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f55900c7840 tx=0x7f5580001be0 comp rx=0 tx=0).stop 2023-10-16T19:57:59.737 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.734+0000 7f557b7fe700 1 -- 172.21.15.157:0/1553396920 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f55900ced00 msgr2=0x7f55900c9f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:59.737 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.734+0000 7f557b7fe700 1 --2- 172.21.15.157:0/1553396920 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f55900ced00 0x7f55900c9f90 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f558c009b90 tx=0x7f558c004750 comp rx=0 tx=0).stop 2023-10-16T19:57:59.737 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.734+0000 7f557b7fe700 1 -- 172.21.15.157:0/1553396920 shutdown_connections 2023-10-16T19:57:59.738 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.734+0000 7f557b7fe700 1 --2- 172.21.15.157:0/1553396920 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f55900ccd00 0x7f559015c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:59.738 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.734+0000 7f557b7fe700 1 --2- 172.21.15.157:0/1553396920 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f55900ced00 0x7f55900c9f90 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:59.738 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.734+0000 7f557b7fe700 1 --2- 172.21.15.157:0/1553396920 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f557406af00 0x7f557406d3c0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:59.738 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.734+0000 7f557b7fe700 1 --2- 172.21.15.157:0/1553396920 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5590161f50 0x7f559015c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:59.738 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.734+0000 7f557b7fe700 1 -- 172.21.15.157:0/1553396920 >> 172.21.15.157:0/1553396920 conn(0x7f55900665a0 msgr2=0x7f55900b88f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:59.739 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.734+0000 7f557b7fe700 1 -- 172.21.15.157:0/1553396920 shutdown_connections 2023-10-16T19:57:59.739 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.734+0000 7f557b7fe700 1 -- 172.21.15.157:0/1553396920 wait complete. 2023-10-16T19:57:59.749 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-10-16T19:57:59.871 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.868+0000 7f4da04e5700 1 Processor -- start 2023-10-16T19:57:59.871 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.868+0000 7f4da04e5700 1 -- start start 2023-10-16T19:57:59.873 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.869+0000 7f4da04e5700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f4d9815e2f0 0x7f4d9806d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:59.874 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.869+0000 7f4da04e5700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f4d9806af60 0x7f4d980ce910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:59.874 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.869+0000 7f4da04e5700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d980d08b0 con 0x7f4d9806de00 2023-10-16T19:57:59.874 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.869+0000 7f4da04e5700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d981628f0 con 0x7f4d9815e2f0 2023-10-16T19:57:59.874 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.869+0000 7f4da04e5700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d98162bd0 con 0x7f4d9806af60 2023-10-16T19:57:59.875 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.869+0000 7f4d9e281700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f4d9815e2f0 0x7f4d9806d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:59.875 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.870+0000 7f4d9e281700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f4d9815e2f0 0x7f4d9806d0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:47390/0 (socket says 172.21.15.157:47390) 2023-10-16T19:57:59.875 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.870+0000 7f4d9e281700 1 -- 172.21.15.157:0/2167503348 learned_addr learned my addr 172.21.15.157:0/2167503348 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:57:59.875 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.870+0000 7f4d9e281700 1 -- 172.21.15.157:0/2167503348 >> v2:172.21.15.187:3300/0 conn(0x7f4d9806af60 msgr2=0x7f4d980ce910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:57:59.875 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.870+0000 7f4d9ea82700 1 --2- 172.21.15.157:0/2167503348 >> v2:172.21.15.187:3300/0 conn(0x7f4d9806af60 0x7f4d980ce910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:59.876 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.870+0000 7f4d9e281700 1 --2- 172.21.15.157:0/2167503348 >> v2:172.21.15.187:3300/0 conn(0x7f4d9806af60 0x7f4d980ce910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:59.876 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.870+0000 7f4d9e281700 1 -- 172.21.15.157:0/2167503348 >> v1:172.21.15.187:6789/0 conn(0x7f4d9806de00 legacy=0x7f4d9806a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:57:59.876 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.870+0000 7f4d9e281700 1 -- 172.21.15.157:0/2167503348 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d980d05d0 con 0x7f4d9815e2f0 2023-10-16T19:57:59.876 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.870+0000 7f4d9e281700 1 --2- 172.21.15.157:0/2167503348 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4d9815e2f0 0x7f4d9806d0f0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f4d9806fbf0 tx=0x7f4d88009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98730c7d70a83cb2 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:59.876 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.870+0000 7f4d9d27f700 1 -- 172.21.15.157:0/2167503348 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d88004230 con 0x7f4d9815e2f0 2023-10-16T19:57:59.877 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.870+0000 7f4d9d27f700 1 -- 172.21.15.157:0/2167503348 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d88004390 con 0x7f4d9815e2f0 2023-10-16T19:57:59.877 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.870+0000 7f4d9d27f700 1 -- 172.21.15.157:0/2167503348 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d880036a0 con 0x7f4d9815e2f0 2023-10-16T19:57:59.877 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.871+0000 7f4da04e5700 1 -- 172.21.15.157:0/2167503348 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4d9815e2f0 msgr2=0x7f4d9806d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:59.877 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.871+0000 7f4da04e5700 1 --2- 172.21.15.157:0/2167503348 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4d9815e2f0 0x7f4d9806d0f0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f4d9806fbf0 tx=0x7f4d88009bd0 comp rx=0 tx=0).stop 2023-10-16T19:57:59.877 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.871+0000 7f4da04e5700 1 -- 172.21.15.157:0/2167503348 shutdown_connections 2023-10-16T19:57:59.878 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.871+0000 7f4da04e5700 1 --2- 172.21.15.157:0/2167503348 >> v2:172.21.15.187:3300/0 conn(0x7f4d9806af60 0x7f4d980ce910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:59.878 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.871+0000 7f4da04e5700 1 --2- 172.21.15.157:0/2167503348 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4d9815e2f0 0x7f4d9806d0f0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:59.878 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.871+0000 7f4da04e5700 1 -- 172.21.15.157:0/2167503348 >> 172.21.15.157:0/2167503348 conn(0x7f4d980cd4e0 msgr2=0x7f4d980cd8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:57:59.878 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.871+0000 7f4da04e5700 1 -- 172.21.15.157:0/2167503348 shutdown_connections 2023-10-16T19:57:59.878 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.871+0000 7f4da04e5700 1 -- 172.21.15.157:0/2167503348 wait complete. 2023-10-16T19:57:59.881 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.872+0000 7f4da04e5700 1 Processor -- start 2023-10-16T19:57:59.881 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.872+0000 7f4da04e5700 1 -- start start 2023-10-16T19:57:59.881 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.873+0000 7f4da04e5700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4d9806af60 0x7f4d981f3520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:59.882 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.873+0000 7f4da04e5700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4d9806de00 0x7f4d98158190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:59.882 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.873+0000 7f4da04e5700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4d9815e2f0 0x7f4d980b5ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:59.882 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.873+0000 7f4da04e5700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d980b3e30 con 0x7f4d9806de00 2023-10-16T19:57:59.882 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.873+0000 7f4da04e5700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d98154a10 con 0x7f4d9815e2f0 2023-10-16T19:57:59.883 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.873+0000 7f4da04e5700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d980c5cd0 con 0x7f4d9806af60 2023-10-16T19:57:59.883 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.873+0000 7f4d9da80700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4d9806de00 0x7f4d98158190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:59.883 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.873+0000 7f4d9da80700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4d9806de00 0x7f4d98158190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:47398/0 (socket says 172.21.15.157:47398) 2023-10-16T19:57:59.883 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.873+0000 7f4d9da80700 1 -- 172.21.15.157:0/2915289075 learned_addr learned my addr 172.21.15.157:0/2915289075 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:57:59.883 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.873+0000 7f4d9ea82700 1 --2- 172.21.15.157:0/2915289075 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4d9815e2f0 0x7f4d980b5ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:59.884 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.873+0000 7f4d9e281700 1 --2- 172.21.15.157:0/2915289075 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4d9806af60 0x7f4d981f3520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:59.884 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.873+0000 7f4d9da80700 1 -- 172.21.15.157:0/2915289075 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4d9806af60 msgr2=0x7f4d981f3520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:59.884 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.873+0000 7f4d9da80700 1 --2- 172.21.15.157:0/2915289075 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4d9806af60 0x7f4d981f3520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:59.884 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.873+0000 7f4d9da80700 1 -- 172.21.15.157:0/2915289075 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4d9815e2f0 msgr2=0x7f4d980b5ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:57:59.884 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.873+0000 7f4d9da80700 1 --2- 172.21.15.157:0/2915289075 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4d9815e2f0 0x7f4d980b5ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:57:59.885 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.873+0000 7f4d9da80700 1 -- 172.21.15.157:0/2915289075 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d88009550 con 0x7f4d9806de00 2023-10-16T19:57:59.885 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.873+0000 7f4d9da80700 1 --2- 172.21.15.157:0/2915289075 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4d9806de00 0x7f4d98158190 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f4d9400b470 tx=0x7f4d9400b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:59.885 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.873+0000 7f4d8effd700 1 -- 172.21.15.157:0/2915289075 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d94011830 con 0x7f4d9806de00 2023-10-16T19:57:59.885 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.873+0000 7f4d8effd700 1 -- 172.21.15.157:0/2915289075 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d940119b0 con 0x7f4d9806de00 2023-10-16T19:57:59.885 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.873+0000 7f4da04e5700 1 -- 172.21.15.157:0/2915289075 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d980b3770 con 0x7f4d9806de00 2023-10-16T19:57:59.885 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.873+0000 7f4d8effd700 1 -- 172.21.15.157:0/2915289075 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d94011d60 con 0x7f4d9806de00 2023-10-16T19:57:59.886 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.874+0000 7f4da04e5700 1 -- 172.21.15.157:0/2915289075 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d980c5fb0 con 0x7f4d9806de00 2023-10-16T19:57:59.886 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.874+0000 7f4da04e5700 1 -- 172.21.15.157:0/2915289075 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d9804f400 con 0x7f4d9806de00 2023-10-16T19:57:59.886 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.875+0000 7f4d8effd700 1 -- 172.21.15.157:0/2915289075 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f4d9401a400 con 0x7f4d9806de00 2023-10-16T19:57:59.886 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.875+0000 7f4d8effd700 1 --2- 172.21.15.157:0/2915289075 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f4d7c06af00 0x7f4d7c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:57:59.886 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.875+0000 7f4d8effd700 1 -- 172.21.15.157:0/2915289075 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f4d940891b0 con 0x7f4d9806de00 2023-10-16T19:57:59.887 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.875+0000 7f4d9e281700 1 --2- 172.21.15.157:0/2915289075 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f4d7c06af00 0x7f4d7c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:57:59.887 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.876+0000 7f4d9e281700 1 --2- 172.21.15.157:0/2915289075 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f4d7c06af00 0x7f4d7c06d3c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f4d88009130 tx=0x7f4d88008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:57:59.887 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:57:59.880+0000 7f4d8effd700 1 -- 172.21.15.157:0/2915289075 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4d940545b0 con 0x7f4d9806de00 2023-10-16T19:58:00.148 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:00.146+0000 7f4da04e5700 1 -- 172.21.15.157:0/2915289075 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7f4d9806b650 con 0x7f4d9806de00 2023-10-16T19:58:00.150 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:00.148+0000 7f4d8effd700 1 -- 172.21.15.157:0/2915289075 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v11) v1 ==== 90+0+0 (secure 0 0 0) 0x7f4d94057bd0 con 0x7f4d9806de00 2023-10-16T19:58:00.153 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:00.150+0000 7f4da04e5700 1 -- 172.21.15.157:0/2915289075 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f4d7c06af00 msgr2=0x7f4d7c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:00.153 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:00.150+0000 7f4da04e5700 1 --2- 172.21.15.157:0/2915289075 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f4d7c06af00 0x7f4d7c06d3c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f4d88009130 tx=0x7f4d88008030 comp rx=0 tx=0).stop 2023-10-16T19:58:00.154 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:00.150+0000 7f4da04e5700 1 -- 172.21.15.157:0/2915289075 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4d9806de00 msgr2=0x7f4d98158190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:00.154 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:00.150+0000 7f4da04e5700 1 --2- 172.21.15.157:0/2915289075 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4d9806de00 0x7f4d98158190 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f4d9400b470 tx=0x7f4d9400b780 comp rx=0 tx=0).stop 2023-10-16T19:58:00.154 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:00.150+0000 7f4da04e5700 1 -- 172.21.15.157:0/2915289075 shutdown_connections 2023-10-16T19:58:00.154 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:00.150+0000 7f4da04e5700 1 --2- 172.21.15.157:0/2915289075 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f4d7c06af00 0x7f4d7c06d3c0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:00.154 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:00.150+0000 7f4da04e5700 1 --2- 172.21.15.157:0/2915289075 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4d9815e2f0 0x7f4d980b5ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:00.155 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:00.150+0000 7f4da04e5700 1 --2- 172.21.15.157:0/2915289075 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4d9806af60 0x7f4d981f3520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:00.155 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:00.150+0000 7f4da04e5700 1 --2- 172.21.15.157:0/2915289075 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4d9806de00 0x7f4d98158190 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:00.155 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:00.150+0000 7f4da04e5700 1 -- 172.21.15.157:0/2915289075 >> 172.21.15.157:0/2915289075 conn(0x7f4d980cd4e0 msgr2=0x7f4d980cd8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:58:00.155 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:00.150+0000 7f4da04e5700 1 -- 172.21.15.157:0/2915289075 shutdown_connections 2023-10-16T19:58:00.155 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:00.150+0000 7f4da04e5700 1 -- 172.21.15.157:0/2915289075 wait complete. 2023-10-16T19:58:00.165 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-10-16T19:58:00.287 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:00.285+0000 7f6e7eb82700 1 Processor -- start 2023-10-16T19:58:00.288 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:00.285+0000 7f6e7eb82700 1 -- start start 2023-10-16T19:58:00.291 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:00.286+0000 7f6e7eb82700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f6e780d1a90 0x7f6e780b3690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:00.292 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:00.286+0000 7f6e7eb82700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e7806d9c0 con 0x7f6e7815dce0 2023-10-16T19:58:00.292 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:00.286+0000 7f6e7eb82700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e780ce610 con 0x7f6e7815e0c0 2023-10-16T19:58:00.292 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:00.286+0000 7f6e7eb82700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e780b13c0 con 0x7f6e780d1a90 2023-10-16T19:58:00.292 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:00.286+0000 7f6e7c91e700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f6e7815dce0 0x7f6e7806d2b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:57076/0 (socket says 172.21.15.157:57076) 2023-10-16T19:58:00.292 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:00.286+0000 7f6e7c91e700 1 -- 172.21.15.157:0/2724679663 learned_addr learned my addr 172.21.15.157:0/2724679663 (peer_addr_for_me v1:172.21.15.157:0/0) 2023-10-16T19:58:00.292 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:00.286+0000 7f6e77fff700 1 --2- 172.21.15.157:0/2724679663 >> v2:172.21.15.187:3300/0 conn(0x7f6e780d1a90 0x7f6e780b3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:00.293 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:00.286+0000 7f6e777fe700 1 -- 172.21.15.157:0/2724679663 <== mon.0 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2064117208 0 0) 0x7f6e7806d9c0 con 0x7f6e7815dce0 2023-10-16T19:58:00.293 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:00.286+0000 7f6e777fe700 1 -- 172.21.15.157:0/2724679663 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6e680035b0 con 0x7f6e7815dce0 2023-10-16T19:58:00.293 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:00.286+0000 7f6e777fe700 1 -- 172.21.15.157:0/2724679663 <== mon.0 v1:172.21.15.157:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 79795815 0 0) 0x7f6e680035b0 con 0x7f6e7815dce0 2023-10-16T19:58:00.293 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:00.286+0000 7f6e777fe700 1 -- 172.21.15.157:0/2724679663 >> v2:172.21.15.187:3300/0 conn(0x7f6e780d1a90 msgr2=0x7f6e780b3690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:58:00.293 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:00.286+0000 7f6e777fe700 1 --2- 172.21.15.157:0/2724679663 >> v2:172.21.15.187:3300/0 conn(0x7f6e780d1a90 0x7f6e780b3690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:00.294 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:00.286+0000 7f6e777fe700 1 -- 172.21.15.157:0/2724679663 >> v1:172.21.15.187:6789/0 conn(0x7f6e7815e0c0 legacy=0x7f6e78167b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:00.294 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:00.286+0000 7f6e777fe700 1 -- 172.21.15.157:0/2724679663 --> v1:172.21.15.157:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e780d1f50 con 0x7f6e7815dce0 2023-10-16T19:58:00.294 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:00.286+0000 7f6e777fe700 1 -- 172.21.15.157:0/2724679663 <== mon.0 v1:172.21.15.157:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4021145519 0 0) 0x7f6e6c001670 con 0x7f6e7815dce0 2023-10-16T19:58:00.294 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:00.286+0000 7f6e777fe700 1 -- 172.21.15.157:0/2724679663 >> v1:172.21.15.157:6789/0 conn(0x7f6e7815dce0 legacy=0x7f6e7806d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:00.294 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:00.286+0000 7f6e777fe700 1 --2- 172.21.15.157:0/2724679663 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6e68003a00 0x7f6e68003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:00.295 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:00.286+0000 7f6e777fe700 1 --2- 172.21.15.157:0/2724679663 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6e68004850 0x7f6e68004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:00.295 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:00.287+0000 7f6e777fe700 1 --2- 172.21.15.157:0/2724679663 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6e68005330 0x7f6e6800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:00.295 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:00.287+0000 7f6e777fe700 1 -- 172.21.15.157:0/2724679663 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e780b13c0 con 0x7f6e68005330 2023-10-16T19:58:00.295 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:00.287+0000 7f6e777fe700 1 -- 172.21.15.157:0/2724679663 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e6800c200 con 0x7f6e68004850 2023-10-16T19:58:00.295 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:00.287+0000 7f6e777fe700 1 -- 172.21.15.157:0/2724679663 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e6800c3c0 con 0x7f6e68003a00 2023-10-16T19:58:00.296 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:00.287+0000 7f6e7d11f700 1 --2- 172.21.15.157:0/2724679663 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6e68005330 0x7f6e6800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:00.296 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:00.287+0000 7f6e7c91e700 1 --2- 172.21.15.157:0/2724679663 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6e68003a00 0x7f6e68003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:00.296 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:00.287+0000 7f6e77fff700 1 --2- 172.21.15.157:0/2724679663 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6e68004850 0x7f6e68004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:00.296 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:00.287+0000 7f6e7d11f700 1 -- 172.21.15.157:0/2724679663 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6e68003a00 msgr2=0x7f6e68003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:58:00.296 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:00.287+0000 7f6e7d11f700 1 --2- 172.21.15.157:0/2724679663 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6e68003a00 0x7f6e68003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:00.297 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:00.287+0000 7f6e7d11f700 1 -- 172.21.15.157:0/2724679663 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6e68004850 msgr2=0x7f6e68004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:58:00.297 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:00.287+0000 7f6e7d11f700 1 --2- 172.21.15.157:0/2724679663 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6e68004850 0x7f6e68004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:00.297 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:00.287+0000 7f6e7d11f700 1 -- 172.21.15.157:0/2724679663 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e680035b0 con 0x7f6e68005330 2023-10-16T19:58:00.297 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:00.287+0000 7f6e77fff700 1 --2- 172.21.15.157:0/2724679663 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6e68004850 0x7f6e68004cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T19:58:00.297 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:00.287+0000 7f6e7d11f700 1 -- 172.21.15.157:0/2724679663 reap_dead start 2023-10-16T19:58:00.298 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:00.287+0000 7f6e7d11f700 1 --2- 172.21.15.157:0/2724679663 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6e68005330 0x7f6e6800ba10 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f6e7000c160 tx=0x7f6e68005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90ef70ce6bf2a767 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:58:00.298 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:00.287+0000 7f6e777fe700 1 -- 172.21.15.157:0/2724679663 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e70001db0 con 0x7f6e68005330 2023-10-16T19:58:00.298 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:00.287+0000 7f6e777fe700 1 -- 172.21.15.157:0/2724679663 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e7000cca0 con 0x7f6e68005330 2023-10-16T19:58:00.298 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:00.287+0000 7f6e777fe700 1 -- 172.21.15.157:0/2724679663 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e70003c00 con 0x7f6e68005330 2023-10-16T19:58:00.298 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:00.288+0000 7f6e7eb82700 1 -- 172.21.15.157:0/2724679663 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6e68005330 msgr2=0x7f6e6800ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:00.301 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:00.288+0000 7f6e7eb82700 1 --2- 172.21.15.157:0/2724679663 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6e68005330 0x7f6e6800ba10 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f6e7000c160 tx=0x7f6e68005880 comp rx=0 tx=0).stop 2023-10-16T19:58:00.302 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:00.288+0000 7f6e7eb82700 1 -- 172.21.15.157:0/2724679663 shutdown_connections 2023-10-16T19:58:00.302 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:00.288+0000 7f6e7eb82700 1 --2- 172.21.15.157:0/2724679663 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6e68005330 0x7f6e6800ba10 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:00.302 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:00.288+0000 7f6e7eb82700 1 -- 172.21.15.157:0/2724679663 >> 172.21.15.157:0/2724679663 conn(0x7f6e7806e300 msgr2=0x7f6e7806e6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:58:00.302 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:00.288+0000 7f6e7eb82700 1 -- 172.21.15.157:0/2724679663 shutdown_connections 2023-10-16T19:58:00.302 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:00.288+0000 7f6e7eb82700 1 -- 172.21.15.157:0/2724679663 wait complete. 2023-10-16T19:58:00.303 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:00.289+0000 7f6e7eb82700 1 Processor -- start 2023-10-16T19:58:00.303 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:00.289+0000 7f6e7eb82700 1 -- start start 2023-10-16T19:58:00.306 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:00.290+0000 7f6e7eb82700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6e68005330 0x7f6e78155ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:00.306 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:00.290+0000 7f6e7eb82700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6e78153c60 0x7f6e781540e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:00.306 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:00.290+0000 7f6e7eb82700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6e78145fb0 0x7f6e78146460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:00.307 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:00.290+0000 7f6e7eb82700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e78154620 con 0x7f6e78153c60 2023-10-16T19:58:00.307 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:00.290+0000 7f6e7eb82700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e78156370 con 0x7f6e78145fb0 2023-10-16T19:58:00.307 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:00.290+0000 7f6e7eb82700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e78156650 con 0x7f6e68005330 2023-10-16T19:58:00.307 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:00.290+0000 7f6e77fff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6e78153c60 0x7f6e781540e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:00.307 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:00.290+0000 7f6e77fff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6e78153c60 0x7f6e781540e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:47418/0 (socket says 172.21.15.157:47418) 2023-10-16T19:58:00.308 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:00.290+0000 7f6e77fff700 1 -- 172.21.15.157:0/2947536385 learned_addr learned my addr 172.21.15.157:0/2947536385 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:58:00.308 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:00.290+0000 7f6e7c91e700 1 --2- 172.21.15.157:0/2947536385 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6e68005330 0x7f6e78155ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:00.308 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:00.290+0000 7f6e7d11f700 1 --2- 172.21.15.157:0/2947536385 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6e78145fb0 0x7f6e78146460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:00.308 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:00.290+0000 7f6e77fff700 1 -- 172.21.15.157:0/2947536385 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6e68005330 msgr2=0x7f6e78155ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:00.308 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:00.290+0000 7f6e77fff700 1 --2- 172.21.15.157:0/2947536385 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6e68005330 0x7f6e78155ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:00.309 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:00.290+0000 7f6e77fff700 1 -- 172.21.15.157:0/2947536385 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6e78145fb0 msgr2=0x7f6e78146460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:00.309 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:00.290+0000 7f6e77fff700 1 --2- 172.21.15.157:0/2947536385 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6e78145fb0 0x7f6e78146460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:00.309 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:00.290+0000 7f6e77fff700 1 -- 172.21.15.157:0/2947536385 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e78156930 con 0x7f6e78153c60 2023-10-16T19:58:00.309 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:00.290+0000 7f6e77fff700 1 --2- 172.21.15.157:0/2947536385 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6e78153c60 0x7f6e781540e0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f6e640108f0 tx=0x7f6e64010c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:58:00.309 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:00.290+0000 7f6e757fa700 1 -- 172.21.15.157:0/2947536385 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e64004020 con 0x7f6e78153c60 2023-10-16T19:58:00.310 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:00.290+0000 7f6e757fa700 1 -- 172.21.15.157:0/2947536385 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e64004180 con 0x7f6e78153c60 2023-10-16T19:58:00.310 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:00.290+0000 7f6e7eb82700 1 -- 172.21.15.157:0/2947536385 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e78156c10 con 0x7f6e78153c60 2023-10-16T19:58:00.310 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:00.290+0000 7f6e757fa700 1 -- 172.21.15.157:0/2947536385 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e64004530 con 0x7f6e78153c60 2023-10-16T19:58:00.310 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:00.291+0000 7f6e7eb82700 1 -- 172.21.15.157:0/2947536385 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e78156010 con 0x7f6e78153c60 2023-10-16T19:58:00.310 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:00.291+0000 7f6e7eb82700 1 -- 172.21.15.157:0/2947536385 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e780c9c30 con 0x7f6e78153c60 2023-10-16T19:58:00.310 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:00.292+0000 7f6e757fa700 1 -- 172.21.15.157:0/2947536385 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f6e64016730 con 0x7f6e78153c60 2023-10-16T19:58:00.311 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:00.292+0000 7f6e757fa700 1 --2- 172.21.15.157:0/2947536385 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f6e5c06af00 0x7f6e5c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:00.311 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:00.292+0000 7f6e757fa700 1 -- 172.21.15.157:0/2947536385 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f6e64089450 con 0x7f6e78153c60 2023-10-16T19:58:00.311 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:00.293+0000 7f6e7c91e700 1 --2- 172.21.15.157:0/2947536385 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f6e5c06af00 0x7f6e5c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:00.311 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:00.293+0000 7f6e7c91e700 1 --2- 172.21.15.157:0/2947536385 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f6e5c06af00 0x7f6e5c06d3c0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f6e6c007cd0 tx=0x7f6e6c000f80 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:58:00.312 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:00.296+0000 7f6e757fa700 1 -- 172.21.15.157:0/2947536385 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6e64054850 con 0x7f6e78153c60 2023-10-16T19:58:00.566 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:00.563+0000 7f6e7eb82700 1 -- 172.21.15.157:0/2947536385 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7f6e7804f400 con 0x7f6e78153c60 2023-10-16T19:58:00.567 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:00.565+0000 7f6e757fa700 1 -- 172.21.15.157:0/2947536385 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v12) v1 ==== 90+0+0 (secure 0 0 0) 0x7f6e64057e70 con 0x7f6e78153c60 2023-10-16T19:58:00.570 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:00.567+0000 7f6e7eb82700 1 -- 172.21.15.157:0/2947536385 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f6e5c06af00 msgr2=0x7f6e5c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:00.570 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:00.567+0000 7f6e7eb82700 1 --2- 172.21.15.157:0/2947536385 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f6e5c06af00 0x7f6e5c06d3c0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f6e6c007cd0 tx=0x7f6e6c000f80 comp rx=0 tx=0).stop 2023-10-16T19:58:00.570 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:00.567+0000 7f6e7eb82700 1 -- 172.21.15.157:0/2947536385 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6e78153c60 msgr2=0x7f6e781540e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:00.571 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:00.567+0000 7f6e7eb82700 1 --2- 172.21.15.157:0/2947536385 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6e78153c60 0x7f6e781540e0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f6e640108f0 tx=0x7f6e64010c00 comp rx=0 tx=0).stop 2023-10-16T19:58:00.571 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:00.567+0000 7f6e7eb82700 1 -- 172.21.15.157:0/2947536385 shutdown_connections 2023-10-16T19:58:00.571 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:00.567+0000 7f6e7eb82700 1 --2- 172.21.15.157:0/2947536385 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f6e5c06af00 0x7f6e5c06d3c0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:00.571 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:00.567+0000 7f6e7eb82700 1 --2- 172.21.15.157:0/2947536385 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6e78145fb0 0x7f6e78146460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:00.571 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:00.567+0000 7f6e7eb82700 1 --2- 172.21.15.157:0/2947536385 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6e68005330 0x7f6e78155ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:00.572 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:00.567+0000 7f6e7eb82700 1 --2- 172.21.15.157:0/2947536385 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6e78153c60 0x7f6e781540e0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:00.572 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:00.567+0000 7f6e7eb82700 1 -- 172.21.15.157:0/2947536385 >> 172.21.15.157:0/2947536385 conn(0x7f6e7806e300 msgr2=0x7f6e7815f240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:58:00.572 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:00.567+0000 7f6e7eb82700 1 -- 172.21.15.157:0/2947536385 shutdown_connections 2023-10-16T19:58:00.572 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:00.567+0000 7f6e7eb82700 1 -- 172.21.15.157:0/2947536385 wait complete. 2023-10-16T19:58:00.582 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-10-16T19:58:00.704 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:00.701+0000 7f1f3d429700 1 Processor -- start 2023-10-16T19:58:00.704 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:00.701+0000 7f1f3d429700 1 -- start start 2023-10-16T19:58:00.708 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:00.702+0000 7f1f3d429700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1f3815b130 0x7f1f38071f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:00.708 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:00.702+0000 7f1f3d429700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f380cefc0 con 0x7f1f3806d0f0 2023-10-16T19:58:00.709 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:00.702+0000 7f1f3d429700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f3806e090 con 0x7f1f3806eb20 2023-10-16T19:58:00.709 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:00.702+0000 7f1f3d429700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f380b0050 con 0x7f1f3815b130 2023-10-16T19:58:00.709 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:00.702+0000 7f1f367fc700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f1f3806d0f0 0x7f1f380cb970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:57096/0 (socket says 172.21.15.157:57096) 2023-10-16T19:58:00.709 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:00.702+0000 7f1f367fc700 1 -- 172.21.15.157:0/947974254 learned_addr learned my addr 172.21.15.157:0/947974254 (peer_addr_for_me v1:172.21.15.157:0/0) 2023-10-16T19:58:00.709 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:00.703+0000 7f1f36ffd700 1 --2- 172.21.15.157:0/947974254 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1f3815b130 0x7f1f38071f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:00.710 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:00.703+0000 7f1f35ffb700 1 -- 172.21.15.157:0/947974254 <== mon.0 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3797153857 0 0) 0x7f1f380cefc0 con 0x7f1f3806d0f0 2023-10-16T19:58:00.710 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:00.703+0000 7f1f35ffb700 1 -- 172.21.15.157:0/947974254 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1f200035b0 con 0x7f1f3806d0f0 2023-10-16T19:58:00.710 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:00.703+0000 7f1f35ffb700 1 -- 172.21.15.157:0/947974254 <== mon.0 v1:172.21.15.157:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1019339024 0 0) 0x7f1f200035b0 con 0x7f1f3806d0f0 2023-10-16T19:58:00.710 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:00.703+0000 7f1f35ffb700 1 -- 172.21.15.157:0/947974254 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1f3815b130 msgr2=0x7f1f38071f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:58:00.710 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:00.703+0000 7f1f35ffb700 1 --2- 172.21.15.157:0/947974254 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1f3815b130 0x7f1f38071f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:00.711 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:00.703+0000 7f1f35ffb700 1 -- 172.21.15.157:0/947974254 >> v1:172.21.15.187:6789/0 conn(0x7f1f3806eb20 legacy=0x7f1f380cf450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:00.711 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:00.703+0000 7f1f35ffb700 1 -- 172.21.15.157:0/947974254 --> v1:172.21.15.157:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f3806d570 con 0x7f1f3806d0f0 2023-10-16T19:58:00.711 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:00.703+0000 7f1f35ffb700 1 -- 172.21.15.157:0/947974254 <== mon.0 v1:172.21.15.157:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4021145519 0 0) 0x7f1f28001670 con 0x7f1f3806d0f0 2023-10-16T19:58:00.711 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:00.703+0000 7f1f35ffb700 1 -- 172.21.15.157:0/947974254 >> v1:172.21.15.157:6789/0 conn(0x7f1f3806d0f0 legacy=0x7f1f380cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:00.711 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:00.703+0000 7f1f35ffb700 1 --2- 172.21.15.157:0/947974254 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1f3815b130 0x7f1f20003a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:00.712 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:00.703+0000 7f1f35ffb700 1 --2- 172.21.15.157:0/947974254 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1f20003f70 0x7f1f20004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:00.712 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:00.703+0000 7f1f35ffb700 1 --2- 172.21.15.157:0/947974254 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1f20004d90 0x7f1f20005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:00.712 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:00.703+0000 7f1f35ffb700 1 -- 172.21.15.157:0/947974254 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f2000bb20 con 0x7f1f20003f70 2023-10-16T19:58:00.712 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:00.703+0000 7f1f35ffb700 1 -- 172.21.15.157:0/947974254 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f2000bc90 con 0x7f1f20004d90 2023-10-16T19:58:00.712 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:00.703+0000 7f1f35ffb700 1 -- 172.21.15.157:0/947974254 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f2000be50 con 0x7f1f3815b130 2023-10-16T19:58:00.713 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:00.703+0000 7f1f367fc700 1 --2- 172.21.15.157:0/947974254 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1f20003f70 0x7f1f20004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:00.713 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:00.703+0000 7f1f36ffd700 1 --2- 172.21.15.157:0/947974254 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1f3815b130 0x7f1f20003a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:00.713 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:00.703+0000 7f1f377fe700 1 --2- 172.21.15.157:0/947974254 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1f20004d90 0x7f1f20005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:00.714 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:00.703+0000 7f1f367fc700 1 -- 172.21.15.157:0/947974254 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1f3815b130 msgr2=0x7f1f20003a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:58:00.714 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:00.703+0000 7f1f367fc700 1 --2- 172.21.15.157:0/947974254 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1f3815b130 0x7f1f20003a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:00.714 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:00.703+0000 7f1f367fc700 1 -- 172.21.15.157:0/947974254 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1f20004d90 msgr2=0x7f1f20005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:58:00.715 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:00.703+0000 7f1f367fc700 1 --2- 172.21.15.157:0/947974254 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1f20004d90 0x7f1f20005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:00.715 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:00.703+0000 7f1f367fc700 1 -- 172.21.15.157:0/947974254 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f200035b0 con 0x7f1f20003f70 2023-10-16T19:58:00.715 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:00.704+0000 7f1f367fc700 1 --2- 172.21.15.157:0/947974254 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1f20003f70 0x7f1f20004850 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f1f28005110 tx=0x7f1f20005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bca4e5c86942d426 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:58:00.715 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:00.704+0000 7f1f35ffb700 1 -- 172.21.15.157:0/947974254 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f28005b60 con 0x7f1f20003f70 2023-10-16T19:58:00.715 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:00.704+0000 7f1f35ffb700 1 -- 172.21.15.157:0/947974254 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f28005cc0 con 0x7f1f20003f70 2023-10-16T19:58:00.716 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:00.704+0000 7f1f35ffb700 1 -- 172.21.15.157:0/947974254 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f280082f0 con 0x7f1f20003f70 2023-10-16T19:58:00.716 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:00.704+0000 7f1f3d429700 1 -- 172.21.15.157:0/947974254 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1f20003f70 msgr2=0x7f1f20004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:00.716 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:00.704+0000 7f1f3d429700 1 --2- 172.21.15.157:0/947974254 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1f20003f70 0x7f1f20004850 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f1f28005110 tx=0x7f1f20005880 comp rx=0 tx=0).stop 2023-10-16T19:58:00.716 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:00.704+0000 7f1f377fe700 1 -- 172.21.15.157:0/947974254 reap_dead start 2023-10-16T19:58:00.716 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:00.704+0000 7f1f3d429700 1 -- 172.21.15.157:0/947974254 shutdown_connections 2023-10-16T19:58:00.717 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:00.704+0000 7f1f3d429700 1 -- 172.21.15.157:0/947974254 >> 172.21.15.157:0/947974254 conn(0x7f1f380cd4e0 msgr2=0x7f1f380cd8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:58:00.717 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:00.704+0000 7f1f3d429700 1 -- 172.21.15.157:0/947974254 shutdown_connections 2023-10-16T19:58:00.717 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:00.704+0000 7f1f3d429700 1 -- 172.21.15.157:0/947974254 wait complete. 2023-10-16T19:58:00.717 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:00.706+0000 7f1f3d429700 1 Processor -- start 2023-10-16T19:58:00.717 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:00.706+0000 7f1f3d429700 1 -- start start 2023-10-16T19:58:00.720 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:00.707+0000 7f1f3d429700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1f20003f70 0x7f1f3815e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:00.721 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:00.707+0000 7f1f3d429700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1f3815ee60 0x7f1f380ae9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:00.721 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:00.707+0000 7f1f3d429700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1f380aef20 0x7f1f38148040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:00.721 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:00.707+0000 7f1f3d429700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f380ade40 con 0x7f1f3815ee60 2023-10-16T19:58:00.721 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:00.707+0000 7f1f3d429700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f3815e490 con 0x7f1f380aef20 2023-10-16T19:58:00.721 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:00.707+0000 7f1f3d429700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f38159420 con 0x7f1f20003f70 2023-10-16T19:58:00.722 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:00.707+0000 7f1f367fc700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1f3815ee60 0x7f1f380ae9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:00.722 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:00.707+0000 7f1f367fc700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1f3815ee60 0x7f1f380ae9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:47436/0 (socket says 172.21.15.157:47436) 2023-10-16T19:58:00.722 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:00.707+0000 7f1f367fc700 1 -- 172.21.15.157:0/1773431439 learned_addr learned my addr 172.21.15.157:0/1773431439 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:58:00.722 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:00.707+0000 7f1f36ffd700 1 --2- 172.21.15.157:0/1773431439 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1f20003f70 0x7f1f3815e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:00.722 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:00.707+0000 7f1f377fe700 1 --2- 172.21.15.157:0/1773431439 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1f380aef20 0x7f1f38148040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:00.723 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:00.707+0000 7f1f367fc700 1 -- 172.21.15.157:0/1773431439 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1f20003f70 msgr2=0x7f1f3815e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:00.723 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:00.707+0000 7f1f367fc700 1 --2- 172.21.15.157:0/1773431439 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1f20003f70 0x7f1f3815e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:00.723 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:00.707+0000 7f1f367fc700 1 -- 172.21.15.157:0/1773431439 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1f380aef20 msgr2=0x7f1f38148040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:00.723 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:00.707+0000 7f1f367fc700 1 --2- 172.21.15.157:0/1773431439 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1f380aef20 0x7f1f38148040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:00.723 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:00.707+0000 7f1f367fc700 1 -- 172.21.15.157:0/1773431439 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f3815d880 con 0x7f1f3815ee60 2023-10-16T19:58:00.724 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:00.707+0000 7f1f36ffd700 1 --2- 172.21.15.157:0/1773431439 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1f20003f70 0x7f1f3815e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T19:58:00.724 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:00.707+0000 7f1f377fe700 1 --2- 172.21.15.157:0/1773431439 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1f380aef20 0x7f1f38148040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T19:58:00.724 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:00.707+0000 7f1f367fc700 1 --2- 172.21.15.157:0/1773431439 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1f3815ee60 0x7f1f380ae9e0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f1f28001eb0 tx=0x7f1f28004930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:58:00.724 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:00.708+0000 7f1f1f7fe700 1 -- 172.21.15.157:0/1773431439 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f280080d0 con 0x7f1f3815ee60 2023-10-16T19:58:00.724 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:00.708+0000 7f1f1f7fe700 1 -- 172.21.15.157:0/1773431439 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f28008230 con 0x7f1f3815ee60 2023-10-16T19:58:00.725 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:00.708+0000 7f1f3d429700 1 -- 172.21.15.157:0/1773431439 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f3815db60 con 0x7f1f3815ee60 2023-10-16T19:58:00.725 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:00.708+0000 7f1f1f7fe700 1 -- 172.21.15.157:0/1773431439 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f280085a0 con 0x7f1f3815ee60 2023-10-16T19:58:00.725 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:00.708+0000 7f1f3d429700 1 -- 172.21.15.157:0/1773431439 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f3815e120 con 0x7f1f3815ee60 2023-10-16T19:58:00.725 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:00.709+0000 7f1f3d429700 1 -- 172.21.15.157:0/1773431439 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f3815e640 con 0x7f1f3815ee60 2023-10-16T19:58:00.726 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:00.709+0000 7f1f1f7fe700 1 -- 172.21.15.157:0/1773431439 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f1f28015420 con 0x7f1f3815ee60 2023-10-16T19:58:00.726 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:00.709+0000 7f1f1f7fe700 1 --2- 172.21.15.157:0/1773431439 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f1f2406af00 0x7f1f2406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:00.726 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:00.709+0000 7f1f1f7fe700 1 -- 172.21.15.157:0/1773431439 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f1f2808c6b0 con 0x7f1f3815ee60 2023-10-16T19:58:00.726 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:00.710+0000 7f1f36ffd700 1 --2- 172.21.15.157:0/1773431439 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f1f2406af00 0x7f1f2406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:00.727 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:00.710+0000 7f1f36ffd700 1 --2- 172.21.15.157:0/1773431439 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f1f2406af00 0x7f1f2406d3c0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f1f2c009b50 tx=0x7f1f2c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:58:00.727 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:00.714+0000 7f1f1f7fe700 1 -- 172.21.15.157:0/1773431439 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1f3815e640 con 0x7f1f3815ee60 2023-10-16T19:58:00.982 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:00.980+0000 7f1f3d429700 1 -- 172.21.15.157:0/1773431439 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f1f3815e600 con 0x7f1f3815ee60 2023-10-16T19:58:00.984 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:00.982+0000 7f1f1f7fe700 1 -- 172.21.15.157:0/1773431439 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v13) v1 ==== 97+0+0 (secure 0 0 0) 0x7f1f28057b40 con 0x7f1f3815ee60 2023-10-16T19:58:00.986 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:00.984+0000 7f1f3d429700 1 -- 172.21.15.157:0/1773431439 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f1f2406af00 msgr2=0x7f1f2406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:00.987 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:00.984+0000 7f1f3d429700 1 --2- 172.21.15.157:0/1773431439 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f1f2406af00 0x7f1f2406d3c0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f1f2c009b50 tx=0x7f1f2c008040 comp rx=0 tx=0).stop 2023-10-16T19:58:00.987 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:00.984+0000 7f1f3d429700 1 -- 172.21.15.157:0/1773431439 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1f3815ee60 msgr2=0x7f1f380ae9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:00.987 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:00.984+0000 7f1f3d429700 1 --2- 172.21.15.157:0/1773431439 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1f3815ee60 0x7f1f380ae9e0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f1f28001eb0 tx=0x7f1f28004930 comp rx=0 tx=0).stop 2023-10-16T19:58:00.987 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:00.984+0000 7f1f3d429700 1 -- 172.21.15.157:0/1773431439 shutdown_connections 2023-10-16T19:58:00.988 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:00.984+0000 7f1f3d429700 1 --2- 172.21.15.157:0/1773431439 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f1f2406af00 0x7f1f2406d3c0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:00.988 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:00.984+0000 7f1f3d429700 1 --2- 172.21.15.157:0/1773431439 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1f380aef20 0x7f1f38148040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:00.988 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:00.984+0000 7f1f3d429700 1 --2- 172.21.15.157:0/1773431439 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1f20003f70 0x7f1f3815e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:00.988 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:00.984+0000 7f1f3d429700 1 --2- 172.21.15.157:0/1773431439 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1f3815ee60 0x7f1f380ae9e0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:00.988 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:00.984+0000 7f1f3d429700 1 -- 172.21.15.157:0/1773431439 >> 172.21.15.157:0/1773431439 conn(0x7f1f380cd4e0 msgr2=0x7f1f380b2de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:58:00.989 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:00.984+0000 7f1f3d429700 1 -- 172.21.15.157:0/1773431439 shutdown_connections 2023-10-16T19:58:00.989 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:00.984+0000 7f1f3d429700 1 -- 172.21.15.157:0/1773431439 wait complete. 2023-10-16T19:58:00.999 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-10-16T19:58:01.120 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.118+0000 7f40baa12700 1 Processor -- start 2023-10-16T19:58:01.120 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.118+0000 7f40baa12700 1 -- start start 2023-10-16T19:58:01.122 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.119+0000 7f40baa12700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f40b415dce0 0x7f40b406d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:01.123 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.119+0000 7f40baa12700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f40b40d1a90 0x7f40b40b3690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:01.123 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.119+0000 7f40baa12700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f40b415e0c0 0x7f40b40b3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:01.123 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.119+0000 7f40baa12700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40b40b13c0 con 0x7f40b415e0c0 2023-10-16T19:58:01.123 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.119+0000 7f40baa12700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40b40ce610 con 0x7f40b415dce0 2023-10-16T19:58:01.124 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.119+0000 7f40baa12700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40b40d1f50 con 0x7f40b40d1a90 2023-10-16T19:58:01.125 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.119+0000 7f40b8faf700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f40b415e0c0 0x7f40b40b3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:01.125 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.119+0000 7f40b8faf700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f40b415e0c0 0x7f40b40b3bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:47446/0 (socket says 172.21.15.157:47446) 2023-10-16T19:58:01.125 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.119+0000 7f40b8faf700 1 -- 172.21.15.157:0/819010077 learned_addr learned my addr 172.21.15.157:0/819010077 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:58:01.126 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.119+0000 7f40b37fe700 1 --2- 172.21.15.157:0/819010077 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f40b40d1a90 0x7f40b40b3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:01.126 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.119+0000 7f40b3fff700 1 --2- 172.21.15.157:0/819010077 >> v2:172.21.15.187:3300/0 conn(0x7f40b415dce0 0x7f40b406d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:01.126 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.119+0000 7f40b8faf700 1 -- 172.21.15.157:0/819010077 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f40b40d1a90 msgr2=0x7f40b40b3690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:58:01.126 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.119+0000 7f40b8faf700 1 --2- 172.21.15.157:0/819010077 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f40b40d1a90 0x7f40b40b3690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:01.127 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.119+0000 7f40b8faf700 1 -- 172.21.15.157:0/819010077 >> v2:172.21.15.187:3300/0 conn(0x7f40b415dce0 msgr2=0x7f40b406d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:58:01.127 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.119+0000 7f40b8faf700 1 --2- 172.21.15.157:0/819010077 >> v2:172.21.15.187:3300/0 conn(0x7f40b415dce0 0x7f40b406d2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:01.127 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.119+0000 7f40b8faf700 1 -- 172.21.15.157:0/819010077 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40b40d2230 con 0x7f40b415e0c0 2023-10-16T19:58:01.128 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.119+0000 7f40b8faf700 1 --2- 172.21.15.157:0/819010077 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f40b415e0c0 0x7f40b40b3bd0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f40b40cf750 tx=0x7f40ac00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a277435bfdf4406f server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:58:01.128 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.119+0000 7f40b2ffd700 1 -- 172.21.15.157:0/819010077 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40ac00e070 con 0x7f40b415e0c0 2023-10-16T19:58:01.128 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.119+0000 7f40b2ffd700 1 -- 172.21.15.157:0/819010077 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40ac00b910 con 0x7f40b415e0c0 2023-10-16T19:58:01.128 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.119+0000 7f40b2ffd700 1 -- 172.21.15.157:0/819010077 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40ac00bcc0 con 0x7f40b415e0c0 2023-10-16T19:58:01.128 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.120+0000 7f40baa12700 1 -- 172.21.15.157:0/819010077 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f40b415e0c0 msgr2=0x7f40b40b3bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:01.129 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.120+0000 7f40baa12700 1 --2- 172.21.15.157:0/819010077 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f40b415e0c0 0x7f40b40b3bd0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f40b40cf750 tx=0x7f40ac00b330 comp rx=0 tx=0).stop 2023-10-16T19:58:01.129 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.120+0000 7f40baa12700 1 -- 172.21.15.157:0/819010077 shutdown_connections 2023-10-16T19:58:01.129 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.120+0000 7f40baa12700 1 --2- 172.21.15.157:0/819010077 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f40b415e0c0 0x7f40b40b3bd0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:01.129 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.120+0000 7f40baa12700 1 --2- 172.21.15.157:0/819010077 >> v2:172.21.15.187:3300/0 conn(0x7f40b415dce0 0x7f40b406d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:01.129 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.120+0000 7f40baa12700 1 --2- 172.21.15.157:0/819010077 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f40b40d1a90 0x7f40b40b3690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:01.130 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.120+0000 7f40baa12700 1 -- 172.21.15.157:0/819010077 >> 172.21.15.157:0/819010077 conn(0x7f40b406e300 msgr2=0x7f40b406e6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:58:01.130 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.120+0000 7f40baa12700 1 -- 172.21.15.157:0/819010077 shutdown_connections 2023-10-16T19:58:01.130 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.120+0000 7f40baa12700 1 -- 172.21.15.157:0/819010077 wait complete. 2023-10-16T19:58:01.133 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.122+0000 7f40baa12700 1 Processor -- start 2023-10-16T19:58:01.133 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.122+0000 7f40baa12700 1 -- start start 2023-10-16T19:58:01.133 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.123+0000 7f40baa12700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f40b40d1a90 0x7f40b4154070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:01.133 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.123+0000 7f40baa12700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f40b415dce0 0x7f40b40b41c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:01.134 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.123+0000 7f40baa12700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f40b415e0c0 0x7f40b40b4700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:01.134 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.123+0000 7f40baa12700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40b41545b0 con 0x7f40b415dce0 2023-10-16T19:58:01.134 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.123+0000 7f40baa12700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40b40c5c50 con 0x7f40b415e0c0 2023-10-16T19:58:01.134 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.123+0000 7f40baa12700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40b40c5f30 con 0x7f40b40d1a90 2023-10-16T19:58:01.135 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.123+0000 7f40b37fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f40b415dce0 0x7f40b40b41c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:01.135 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.123+0000 7f40b37fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f40b415dce0 0x7f40b40b41c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:47450/0 (socket says 172.21.15.157:47450) 2023-10-16T19:58:01.135 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.123+0000 7f40b37fe700 1 -- 172.21.15.157:0/1291396449 learned_addr learned my addr 172.21.15.157:0/1291396449 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:58:01.135 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.123+0000 7f40b3fff700 1 --2- 172.21.15.157:0/1291396449 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f40b40d1a90 0x7f40b4154070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:01.135 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.123+0000 7f40b8faf700 1 --2- 172.21.15.157:0/1291396449 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f40b415e0c0 0x7f40b40b4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:01.135 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.123+0000 7f40b37fe700 1 -- 172.21.15.157:0/1291396449 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f40b40d1a90 msgr2=0x7f40b4154070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:01.136 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.123+0000 7f40b37fe700 1 --2- 172.21.15.157:0/1291396449 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f40b40d1a90 0x7f40b4154070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:01.136 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.123+0000 7f40b37fe700 1 -- 172.21.15.157:0/1291396449 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f40b415e0c0 msgr2=0x7f40b40b4700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:01.136 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.123+0000 7f40b37fe700 1 --2- 172.21.15.157:0/1291396449 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f40b415e0c0 0x7f40b40b4700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:01.136 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.123+0000 7f40b37fe700 1 -- 172.21.15.157:0/1291396449 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40ac009b30 con 0x7f40b415dce0 2023-10-16T19:58:01.136 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.123+0000 7f40b37fe700 1 --2- 172.21.15.157:0/1291396449 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f40b415dce0 0x7f40b40b41c0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f40a800e9b0 tx=0x7f40a800ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:58:01.137 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.123+0000 7f40b0ff9700 1 -- 172.21.15.157:0/1291396449 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40a8009710 con 0x7f40b415dce0 2023-10-16T19:58:01.137 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.123+0000 7f40b0ff9700 1 -- 172.21.15.157:0/1291396449 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40a800ee50 con 0x7f40b415dce0 2023-10-16T19:58:01.137 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.123+0000 7f40baa12700 1 -- 172.21.15.157:0/1291396449 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40b40c6210 con 0x7f40b415dce0 2023-10-16T19:58:01.137 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.123+0000 7f40b0ff9700 1 -- 172.21.15.157:0/1291396449 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40a800ca50 con 0x7f40b415dce0 2023-10-16T19:58:01.138 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.123+0000 7f40baa12700 1 -- 172.21.15.157:0/1291396449 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40b40c67d0 con 0x7f40b415dce0 2023-10-16T19:58:01.138 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.124+0000 7f40baa12700 1 -- 172.21.15.157:0/1291396449 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40b40c6990 con 0x7f40b415dce0 2023-10-16T19:58:01.138 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.125+0000 7f40b0ff9700 1 -- 172.21.15.157:0/1291396449 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f40a800cbb0 con 0x7f40b415dce0 2023-10-16T19:58:01.138 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.125+0000 7f40b0ff9700 1 --2- 172.21.15.157:0/1291396449 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f40a006af00 0x7f40a006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:01.139 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.125+0000 7f40b0ff9700 1 -- 172.21.15.157:0/1291396449 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f40a8089260 con 0x7f40b415dce0 2023-10-16T19:58:01.139 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.125+0000 7f40b3fff700 1 --2- 172.21.15.157:0/1291396449 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f40a006af00 0x7f40a006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:01.139 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.126+0000 7f40b3fff700 1 --2- 172.21.15.157:0/1291396449 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f40a006af00 0x7f40a006d3c0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f40b4073fa0 tx=0x7f40a4009210 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:58:01.139 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.129+0000 7f40b0ff9700 1 -- 172.21.15.157:0/1291396449 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f40a8054660 con 0x7f40b415dce0 2023-10-16T19:58:01.400 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.397+0000 7f40baa12700 1 -- 172.21.15.157:0/1291396449 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7f40b40c6b40 con 0x7f40b415dce0 2023-10-16T19:58:01.402 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.399+0000 7f40b0ff9700 1 -- 172.21.15.157:0/1291396449 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v14) v1 ==== 90+0+0 (secure 0 0 0) 0x7f40a800ce60 con 0x7f40b415dce0 2023-10-16T19:58:01.404 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.401+0000 7f40baa12700 1 -- 172.21.15.157:0/1291396449 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f40a006af00 msgr2=0x7f40a006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:01.404 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.401+0000 7f40baa12700 1 --2- 172.21.15.157:0/1291396449 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f40a006af00 0x7f40a006d3c0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f40b4073fa0 tx=0x7f40a4009210 comp rx=0 tx=0).stop 2023-10-16T19:58:01.404 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.401+0000 7f40baa12700 1 -- 172.21.15.157:0/1291396449 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f40b415dce0 msgr2=0x7f40b40b41c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:01.405 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.401+0000 7f40baa12700 1 --2- 172.21.15.157:0/1291396449 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f40b415dce0 0x7f40b40b41c0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f40a800e9b0 tx=0x7f40a800ecc0 comp rx=0 tx=0).stop 2023-10-16T19:58:01.405 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.401+0000 7f40baa12700 1 -- 172.21.15.157:0/1291396449 shutdown_connections 2023-10-16T19:58:01.405 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.401+0000 7f40baa12700 1 --2- 172.21.15.157:0/1291396449 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f40a006af00 0x7f40a006d3c0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:01.405 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.401+0000 7f40baa12700 1 --2- 172.21.15.157:0/1291396449 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f40b415e0c0 0x7f40b40b4700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:01.405 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.401+0000 7f40baa12700 1 --2- 172.21.15.157:0/1291396449 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f40b40d1a90 0x7f40b4154070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:01.406 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.401+0000 7f40baa12700 1 --2- 172.21.15.157:0/1291396449 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f40b415dce0 0x7f40b40b41c0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:01.406 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.401+0000 7f40baa12700 1 -- 172.21.15.157:0/1291396449 >> 172.21.15.157:0/1291396449 conn(0x7f40b406e300 msgr2=0x7f40b40cc500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:58:01.406 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.402+0000 7f40baa12700 1 -- 172.21.15.157:0/1291396449 shutdown_connections 2023-10-16T19:58:01.406 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.402+0000 7f40baa12700 1 -- 172.21.15.157:0/1291396449 wait complete. 2023-10-16T19:58:01.416 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T19:58:01.541 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.535+0000 7f6e80051700 1 Processor -- start 2023-10-16T19:58:01.541 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.536+0000 7f6e80051700 1 -- start start 2023-10-16T19:58:01.541 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.536+0000 7f6e80051700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6e7815e2f0 0x7f6e7806d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:01.542 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.536+0000 7f6e80051700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f6e7806af60 0x7f6e780ce910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:01.542 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.536+0000 7f6e80051700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e780d08b0 con 0x7f6e7806de00 2023-10-16T19:58:01.542 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.536+0000 7f6e80051700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e781628f0 con 0x7f6e7806af60 2023-10-16T19:58:01.542 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.536+0000 7f6e80051700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e78162bd0 con 0x7f6e7815e2f0 2023-10-16T19:58:01.543 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.537+0000 7f6e7dded700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6e7815e2f0 0x7f6e7806d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:01.543 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.537+0000 7f6e7e5ee700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f6e7806af60 0x7f6e780ce910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:01.543 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.537+0000 7f6e7e5ee700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f6e7806af60 0x7f6e780ce910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.157:42568/0 (socket says 172.21.15.157:42568) 2023-10-16T19:58:01.543 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.537+0000 7f6e7dded700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6e7815e2f0 0x7f6e7806d0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.157:56762/0 (socket says 172.21.15.157:56762) 2023-10-16T19:58:01.544 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.537+0000 7f6e7e5ee700 1 -- 172.21.15.157:0/2994283657 learned_addr learned my addr 172.21.15.157:0/2994283657 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:58:01.544 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.537+0000 7f6e7d5ec700 1 --1- 172.21.15.157:0/2994283657 >> v1:172.21.15.187:6789/0 conn(0x7f6e7806de00 0x7f6e7806a850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.157:40824/0 (socket says 172.21.15.157:40824) 2023-10-16T19:58:01.544 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.537+0000 7f6e7dded700 1 -- 172.21.15.157:0/2994283657 >> v2:172.21.15.187:3300/0 conn(0x7f6e7806af60 msgr2=0x7f6e780ce910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:58:01.544 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.537+0000 7f6e7dded700 1 --2- 172.21.15.157:0/2994283657 >> v2:172.21.15.187:3300/0 conn(0x7f6e7806af60 0x7f6e780ce910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:01.544 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.537+0000 7f6e7dded700 1 -- 172.21.15.157:0/2994283657 >> v1:172.21.15.187:6789/0 conn(0x7f6e7806de00 legacy=0x7f6e7806a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:01.545 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.537+0000 7f6e7dded700 1 -- 172.21.15.157:0/2994283657 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e780d05d0 con 0x7f6e7815e2f0 2023-10-16T19:58:01.545 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.537+0000 7f6e7e5ee700 1 --2- 172.21.15.157:0/2994283657 >> v2:172.21.15.187:3300/0 conn(0x7f6e7806af60 0x7f6e780ce910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T19:58:01.545 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.537+0000 7f6e7dded700 1 --2- 172.21.15.157:0/2994283657 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6e7815e2f0 0x7f6e7806d0f0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f6e68009840 tx=0x7f6e68009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3db66c78303dc6ef server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:58:01.545 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.537+0000 7f6e7cdeb700 1 -- 172.21.15.157:0/2994283657 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e68011830 con 0x7f6e7815e2f0 2023-10-16T19:58:01.545 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.538+0000 7f6e7cdeb700 1 -- 172.21.15.157:0/2994283657 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e68011990 con 0x7f6e7815e2f0 2023-10-16T19:58:01.546 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.538+0000 7f6e7cdeb700 1 -- 172.21.15.157:0/2994283657 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e68011d20 con 0x7f6e7815e2f0 2023-10-16T19:58:01.546 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.538+0000 7f6e80051700 1 -- 172.21.15.157:0/2994283657 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6e7815e2f0 msgr2=0x7f6e7806d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:01.546 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.538+0000 7f6e80051700 1 --2- 172.21.15.157:0/2994283657 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6e7815e2f0 0x7f6e7806d0f0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f6e68009840 tx=0x7f6e68009b50 comp rx=0 tx=0).stop 2023-10-16T19:58:01.547 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.538+0000 7f6e80051700 1 -- 172.21.15.157:0/2994283657 shutdown_connections 2023-10-16T19:58:01.547 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.538+0000 7f6e80051700 1 --2- 172.21.15.157:0/2994283657 >> v2:172.21.15.187:3300/0 conn(0x7f6e7806af60 0x7f6e780ce910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:01.548 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.538+0000 7f6e80051700 1 --2- 172.21.15.157:0/2994283657 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6e7815e2f0 0x7f6e7806d0f0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:01.548 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.538+0000 7f6e80051700 1 -- 172.21.15.157:0/2994283657 >> 172.21.15.157:0/2994283657 conn(0x7f6e780cd4e0 msgr2=0x7f6e780cd8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:58:01.548 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.538+0000 7f6e80051700 1 -- 172.21.15.157:0/2994283657 shutdown_connections 2023-10-16T19:58:01.548 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.538+0000 7f6e80051700 1 -- 172.21.15.157:0/2994283657 wait complete. 2023-10-16T19:58:01.551 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.539+0000 7f6e80051700 1 Processor -- start 2023-10-16T19:58:01.551 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.539+0000 7f6e80051700 1 -- start start 2023-10-16T19:58:01.552 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.540+0000 7f6e80051700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6e7806af60 0x7f6e78159110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:01.552 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.540+0000 7f6e80051700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6e7806de00 0x7f6e780b55e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:01.552 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.540+0000 7f6e80051700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6e7815e2f0 0x7f6e780b5b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:01.552 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.540+0000 7f6e80051700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e78159650 con 0x7f6e7815e2f0 2023-10-16T19:58:01.552 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.540+0000 7f6e80051700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e78159e00 con 0x7f6e7806af60 2023-10-16T19:58:01.553 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.540+0000 7f6e80051700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e7815a0a0 con 0x7f6e7806de00 2023-10-16T19:58:01.553 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.540+0000 7f6e7e5ee700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6e7815e2f0 0x7f6e780b5b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:01.553 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.540+0000 7f6e7e5ee700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6e7815e2f0 0x7f6e780b5b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:47466/0 (socket says 172.21.15.157:47466) 2023-10-16T19:58:01.553 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.540+0000 7f6e7e5ee700 1 -- 172.21.15.157:0/121821448 learned_addr learned my addr 172.21.15.157:0/121821448 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:58:01.554 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.541+0000 7f6e7dded700 1 --2- 172.21.15.157:0/121821448 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6e7806af60 0x7f6e78159110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:01.554 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.541+0000 7f6e7d5ec700 1 --2- 172.21.15.157:0/121821448 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6e7806de00 0x7f6e780b55e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:01.554 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.541+0000 7f6e7e5ee700 1 -- 172.21.15.157:0/121821448 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6e7806de00 msgr2=0x7f6e780b55e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:01.554 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.541+0000 7f6e7e5ee700 1 --2- 172.21.15.157:0/121821448 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6e7806de00 0x7f6e780b55e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:01.554 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.541+0000 7f6e7e5ee700 1 -- 172.21.15.157:0/121821448 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6e7806af60 msgr2=0x7f6e78159110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:01.555 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.541+0000 7f6e7e5ee700 1 --2- 172.21.15.157:0/121821448 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6e7806af60 0x7f6e78159110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:01.555 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.541+0000 7f6e7e5ee700 1 -- 172.21.15.157:0/121821448 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e70009b30 con 0x7f6e7815e2f0 2023-10-16T19:58:01.555 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.541+0000 7f6e7e5ee700 1 --2- 172.21.15.157:0/121821448 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6e7815e2f0 0x7f6e780b5b20 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f6e7000efc0 tx=0x7f6e7000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:58:01.555 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.541+0000 7f6e6e7fc700 1 -- 172.21.15.157:0/121821448 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e70018070 con 0x7f6e7815e2f0 2023-10-16T19:58:01.555 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.541+0000 7f6e6e7fc700 1 -- 172.21.15.157:0/121821448 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e7000f040 con 0x7f6e7815e2f0 2023-10-16T19:58:01.556 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.541+0000 7f6e80051700 1 -- 172.21.15.157:0/121821448 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e680094a0 con 0x7f6e7815e2f0 2023-10-16T19:58:01.556 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.541+0000 7f6e6e7fc700 1 -- 172.21.15.157:0/121821448 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e70003c90 con 0x7f6e7815e2f0 2023-10-16T19:58:01.556 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.541+0000 7f6e80051700 1 -- 172.21.15.157:0/121821448 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e7815a660 con 0x7f6e7815e2f0 2023-10-16T19:58:01.556 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.542+0000 7f6e80051700 1 -- 172.21.15.157:0/121821448 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e7804f400 con 0x7f6e7815e2f0 2023-10-16T19:58:01.556 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.543+0000 7f6e6e7fc700 1 -- 172.21.15.157:0/121821448 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f6e7000c9f0 con 0x7f6e7815e2f0 2023-10-16T19:58:01.557 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.543+0000 7f6e6e7fc700 1 --2- 172.21.15.157:0/121821448 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f6e5c06af00 0x7f6e5c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:01.557 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.543+0000 7f6e6e7fc700 1 -- 172.21.15.157:0/121821448 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f6e70089460 con 0x7f6e7815e2f0 2023-10-16T19:58:01.557 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.543+0000 7f6e7dded700 1 --2- 172.21.15.157:0/121821448 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f6e5c06af00 0x7f6e5c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:01.558 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.544+0000 7f6e7dded700 1 --2- 172.21.15.157:0/121821448 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f6e5c06af00 0x7f6e5c06d3c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f6e68000c00 tx=0x7f6e68008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:58:01.558 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.547+0000 7f6e6e7fc700 1 -- 172.21.15.157:0/121821448 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6e700547e0 con 0x7f6e7815e2f0 2023-10-16T19:58:01.738 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.735+0000 7f6e80051700 1 -- 172.21.15.157:0/121821448 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6e7806b650 con 0x7f6e7815e2f0 2023-10-16T19:58:01.739 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.736+0000 7f6e6e7fc700 1 -- 172.21.15.157:0/121821448 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+12869 (secure 0 0 0) 0x7f6e70057e00 con 0x7f6e7815e2f0 2023-10-16T19:58:01.740 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-10-16T19:58:01.740 INFO:teuthology.orchestra.run.smithi157.stdout:{"epoch":29,"fsid":"28199dc9-64d5-479e-83c6-21f097c33d39","created":"2023-10-16T19:56:49.201889+0000","modified":"2023-10-16T19:57:58.457327+0000","last_up_change":"2023-10-16T19:56:54.675673+0000","last_in_change":"2023-10-16T19:56:51.666728+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T19:56:56.932895+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":335785898},{"type":"v1","addr":"172.21.15.157:6809","nonce":335785898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":335785898},{"type":"v1","addr":"172.21.15.157:6811","nonce":335785898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6815","nonce":335785898},{"type":"v1","addr":"172.21.15.157:6817","nonce":335785898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":335785898},{"type":"v1","addr":"172.21.15.157:6813","nonce":335785898}]},"public_addr":"172.21.15.157:6809/335785898","cluster_addr":"172.21.15.157:6811/335785898","heartbeat_back_addr":"172.21.15.157:6817/335785898","heartbeat_front_addr":"172.21.15.157:6813/335785898","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":3482825047},{"type":"v1","addr":"172.21.15.157:6801","nonce":3482825047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":3482825047},{"type":"v1","addr":"172.21.15.157:6803","nonce":3482825047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":3482825047},{"type":"v1","addr":"172.21.15.157:6807","nonce":3482825047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":3482825047},{"type":"v1","addr":"172.21.15.157:6805","nonce":3482825047}]},"public_addr":"172.21.15.157:6801/3482825047","cluster_addr":"172.21.15.157:6803/3482825047","heartbeat_back_addr":"172.21.15.157:6807/3482825047","heartbeat_front_addr":"172.21.15.157:6805/3482825047","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":1118292389},{"type":"v1","addr":"172.21.15.157:6825","nonce":1118292389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":1118292389},{"type":"v1","addr":"172.21.15.157:6827","nonce":1118292389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":1118292389},{"type":"v1","addr":"172.21.15.157:6831","nonce":1118292389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":1118292389},{"type":"v1","addr":"172.21.15.157:6829","nonce":1118292389}]},"public_addr":"172.21.15.157:6825/1118292389","cluster_addr":"172.21.15.157:6827/1118292389","heartbeat_back_addr":"172.21.15.157:6831/1118292389","heartbeat_front_addr":"172.21.15.157:6829/1118292389","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":989329821},{"type":"v1","addr":"172.21.15.157:6816","nonce":989329821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":989329821},{"type":"v1","addr":"172.21.15.157:6819","nonce":989329821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":989329821},{"type":"v1","addr":"172.21.15.157:6823","nonce":989329821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":989329821},{"type":"v1","addr":"172.21.15.157:6821","nonce":989329821}]},"public_addr":"172.21.15.157:6816/989329821","cluster_addr":"172.21.15.157:6819/989329821","heartbeat_back_addr":"172.21.15.157:6823/989329821","heartbeat_front_addr":"172.21.15.157:6821/989329821","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":3841016811},{"type":"v1","addr":"172.21.15.187:6801","nonce":3841016811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6803","nonce":3841016811},{"type":"v1","addr":"172.21.15.187:6804","nonce":3841016811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6809","nonce":3841016811},{"type":"v1","addr":"172.21.15.187:6811","nonce":3841016811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":3841016811},{"type":"v1","addr":"172.21.15.187:6808","nonce":3841016811}]},"public_addr":"172.21.15.187:6801/3841016811","cluster_addr":"172.21.15.187:6804/3841016811","heartbeat_back_addr":"172.21.15.187:6811/3841016811","heartbeat_front_addr":"172.21.15.187:6808/3841016811","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":915130263},{"type":"v1","addr":"172.21.15.187:6805","nonce":915130263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6807","nonce":915130263},{"type":"v1","addr":"172.21.15.187:6810","nonce":915130263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":915130263},{"type":"v1","addr":"172.21.15.187:6815","nonce":915130263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":915130263},{"type":"v1","addr":"172.21.15.187:6813","nonce":915130263}]},"public_addr":"172.21.15.187:6805/915130263","cluster_addr":"172.21.15.187:6810/915130263","heartbeat_back_addr":"172.21.15.187:6815/915130263","heartbeat_front_addr":"172.21.15.187:6813/915130263","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":654976824},{"type":"v1","addr":"172.21.15.187:6817","nonce":654976824}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":654976824},{"type":"v1","addr":"172.21.15.187:6819","nonce":654976824}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":654976824},{"type":"v1","addr":"172.21.15.187:6823","nonce":654976824}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":654976824},{"type":"v1","addr":"172.21.15.187:6821","nonce":654976824}]},"public_addr":"172.21.15.187:6817/654976824","cluster_addr":"172.21.15.187:6819/654976824","heartbeat_back_addr":"172.21.15.187:6823/654976824","heartbeat_front_addr":"172.21.15.187:6821/654976824","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":4284059445},{"type":"v1","addr":"172.21.15.187:6825","nonce":4284059445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":4284059445},{"type":"v1","addr":"172.21.15.187:6827","nonce":4284059445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":4284059445},{"type":"v1","addr":"172.21.15.187:6831","nonce":4284059445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":4284059445},{"type":"v1","addr":"172.21.15.187:6829","nonce":4284059445}]},"public_addr":"172.21.15.187:6825/4284059445","cluster_addr":"172.21.15.187:6827/4284059445","heartbeat_back_addr":"172.21.15.187:6831/4284059445","heartbeat_front_addr":"172.21.15.187:6829/4284059445","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.819780+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.824193+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.849575+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.824806+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.809540+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.805093+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.866109+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.807372+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T19:58:01.741 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.738+0000 7f6e80051700 1 -- 172.21.15.157:0/121821448 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f6e5c06af00 msgr2=0x7f6e5c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:01.741 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.738+0000 7f6e80051700 1 --2- 172.21.15.157:0/121821448 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f6e5c06af00 0x7f6e5c06d3c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f6e68000c00 tx=0x7f6e68008030 comp rx=0 tx=0).stop 2023-10-16T19:58:01.741 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.738+0000 7f6e80051700 1 -- 172.21.15.157:0/121821448 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6e7815e2f0 msgr2=0x7f6e780b5b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:01.742 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.738+0000 7f6e80051700 1 --2- 172.21.15.157:0/121821448 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6e7815e2f0 0x7f6e780b5b20 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f6e7000efc0 tx=0x7f6e7000c3a0 comp rx=0 tx=0).stop 2023-10-16T19:58:01.742 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.738+0000 7f6e80051700 1 -- 172.21.15.157:0/121821448 shutdown_connections 2023-10-16T19:58:01.742 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.738+0000 7f6e80051700 1 --2- 172.21.15.157:0/121821448 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f6e5c06af00 0x7f6e5c06d3c0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:01.742 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.738+0000 7f6e80051700 1 --2- 172.21.15.157:0/121821448 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6e7806af60 0x7f6e78159110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:01.742 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.738+0000 7f6e80051700 1 --2- 172.21.15.157:0/121821448 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6e7815e2f0 0x7f6e780b5b20 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:01.743 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.738+0000 7f6e80051700 1 --2- 172.21.15.157:0/121821448 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6e7806de00 0x7f6e780b55e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:01.743 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.738+0000 7f6e80051700 1 -- 172.21.15.157:0/121821448 >> 172.21.15.157:0/121821448 conn(0x7f6e780cd4e0 msgr2=0x7f6e780b08a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:58:01.743 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.738+0000 7f6e80051700 1 -- 172.21.15.157:0/121821448 shutdown_connections 2023-10-16T19:58:01.743 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.738+0000 7f6e80051700 1 -- 172.21.15.157:0/121821448 wait complete. 2023-10-16T19:58:01.753 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-16T19:56:56.932895+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-16T19:58:01.753 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-16T19:58:01.877 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.874+0000 7f61e7409700 1 Processor -- start 2023-10-16T19:58:01.877 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.875+0000 7f61e7409700 1 -- start start 2023-10-16T19:58:01.879 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.875+0000 7f61e7409700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f61e015e090 0x7f61e006b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:01.880 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.875+0000 7f61e7409700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f61e006ea10 0x7f61e00afa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:01.880 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.875+0000 7f61e7409700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61e006b6a0 con 0x7f61e00affc0 2023-10-16T19:58:01.880 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.875+0000 7f61e7409700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61e0071b50 con 0x7f61e006ea10 2023-10-16T19:58:01.880 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.875+0000 7f61e7409700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61e00b0430 con 0x7f61e015e090 2023-10-16T19:58:01.880 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.876+0000 7f61e51a5700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f61e015e090 0x7f61e006b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:01.881 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.876+0000 7f61e49a4700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f61e006ea10 0x7f61e00afa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:01.881 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.876+0000 7f61e59a6700 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7f61e00affc0 0x7f61e015e470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.157:40840/0 (socket says 172.21.15.157:40840) 2023-10-16T19:58:01.881 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.876+0000 7f61e59a6700 1 -- 172.21.15.157:0/3525708654 learned_addr learned my addr 172.21.15.157:0/3525708654 (peer_addr_for_me v1:172.21.15.157:0/0) 2023-10-16T19:58:01.881 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.876+0000 7f61e51a5700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f61e015e090 0x7f61e006b160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.157:56776/0 (socket says 172.21.15.157:56776) 2023-10-16T19:58:01.881 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.876+0000 7f61e49a4700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f61e006ea10 0x7f61e00afa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.157:42578/0 (socket says 172.21.15.157:42578) 2023-10-16T19:58:01.882 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.876+0000 7f61e51a5700 1 -- 172.21.15.157:0/3525708654 >> v2:172.21.15.187:3300/0 conn(0x7f61e006ea10 msgr2=0x7f61e00afa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:58:01.882 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.876+0000 7f61e51a5700 1 --2- 172.21.15.157:0/3525708654 >> v2:172.21.15.187:3300/0 conn(0x7f61e006ea10 0x7f61e00afa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:01.882 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.876+0000 7f61e51a5700 1 -- 172.21.15.157:0/3525708654 >> v1:172.21.15.187:6789/0 conn(0x7f61e00affc0 legacy=0x7f61e015e470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:01.882 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.876+0000 7f61e51a5700 1 -- 172.21.15.157:0/3525708654 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61e0072320 con 0x7f61e015e090 2023-10-16T19:58:01.882 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.876+0000 7f61e51a5700 1 --2- 172.21.15.157:0/3525708654 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f61e015e090 0x7f61e006b160 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f61d4009840 tx=0x7f61d4009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=da636078fb1b3e7a server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:58:01.883 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.876+0000 7f61d3fff700 1 -- 172.21.15.157:0/3525708654 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61d4011830 con 0x7f61e015e090 2023-10-16T19:58:01.883 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.876+0000 7f61d3fff700 1 -- 172.21.15.157:0/3525708654 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61d4011990 con 0x7f61e015e090 2023-10-16T19:58:01.883 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.876+0000 7f61d3fff700 1 -- 172.21.15.157:0/3525708654 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61d4011d20 con 0x7f61e015e090 2023-10-16T19:58:01.883 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.877+0000 7f61e7409700 1 -- 172.21.15.157:0/3525708654 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f61e015e090 msgr2=0x7f61e006b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:01.883 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.877+0000 7f61e7409700 1 --2- 172.21.15.157:0/3525708654 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f61e015e090 0x7f61e006b160 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f61d4009840 tx=0x7f61d4009b50 comp rx=0 tx=0).stop 2023-10-16T19:58:01.883 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.877+0000 7f61e7409700 1 -- 172.21.15.157:0/3525708654 shutdown_connections 2023-10-16T19:58:01.884 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.877+0000 7f61e7409700 1 --2- 172.21.15.157:0/3525708654 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f61e015e090 0x7f61e006b160 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:01.884 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.877+0000 7f61e7409700 1 --2- 172.21.15.157:0/3525708654 >> v2:172.21.15.187:3300/0 conn(0x7f61e006ea10 0x7f61e00afa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:01.884 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.877+0000 7f61e7409700 1 -- 172.21.15.157:0/3525708654 >> 172.21.15.157:0/3525708654 conn(0x7f61e00d0b30 msgr2=0x7f61e00d0f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:58:01.884 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.877+0000 7f61e7409700 1 -- 172.21.15.157:0/3525708654 shutdown_connections 2023-10-16T19:58:01.884 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.877+0000 7f61e7409700 1 -- 172.21.15.157:0/3525708654 wait complete. 2023-10-16T19:58:01.887 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.878+0000 7f61e7409700 1 Processor -- start 2023-10-16T19:58:01.887 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.878+0000 7f61e7409700 1 -- start start 2023-10-16T19:58:01.887 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.879+0000 7f61e7409700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f61e006ea10 0x7f61e0159570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:01.887 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.879+0000 7f61e7409700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f61e00affc0 0x7f61e00b3e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:01.888 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.879+0000 7f61e7409700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f61e015e090 0x7f61e00b0e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:01.888 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.879+0000 7f61e7409700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61e0159ab0 con 0x7f61e006ea10 2023-10-16T19:58:01.888 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.879+0000 7f61e7409700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61e00b6830 con 0x7f61e00affc0 2023-10-16T19:58:01.888 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.879+0000 7f61e7409700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61e00b47d0 con 0x7f61e015e090 2023-10-16T19:58:01.888 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.879+0000 7f61e51a5700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f61e006ea10 0x7f61e0159570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:01.889 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.879+0000 7f61e51a5700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f61e006ea10 0x7f61e0159570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:47474/0 (socket says 172.21.15.157:47474) 2023-10-16T19:58:01.889 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.879+0000 7f61e51a5700 1 -- 172.21.15.157:0/2587011197 learned_addr learned my addr 172.21.15.157:0/2587011197 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:58:01.889 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.879+0000 7f61e59a6700 1 --2- 172.21.15.157:0/2587011197 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f61e015e090 0x7f61e00b0e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:01.889 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.879+0000 7f61e49a4700 1 --2- 172.21.15.157:0/2587011197 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f61e00affc0 0x7f61e00b3e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:01.889 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.879+0000 7f61e51a5700 1 -- 172.21.15.157:0/2587011197 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f61e015e090 msgr2=0x7f61e00b0e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:01.890 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.879+0000 7f61e51a5700 1 --2- 172.21.15.157:0/2587011197 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f61e015e090 0x7f61e00b0e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:01.890 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.879+0000 7f61e51a5700 1 -- 172.21.15.157:0/2587011197 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f61e00affc0 msgr2=0x7f61e00b3e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:01.890 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.879+0000 7f61e51a5700 1 --2- 172.21.15.157:0/2587011197 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f61e00affc0 0x7f61e00b3e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:01.890 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.879+0000 7f61e51a5700 1 -- 172.21.15.157:0/2587011197 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61d40094a0 con 0x7f61e006ea10 2023-10-16T19:58:01.890 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.879+0000 7f61e49a4700 1 --2- 172.21.15.157:0/2587011197 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f61e00affc0 0x7f61e00b3e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T19:58:01.891 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.880+0000 7f61e51a5700 1 --2- 172.21.15.157:0/2587011197 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f61e006ea10 0x7f61e0159570 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f61d4014040 tx=0x7f61d4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:58:01.891 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.880+0000 7f61d1ffb700 1 -- 172.21.15.157:0/2587011197 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61d40036a0 con 0x7f61e006ea10 2023-10-16T19:58:01.891 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.880+0000 7f61d1ffb700 1 -- 172.21.15.157:0/2587011197 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61d401f070 con 0x7f61e006ea10 2023-10-16T19:58:01.891 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.880+0000 7f61e7409700 1 -- 172.21.15.157:0/2587011197 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61e00b61e0 con 0x7f61e006ea10 2023-10-16T19:58:01.891 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.880+0000 7f61d1ffb700 1 -- 172.21.15.157:0/2587011197 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61d4003a00 con 0x7f61e006ea10 2023-10-16T19:58:01.892 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.880+0000 7f61e7409700 1 -- 172.21.15.157:0/2587011197 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61e00b5e00 con 0x7f61e006ea10 2023-10-16T19:58:01.892 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.881+0000 7f61e7409700 1 -- 172.21.15.157:0/2587011197 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61e00b6050 con 0x7f61e006ea10 2023-10-16T19:58:01.892 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.881+0000 7f61d1ffb700 1 -- 172.21.15.157:0/2587011197 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f61d4003b60 con 0x7f61e006ea10 2023-10-16T19:58:01.892 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.882+0000 7f61d1ffb700 1 --2- 172.21.15.157:0/2587011197 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f61c406af00 0x7f61c406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:01.892 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.882+0000 7f61d1ffb700 1 -- 172.21.15.157:0/2587011197 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f61d4021070 con 0x7f61e006ea10 2023-10-16T19:58:01.892 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.882+0000 7f61e49a4700 1 --2- 172.21.15.157:0/2587011197 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f61c406af00 0x7f61c406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:01.893 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.882+0000 7f61e49a4700 1 --2- 172.21.15.157:0/2587011197 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f61c406af00 0x7f61c406d3c0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f61e015d3e0 tx=0x7f61dc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:58:01.893 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:01.886+0000 7f61d1ffb700 1 -- 172.21.15.157:0/2587011197 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f61d4056000 con 0x7f61e006ea10 2023-10-16T19:58:02.076 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:02.073+0000 7f61e7409700 1 -- 172.21.15.157:0/2587011197 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f61e00b69a0 con 0x7f61e006ea10 2023-10-16T19:58:02.076 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:02.074+0000 7f61d1ffb700 1 -- 172.21.15.157:0/2587011197 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7f61d4059620 con 0x7f61e006ea10 2023-10-16T19:58:02.077 INFO:teuthology.orchestra.run.smithi157.stdout:pg_num: 1 2023-10-16T19:58:02.078 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:02.076+0000 7f61e7409700 1 -- 172.21.15.157:0/2587011197 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f61c406af00 msgr2=0x7f61c406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:02.079 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:02.076+0000 7f61e7409700 1 --2- 172.21.15.157:0/2587011197 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f61c406af00 0x7f61c406d3c0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f61e015d3e0 tx=0x7f61dc008040 comp rx=0 tx=0).stop 2023-10-16T19:58:02.079 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:02.076+0000 7f61e7409700 1 -- 172.21.15.157:0/2587011197 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f61e006ea10 msgr2=0x7f61e0159570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:02.079 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:02.076+0000 7f61e7409700 1 --2- 172.21.15.157:0/2587011197 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f61e006ea10 0x7f61e0159570 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f61d4014040 tx=0x7f61d4004750 comp rx=0 tx=0).stop 2023-10-16T19:58:02.079 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:02.076+0000 7f61e7409700 1 -- 172.21.15.157:0/2587011197 shutdown_connections 2023-10-16T19:58:02.080 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:02.076+0000 7f61e7409700 1 --2- 172.21.15.157:0/2587011197 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f61e015e090 0x7f61e00b0e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:02.080 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:02.076+0000 7f61e7409700 1 --2- 172.21.15.157:0/2587011197 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f61e006ea10 0x7f61e0159570 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:02.080 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:02.076+0000 7f61e7409700 1 --2- 172.21.15.157:0/2587011197 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f61c406af00 0x7f61c406d3c0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:02.080 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:02.076+0000 7f61e7409700 1 --2- 172.21.15.157:0/2587011197 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f61e00affc0 0x7f61e00b3e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:02.080 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:02.076+0000 7f61e7409700 1 -- 172.21.15.157:0/2587011197 >> 172.21.15.157:0/2587011197 conn(0x7f61e00d0b30 msgr2=0x7f61e006da10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:58:02.081 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:02.076+0000 7f61e7409700 1 -- 172.21.15.157:0/2587011197 shutdown_connections 2023-10-16T19:58:02.081 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:02.076+0000 7f61e7409700 1 -- 172.21.15.157:0/2587011197 wait complete. 2023-10-16T19:58:02.090 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-16T19:58:02.212 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:02.210+0000 7f720ed54700 1 Processor -- start 2023-10-16T19:58:02.213 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:02.210+0000 7f720ed54700 1 -- start start 2023-10-16T19:58:02.216 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:02.211+0000 7f720ed54700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f720815bf50 0x7f72080cef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:02.216 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:02.211+0000 7f720ed54700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f72080cdf80 0x7f72080d0e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:02.216 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:02.211+0000 7f720ed54700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72080cf920 con 0x7f72080b76e0 2023-10-16T19:58:02.217 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:02.211+0000 7f720ed54700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72080cc4b0 con 0x7f72080cdf80 2023-10-16T19:58:02.217 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:02.211+0000 7f720ed54700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72080cfc00 con 0x7f720815bf50 2023-10-16T19:58:02.217 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:02.211+0000 7f7207fff700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f72080b76e0 0x7f72080cd870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:57156/0 (socket says 172.21.15.157:57156) 2023-10-16T19:58:02.217 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:02.211+0000 7f7207fff700 1 -- 172.21.15.157:0/75902810 learned_addr learned my addr 172.21.15.157:0/75902810 (peer_addr_for_me v1:172.21.15.157:0/0) 2023-10-16T19:58:02.217 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:02.211+0000 7f720d2f1700 1 --2- 172.21.15.157:0/75902810 >> v2:172.21.15.187:3300/0 conn(0x7f72080cdf80 0x7f72080d0e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:02.218 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:02.211+0000 7f72077fe700 1 -- 172.21.15.157:0/75902810 <== mon.0 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 452200653 0 0) 0x7f72080cf920 con 0x7f72080b76e0 2023-10-16T19:58:02.218 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:02.211+0000 7f720caf0700 1 --2- 172.21.15.157:0/75902810 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f720815bf50 0x7f72080cef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:02.218 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:02.211+0000 7f72077fe700 1 -- 172.21.15.157:0/75902810 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f71f80035b0 con 0x7f72080b76e0 2023-10-16T19:58:02.218 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:02.211+0000 7f72077fe700 1 -- 172.21.15.157:0/75902810 <== mon.0 v1:172.21.15.157:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1739881908 0 0) 0x7f71f80035b0 con 0x7f72080b76e0 2023-10-16T19:58:02.218 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:02.211+0000 7f72077fe700 1 -- 172.21.15.157:0/75902810 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f720815bf50 msgr2=0x7f72080cef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:58:02.219 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:02.211+0000 7f72077fe700 1 --2- 172.21.15.157:0/75902810 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f720815bf50 0x7f72080cef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:02.219 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:02.211+0000 7f72077fe700 1 -- 172.21.15.157:0/75902810 >> v2:172.21.15.187:3300/0 conn(0x7f72080cdf80 msgr2=0x7f72080d0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:58:02.219 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:02.211+0000 7f72077fe700 1 --2- 172.21.15.157:0/75902810 >> v2:172.21.15.187:3300/0 conn(0x7f72080cdf80 0x7f72080d0e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:02.219 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:02.211+0000 7f72077fe700 1 -- 172.21.15.157:0/75902810 --> v1:172.21.15.157:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72080cfee0 con 0x7f72080b76e0 2023-10-16T19:58:02.219 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:02.211+0000 7f72077fe700 1 -- 172.21.15.157:0/75902810 <== mon.0 v1:172.21.15.157:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4021145519 0 0) 0x7f71f4001670 con 0x7f72080b76e0 2023-10-16T19:58:02.220 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:02.211+0000 7f72077fe700 1 -- 172.21.15.157:0/75902810 >> v1:172.21.15.157:6789/0 conn(0x7f72080b76e0 legacy=0x7f72080cd870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:02.220 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:02.212+0000 7f72077fe700 1 --2- 172.21.15.157:0/75902810 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f720815bf50 0x7f71f8003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:02.220 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:02.212+0000 7f72077fe700 1 --2- 172.21.15.157:0/75902810 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f71f8003f80 0x7f71f8004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:02.220 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:02.212+0000 7f72077fe700 1 --2- 172.21.15.157:0/75902810 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f71f8004d90 0x7f71f8005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:02.221 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:02.212+0000 7f72077fe700 1 -- 172.21.15.157:0/75902810 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72080cc4b0 con 0x7f71f8004d90 2023-10-16T19:58:02.221 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:02.212+0000 7f72077fe700 1 -- 172.21.15.157:0/75902810 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72080cfc00 con 0x7f71f8003f80 2023-10-16T19:58:02.221 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:02.212+0000 7f72077fe700 1 -- 172.21.15.157:0/75902810 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71f800ba10 con 0x7f720815bf50 2023-10-16T19:58:02.221 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:02.212+0000 7f720d2f1700 1 --2- 172.21.15.157:0/75902810 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f71f8004d90 0x7f71f8005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:02.221 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:02.212+0000 7f720caf0700 1 --2- 172.21.15.157:0/75902810 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f720815bf50 0x7f71f8003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:02.221 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:02.212+0000 7f7207fff700 1 --2- 172.21.15.157:0/75902810 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f71f8003f80 0x7f71f8004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:02.222 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:02.212+0000 7f720d2f1700 1 -- 172.21.15.157:0/75902810 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f720815bf50 msgr2=0x7f71f8003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:58:02.222 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:02.212+0000 7f720d2f1700 1 --2- 172.21.15.157:0/75902810 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f720815bf50 0x7f71f8003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:02.222 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:02.212+0000 7f720d2f1700 1 -- 172.21.15.157:0/75902810 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f71f8003f80 msgr2=0x7f71f8004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:58:02.222 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:02.212+0000 7f720d2f1700 1 --2- 172.21.15.157:0/75902810 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f71f8003f80 0x7f71f8004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:02.222 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:02.212+0000 7f720d2f1700 1 -- 172.21.15.157:0/75902810 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71f80035b0 con 0x7f71f8004d90 2023-10-16T19:58:02.223 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:02.212+0000 7f720d2f1700 1 --2- 172.21.15.157:0/75902810 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f71f8004d90 0x7f71f8005210 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f7200009fc0 tx=0x7f71f8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc5c57e433af2a8c server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:58:02.223 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:02.212+0000 7f72077fe700 1 -- 172.21.15.157:0/75902810 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f720000ebd0 con 0x7f71f8004d90 2023-10-16T19:58:02.223 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:02.212+0000 7f72077fe700 1 -- 172.21.15.157:0/75902810 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f720000f040 con 0x7f71f8004d90 2023-10-16T19:58:02.223 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:02.212+0000 7f72077fe700 1 -- 172.21.15.157:0/75902810 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7200014480 con 0x7f71f8004d90 2023-10-16T19:58:02.223 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:02.213+0000 7f720ed54700 1 -- 172.21.15.157:0/75902810 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f71f8004d90 msgr2=0x7f71f8005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:02.224 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:02.213+0000 7f720ed54700 1 --2- 172.21.15.157:0/75902810 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f71f8004d90 0x7f71f8005210 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f7200009fc0 tx=0x7f71f8005880 comp rx=0 tx=0).stop 2023-10-16T19:58:02.224 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:02.213+0000 7f720d2f1700 1 -- 172.21.15.157:0/75902810 reap_dead start 2023-10-16T19:58:02.224 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:02.213+0000 7f720ed54700 1 -- 172.21.15.157:0/75902810 shutdown_connections 2023-10-16T19:58:02.224 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:02.213+0000 7f720ed54700 1 -- 172.21.15.157:0/75902810 >> 172.21.15.157:0/75902810 conn(0x7f720806e300 msgr2=0x7f720806e6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:58:02.224 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:02.213+0000 7f720ed54700 1 -- 172.21.15.157:0/75902810 shutdown_connections 2023-10-16T19:58:02.224 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:02.213+0000 7f720ed54700 1 -- 172.21.15.157:0/75902810 wait complete. 2023-10-16T19:58:02.227 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:02.214+0000 7f720ed54700 1 Processor -- start 2023-10-16T19:58:02.227 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:02.214+0000 7f720ed54700 1 -- start start 2023-10-16T19:58:02.228 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:02.215+0000 7f720ed54700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f72080b2dc0 0x7f72080c8ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:02.228 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:02.215+0000 7f720ed54700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f72080c91e0 0x7f7208155f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:02.228 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:02.215+0000 7f720ed54700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f72080b31a0 0x7f7208156460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:02.228 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:02.215+0000 7f720ed54700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72081569a0 con 0x7f72080c91e0 2023-10-16T19:58:02.228 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:02.215+0000 7f720ed54700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72080c9720 con 0x7f72080b2dc0 2023-10-16T19:58:02.229 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:02.215+0000 7f720ed54700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72080c9a00 con 0x7f72080b31a0 2023-10-16T19:58:02.229 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:02.215+0000 7f7207fff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f72080c91e0 0x7f7208155f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:02.229 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:02.215+0000 7f7207fff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f72080c91e0 0x7f7208155f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:47496/0 (socket says 172.21.15.157:47496) 2023-10-16T19:58:02.229 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:02.215+0000 7f7207fff700 1 -- 172.21.15.157:0/3113750506 learned_addr learned my addr 172.21.15.157:0/3113750506 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:58:02.229 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:02.215+0000 7f7207fff700 1 -- 172.21.15.157:0/3113750506 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f72080b31a0 msgr2=0x7f7208156460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:02.230 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:02.215+0000 7f720d2f1700 1 --2- 172.21.15.157:0/3113750506 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f72080b31a0 0x7f7208156460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:02.230 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:02.215+0000 7f720caf0700 1 --2- 172.21.15.157:0/3113750506 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f72080b2dc0 0x7f72080c8ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:02.230 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:02.215+0000 7f7207fff700 1 --2- 172.21.15.157:0/3113750506 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f72080b31a0 0x7f7208156460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:02.230 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:02.215+0000 7f7207fff700 1 -- 172.21.15.157:0/3113750506 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f72080b2dc0 msgr2=0x7f72080c8ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:02.230 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:02.215+0000 7f7207fff700 1 --2- 172.21.15.157:0/3113750506 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f72080b2dc0 0x7f72080c8ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:02.230 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:02.215+0000 7f7207fff700 1 -- 172.21.15.157:0/3113750506 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72080c9ce0 con 0x7f72080c91e0 2023-10-16T19:58:02.231 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:02.215+0000 7f7207fff700 1 --2- 172.21.15.157:0/3113750506 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f72080c91e0 0x7f7208155f20 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f71f40017a0 tx=0x7f71f40076a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:58:02.231 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:02.216+0000 7f72057fa700 1 -- 172.21.15.157:0/3113750506 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71f400f8d0 con 0x7f72080c91e0 2023-10-16T19:58:02.231 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:02.216+0000 7f72057fa700 1 -- 172.21.15.157:0/3113750506 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71f400fa30 con 0x7f72080c91e0 2023-10-16T19:58:02.231 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:02.216+0000 7f720ed54700 1 -- 172.21.15.157:0/3113750506 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72080c9fc0 con 0x7f72080c91e0 2023-10-16T19:58:02.231 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:02.216+0000 7f72057fa700 1 -- 172.21.15.157:0/3113750506 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71f400fde0 con 0x7f72080c91e0 2023-10-16T19:58:02.232 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:02.216+0000 7f720ed54700 1 -- 172.21.15.157:0/3113750506 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f720815cf70 con 0x7f72080c91e0 2023-10-16T19:58:02.232 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:02.217+0000 7f720ed54700 1 -- 172.21.15.157:0/3113750506 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72080ca4e0 con 0x7f72080c91e0 2023-10-16T19:58:02.232 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:02.217+0000 7f72057fa700 1 -- 172.21.15.157:0/3113750506 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f71f401d460 con 0x7f72080c91e0 2023-10-16T19:58:02.232 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:02.217+0000 7f72057fa700 1 --2- 172.21.15.157:0/3113750506 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f71ec06af00 0x7f71ec06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:02.232 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:02.217+0000 7f72057fa700 1 -- 172.21.15.157:0/3113750506 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f71f40893e0 con 0x7f72080c91e0 2023-10-16T19:58:02.233 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:02.218+0000 7f720caf0700 1 --2- 172.21.15.157:0/3113750506 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f71ec06af00 0x7f71ec06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:02.233 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:02.218+0000 7f720caf0700 1 --2- 172.21.15.157:0/3113750506 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f71ec06af00 0x7f71ec06d3c0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f71fc009aa0 tx=0x7f71fc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:58:02.233 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:02.222+0000 7f72057fa700 1 -- 172.21.15.157:0/3113750506 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f72080ca4e0 con 0x7f72080c91e0 2023-10-16T19:58:02.416 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:02.413+0000 7f720ed54700 1 -- 172.21.15.157:0/3113750506 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f72080ca4e0 con 0x7f72080c91e0 2023-10-16T19:58:02.416 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:02.413+0000 7f72057fa700 1 -- 172.21.15.157:0/3113750506 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v29) v1 ==== 84+0+65 (secure 0 0 0) 0x7f72080ca4e0 con 0x7f72080c91e0 2023-10-16T19:58:02.416 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-10-16T19:58:02.416 INFO:teuthology.orchestra.run.smithi157.stdout:[ 2023-10-16T19:58:02.417 INFO:teuthology.orchestra.run.smithi157.stdout: { 2023-10-16T19:58:02.417 INFO:teuthology.orchestra.run.smithi157.stdout: "poolnum": 1, 2023-10-16T19:58:02.417 INFO:teuthology.orchestra.run.smithi157.stdout: "poolname": ".mgr" 2023-10-16T19:58:02.417 INFO:teuthology.orchestra.run.smithi157.stdout: } 2023-10-16T19:58:02.417 INFO:teuthology.orchestra.run.smithi157.stdout:] 2023-10-16T19:58:02.418 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:02.416+0000 7f720ed54700 1 -- 172.21.15.157:0/3113750506 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f71ec06af00 msgr2=0x7f71ec06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:02.419 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:02.416+0000 7f720ed54700 1 --2- 172.21.15.157:0/3113750506 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f71ec06af00 0x7f71ec06d3c0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f71fc009aa0 tx=0x7f71fc008040 comp rx=0 tx=0).stop 2023-10-16T19:58:02.419 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:02.416+0000 7f720ed54700 1 -- 172.21.15.157:0/3113750506 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f72080c91e0 msgr2=0x7f7208155f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:02.419 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:02.416+0000 7f720ed54700 1 --2- 172.21.15.157:0/3113750506 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f72080c91e0 0x7f7208155f20 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f71f40017a0 tx=0x7f71f40076a0 comp rx=0 tx=0).stop 2023-10-16T19:58:02.419 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:02.416+0000 7f720ed54700 1 -- 172.21.15.157:0/3113750506 shutdown_connections 2023-10-16T19:58:02.419 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:02.416+0000 7f720ed54700 1 --2- 172.21.15.157:0/3113750506 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f71ec06af00 0x7f71ec06d3c0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:02.420 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:02.416+0000 7f720ed54700 1 --2- 172.21.15.157:0/3113750506 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f72080b2dc0 0x7f72080c8ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:02.420 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:02.416+0000 7f720ed54700 1 --2- 172.21.15.157:0/3113750506 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f72080b31a0 0x7f7208156460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:02.420 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:02.416+0000 7f720ed54700 1 --2- 172.21.15.157:0/3113750506 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f72080c91e0 0x7f7208155f20 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:02.420 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:02.416+0000 7f720ed54700 1 -- 172.21.15.157:0/3113750506 >> 172.21.15.157:0/3113750506 conn(0x7f720806e300 msgr2=0x7f72080d1080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:58:02.420 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:02.416+0000 7f720ed54700 1 -- 172.21.15.157:0/3113750506 shutdown_connections 2023-10-16T19:58:02.420 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:02.416+0000 7f720ed54700 1 -- 172.21.15.157:0/3113750506 wait complete. 2023-10-16T19:58:02.430 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'testcephfs1' 2023-10-16T19:58:02.431 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create testcephfs1_metadata --pg_num_min 64 2023-10-16T19:58:02.555 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:02.553+0000 7f0701d2e700 1 Processor -- start 2023-10-16T19:58:02.556 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:02.553+0000 7f0701d2e700 1 -- start start 2023-10-16T19:58:02.559 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:02.554+0000 7f0701d2e700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f06fc06c070 0x7f06fc165bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:02.559 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:02.554+0000 7f0701d2e700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06fc15b100 con 0x7f06fc0729a0 2023-10-16T19:58:02.560 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:02.554+0000 7f0701d2e700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06fc071fd0 con 0x7f06fc15ad20 2023-10-16T19:58:02.560 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:02.554+0000 7f0701d2e700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06fc072460 con 0x7f06fc06c070 2023-10-16T19:58:02.560 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:02.554+0000 7f06faffd700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f06fc0729a0 0x7f06fc06b960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:57174/0 (socket says 172.21.15.157:57174) 2023-10-16T19:58:02.560 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:02.554+0000 7f06faffd700 1 -- 172.21.15.157:0/853756525 learned_addr learned my addr 172.21.15.157:0/853756525 (peer_addr_for_me v1:172.21.15.157:0/0) 2023-10-16T19:58:02.560 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:02.554+0000 7f06fbfff700 1 --2- 172.21.15.157:0/853756525 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f06fc06c070 0x7f06fc165bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:02.561 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:02.554+0000 7f06fa7fc700 1 -- 172.21.15.157:0/853756525 <== mon.0 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2820126381 0 0) 0x7f06fc15b100 con 0x7f06fc0729a0 2023-10-16T19:58:02.561 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:02.554+0000 7f06fa7fc700 1 -- 172.21.15.157:0/853756525 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f06dc0035b0 con 0x7f06fc0729a0 2023-10-16T19:58:02.561 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:02.554+0000 7f06fa7fc700 1 -- 172.21.15.157:0/853756525 <== mon.0 v1:172.21.15.157:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3649444106 0 0) 0x7f06dc0035b0 con 0x7f06fc0729a0 2023-10-16T19:58:02.561 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:02.554+0000 7f06fa7fc700 1 -- 172.21.15.157:0/853756525 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f06fc06c070 msgr2=0x7f06fc165bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:58:02.561 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:02.554+0000 7f06fa7fc700 1 --2- 172.21.15.157:0/853756525 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f06fc06c070 0x7f06fc165bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:02.562 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:02.554+0000 7f06fa7fc700 1 -- 172.21.15.157:0/853756525 >> v1:172.21.15.187:6789/0 conn(0x7f06fc15ad20 legacy=0x7f06fc066650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:02.562 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:02.554+0000 7f06fa7fc700 1 -- 172.21.15.157:0/853756525 --> v1:172.21.15.157:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06fc0713c0 con 0x7f06fc0729a0 2023-10-16T19:58:02.562 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:02.555+0000 7f06fa7fc700 1 -- 172.21.15.157:0/853756525 <== mon.0 v1:172.21.15.157:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4021145519 0 0) 0x7f06e4001670 con 0x7f06fc0729a0 2023-10-16T19:58:02.562 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:02.555+0000 7f06fa7fc700 1 -- 172.21.15.157:0/853756525 >> v1:172.21.15.157:6789/0 conn(0x7f06fc0729a0 legacy=0x7f06fc06b960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:02.562 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:02.555+0000 7f06fa7fc700 1 --2- 172.21.15.157:0/853756525 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f06fc06c070 0x7f06dc003a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:02.563 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:02.555+0000 7f06fa7fc700 1 --2- 172.21.15.157:0/853756525 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f06dc003fb0 0x7f06dc004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:02.563 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:02.555+0000 7f06fa7fc700 1 --2- 172.21.15.157:0/853756525 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f06dc004d90 0x7f06dc005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:02.563 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:02.555+0000 7f06fa7fc700 1 -- 172.21.15.157:0/853756525 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06fc072460 con 0x7f06dc004d90 2023-10-16T19:58:02.563 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:02.555+0000 7f06fa7fc700 1 -- 172.21.15.157:0/853756525 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06dc00baf0 con 0x7f06dc003fb0 2023-10-16T19:58:02.564 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:02.555+0000 7f06fa7fc700 1 -- 172.21.15.157:0/853756525 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06dc00bcb0 con 0x7f06fc06c070 2023-10-16T19:58:02.564 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:02.555+0000 7f06fbfff700 1 --2- 172.21.15.157:0/853756525 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f06dc004d90 0x7f06dc005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:02.564 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:02.555+0000 7f06fb7fe700 1 --2- 172.21.15.157:0/853756525 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f06fc06c070 0x7f06dc003a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:02.564 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:02.555+0000 7f06faffd700 1 --2- 172.21.15.157:0/853756525 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f06dc003fb0 0x7f06dc004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:02.564 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:02.555+0000 7f06fbfff700 1 -- 172.21.15.157:0/853756525 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f06fc06c070 msgr2=0x7f06dc003a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:58:02.565 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:02.555+0000 7f06fbfff700 1 --2- 172.21.15.157:0/853756525 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f06fc06c070 0x7f06dc003a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:02.565 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:02.555+0000 7f06fbfff700 1 -- 172.21.15.157:0/853756525 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f06dc003fb0 msgr2=0x7f06dc004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:58:02.565 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:02.555+0000 7f06fbfff700 1 --2- 172.21.15.157:0/853756525 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f06dc003fb0 0x7f06dc004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:02.565 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:02.555+0000 7f06fbfff700 1 -- 172.21.15.157:0/853756525 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06dc0035b0 con 0x7f06dc004d90 2023-10-16T19:58:02.565 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:02.555+0000 7f06fbfff700 1 --2- 172.21.15.157:0/853756525 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f06dc004d90 0x7f06dc005210 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f06fc0700f0 tx=0x7f06dc005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0894f7eeb620c0c server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:58:02.566 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:02.555+0000 7f06fa7fc700 1 -- 172.21.15.157:0/853756525 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06f400ebd0 con 0x7f06dc004d90 2023-10-16T19:58:02.566 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:02.555+0000 7f06fa7fc700 1 -- 172.21.15.157:0/853756525 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06f400f040 con 0x7f06dc004d90 2023-10-16T19:58:02.566 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:02.555+0000 7f06fa7fc700 1 -- 172.21.15.157:0/853756525 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06f4014480 con 0x7f06dc004d90 2023-10-16T19:58:02.566 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:02.556+0000 7f0701d2e700 1 -- 172.21.15.157:0/853756525 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f06dc004d90 msgr2=0x7f06dc005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:02.566 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:02.556+0000 7f0701d2e700 1 --2- 172.21.15.157:0/853756525 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f06dc004d90 0x7f06dc005210 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f06fc0700f0 tx=0x7f06dc005880 comp rx=0 tx=0).stop 2023-10-16T19:58:02.567 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:02.556+0000 7f06fbfff700 1 -- 172.21.15.157:0/853756525 reap_dead start 2023-10-16T19:58:02.567 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:02.556+0000 7f0701d2e700 1 -- 172.21.15.157:0/853756525 shutdown_connections 2023-10-16T19:58:02.567 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:02.556+0000 7f0701d2e700 1 -- 172.21.15.157:0/853756525 >> 172.21.15.157:0/853756525 conn(0x7f06fc06c7e0 msgr2=0x7f06fc06cbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:58:02.567 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:02.556+0000 7f0701d2e700 1 -- 172.21.15.157:0/853756525 shutdown_connections 2023-10-16T19:58:02.567 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:02.556+0000 7f0701d2e700 1 -- 172.21.15.157:0/853756525 wait complete. 2023-10-16T19:58:02.568 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:02.557+0000 7f0701d2e700 1 Processor -- start 2023-10-16T19:58:02.570 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:02.557+0000 7f0701d2e700 1 -- start start 2023-10-16T19:58:02.570 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:02.558+0000 7f0701d2e700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f06fc153810 0x7f06fc0c3de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:02.571 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:02.558+0000 7f0701d2e700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f06fc0b5080 0x7f06fc0b5500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:02.571 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:02.558+0000 7f0701d2e700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f06fc15b2b0 0x7f06fc15b730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:02.571 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:02.558+0000 7f0701d2e700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06fc15bc70 con 0x7f06fc153810 2023-10-16T19:58:02.571 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:02.558+0000 7f0701d2e700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06fc157d00 con 0x7f06fc0b5080 2023-10-16T19:58:02.571 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:02.558+0000 7f0701d2e700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06fc0b5b60 con 0x7f06fc15b2b0 2023-10-16T19:58:02.572 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:02.558+0000 7f06fb7fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f06fc153810 0x7f06fc0c3de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:02.572 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:02.558+0000 7f06fb7fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f06fc153810 0x7f06fc0c3de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:47516/0 (socket says 172.21.15.157:47516) 2023-10-16T19:58:02.572 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:02.558+0000 7f06fb7fe700 1 -- 172.21.15.157:0/1749462817 learned_addr learned my addr 172.21.15.157:0/1749462817 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:58:02.572 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:02.558+0000 7f06fbfff700 1 --2- 172.21.15.157:0/1749462817 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f06fc15b2b0 0x7f06fc15b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:02.572 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:02.558+0000 7f06faffd700 1 --2- 172.21.15.157:0/1749462817 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f06fc0b5080 0x7f06fc0b5500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:02.573 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:02.558+0000 7f06fb7fe700 1 -- 172.21.15.157:0/1749462817 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f06fc15b2b0 msgr2=0x7f06fc15b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:02.573 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:02.558+0000 7f06fb7fe700 1 --2- 172.21.15.157:0/1749462817 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f06fc15b2b0 0x7f06fc15b730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:02.573 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:02.558+0000 7f06fb7fe700 1 -- 172.21.15.157:0/1749462817 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f06fc0b5080 msgr2=0x7f06fc0b5500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:02.573 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:02.558+0000 7f06fb7fe700 1 --2- 172.21.15.157:0/1749462817 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f06fc0b5080 0x7f06fc0b5500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:02.573 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:02.558+0000 7f06fb7fe700 1 -- 172.21.15.157:0/1749462817 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06fc0b5e40 con 0x7f06fc153810 2023-10-16T19:58:02.574 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:02.559+0000 7f06fb7fe700 1 --2- 172.21.15.157:0/1749462817 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f06fc153810 0x7f06fc0c3de0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f06ec00f850 tx=0x7f06ec00fc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:58:02.574 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:02.559+0000 7f06f3fff700 1 -- 172.21.15.157:0/1749462817 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06ec0050d0 con 0x7f06fc153810 2023-10-16T19:58:02.574 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:02.559+0000 7f06f3fff700 1 -- 172.21.15.157:0/1749462817 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06ec005230 con 0x7f06fc153810 2023-10-16T19:58:02.574 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:02.559+0000 7f06f3fff700 1 -- 172.21.15.157:0/1749462817 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06ec003680 con 0x7f06fc153810 2023-10-16T19:58:02.574 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:02.559+0000 7f0701d2e700 1 -- 172.21.15.157:0/1749462817 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06fc157f70 con 0x7f06fc153810 2023-10-16T19:58:02.575 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:02.559+0000 7f0701d2e700 1 -- 172.21.15.157:0/1749462817 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06fc0b6120 con 0x7f06fc153810 2023-10-16T19:58:02.575 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:02.560+0000 7f0701d2e700 1 -- 172.21.15.157:0/1749462817 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06fc1582e0 con 0x7f06fc153810 2023-10-16T19:58:02.575 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:02.560+0000 7f06f3fff700 1 -- 172.21.15.157:0/1749462817 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f06ec0037e0 con 0x7f06fc153810 2023-10-16T19:58:02.575 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:02.560+0000 7f06f3fff700 1 --2- 172.21.15.157:0/1749462817 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f06e006af00 0x7f06e006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:02.575 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:02.561+0000 7f06f3fff700 1 -- 172.21.15.157:0/1749462817 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f06ec089120 con 0x7f06fc153810 2023-10-16T19:58:02.576 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:02.561+0000 7f06faffd700 1 --2- 172.21.15.157:0/1749462817 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f06e006af00 0x7f06e006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:02.576 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:02.561+0000 7f06faffd700 1 --2- 172.21.15.157:0/1749462817 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f06e006af00 0x7f06e006d3c0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f06fc0af660 tx=0x7f06e4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:58:02.576 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:02.565+0000 7f06f3fff700 1 -- 172.21.15.157:0/1749462817 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f06ec054520 con 0x7f06fc153810 2023-10-16T19:58:02.758 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:02.756+0000 7f0701d2e700 1 -- 172.21.15.157:0/1749462817 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "testcephfs1_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f06fc04f400 con 0x7f06fc153810 2023-10-16T19:58:03.575 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:03.572+0000 7f06f3fff700 1 -- 172.21.15.157:0/1749462817 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "testcephfs1_metadata", "pg_num_min": 64}]=0 pool 'testcephfs1_metadata' created v30) v1 ==== 148+0+0 (secure 0 0 0) 0x7f06ec057b40 con 0x7f06fc153810 2023-10-16T19:58:03.578 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:03.575+0000 7f0701d2e700 1 -- 172.21.15.157:0/1749462817 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f06e006af00 msgr2=0x7f06e006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:03.579 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:03.575+0000 7f0701d2e700 1 --2- 172.21.15.157:0/1749462817 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f06e006af00 0x7f06e006d3c0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f06fc0af660 tx=0x7f06e4009040 comp rx=0 tx=0).stop 2023-10-16T19:58:03.579 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:03.575+0000 7f0701d2e700 1 -- 172.21.15.157:0/1749462817 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f06fc153810 msgr2=0x7f06fc0c3de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:03.580 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:03.575+0000 7f0701d2e700 1 --2- 172.21.15.157:0/1749462817 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f06fc153810 0x7f06fc0c3de0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f06ec00f850 tx=0x7f06ec00fc10 comp rx=0 tx=0).stop 2023-10-16T19:58:03.580 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:03.576+0000 7f0701d2e700 1 -- 172.21.15.157:0/1749462817 shutdown_connections 2023-10-16T19:58:03.580 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:03.576+0000 7f0701d2e700 1 --2- 172.21.15.157:0/1749462817 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f06fc15b2b0 0x7f06fc15b730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:03.581 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:03.576+0000 7f0701d2e700 1 --2- 172.21.15.157:0/1749462817 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f06fc153810 0x7f06fc0c3de0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:03.582 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:03.576+0000 7f0701d2e700 1 --2- 172.21.15.157:0/1749462817 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f06e006af00 0x7f06e006d3c0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:03.582 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:03.576+0000 7f0701d2e700 1 --2- 172.21.15.157:0/1749462817 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f06fc0b5080 0x7f06fc0b5500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:03.583 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:03.576+0000 7f0701d2e700 1 -- 172.21.15.157:0/1749462817 >> 172.21.15.157:0/1749462817 conn(0x7f06fc06c7e0 msgr2=0x7f06fc15d8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:58:03.584 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:03.576+0000 7f0701d2e700 1 -- 172.21.15.157:0/1749462817 shutdown_connections 2023-10-16T19:58:03.585 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:03.576+0000 7f0701d2e700 1 -- 172.21.15.157:0/1749462817 wait complete. 2023-10-16T19:58:03.585 INFO:teuthology.orchestra.run.smithi157.stderr:pool 'testcephfs1_metadata' created 2023-10-16T19:58:03.594 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create testcephfs1_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-16T19:58:03.725 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:03.722+0000 7feecb1fb700 1 Processor -- start 2023-10-16T19:58:03.725 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:03.723+0000 7feecb1fb700 1 -- start start 2023-10-16T19:58:03.728 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:03.723+0000 7feecb1fb700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7feec415ad40 0x7feec4071070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:03.728 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:03.723+0000 7feecb1fb700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7feec40728e0 0x7feec406b960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:03.728 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:03.723+0000 7feecb1fb700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feec4072130 con 0x7feec4066630 2023-10-16T19:58:03.728 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:03.723+0000 7feecb1fb700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feec40ce590 con 0x7feec415ad40 2023-10-16T19:58:03.729 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:03.723+0000 7feecb1fb700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feec4072410 con 0x7feec40728e0 2023-10-16T19:58:03.729 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:03.723+0000 7feec8f97700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7feec415ad40 0x7feec4071070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:03.729 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:03.724+0000 7feec3fff700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7feec4066630 0x7feec40cde80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:57194/0 (socket says 172.21.15.157:57194) 2023-10-16T19:58:03.729 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:03.724+0000 7feec8f97700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7feec415ad40 0x7feec4071070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:47522/0 (socket says 172.21.15.157:47522) 2023-10-16T19:58:03.729 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:03.724+0000 7feec3fff700 1 -- 172.21.15.157:0/2729113855 learned_addr learned my addr 172.21.15.157:0/2729113855 (peer_addr_for_me v1:172.21.15.157:0/0) 2023-10-16T19:58:03.730 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:03.724+0000 7feec9798700 1 --2- 172.21.15.157:0/2729113855 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7feec40728e0 0x7feec406b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:03.730 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:03.724+0000 7feec8f97700 1 -- 172.21.15.157:0/2729113855 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7feec40728e0 msgr2=0x7feec406b960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:58:03.730 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:03.724+0000 7feec8f97700 1 --2- 172.21.15.157:0/2729113855 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7feec40728e0 0x7feec406b960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:03.730 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:03.724+0000 7feec8f97700 1 -- 172.21.15.157:0/2729113855 >> v1:172.21.15.157:6789/0 conn(0x7feec4066630 legacy=0x7feec40cde80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:03.730 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:03.724+0000 7feec37fe700 1 -- 172.21.15.157:0/2729113855 <== mon.0 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2439460210 0 0) 0x7feec4072130 con 0x7feec4066630 2023-10-16T19:58:03.731 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:03.724+0000 7feec8f97700 1 -- 172.21.15.157:0/2729113855 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feec40ca9a0 con 0x7feec415ad40 2023-10-16T19:58:03.731 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:03.724+0000 7feec9798700 1 --2- 172.21.15.157:0/2729113855 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7feec40728e0 0x7feec406b960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T19:58:03.731 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:03.724+0000 7feec8f97700 1 --2- 172.21.15.157:0/2729113855 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feec415ad40 0x7feec4071070 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7feeb8009840 tx=0x7feeb8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6b1a1a3b5137497 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:58:03.731 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:03.724+0000 7feec37fe700 1 -- 172.21.15.157:0/2729113855 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeb8011830 con 0x7feec415ad40 2023-10-16T19:58:03.731 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:03.724+0000 7feec37fe700 1 -- 172.21.15.157:0/2729113855 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feeb8011990 con 0x7feec415ad40 2023-10-16T19:58:03.732 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:03.724+0000 7feec37fe700 1 -- 172.21.15.157:0/2729113855 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeb8011d20 con 0x7feec415ad40 2023-10-16T19:58:03.732 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:03.725+0000 7feecb1fb700 1 -- 172.21.15.157:0/2729113855 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feec415ad40 msgr2=0x7feec4071070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:03.732 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:03.725+0000 7feecb1fb700 1 --2- 172.21.15.157:0/2729113855 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feec415ad40 0x7feec4071070 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7feeb8009840 tx=0x7feeb8009b50 comp rx=0 tx=0).stop 2023-10-16T19:58:03.732 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:03.725+0000 7feecb1fb700 1 -- 172.21.15.157:0/2729113855 shutdown_connections 2023-10-16T19:58:03.732 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:03.725+0000 7feecb1fb700 1 --2- 172.21.15.157:0/2729113855 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7feec40728e0 0x7feec406b960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:03.733 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:03.725+0000 7feecb1fb700 1 --2- 172.21.15.157:0/2729113855 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feec415ad40 0x7feec4071070 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:03.733 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:03.725+0000 7feecb1fb700 1 -- 172.21.15.157:0/2729113855 >> 172.21.15.157:0/2729113855 conn(0x7feec406c7e0 msgr2=0x7feec406cbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:58:03.733 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:03.725+0000 7feecb1fb700 1 -- 172.21.15.157:0/2729113855 shutdown_connections 2023-10-16T19:58:03.733 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:03.725+0000 7feecb1fb700 1 -- 172.21.15.157:0/2729113855 wait complete. 2023-10-16T19:58:03.736 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:03.726+0000 7feecb1fb700 1 Processor -- start 2023-10-16T19:58:03.736 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:03.726+0000 7feecb1fb700 1 -- start start 2023-10-16T19:58:03.736 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:03.727+0000 7feecb1fb700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7feec4066630 0x7feec414f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:03.736 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:03.727+0000 7feecb1fb700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feec40728e0 0x7feec40ce6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:03.737 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:03.727+0000 7feecb1fb700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7feec415ad40 0x7feec40cec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:03.737 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:03.727+0000 7feecb1fb700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feec40b53e0 con 0x7feec40728e0 2023-10-16T19:58:03.737 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:03.727+0000 7feecb1fb700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feec414fe50 con 0x7feec4066630 2023-10-16T19:58:03.737 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:03.727+0000 7feecb1fb700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feec40af2e0 con 0x7feec415ad40 2023-10-16T19:58:03.737 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:03.727+0000 7feec3fff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feec40728e0 0x7feec40ce6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:03.738 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:03.728+0000 7feec3fff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feec40728e0 0x7feec40ce6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:47528/0 (socket says 172.21.15.157:47528) 2023-10-16T19:58:03.738 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:03.728+0000 7feec3fff700 1 -- 172.21.15.157:0/2583408979 learned_addr learned my addr 172.21.15.157:0/2583408979 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:58:03.738 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:03.728+0000 7feec9798700 1 --2- 172.21.15.157:0/2583408979 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7feec415ad40 0x7feec40cec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:03.738 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:03.728+0000 7feec8f97700 1 --2- 172.21.15.157:0/2583408979 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7feec4066630 0x7feec414f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:03.738 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:03.728+0000 7feec3fff700 1 -- 172.21.15.157:0/2583408979 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7feec415ad40 msgr2=0x7feec40cec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:03.739 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:03.728+0000 7feec3fff700 1 --2- 172.21.15.157:0/2583408979 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7feec415ad40 0x7feec40cec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:03.739 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:03.728+0000 7feec3fff700 1 -- 172.21.15.157:0/2583408979 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7feec4066630 msgr2=0x7feec414f0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:03.739 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:03.728+0000 7feec3fff700 1 --2- 172.21.15.157:0/2583408979 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7feec4066630 0x7feec414f0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:03.739 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:03.728+0000 7feec3fff700 1 -- 172.21.15.157:0/2583408979 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feeb80094a0 con 0x7feec40728e0 2023-10-16T19:58:03.739 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:03.728+0000 7feec9798700 1 --2- 172.21.15.157:0/2583408979 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7feec415ad40 0x7feec40cec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T19:58:03.740 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:03.728+0000 7feec8f97700 1 --2- 172.21.15.157:0/2583408979 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7feec4066630 0x7feec414f0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T19:58:03.740 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:03.728+0000 7feec3fff700 1 --2- 172.21.15.157:0/2583408979 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feec40728e0 0x7feec40ce6d0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7feeb00011e0 tx=0x7feeb000cae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:58:03.740 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:03.728+0000 7feec17fa700 1 -- 172.21.15.157:0/2583408979 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeb0004c80 con 0x7feec40728e0 2023-10-16T19:58:03.740 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:03.728+0000 7feec17fa700 1 -- 172.21.15.157:0/2583408979 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feeb0004e00 con 0x7feec40728e0 2023-10-16T19:58:03.740 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:03.728+0000 7feecb1fb700 1 -- 172.21.15.157:0/2583408979 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feec40aed20 con 0x7feec40728e0 2023-10-16T19:58:03.741 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:03.728+0000 7feec17fa700 1 -- 172.21.15.157:0/2583408979 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeb0007310 con 0x7feec40728e0 2023-10-16T19:58:03.741 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:03.728+0000 7feecb1fb700 1 -- 172.21.15.157:0/2583408979 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feec40b4be0 con 0x7feec40728e0 2023-10-16T19:58:03.741 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:03.729+0000 7feecb1fb700 1 -- 172.21.15.157:0/2583408979 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feec404f400 con 0x7feec40728e0 2023-10-16T19:58:03.741 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:03.730+0000 7feec17fa700 1 -- 172.21.15.157:0/2583408979 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7feeb0007470 con 0x7feec40728e0 2023-10-16T19:58:03.741 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:03.730+0000 7feec17fa700 1 --2- 172.21.15.157:0/2583408979 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7feea806af00 0x7feea806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:03.742 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:03.730+0000 7feec17fa700 1 -- 172.21.15.157:0/2583408979 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5232+0+0 (secure 0 0 0) 0x7feeb0089180 con 0x7feec40728e0 2023-10-16T19:58:03.742 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:03.730+0000 7feec8f97700 1 --2- 172.21.15.157:0/2583408979 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7feea806af00 0x7feea806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:03.742 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:03.731+0000 7feec8f97700 1 --2- 172.21.15.157:0/2583408979 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7feea806af00 0x7feea806d3c0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7feeb80090b0 tx=0x7feeb801c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:58:03.743 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:03.734+0000 7feec17fa700 1 -- 172.21.15.157:0/2583408979 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7feeb00544a0 con 0x7feec40728e0 2023-10-16T19:58:03.923 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:03.921+0000 7feecb1fb700 1 -- 172.21.15.157:0/2583408979 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "testcephfs1_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7feec40cac50 con 0x7feec40728e0 2023-10-16T19:58:04.382 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a has been restored 2023-10-16T19:58:04.383 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c has been restored 2023-10-16T19:58:04.383 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b has been restored 2023-10-16T19:58:04.383 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d has been restored 2023-10-16T19:58:04.577 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:04.574+0000 7feec17fa700 1 -- 172.21.15.157:0/2583408979 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "testcephfs1_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'testcephfs1_data' created v31) v1 ==== 180+0+0 (secure 0 0 0) 0x7feeb0057ac0 con 0x7feec40728e0 2023-10-16T19:58:04.579 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:04.577+0000 7feecb1fb700 1 -- 172.21.15.157:0/2583408979 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7feea806af00 msgr2=0x7feea806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:04.579 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:04.577+0000 7feecb1fb700 1 --2- 172.21.15.157:0/2583408979 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7feea806af00 0x7feea806d3c0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7feeb80090b0 tx=0x7feeb801c040 comp rx=0 tx=0).stop 2023-10-16T19:58:04.579 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:04.577+0000 7feecb1fb700 1 -- 172.21.15.157:0/2583408979 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feec40728e0 msgr2=0x7feec40ce6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:04.580 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:04.577+0000 7feecb1fb700 1 --2- 172.21.15.157:0/2583408979 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feec40728e0 0x7feec40ce6d0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7feeb00011e0 tx=0x7feeb000cae0 comp rx=0 tx=0).stop 2023-10-16T19:58:04.580 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:04.578+0000 7feecb1fb700 1 -- 172.21.15.157:0/2583408979 shutdown_connections 2023-10-16T19:58:04.580 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:04.578+0000 7feecb1fb700 1 --2- 172.21.15.157:0/2583408979 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7feea806af00 0x7feea806d3c0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:04.581 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:04.578+0000 7feecb1fb700 1 --2- 172.21.15.157:0/2583408979 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7feec4066630 0x7feec414f0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:04.581 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:04.578+0000 7feecb1fb700 1 --2- 172.21.15.157:0/2583408979 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7feec415ad40 0x7feec40cec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:04.581 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:04.578+0000 7feecb1fb700 1 --2- 172.21.15.157:0/2583408979 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feec40728e0 0x7feec40ce6d0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:04.581 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:04.578+0000 7feecb1fb700 1 -- 172.21.15.157:0/2583408979 >> 172.21.15.157:0/2583408979 conn(0x7feec406c7e0 msgr2=0x7feec406e5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:58:04.582 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:04.579+0000 7feecb1fb700 1 -- 172.21.15.157:0/2583408979 shutdown_connections 2023-10-16T19:58:04.582 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:04.579+0000 7feecb1fb700 1 -- 172.21.15.157:0/2583408979 wait complete. 2023-10-16T19:58:04.590 INFO:teuthology.orchestra.run.smithi157.stderr:pool 'testcephfs1_data' created 2023-10-16T19:58:04.603 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new testcephfs1 testcephfs1_metadata testcephfs1_data 2023-10-16T19:58:04.731 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:04.726+0000 7fede58b8700 1 Processor -- start 2023-10-16T19:58:04.731 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:04.726+0000 7fede58b8700 1 -- start start 2023-10-16T19:58:04.732 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:04.727+0000 7fede58b8700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fede00b36a0 0x7fede00b3a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:04.732 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:04.727+0000 7fede58b8700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fede015e760 0x7fede00d1460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:04.732 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:04.727+0000 7fede58b8700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fede00b3fc0 con 0x7fede00cfd10 2023-10-16T19:58:04.732 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:04.727+0000 7fede58b8700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fede015f950 con 0x7fede015e760 2023-10-16T19:58:04.732 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:04.727+0000 7fede58b8700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fede006d530 con 0x7fede00b36a0 2023-10-16T19:58:04.733 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:04.727+0000 7fedde7fc700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fede015e760 0x7fede00d1460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:04.733 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:04.727+0000 7feddf7fe700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7fede00cfd10 0x7fede0162060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:57206/0 (socket says 172.21.15.157:57206) 2023-10-16T19:58:04.733 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:04.727+0000 7feddf7fe700 1 -- 172.21.15.157:0/2786429213 learned_addr learned my addr 172.21.15.157:0/2786429213 (peer_addr_for_me v1:172.21.15.157:0/0) 2023-10-16T19:58:04.733 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:04.727+0000 7fedde7fc700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fede015e760 0x7fede00d1460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:47534/0 (socket says 172.21.15.157:47534) 2023-10-16T19:58:04.733 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:04.727+0000 7feddeffd700 1 --2- 172.21.15.157:0/2786429213 >> v2:172.21.15.187:3300/0 conn(0x7fede00b36a0 0x7fede00b3a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:04.734 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:04.727+0000 7fedde7fc700 1 -- 172.21.15.157:0/2786429213 >> v2:172.21.15.187:3300/0 conn(0x7fede00b36a0 msgr2=0x7fede00b3a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:58:04.734 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:04.727+0000 7fedde7fc700 1 --2- 172.21.15.157:0/2786429213 >> v2:172.21.15.187:3300/0 conn(0x7fede00b36a0 0x7fede00b3a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:04.734 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:04.727+0000 7fedde7fc700 1 -- 172.21.15.157:0/2786429213 >> v1:172.21.15.157:6789/0 conn(0x7fede00cfd10 legacy=0x7fede0162060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:04.734 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:04.727+0000 7fedde7fc700 1 -- 172.21.15.157:0/2786429213 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fede006d810 con 0x7fede015e760 2023-10-16T19:58:04.734 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:04.728+0000 7fedde7fc700 1 --2- 172.21.15.157:0/2786429213 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fede015e760 0x7fede00d1460 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fede00679f0 tx=0x7fedd0009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97e90e072b8e4c09 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:58:04.735 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:04.728+0000 7fedddffb700 1 -- 172.21.15.157:0/2786429213 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedd0011830 con 0x7fede015e760 2023-10-16T19:58:04.735 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:04.728+0000 7fedddffb700 1 -- 172.21.15.157:0/2786429213 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedd0011990 con 0x7fede015e760 2023-10-16T19:58:04.735 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:04.728+0000 7fedddffb700 1 -- 172.21.15.157:0/2786429213 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedd0011d20 con 0x7fede015e760 2023-10-16T19:58:04.735 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:04.728+0000 7fede58b8700 1 -- 172.21.15.157:0/2786429213 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fede015e760 msgr2=0x7fede00d1460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:04.735 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:04.728+0000 7fede58b8700 1 --2- 172.21.15.157:0/2786429213 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fede015e760 0x7fede00d1460 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fede00679f0 tx=0x7fedd0009b20 comp rx=0 tx=0).stop 2023-10-16T19:58:04.736 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:04.728+0000 7fede58b8700 1 -- 172.21.15.157:0/2786429213 shutdown_connections 2023-10-16T19:58:04.736 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:04.728+0000 7fede58b8700 1 --2- 172.21.15.157:0/2786429213 >> v2:172.21.15.187:3300/0 conn(0x7fede00b36a0 0x7fede00b3a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:04.736 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:04.728+0000 7fede58b8700 1 --2- 172.21.15.157:0/2786429213 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fede015e760 0x7fede00d1460 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:04.736 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:04.729+0000 7fede58b8700 1 -- 172.21.15.157:0/2786429213 >> 172.21.15.157:0/2786429213 conn(0x7fede006e310 msgr2=0x7fede006e6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:58:04.736 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:04.729+0000 7fede58b8700 1 -- 172.21.15.157:0/2786429213 shutdown_connections 2023-10-16T19:58:04.737 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:04.729+0000 7fede58b8700 1 -- 172.21.15.157:0/2786429213 wait complete. 2023-10-16T19:58:04.739 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:04.730+0000 7fede58b8700 1 Processor -- start 2023-10-16T19:58:04.740 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:04.730+0000 7fede58b8700 1 -- start start 2023-10-16T19:58:04.740 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:04.731+0000 7fede58b8700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fede00b36a0 0x7fede01592e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:04.740 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:04.731+0000 7fede58b8700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fede00cfd10 0x7fede00b5a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:04.740 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:04.731+0000 7fede58b8700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fede01f7690 0x7fede01f7b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:04.740 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:04.731+0000 7fede58b8700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fede01f8060 con 0x7fede00cfd10 2023-10-16T19:58:04.741 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:04.731+0000 7fede58b8700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fede00b4a70 con 0x7fede01f7690 2023-10-16T19:58:04.741 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:04.731+0000 7fede58b8700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fede00b55f0 con 0x7fede00b36a0 2023-10-16T19:58:04.741 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:04.731+0000 7fedde7fc700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fede00cfd10 0x7fede00b5a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:04.741 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:04.731+0000 7fedde7fc700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fede00cfd10 0x7fede00b5a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:47540/0 (socket says 172.21.15.157:47540) 2023-10-16T19:58:04.742 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:04.731+0000 7fedde7fc700 1 -- 172.21.15.157:0/419304776 learned_addr learned my addr 172.21.15.157:0/419304776 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:58:04.742 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:04.732+0000 7feddeffd700 1 --2- 172.21.15.157:0/419304776 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fede00b36a0 0x7fede01592e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:04.742 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:04.732+0000 7feddf7fe700 1 --2- 172.21.15.157:0/419304776 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fede01f7690 0x7fede01f7b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:04.742 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:04.732+0000 7fedde7fc700 1 -- 172.21.15.157:0/419304776 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fede00b36a0 msgr2=0x7fede01592e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:04.742 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:04.732+0000 7fedde7fc700 1 --2- 172.21.15.157:0/419304776 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fede00b36a0 0x7fede01592e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:04.743 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:04.732+0000 7fedde7fc700 1 -- 172.21.15.157:0/419304776 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fede01f7690 msgr2=0x7fede01f7b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:04.743 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:04.732+0000 7fedde7fc700 1 --2- 172.21.15.157:0/419304776 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fede01f7690 0x7fede01f7b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:04.743 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:04.732+0000 7fedde7fc700 1 -- 172.21.15.157:0/419304776 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedd00094a0 con 0x7fede00cfd10 2023-10-16T19:58:04.743 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:04.732+0000 7feddeffd700 1 --2- 172.21.15.157:0/419304776 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fede00b36a0 0x7fede01592e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T19:58:04.743 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:04.732+0000 7feddf7fe700 1 --2- 172.21.15.157:0/419304776 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fede01f7690 0x7fede01f7b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T19:58:04.744 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:04.732+0000 7fedde7fc700 1 --2- 172.21.15.157:0/419304776 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fede00cfd10 0x7fede00b5a80 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fede00b4790 tx=0x7fedd0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:58:04.744 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:04.732+0000 7fedc7fff700 1 -- 172.21.15.157:0/419304776 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedd00036a0 con 0x7fede00cfd10 2023-10-16T19:58:04.744 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:04.732+0000 7fedc7fff700 1 -- 172.21.15.157:0/419304776 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedd001f070 con 0x7fede00cfd10 2023-10-16T19:58:04.744 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:04.732+0000 7fede58b8700 1 -- 172.21.15.157:0/419304776 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fede01f84e0 con 0x7fede00cfd10 2023-10-16T19:58:04.744 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:04.732+0000 7fedc7fff700 1 -- 172.21.15.157:0/419304776 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedd0003a00 con 0x7fede00cfd10 2023-10-16T19:58:04.745 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:04.732+0000 7fede58b8700 1 -- 172.21.15.157:0/419304776 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fede00b4fa0 con 0x7fede00cfd10 2023-10-16T19:58:04.745 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:04.733+0000 7fede58b8700 1 -- 172.21.15.157:0/419304776 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fede0067ab0 con 0x7fede00cfd10 2023-10-16T19:58:04.745 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:04.734+0000 7fedc7fff700 1 -- 172.21.15.157:0/419304776 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fedd0003b60 con 0x7fede00cfd10 2023-10-16T19:58:04.745 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:04.734+0000 7fedc7fff700 1 --2- 172.21.15.157:0/419304776 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fedcc06af00 0x7fedcc06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:04.745 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:04.734+0000 7fedc7fff700 1 -- 172.21.15.157:0/419304776 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5619+0+0 (secure 0 0 0) 0x7fedd0021070 con 0x7fede00cfd10 2023-10-16T19:58:04.746 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:04.734+0000 7feddeffd700 1 --2- 172.21.15.157:0/419304776 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fedcc06af00 0x7fedcc06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:04.746 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:04.735+0000 7feddeffd700 1 --2- 172.21.15.157:0/419304776 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fedcc06af00 0x7fedcc06d3c0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fede00c87f0 tx=0x7fedd4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:58:04.746 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:04.739+0000 7fedc7fff700 1 -- 172.21.15.157:0/419304776 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fedd0055ec0 con 0x7fede00cfd10 2023-10-16T19:58:04.972 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:04.970+0000 7fede58b8700 1 -- 172.21.15.157:0/419304776 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "testcephfs1", "metadata": "testcephfs1_metadata", "data": "testcephfs1_data"} v 0) v1 -- 0x7fede004f400 con 0x7fede00cfd10 2023-10-16T19:58:05.609 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:05.607+0000 7fedc7fff700 1 -- 172.21.15.157:0/419304776 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "testcephfs1", "metadata": "testcephfs1_metadata", "data": "testcephfs1_data"}]=0 new fs with metadata pool 4 and data pool 5 v13) v1 ==== 187+0+0 (secure 0 0 0) 0x7fedd002b0d0 con 0x7fede00cfd10 2023-10-16T19:58:05.613 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:05.610+0000 7fede58b8700 1 -- 172.21.15.157:0/419304776 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fedcc06af00 msgr2=0x7fedcc06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:05.613 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:05.610+0000 7fede58b8700 1 --2- 172.21.15.157:0/419304776 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fedcc06af00 0x7fedcc06d3c0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fede00c87f0 tx=0x7fedd4008040 comp rx=0 tx=0).stop 2023-10-16T19:58:05.614 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:05.610+0000 7fede58b8700 1 -- 172.21.15.157:0/419304776 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fede00cfd10 msgr2=0x7fede00b5a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:05.614 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:05.610+0000 7fede58b8700 1 --2- 172.21.15.157:0/419304776 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fede00cfd10 0x7fede00b5a80 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fede00b4790 tx=0x7fedd0004750 comp rx=0 tx=0).stop 2023-10-16T19:58:05.614 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:05.611+0000 7fede58b8700 1 -- 172.21.15.157:0/419304776 shutdown_connections 2023-10-16T19:58:05.614 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:05.611+0000 7fede58b8700 1 --2- 172.21.15.157:0/419304776 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fedcc06af00 0x7fedcc06d3c0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:05.614 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:05.611+0000 7fede58b8700 1 --2- 172.21.15.157:0/419304776 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fede01f7690 0x7fede01f7b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:05.615 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:05.611+0000 7fede58b8700 1 --2- 172.21.15.157:0/419304776 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fede00b36a0 0x7fede01592e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:05.615 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:05.611+0000 7fede58b8700 1 --2- 172.21.15.157:0/419304776 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fede00cfd10 0x7fede00b5a80 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:05.615 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:05.611+0000 7fede58b8700 1 -- 172.21.15.157:0/419304776 >> 172.21.15.157:0/419304776 conn(0x7fede006e310 msgr2=0x7fede00d1b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:58:05.615 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:05.611+0000 7fede58b8700 1 -- 172.21.15.157:0/419304776 shutdown_connections 2023-10-16T19:58:05.615 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:05.611+0000 7fede58b8700 1 -- 172.21.15.157:0/419304776 wait complete. 2023-10-16T19:58:05.618 INFO:teuthology.orchestra.run.smithi157.stderr:new fs with metadata pool 4 and data pool 5 2023-10-16T19:58:05.631 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T19:58:05.755 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:05.750+0000 7f573196e700 1 Processor -- start 2023-10-16T19:58:05.755 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:05.750+0000 7f573196e700 1 -- start start 2023-10-16T19:58:05.755 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:05.751+0000 7f573196e700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f572c161450 0x7f572c0ce1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:05.756 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:05.751+0000 7f573196e700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f572c0ceed0 0x7f572c06fc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:05.756 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:05.751+0000 7f573196e700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f572c0701d0 0x7f572c06b960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:05.756 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:05.751+0000 7f573196e700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f572c0cf350 con 0x7f572c161450 2023-10-16T19:58:05.756 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:05.751+0000 7f573196e700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f572c070660 con 0x7f572c0701d0 2023-10-16T19:58:05.757 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:05.751+0000 7f573196e700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f572c06d650 con 0x7f572c0ceed0 2023-10-16T19:58:05.757 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:05.751+0000 7f572affd700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f572c161450 0x7f572c0ce1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:05.757 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:05.751+0000 7f572affd700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f572c161450 0x7f572c0ce1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:47560/0 (socket says 172.21.15.157:47560) 2023-10-16T19:58:05.757 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:05.751+0000 7f572affd700 1 -- 172.21.15.157:0/4154738155 learned_addr learned my addr 172.21.15.157:0/4154738155 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:58:05.757 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:05.751+0000 7f572b7fe700 1 --2- 172.21.15.157:0/4154738155 >> v2:172.21.15.187:3300/0 conn(0x7f572c0701d0 0x7f572c06b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:05.758 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:05.751+0000 7f572a7fc700 1 --2- 172.21.15.157:0/4154738155 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f572c0ceed0 0x7f572c06fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:05.758 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:05.751+0000 7f572affd700 1 -- 172.21.15.157:0/4154738155 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f572c0ceed0 msgr2=0x7f572c06fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:58:05.758 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:05.751+0000 7f572affd700 1 --2- 172.21.15.157:0/4154738155 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f572c0ceed0 0x7f572c06fc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:05.758 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:05.751+0000 7f572affd700 1 -- 172.21.15.157:0/4154738155 >> v2:172.21.15.187:3300/0 conn(0x7f572c0701d0 msgr2=0x7f572c06b960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:58:05.758 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:05.751+0000 7f572affd700 1 --2- 172.21.15.157:0/4154738155 >> v2:172.21.15.187:3300/0 conn(0x7f572c0701d0 0x7f572c06b960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:05.759 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:05.751+0000 7f572affd700 1 -- 172.21.15.157:0/4154738155 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f572c161830 con 0x7f572c161450 2023-10-16T19:58:05.759 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:05.751+0000 7f572affd700 1 --2- 172.21.15.157:0/4154738155 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f572c161450 0x7f572c0ce1e0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f572c06f2c0 tx=0x7f571c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2101df357fc38b1f server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:58:05.759 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:05.751+0000 7f5729ffb700 1 -- 172.21.15.157:0/4154738155 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f571c00b870 con 0x7f572c161450 2023-10-16T19:58:05.759 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:05.751+0000 7f5729ffb700 1 -- 172.21.15.157:0/4154738155 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f571c00b9d0 con 0x7f572c161450 2023-10-16T19:58:05.760 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:05.751+0000 7f5729ffb700 1 -- 172.21.15.157:0/4154738155 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f571c00bd60 con 0x7f572c161450 2023-10-16T19:58:05.760 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:05.752+0000 7f573196e700 1 -- 172.21.15.157:0/4154738155 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f572c161450 msgr2=0x7f572c0ce1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:05.760 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:05.752+0000 7f573196e700 1 --2- 172.21.15.157:0/4154738155 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f572c161450 0x7f572c0ce1e0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f572c06f2c0 tx=0x7f571c009bd0 comp rx=0 tx=0).stop 2023-10-16T19:58:05.760 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:05.752+0000 7f573196e700 1 -- 172.21.15.157:0/4154738155 shutdown_connections 2023-10-16T19:58:05.760 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:05.752+0000 7f573196e700 1 --2- 172.21.15.157:0/4154738155 >> v2:172.21.15.187:3300/0 conn(0x7f572c0701d0 0x7f572c06b960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:05.761 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:05.752+0000 7f573196e700 1 --2- 172.21.15.157:0/4154738155 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f572c161450 0x7f572c0ce1e0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:05.761 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:05.752+0000 7f573196e700 1 --2- 172.21.15.157:0/4154738155 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f572c0ceed0 0x7f572c06fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:05.761 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:05.752+0000 7f573196e700 1 -- 172.21.15.157:0/4154738155 >> 172.21.15.157:0/4154738155 conn(0x7f572c06e240 msgr2=0x7f572c06e620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:58:05.761 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:05.752+0000 7f573196e700 1 -- 172.21.15.157:0/4154738155 shutdown_connections 2023-10-16T19:58:05.762 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:05.752+0000 7f573196e700 1 -- 172.21.15.157:0/4154738155 wait complete. 2023-10-16T19:58:05.764 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:05.753+0000 7f573196e700 1 Processor -- start 2023-10-16T19:58:05.765 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:05.753+0000 7f573196e700 1 -- start start 2023-10-16T19:58:05.765 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:05.754+0000 7f573196e700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f572c0701d0 0x7f572c0c80b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:05.765 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:05.754+0000 7f573196e700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f572c0ceed0 0x7f572c0b2ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:05.765 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:05.754+0000 7f573196e700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f572c161450 0x7f572c1589c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:05.766 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:05.754+0000 7f573196e700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f572c0b3530 con 0x7f572c0701d0 2023-10-16T19:58:05.766 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:05.754+0000 7f573196e700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f572c0c56e0 con 0x7f572c161450 2023-10-16T19:58:05.766 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:05.754+0000 7f573196e700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f572c0c59c0 con 0x7f572c0ceed0 2023-10-16T19:58:05.766 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:05.754+0000 7f572affd700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f572c0701d0 0x7f572c0c80b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:05.767 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:05.754+0000 7f572affd700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f572c0701d0 0x7f572c0c80b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:47564/0 (socket says 172.21.15.157:47564) 2023-10-16T19:58:05.767 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:05.754+0000 7f572affd700 1 -- 172.21.15.157:0/381197753 learned_addr learned my addr 172.21.15.157:0/381197753 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:58:05.767 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:05.754+0000 7f572affd700 1 -- 172.21.15.157:0/381197753 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f572c0ceed0 msgr2=0x7f572c0b2ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:05.767 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:05.754+0000 7f572affd700 1 --2- 172.21.15.157:0/381197753 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f572c0ceed0 0x7f572c0b2ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:05.767 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:05.754+0000 7f572affd700 1 -- 172.21.15.157:0/381197753 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f572c161450 msgr2=0x7f572c1589c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:05.768 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:05.754+0000 7f572affd700 1 --2- 172.21.15.157:0/381197753 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f572c161450 0x7f572c1589c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:05.768 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:05.754+0000 7f572affd700 1 -- 172.21.15.157:0/381197753 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f571c009550 con 0x7f572c0701d0 2023-10-16T19:58:05.768 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:05.755+0000 7f572affd700 1 --2- 172.21.15.157:0/381197753 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f572c0701d0 0x7f572c0c80b0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f571c000c00 tx=0x7f571c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:58:05.768 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:05.755+0000 7f5713fff700 1 -- 172.21.15.157:0/381197753 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f571c004520 con 0x7f572c0701d0 2023-10-16T19:58:05.769 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:05.755+0000 7f5713fff700 1 -- 172.21.15.157:0/381197753 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f571c01e070 con 0x7f572c0701d0 2023-10-16T19:58:05.769 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:05.755+0000 7f573196e700 1 -- 172.21.15.157:0/381197753 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f572c0c5ca0 con 0x7f572c0701d0 2023-10-16T19:58:05.769 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:05.755+0000 7f5713fff700 1 -- 172.21.15.157:0/381197753 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f571c0038c0 con 0x7f572c0701d0 2023-10-16T19:58:05.769 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:05.755+0000 7f573196e700 1 -- 172.21.15.157:0/381197753 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f572c0c6260 con 0x7f572c0701d0 2023-10-16T19:58:05.769 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:05.756+0000 7f573196e700 1 -- 172.21.15.157:0/381197753 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f572c073170 con 0x7f572c0701d0 2023-10-16T19:58:05.770 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:05.756+0000 7f5713fff700 1 -- 172.21.15.157:0/381197753 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f571c003a20 con 0x7f572c0701d0 2023-10-16T19:58:05.770 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:05.756+0000 7f5713fff700 1 --2- 172.21.15.157:0/381197753 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f571806af00 0x7f571806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:05.770 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:05.756+0000 7f5713fff700 1 -- 172.21.15.157:0/381197753 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5729+0+0 (secure 0 0 0) 0x7f571c020070 con 0x7f572c0701d0 2023-10-16T19:58:05.770 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:05.757+0000 7f572a7fc700 1 --2- 172.21.15.157:0/381197753 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f571806af00 0x7f571806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:05.771 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:05.757+0000 7f572a7fc700 1 --2- 172.21.15.157:0/381197753 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f571806af00 0x7f571806d3c0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f572c0ad980 tx=0x7f5720008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:58:05.771 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:05.761+0000 7f5713fff700 1 -- 172.21.15.157:0/381197753 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f571c055c70 con 0x7f572c0701d0 2023-10-16T19:58:05.953 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:05.950+0000 7f573196e700 1 -- 172.21.15.157:0/381197753 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f572c067a10 con 0x7f572c0701d0 2023-10-16T19:58:05.953 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:05.951+0000 7f5713fff700 1 -- 172.21.15.157:0/381197753 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) v1 ==== 74+0+16614 (secure 0 0 0) 0x7f571c015020 con 0x7f572c0701d0 2023-10-16T19:58:05.954 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-10-16T19:58:05.954 INFO:teuthology.orchestra.run.smithi157.stdout:{"epoch":32,"fsid":"28199dc9-64d5-479e-83c6-21f097c33d39","created":"2023-10-16T19:56:49.201889+0000","modified":"2023-10-16T19:58:04.971749+0000","last_up_change":"2023-10-16T19:56:54.675673+0000","last_in_change":"2023-10-16T19:56:51.666728+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T19:56:56.932895+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"testcephfs1_metadata","create_time":"2023-10-16T19:58:02.774777+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"testcephfs1"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"testcephfs1_data","create_time":"2023-10-16T19:58:03.939912+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"testcephfs1"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":335785898},{"type":"v1","addr":"172.21.15.157:6809","nonce":335785898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":335785898},{"type":"v1","addr":"172.21.15.157:6811","nonce":335785898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6815","nonce":335785898},{"type":"v1","addr":"172.21.15.157:6817","nonce":335785898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":335785898},{"type":"v1","addr":"172.21.15.157:6813","nonce":335785898}]},"public_addr":"172.21.15.157:6809/335785898","cluster_addr":"172.21.15.157:6811/335785898","heartbeat_back_addr":"172.21.15.157:6817/335785898","heartbeat_front_addr":"172.21.15.157:6813/335785898","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":3482825047},{"type":"v1","addr":"172.21.15.157:6801","nonce":3482825047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":3482825047},{"type":"v1","addr":"172.21.15.157:6803","nonce":3482825047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":3482825047},{"type":"v1","addr":"172.21.15.157:6807","nonce":3482825047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":3482825047},{"type":"v1","addr":"172.21.15.157:6805","nonce":3482825047}]},"public_addr":"172.21.15.157:6801/3482825047","cluster_addr":"172.21.15.157:6803/3482825047","heartbeat_back_addr":"172.21.15.157:6807/3482825047","heartbeat_front_addr":"172.21.15.157:6805/3482825047","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":1118292389},{"type":"v1","addr":"172.21.15.157:6825","nonce":1118292389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":1118292389},{"type":"v1","addr":"172.21.15.157:6827","nonce":1118292389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":1118292389},{"type":"v1","addr":"172.21.15.157:6831","nonce":1118292389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":1118292389},{"type":"v1","addr":"172.21.15.157:6829","nonce":1118292389}]},"public_addr":"172.21.15.157:6825/1118292389","cluster_addr":"172.21.15.157:6827/1118292389","heartbeat_back_addr":"172.21.15.157:6831/1118292389","heartbeat_front_addr":"172.21.15.157:6829/1118292389","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":989329821},{"type":"v1","addr":"172.21.15.157:6816","nonce":989329821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":989329821},{"type":"v1","addr":"172.21.15.157:6819","nonce":989329821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":989329821},{"type":"v1","addr":"172.21.15.157:6823","nonce":989329821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":989329821},{"type":"v1","addr":"172.21.15.157:6821","nonce":989329821}]},"public_addr":"172.21.15.157:6816/989329821","cluster_addr":"172.21.15.157:6819/989329821","heartbeat_back_addr":"172.21.15.157:6823/989329821","heartbeat_front_addr":"172.21.15.157:6821/989329821","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":3841016811},{"type":"v1","addr":"172.21.15.187:6801","nonce":3841016811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6803","nonce":3841016811},{"type":"v1","addr":"172.21.15.187:6804","nonce":3841016811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6809","nonce":3841016811},{"type":"v1","addr":"172.21.15.187:6811","nonce":3841016811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":3841016811},{"type":"v1","addr":"172.21.15.187:6808","nonce":3841016811}]},"public_addr":"172.21.15.187:6801/3841016811","cluster_addr":"172.21.15.187:6804/3841016811","heartbeat_back_addr":"172.21.15.187:6811/3841016811","heartbeat_front_addr":"172.21.15.187:6808/3841016811","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":915130263},{"type":"v1","addr":"172.21.15.187:6805","nonce":915130263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6807","nonce":915130263},{"type":"v1","addr":"172.21.15.187:6810","nonce":915130263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":915130263},{"type":"v1","addr":"172.21.15.187:6815","nonce":915130263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":915130263},{"type":"v1","addr":"172.21.15.187:6813","nonce":915130263}]},"public_addr":"172.21.15.187:6805/915130263","cluster_addr":"172.21.15.187:6810/915130263","heartbeat_back_addr":"172.21.15.187:6815/915130263","heartbeat_front_addr":"172.21.15.187:6813/915130263","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":654976824},{"type":"v1","addr":"172.21.15.187:6817","nonce":654976824}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":654976824},{"type":"v1","addr":"172.21.15.187:6819","nonce":654976824}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":654976824},{"type":"v1","addr":"172.21.15.187:6823","nonce":654976824}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":654976824},{"type":"v1","addr":"172.21.15.187:6821","nonce":654976824}]},"public_addr":"172.21.15.187:6817/654976824","cluster_addr":"172.21.15.187:6819/654976824","heartbeat_back_addr":"172.21.15.187:6823/654976824","heartbeat_front_addr":"172.21.15.187:6821/654976824","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":4284059445},{"type":"v1","addr":"172.21.15.187:6825","nonce":4284059445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":4284059445},{"type":"v1","addr":"172.21.15.187:6827","nonce":4284059445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":4284059445},{"type":"v1","addr":"172.21.15.187:6831","nonce":4284059445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":4284059445},{"type":"v1","addr":"172.21.15.187:6829","nonce":4284059445}]},"public_addr":"172.21.15.187:6825/4284059445","cluster_addr":"172.21.15.187:6827/4284059445","heartbeat_back_addr":"172.21.15.187:6831/4284059445","heartbeat_front_addr":"172.21.15.187:6829/4284059445","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.819780+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.824193+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.849575+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.824806+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.809540+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.805093+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.866109+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.807372+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T19:58:05.956 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:05.954+0000 7f573196e700 1 -- 172.21.15.157:0/381197753 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f571806af00 msgr2=0x7f571806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:05.957 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:05.954+0000 7f573196e700 1 --2- 172.21.15.157:0/381197753 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f571806af00 0x7f571806d3c0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f572c0ad980 tx=0x7f5720008040 comp rx=0 tx=0).stop 2023-10-16T19:58:05.957 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:05.954+0000 7f573196e700 1 -- 172.21.15.157:0/381197753 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f572c0701d0 msgr2=0x7f572c0c80b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:05.957 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:05.954+0000 7f573196e700 1 --2- 172.21.15.157:0/381197753 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f572c0701d0 0x7f572c0c80b0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f571c000c00 tx=0x7f571c004750 comp rx=0 tx=0).stop 2023-10-16T19:58:05.957 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:05.954+0000 7f573196e700 1 -- 172.21.15.157:0/381197753 shutdown_connections 2023-10-16T19:58:05.957 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:05.954+0000 7f573196e700 1 --2- 172.21.15.157:0/381197753 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f571806af00 0x7f571806d3c0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:05.958 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:05.954+0000 7f573196e700 1 --2- 172.21.15.157:0/381197753 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f572c161450 0x7f572c1589c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:05.958 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:05.954+0000 7f573196e700 1 --2- 172.21.15.157:0/381197753 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f572c0701d0 0x7f572c0c80b0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:05.958 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:05.954+0000 7f573196e700 1 --2- 172.21.15.157:0/381197753 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f572c0ceed0 0x7f572c0b2ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:05.958 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:05.954+0000 7f573196e700 1 -- 172.21.15.157:0/381197753 >> 172.21.15.157:0/381197753 conn(0x7f572c06e240 msgr2=0x7f572c0c8c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:58:05.958 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:05.954+0000 7f573196e700 1 -- 172.21.15.157:0/381197753 shutdown_connections 2023-10-16T19:58:05.959 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:05.954+0000 7f573196e700 1 -- 172.21.15.157:0/381197753 wait complete. 2023-10-16T19:58:05.969 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T19:58:06.088 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:06.086+0000 7fd1bc2a3700 1 Processor -- start 2023-10-16T19:58:06.089 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:06.086+0000 7fd1bc2a3700 1 -- start start 2023-10-16T19:58:06.091 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:06.087+0000 7fd1bc2a3700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd1b406af60 0x7fd1b406d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:06.091 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:06.087+0000 7fd1bc2a3700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fd1b406de00 0x7fd1b40ce910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:06.091 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:06.087+0000 7fd1bc2a3700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1b40d08b0 con 0x7fd1b415e2f0 2023-10-16T19:58:06.091 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:06.087+0000 7fd1bc2a3700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1b41628f0 con 0x7fd1b406de00 2023-10-16T19:58:06.092 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:06.087+0000 7fd1bc2a3700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1b4162bd0 con 0x7fd1b406af60 2023-10-16T19:58:06.092 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:06.087+0000 7fd1ba840700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fd1b406de00 0x7fd1b40ce910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:06.092 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:06.087+0000 7fd1ba840700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fd1b406de00 0x7fd1b40ce910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:47576/0 (socket says 172.21.15.157:47576) 2023-10-16T19:58:06.092 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:06.087+0000 7fd1ba840700 1 -- 172.21.15.157:0/191768178 learned_addr learned my addr 172.21.15.157:0/191768178 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:58:06.092 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:06.087+0000 7fd1ba03f700 1 --1- 172.21.15.157:0/191768178 >> v1:172.21.15.157:6789/0 conn(0x7fd1b415e2f0 0x7fd1b406a850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:57244/0 (socket says 172.21.15.157:57244) 2023-10-16T19:58:06.093 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:06.087+0000 7fd1b983e700 1 --2- 172.21.15.157:0/191768178 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd1b406af60 0x7fd1b406d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:06.093 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:06.087+0000 7fd1ba840700 1 -- 172.21.15.157:0/191768178 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd1b406af60 msgr2=0x7fd1b406d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:58:06.093 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:06.087+0000 7fd1ba840700 1 --2- 172.21.15.157:0/191768178 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd1b406af60 0x7fd1b406d0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:06.093 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:06.087+0000 7fd1ba840700 1 -- 172.21.15.157:0/191768178 >> v1:172.21.15.157:6789/0 conn(0x7fd1b415e2f0 legacy=0x7fd1b406a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:06.093 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:06.087+0000 7fd1ba840700 1 -- 172.21.15.157:0/191768178 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1b40d05d0 con 0x7fd1b406de00 2023-10-16T19:58:06.094 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:06.087+0000 7fd1b903d700 1 -- 172.21.15.157:0/191768178 <== mon.0 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3804466712 0 0) 0x7fd1b40d08b0 con 0x7fd1b415e2f0 2023-10-16T19:58:06.094 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:06.087+0000 7fd1ba840700 1 --2- 172.21.15.157:0/191768178 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd1b406de00 0x7fd1b40ce910 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fd1ac009e50 tx=0x7fd1ac00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcc48db5a558ee06 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:58:06.094 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:06.088+0000 7fd1b903d700 1 -- 172.21.15.157:0/191768178 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1ac00e070 con 0x7fd1b406de00 2023-10-16T19:58:06.094 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:06.088+0000 7fd1b903d700 1 -- 172.21.15.157:0/191768178 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1ac00b9c0 con 0x7fd1b406de00 2023-10-16T19:58:06.094 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:06.088+0000 7fd1b903d700 1 -- 172.21.15.157:0/191768178 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1ac00bd70 con 0x7fd1b406de00 2023-10-16T19:58:06.095 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:06.088+0000 7fd1bc2a3700 1 -- 172.21.15.157:0/191768178 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd1b406de00 msgr2=0x7fd1b40ce910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:06.095 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:06.088+0000 7fd1bc2a3700 1 --2- 172.21.15.157:0/191768178 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd1b406de00 0x7fd1b40ce910 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fd1ac009e50 tx=0x7fd1ac00b330 comp rx=0 tx=0).stop 2023-10-16T19:58:06.095 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:06.088+0000 7fd1bc2a3700 1 -- 172.21.15.157:0/191768178 shutdown_connections 2023-10-16T19:58:06.095 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:06.088+0000 7fd1bc2a3700 1 --2- 172.21.15.157:0/191768178 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd1b406de00 0x7fd1b40ce910 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:06.095 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:06.088+0000 7fd1bc2a3700 1 --2- 172.21.15.157:0/191768178 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd1b406af60 0x7fd1b406d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:06.096 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:06.088+0000 7fd1bc2a3700 1 -- 172.21.15.157:0/191768178 >> 172.21.15.157:0/191768178 conn(0x7fd1b40cd4e0 msgr2=0x7fd1b40cd8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:58:06.096 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:06.088+0000 7fd1bc2a3700 1 -- 172.21.15.157:0/191768178 shutdown_connections 2023-10-16T19:58:06.096 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:06.088+0000 7fd1bc2a3700 1 -- 172.21.15.157:0/191768178 wait complete. 2023-10-16T19:58:06.099 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:06.089+0000 7fd1bc2a3700 1 Processor -- start 2023-10-16T19:58:06.099 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:06.089+0000 7fd1bc2a3700 1 -- start start 2023-10-16T19:58:06.099 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:06.090+0000 7fd1bc2a3700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd1b406af60 0x7fd1b4158d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:06.100 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:06.090+0000 7fd1bc2a3700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd1b406de00 0x7fd1b4159b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:06.100 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:06.090+0000 7fd1bc2a3700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd1b415e2f0 0x7fd1b415a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:06.100 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:06.090+0000 7fd1bc2a3700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1b4159290 con 0x7fd1b406de00 2023-10-16T19:58:06.100 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:06.090+0000 7fd1bc2a3700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1b40b36d0 con 0x7fd1b415e2f0 2023-10-16T19:58:06.100 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:06.090+0000 7fd1bc2a3700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1b415f710 con 0x7fd1b406af60 2023-10-16T19:58:06.101 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:06.090+0000 7fd1b983e700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd1b406de00 0x7fd1b4159b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:06.101 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:06.090+0000 7fd1b983e700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd1b406de00 0x7fd1b4159b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:47582/0 (socket says 172.21.15.157:47582) 2023-10-16T19:58:06.101 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:06.090+0000 7fd1b983e700 1 -- 172.21.15.157:0/887412920 learned_addr learned my addr 172.21.15.157:0/887412920 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:58:06.101 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:06.090+0000 7fd1ba03f700 1 --2- 172.21.15.157:0/887412920 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd1b406af60 0x7fd1b4158d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:06.101 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:06.090+0000 7fd1ba840700 1 --2- 172.21.15.157:0/887412920 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd1b415e2f0 0x7fd1b415a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:06.102 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:06.090+0000 7fd1b983e700 1 -- 172.21.15.157:0/887412920 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd1b406af60 msgr2=0x7fd1b4158d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:06.102 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:06.090+0000 7fd1b983e700 1 --2- 172.21.15.157:0/887412920 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd1b406af60 0x7fd1b4158d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:06.102 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:06.091+0000 7fd1b983e700 1 -- 172.21.15.157:0/887412920 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd1b415e2f0 msgr2=0x7fd1b415a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:06.102 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:06.091+0000 7fd1b983e700 1 --2- 172.21.15.157:0/887412920 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd1b415e2f0 0x7fd1b415a0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:06.102 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:06.091+0000 7fd1b983e700 1 -- 172.21.15.157:0/887412920 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1ac009b30 con 0x7fd1b406de00 2023-10-16T19:58:06.103 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:06.091+0000 7fd1ba03f700 1 --2- 172.21.15.157:0/887412920 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd1b406af60 0x7fd1b4158d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T19:58:06.103 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:06.091+0000 7fd1b983e700 1 --2- 172.21.15.157:0/887412920 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd1b406de00 0x7fd1b4159b60 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fd1a400d800 tx=0x7fd1a400dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:58:06.103 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:06.091+0000 7fd1aaffd700 1 -- 172.21.15.157:0/887412920 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1a40125f0 con 0x7fd1b406de00 2023-10-16T19:58:06.103 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:06.091+0000 7fd1aaffd700 1 -- 172.21.15.157:0/887412920 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1a4012750 con 0x7fd1b406de00 2023-10-16T19:58:06.103 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:06.091+0000 7fd1bc2a3700 1 -- 172.21.15.157:0/887412920 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1b40b3920 con 0x7fd1b406de00 2023-10-16T19:58:06.104 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:06.091+0000 7fd1aaffd700 1 -- 172.21.15.157:0/887412920 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1a4012b00 con 0x7fd1b406de00 2023-10-16T19:58:06.104 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:06.091+0000 7fd1bc2a3700 1 -- 172.21.15.157:0/887412920 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1b40b3ee0 con 0x7fd1b406de00 2023-10-16T19:58:06.104 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:06.092+0000 7fd1bc2a3700 1 -- 172.21.15.157:0/887412920 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1b40b40a0 con 0x7fd1b406de00 2023-10-16T19:58:06.104 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:06.092+0000 7fd1aaffd700 1 -- 172.21.15.157:0/887412920 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fd1a4012c60 con 0x7fd1b406de00 2023-10-16T19:58:06.104 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:06.092+0000 7fd1aaffd700 1 --2- 172.21.15.157:0/887412920 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fd19806af00 0x7fd19806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:06.105 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:06.093+0000 7fd1aaffd700 1 -- 172.21.15.157:0/887412920 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5729+0+0 (secure 0 0 0) 0x7fd1a4089a30 con 0x7fd1b406de00 2023-10-16T19:58:06.105 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:06.093+0000 7fd1ba03f700 1 --2- 172.21.15.157:0/887412920 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fd19806af00 0x7fd19806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:06.105 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:06.093+0000 7fd1ba03f700 1 --2- 172.21.15.157:0/887412920 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fd19806af00 0x7fd19806d3c0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fd1b0000f60 tx=0x7fd1b0007cc0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:58:06.105 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:06.097+0000 7fd1aaffd700 1 -- 172.21.15.157:0/887412920 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd1a4054a30 con 0x7fd1b406de00 2023-10-16T19:58:06.290 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:06.288+0000 7fd1bc2a3700 1 -- 172.21.15.157:0/887412920 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd1b404f400 con 0x7fd1b406de00 2023-10-16T19:58:06.291 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:06.289+0000 7fd1aaffd700 1 -- 172.21.15.157:0/887412920 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) v1 ==== 74+0+16614 (secure 0 0 0) 0x7fd1a4081e60 con 0x7fd1b406de00 2023-10-16T19:58:06.292 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-10-16T19:58:06.292 INFO:teuthology.orchestra.run.smithi157.stdout:{"epoch":32,"fsid":"28199dc9-64d5-479e-83c6-21f097c33d39","created":"2023-10-16T19:56:49.201889+0000","modified":"2023-10-16T19:58:04.971749+0000","last_up_change":"2023-10-16T19:56:54.675673+0000","last_in_change":"2023-10-16T19:56:51.666728+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T19:56:56.932895+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"testcephfs1_metadata","create_time":"2023-10-16T19:58:02.774777+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"testcephfs1"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"testcephfs1_data","create_time":"2023-10-16T19:58:03.939912+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"testcephfs1"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":335785898},{"type":"v1","addr":"172.21.15.157:6809","nonce":335785898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":335785898},{"type":"v1","addr":"172.21.15.157:6811","nonce":335785898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6815","nonce":335785898},{"type":"v1","addr":"172.21.15.157:6817","nonce":335785898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":335785898},{"type":"v1","addr":"172.21.15.157:6813","nonce":335785898}]},"public_addr":"172.21.15.157:6809/335785898","cluster_addr":"172.21.15.157:6811/335785898","heartbeat_back_addr":"172.21.15.157:6817/335785898","heartbeat_front_addr":"172.21.15.157:6813/335785898","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":3482825047},{"type":"v1","addr":"172.21.15.157:6801","nonce":3482825047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":3482825047},{"type":"v1","addr":"172.21.15.157:6803","nonce":3482825047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":3482825047},{"type":"v1","addr":"172.21.15.157:6807","nonce":3482825047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":3482825047},{"type":"v1","addr":"172.21.15.157:6805","nonce":3482825047}]},"public_addr":"172.21.15.157:6801/3482825047","cluster_addr":"172.21.15.157:6803/3482825047","heartbeat_back_addr":"172.21.15.157:6807/3482825047","heartbeat_front_addr":"172.21.15.157:6805/3482825047","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":1118292389},{"type":"v1","addr":"172.21.15.157:6825","nonce":1118292389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":1118292389},{"type":"v1","addr":"172.21.15.157:6827","nonce":1118292389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":1118292389},{"type":"v1","addr":"172.21.15.157:6831","nonce":1118292389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":1118292389},{"type":"v1","addr":"172.21.15.157:6829","nonce":1118292389}]},"public_addr":"172.21.15.157:6825/1118292389","cluster_addr":"172.21.15.157:6827/1118292389","heartbeat_back_addr":"172.21.15.157:6831/1118292389","heartbeat_front_addr":"172.21.15.157:6829/1118292389","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":989329821},{"type":"v1","addr":"172.21.15.157:6816","nonce":989329821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":989329821},{"type":"v1","addr":"172.21.15.157:6819","nonce":989329821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":989329821},{"type":"v1","addr":"172.21.15.157:6823","nonce":989329821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":989329821},{"type":"v1","addr":"172.21.15.157:6821","nonce":989329821}]},"public_addr":"172.21.15.157:6816/989329821","cluster_addr":"172.21.15.157:6819/989329821","heartbeat_back_addr":"172.21.15.157:6823/989329821","heartbeat_front_addr":"172.21.15.157:6821/989329821","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":3841016811},{"type":"v1","addr":"172.21.15.187:6801","nonce":3841016811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6803","nonce":3841016811},{"type":"v1","addr":"172.21.15.187:6804","nonce":3841016811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6809","nonce":3841016811},{"type":"v1","addr":"172.21.15.187:6811","nonce":3841016811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":3841016811},{"type":"v1","addr":"172.21.15.187:6808","nonce":3841016811}]},"public_addr":"172.21.15.187:6801/3841016811","cluster_addr":"172.21.15.187:6804/3841016811","heartbeat_back_addr":"172.21.15.187:6811/3841016811","heartbeat_front_addr":"172.21.15.187:6808/3841016811","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":915130263},{"type":"v1","addr":"172.21.15.187:6805","nonce":915130263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6807","nonce":915130263},{"type":"v1","addr":"172.21.15.187:6810","nonce":915130263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":915130263},{"type":"v1","addr":"172.21.15.187:6815","nonce":915130263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":915130263},{"type":"v1","addr":"172.21.15.187:6813","nonce":915130263}]},"public_addr":"172.21.15.187:6805/915130263","cluster_addr":"172.21.15.187:6810/915130263","heartbeat_back_addr":"172.21.15.187:6815/915130263","heartbeat_front_addr":"172.21.15.187:6813/915130263","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":654976824},{"type":"v1","addr":"172.21.15.187:6817","nonce":654976824}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":654976824},{"type":"v1","addr":"172.21.15.187:6819","nonce":654976824}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":654976824},{"type":"v1","addr":"172.21.15.187:6823","nonce":654976824}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":654976824},{"type":"v1","addr":"172.21.15.187:6821","nonce":654976824}]},"public_addr":"172.21.15.187:6817/654976824","cluster_addr":"172.21.15.187:6819/654976824","heartbeat_back_addr":"172.21.15.187:6823/654976824","heartbeat_front_addr":"172.21.15.187:6821/654976824","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":4284059445},{"type":"v1","addr":"172.21.15.187:6825","nonce":4284059445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":4284059445},{"type":"v1","addr":"172.21.15.187:6827","nonce":4284059445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":4284059445},{"type":"v1","addr":"172.21.15.187:6831","nonce":4284059445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":4284059445},{"type":"v1","addr":"172.21.15.187:6829","nonce":4284059445}]},"public_addr":"172.21.15.187:6825/4284059445","cluster_addr":"172.21.15.187:6827/4284059445","heartbeat_back_addr":"172.21.15.187:6831/4284059445","heartbeat_front_addr":"172.21.15.187:6829/4284059445","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.819780+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.824193+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.849575+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.824806+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.809540+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.805093+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.866109+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.807372+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T19:58:06.293 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:06.291+0000 7fd1bc2a3700 1 -- 172.21.15.157:0/887412920 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fd19806af00 msgr2=0x7fd19806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:06.294 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:06.291+0000 7fd1bc2a3700 1 --2- 172.21.15.157:0/887412920 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fd19806af00 0x7fd19806d3c0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fd1b0000f60 tx=0x7fd1b0007cc0 comp rx=0 tx=0).stop 2023-10-16T19:58:06.294 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:06.291+0000 7fd1bc2a3700 1 -- 172.21.15.157:0/887412920 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd1b406de00 msgr2=0x7fd1b4159b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:06.294 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:06.291+0000 7fd1bc2a3700 1 --2- 172.21.15.157:0/887412920 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd1b406de00 0x7fd1b4159b60 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fd1a400d800 tx=0x7fd1a400dbc0 comp rx=0 tx=0).stop 2023-10-16T19:58:06.294 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:06.291+0000 7fd1bc2a3700 1 -- 172.21.15.157:0/887412920 shutdown_connections 2023-10-16T19:58:06.295 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:06.291+0000 7fd1bc2a3700 1 --2- 172.21.15.157:0/887412920 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fd19806af00 0x7fd19806d3c0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:06.295 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:06.291+0000 7fd1bc2a3700 1 --2- 172.21.15.157:0/887412920 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd1b415e2f0 0x7fd1b415a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:06.295 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:06.291+0000 7fd1bc2a3700 1 --2- 172.21.15.157:0/887412920 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd1b406af60 0x7fd1b4158d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:06.295 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:06.291+0000 7fd1bc2a3700 1 --2- 172.21.15.157:0/887412920 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd1b406de00 0x7fd1b4159b60 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:06.295 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:06.291+0000 7fd1bc2a3700 1 -- 172.21.15.157:0/887412920 >> 172.21.15.157:0/887412920 conn(0x7fd1b40cd4e0 msgr2=0x7fd1b406eb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:58:06.296 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:06.291+0000 7fd1bc2a3700 1 -- 172.21.15.157:0/887412920 shutdown_connections 2023-10-16T19:58:06.296 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:06.291+0000 7fd1bc2a3700 1 -- 172.21.15.157:0/887412920 wait complete. 2023-10-16T19:58:06.307 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set testcephfs1 standby_count_wanted 0 2023-10-16T19:58:06.431 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:06.428+0000 7f3367ff5700 1 Processor -- start 2023-10-16T19:58:06.431 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:06.429+0000 7f3367ff5700 1 -- start start 2023-10-16T19:58:06.435 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:06.429+0000 7f3367ff5700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3360154920 0x7f336006a850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:06.435 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:06.429+0000 7f3367ff5700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f336006beb0 con 0x7f33600cb010 2023-10-16T19:58:06.436 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:06.429+0000 7f3367ff5700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f336006b2a0 con 0x7f336006ad90 2023-10-16T19:58:06.436 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:06.429+0000 7f3367ff5700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33600cfd60 con 0x7f3360154920 2023-10-16T19:58:06.436 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:06.430+0000 7f3366592700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f33600cb010 0x7f336015ab70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:57262/0 (socket says 172.21.15.157:57262) 2023-10-16T19:58:06.436 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:06.430+0000 7f3366592700 1 -- 172.21.15.157:0/1939777950 learned_addr learned my addr 172.21.15.157:0/1939777950 (peer_addr_for_me v1:172.21.15.157:0/0) 2023-10-16T19:58:06.436 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:06.430+0000 7f3365d91700 1 --2- 172.21.15.157:0/1939777950 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3360154920 0x7f336006a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:06.437 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:06.430+0000 7f3364d8f700 1 -- 172.21.15.157:0/1939777950 <== mon.0 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3047008413 0 0) 0x7f336006beb0 con 0x7f33600cb010 2023-10-16T19:58:06.437 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:06.430+0000 7f3364d8f700 1 -- 172.21.15.157:0/1939777950 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f334c0035b0 con 0x7f33600cb010 2023-10-16T19:58:06.437 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:06.430+0000 7f3364d8f700 1 -- 172.21.15.157:0/1939777950 <== mon.0 v1:172.21.15.157:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2311679495 0 0) 0x7f334c0035b0 con 0x7f33600cb010 2023-10-16T19:58:06.437 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:06.430+0000 7f3364d8f700 1 -- 172.21.15.157:0/1939777950 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3360154920 msgr2=0x7f336006a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:58:06.437 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:06.430+0000 7f3364d8f700 1 --2- 172.21.15.157:0/1939777950 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3360154920 0x7f336006a850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:06.438 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:06.430+0000 7f3364d8f700 1 -- 172.21.15.157:0/1939777950 >> v1:172.21.15.187:6789/0 conn(0x7f336006ad90 legacy=0x7f33600ca900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:06.438 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:06.430+0000 7f3364d8f700 1 -- 172.21.15.157:0/1939777950 --> v1:172.21.15.157:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f336006b580 con 0x7f33600cb010 2023-10-16T19:58:06.438 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:06.430+0000 7f3364d8f700 1 -- 172.21.15.157:0/1939777950 <== mon.0 v1:172.21.15.157:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4021145519 0 0) 0x7f33580019f0 con 0x7f33600cb010 2023-10-16T19:58:06.438 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:06.430+0000 7f3364d8f700 1 -- 172.21.15.157:0/1939777950 >> v1:172.21.15.157:6789/0 conn(0x7f33600cb010 legacy=0x7f336015ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:06.438 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:06.430+0000 7f3364d8f700 1 --2- 172.21.15.157:0/1939777950 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3360154920 0x7f334c003a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:06.439 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:06.430+0000 7f3364d8f700 1 --2- 172.21.15.157:0/1939777950 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f334c003fb0 0x7f334c004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:06.439 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:06.430+0000 7f3364d8f700 1 --2- 172.21.15.157:0/1939777950 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f334c004d90 0x7f334c005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:06.439 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:06.430+0000 7f3364d8f700 1 -- 172.21.15.157:0/1939777950 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33600cfd60 con 0x7f334c004d90 2023-10-16T19:58:06.439 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:06.430+0000 7f3364d8f700 1 -- 172.21.15.157:0/1939777950 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f334c00baf0 con 0x7f334c003fb0 2023-10-16T19:58:06.439 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:06.430+0000 7f3364d8f700 1 -- 172.21.15.157:0/1939777950 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f334c00bcb0 con 0x7f3360154920 2023-10-16T19:58:06.440 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:06.430+0000 7f3366592700 1 --2- 172.21.15.157:0/1939777950 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f334c004d90 0x7f334c005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:06.440 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:06.430+0000 7f3365d91700 1 --2- 172.21.15.157:0/1939777950 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3360154920 0x7f334c003a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:06.440 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:06.430+0000 7f3365590700 1 --2- 172.21.15.157:0/1939777950 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f334c003fb0 0x7f334c004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:06.440 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:06.431+0000 7f3366592700 1 -- 172.21.15.157:0/1939777950 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3360154920 msgr2=0x7f334c003a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:58:06.440 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:06.431+0000 7f3366592700 1 --2- 172.21.15.157:0/1939777950 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3360154920 0x7f334c003a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:06.440 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:06.431+0000 7f3366592700 1 -- 172.21.15.157:0/1939777950 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f334c003fb0 msgr2=0x7f334c004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:58:06.441 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:06.431+0000 7f3366592700 1 --2- 172.21.15.157:0/1939777950 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f334c003fb0 0x7f334c004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:06.441 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:06.431+0000 7f3366592700 1 -- 172.21.15.157:0/1939777950 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f334c0035b0 con 0x7f334c004d90 2023-10-16T19:58:06.441 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:06.431+0000 7f3366592700 1 --2- 172.21.15.157:0/1939777950 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f334c004d90 0x7f334c005210 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f336006d320 tx=0x7f334c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ca87a3a7f41b0a5 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:58:06.441 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:06.431+0000 7f3364d8f700 1 -- 172.21.15.157:0/1939777950 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3358012600 con 0x7f334c004d90 2023-10-16T19:58:06.441 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:06.431+0000 7f3364d8f700 1 -- 172.21.15.157:0/1939777950 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3358012760 con 0x7f334c004d90 2023-10-16T19:58:06.442 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:06.431+0000 7f3364d8f700 1 -- 172.21.15.157:0/1939777950 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3358012ad0 con 0x7f334c004d90 2023-10-16T19:58:06.442 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:06.431+0000 7f3367ff5700 1 -- 172.21.15.157:0/1939777950 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f334c004d90 msgr2=0x7f334c005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:06.442 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:06.431+0000 7f3367ff5700 1 --2- 172.21.15.157:0/1939777950 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f334c004d90 0x7f334c005210 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f336006d320 tx=0x7f334c005880 comp rx=0 tx=0).stop 2023-10-16T19:58:06.442 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:06.431+0000 7f3366592700 1 -- 172.21.15.157:0/1939777950 reap_dead start 2023-10-16T19:58:06.442 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:06.431+0000 7f3367ff5700 1 -- 172.21.15.157:0/1939777950 shutdown_connections 2023-10-16T19:58:06.443 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:06.431+0000 7f3367ff5700 1 -- 172.21.15.157:0/1939777950 >> 172.21.15.157:0/1939777950 conn(0x7f336006c7e0 msgr2=0x7f336006cbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:58:06.443 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:06.432+0000 7f3367ff5700 1 -- 172.21.15.157:0/1939777950 shutdown_connections 2023-10-16T19:58:06.443 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:06.432+0000 7f3367ff5700 1 -- 172.21.15.157:0/1939777950 wait complete. 2023-10-16T19:58:06.444 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:06.433+0000 7f3367ff5700 1 Processor -- start 2023-10-16T19:58:06.444 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:06.433+0000 7f3367ff5700 1 -- start start 2023-10-16T19:58:06.447 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:06.433+0000 7f3367ff5700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f334c004d90 0x7f33600c3de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:06.448 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:06.433+0000 7f3367ff5700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f33601e1320 0x7f33601e0710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:06.448 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:06.433+0000 7f3367ff5700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3360152210 0x7f33601e0c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:06.448 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:06.433+0000 7f3367ff5700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33600c4730 con 0x7f3360152210 2023-10-16T19:58:06.448 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:06.433+0000 7f3367ff5700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33600c4a10 con 0x7f33601e1320 2023-10-16T19:58:06.449 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:06.433+0000 7f3367ff5700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33600c4cf0 con 0x7f334c004d90 2023-10-16T19:58:06.449 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:06.434+0000 7f3366592700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3360152210 0x7f33601e0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:06.449 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:06.434+0000 7f3366592700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3360152210 0x7f33601e0c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:47602/0 (socket says 172.21.15.157:47602) 2023-10-16T19:58:06.449 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:06.434+0000 7f3366592700 1 -- 172.21.15.157:0/2975038831 learned_addr learned my addr 172.21.15.157:0/2975038831 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:58:06.449 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:06.434+0000 7f3365d91700 1 --2- 172.21.15.157:0/2975038831 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f334c004d90 0x7f33600c3de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:06.450 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:06.434+0000 7f3365590700 1 --2- 172.21.15.157:0/2975038831 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f33601e1320 0x7f33601e0710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:06.450 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:06.434+0000 7f3366592700 1 -- 172.21.15.157:0/2975038831 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f334c004d90 msgr2=0x7f33600c3de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:06.450 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:06.434+0000 7f3366592700 1 --2- 172.21.15.157:0/2975038831 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f334c004d90 0x7f33600c3de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:06.450 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:06.434+0000 7f3366592700 1 -- 172.21.15.157:0/2975038831 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f33601e1320 msgr2=0x7f33601e0710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:06.450 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:06.434+0000 7f3366592700 1 --2- 172.21.15.157:0/2975038831 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f33601e1320 0x7f33601e0710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:06.451 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:06.434+0000 7f3366592700 1 -- 172.21.15.157:0/2975038831 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33600c4fd0 con 0x7f3360152210 2023-10-16T19:58:06.451 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:06.434+0000 7f3366592700 1 --2- 172.21.15.157:0/2975038831 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3360152210 0x7f33601e0c50 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f3358012000 tx=0x7f336015a940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:58:06.451 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:06.434+0000 7f33567fc700 1 -- 172.21.15.157:0/2975038831 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f335801e630 con 0x7f3360152210 2023-10-16T19:58:06.451 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:06.434+0000 7f33567fc700 1 -- 172.21.15.157:0/2975038831 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f335801e790 con 0x7f3360152210 2023-10-16T19:58:06.451 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:06.434+0000 7f3367ff5700 1 -- 172.21.15.157:0/2975038831 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33600c52b0 con 0x7f3360152210 2023-10-16T19:58:06.452 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:06.434+0000 7f33567fc700 1 -- 172.21.15.157:0/2975038831 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f335801eb40 con 0x7f3360152210 2023-10-16T19:58:06.452 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:06.434+0000 7f3367ff5700 1 -- 172.21.15.157:0/2975038831 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33600c4500 con 0x7f3360152210 2023-10-16T19:58:06.452 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:06.435+0000 7f3367ff5700 1 -- 172.21.15.157:0/2975038831 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33600c54d0 con 0x7f3360152210 2023-10-16T19:58:06.452 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:06.436+0000 7f33567fc700 1 -- 172.21.15.157:0/2975038831 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f335801eca0 con 0x7f3360152210 2023-10-16T19:58:06.452 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:06.436+0000 7f33567fc700 1 --2- 172.21.15.157:0/2975038831 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f334406af30 0x7f334406d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:06.452 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:06.436+0000 7f33567fc700 1 -- 172.21.15.157:0/2975038831 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5729+0+0 (secure 0 0 0) 0x7f335808b600 con 0x7f3360152210 2023-10-16T19:58:06.453 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:06.436+0000 7f3365d91700 1 --2- 172.21.15.157:0/2975038831 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f334406af30 0x7f334406d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:06.453 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:06.437+0000 7f3365d91700 1 --2- 172.21.15.157:0/2975038831 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f334406af30 0x7f334406d3f0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f335000ae00 tx=0x7f335000a320 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:58:06.453 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:06.441+0000 7f33567fc700 1 -- 172.21.15.157:0/2975038831 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3358056840 con 0x7f3360152210 2023-10-16T19:58:06.677 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:06.674+0000 7f3367ff5700 1 -- 172.21.15.157:0/2975038831 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "testcephfs1", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f336006a850 con 0x7f3360152210 2023-10-16T19:58:07.100 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T19:58:07.102 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T19:58:07.618 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:07.615+0000 7f33567fc700 1 -- 172.21.15.157:0/2975038831 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "testcephfs1", "var": "standby_count_wanted", "val": "0"}]=0 v16) v1 ==== 123+0+0 (secure 0 0 0) 0x7f3358059e60 con 0x7f3360152210 2023-10-16T19:58:07.621 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:07.618+0000 7f3367ff5700 1 -- 172.21.15.157:0/2975038831 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f334406af30 msgr2=0x7f334406d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:07.621 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:07.618+0000 7f3367ff5700 1 --2- 172.21.15.157:0/2975038831 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f334406af30 0x7f334406d3f0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f335000ae00 tx=0x7f335000a320 comp rx=0 tx=0).stop 2023-10-16T19:58:07.622 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:07.618+0000 7f3367ff5700 1 -- 172.21.15.157:0/2975038831 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3360152210 msgr2=0x7f33601e0c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:07.622 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:07.618+0000 7f3367ff5700 1 --2- 172.21.15.157:0/2975038831 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3360152210 0x7f33601e0c50 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f3358012000 tx=0x7f336015a940 comp rx=0 tx=0).stop 2023-10-16T19:58:07.622 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:07.619+0000 7f3367ff5700 1 -- 172.21.15.157:0/2975038831 shutdown_connections 2023-10-16T19:58:07.622 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:07.619+0000 7f3367ff5700 1 --2- 172.21.15.157:0/2975038831 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3360152210 0x7f33601e0c50 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:07.623 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:07.619+0000 7f3367ff5700 1 --2- 172.21.15.157:0/2975038831 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f334c004d90 0x7f33600c3de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:07.623 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:07.619+0000 7f3367ff5700 1 --2- 172.21.15.157:0/2975038831 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f334406af30 0x7f334406d3f0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:07.623 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:07.619+0000 7f3367ff5700 1 --2- 172.21.15.157:0/2975038831 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f33601e1320 0x7f33601e0710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:07.623 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:07.619+0000 7f3367ff5700 1 -- 172.21.15.157:0/2975038831 >> 172.21.15.157:0/2975038831 conn(0x7f336006c7e0 msgr2=0x7f3360153d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:58:07.623 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:07.619+0000 7f3367ff5700 1 -- 172.21.15.157:0/2975038831 shutdown_connections 2023-10-16T19:58:07.623 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:07.619+0000 7f3367ff5700 1 -- 172.21.15.157:0/2975038831 wait complete. 2023-10-16T19:58:07.636 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-10-16T19:58:07.636 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set testcephfs1 allow_standby_replay false 2023-10-16T19:58:07.766 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:07.764+0000 7f3b88645700 1 Processor -- start 2023-10-16T19:58:07.766 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:07.764+0000 7f3b88645700 1 -- start start 2023-10-16T19:58:07.769 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:07.765+0000 7f3b88645700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f3b8015e090 0x7f3b8006b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:07.769 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:07.765+0000 7f3b88645700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3b800b0190 0x7f3b8015e470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:07.769 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:07.765+0000 7f3b88645700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b8006b6a0 con 0x7f3b8006ea10 2023-10-16T19:58:07.769 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:07.765+0000 7f3b88645700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b80071b50 con 0x7f3b8015e090 2023-10-16T19:58:07.769 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:07.765+0000 7f3b88645700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b80072320 con 0x7f3b800b0190 2023-10-16T19:58:07.770 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:07.765+0000 7f3b85be0700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f3b8006ea10 0x7f3b800afa80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:57278/0 (socket says 172.21.15.157:57278) 2023-10-16T19:58:07.770 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:07.765+0000 7f3b85be0700 1 -- 172.21.15.157:0/3397364872 learned_addr learned my addr 172.21.15.157:0/3397364872 (peer_addr_for_me v1:172.21.15.157:0/0) 2023-10-16T19:58:07.770 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:07.765+0000 7f3b86be2700 1 --2- 172.21.15.157:0/3397364872 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3b800b0190 0x7f3b8015e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:07.771 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:07.765+0000 7f3b863e1700 1 --2- 172.21.15.157:0/3397364872 >> v2:172.21.15.187:3300/0 conn(0x7f3b8015e090 0x7f3b8006b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:07.771 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:07.765+0000 7f3b853df700 1 -- 172.21.15.157:0/3397364872 <== mon.0 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1929756481 0 0) 0x7f3b8006b6a0 con 0x7f3b8006ea10 2023-10-16T19:58:07.771 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:07.765+0000 7f3b853df700 1 -- 172.21.15.157:0/3397364872 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3b6c0035b0 con 0x7f3b8006ea10 2023-10-16T19:58:07.771 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:07.765+0000 7f3b86be2700 1 -- 172.21.15.157:0/3397364872 >> v2:172.21.15.187:3300/0 conn(0x7f3b8015e090 msgr2=0x7f3b8006b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:58:07.771 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:07.765+0000 7f3b86be2700 1 --2- 172.21.15.157:0/3397364872 >> v2:172.21.15.187:3300/0 conn(0x7f3b8015e090 0x7f3b8006b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:07.772 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:07.765+0000 7f3b86be2700 1 -- 172.21.15.157:0/3397364872 >> v1:172.21.15.157:6789/0 conn(0x7f3b8006ea10 legacy=0x7f3b800afa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:07.772 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:07.765+0000 7f3b86be2700 1 -- 172.21.15.157:0/3397364872 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b80071d60 con 0x7f3b800b0190 2023-10-16T19:58:07.772 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:07.765+0000 7f3b863e1700 1 --2- 172.21.15.157:0/3397364872 >> v2:172.21.15.187:3300/0 conn(0x7f3b8015e090 0x7f3b8006b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T19:58:07.772 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:07.766+0000 7f3b86be2700 1 --2- 172.21.15.157:0/3397364872 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3b800b0190 0x7f3b8015e470 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f3b78009d90 tx=0x7f3b7800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6f7ab512042247cc server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:58:07.772 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:07.766+0000 7f3b853df700 1 -- 172.21.15.157:0/3397364872 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b7800e070 con 0x7f3b800b0190 2023-10-16T19:58:07.773 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:07.766+0000 7f3b853df700 1 -- 172.21.15.157:0/3397364872 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b7800bb20 con 0x7f3b800b0190 2023-10-16T19:58:07.773 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:07.766+0000 7f3b853df700 1 -- 172.21.15.157:0/3397364872 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b78012430 con 0x7f3b800b0190 2023-10-16T19:58:07.773 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:07.766+0000 7f3b88645700 1 -- 172.21.15.157:0/3397364872 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3b800b0190 msgr2=0x7f3b8015e470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:07.773 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:07.766+0000 7f3b88645700 1 --2- 172.21.15.157:0/3397364872 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3b800b0190 0x7f3b8015e470 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f3b78009d90 tx=0x7f3b7800b330 comp rx=0 tx=0).stop 2023-10-16T19:58:07.773 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:07.766+0000 7f3b88645700 1 -- 172.21.15.157:0/3397364872 shutdown_connections 2023-10-16T19:58:07.773 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:07.766+0000 7f3b88645700 1 --2- 172.21.15.157:0/3397364872 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3b800b0190 0x7f3b8015e470 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:07.774 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:07.766+0000 7f3b88645700 1 --2- 172.21.15.157:0/3397364872 >> v2:172.21.15.187:3300/0 conn(0x7f3b8015e090 0x7f3b8006b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:07.774 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:07.766+0000 7f3b88645700 1 -- 172.21.15.157:0/3397364872 >> 172.21.15.157:0/3397364872 conn(0x7f3b800d0b30 msgr2=0x7f3b800d0f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:58:07.774 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:07.766+0000 7f3b88645700 1 -- 172.21.15.157:0/3397364872 shutdown_connections 2023-10-16T19:58:07.774 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:07.766+0000 7f3b88645700 1 -- 172.21.15.157:0/3397364872 wait complete. 2023-10-16T19:58:07.777 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:07.768+0000 7f3b88645700 1 Processor -- start 2023-10-16T19:58:07.777 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:07.768+0000 7f3b88645700 1 -- start start 2023-10-16T19:58:07.777 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:07.768+0000 7f3b88645700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3b8006ea10 0x7f3b8015a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:07.777 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:07.768+0000 7f3b88645700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3b800b0190 0x7f3b80160760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:07.777 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:07.768+0000 7f3b88645700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3b8015e090 0x7f3b80158e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:07.778 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:07.768+0000 7f3b88645700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b80159940 con 0x7f3b8006ea10 2023-10-16T19:58:07.778 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:07.768+0000 7f3b88645700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b80159c20 con 0x7f3b800b0190 2023-10-16T19:58:07.778 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:07.768+0000 7f3b88645700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b80159f00 con 0x7f3b8015e090 2023-10-16T19:58:07.778 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:07.768+0000 7f3b863e1700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3b8006ea10 0x7f3b8015a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:07.778 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:07.768+0000 7f3b863e1700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3b8006ea10 0x7f3b8015a9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:47614/0 (socket says 172.21.15.157:47614) 2023-10-16T19:58:07.779 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:07.768+0000 7f3b863e1700 1 -- 172.21.15.157:0/2979779571 learned_addr learned my addr 172.21.15.157:0/2979779571 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:58:07.779 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:07.769+0000 7f3b863e1700 1 -- 172.21.15.157:0/2979779571 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3b8015e090 msgr2=0x7f3b80158e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:07.779 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:07.769+0000 7f3b863e1700 1 --2- 172.21.15.157:0/2979779571 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3b8015e090 0x7f3b80158e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:07.779 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:07.769+0000 7f3b863e1700 1 -- 172.21.15.157:0/2979779571 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3b800b0190 msgr2=0x7f3b80160760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:07.780 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:07.769+0000 7f3b85be0700 1 --2- 172.21.15.157:0/2979779571 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3b800b0190 0x7f3b80160760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:07.781 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:07.769+0000 7f3b863e1700 1 --2- 172.21.15.157:0/2979779571 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3b800b0190 0x7f3b80160760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:07.781 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:07.769+0000 7f3b863e1700 1 -- 172.21.15.157:0/2979779571 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b7c0094a0 con 0x7f3b8006ea10 2023-10-16T19:58:07.781 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:07.769+0000 7f3b863e1700 1 --2- 172.21.15.157:0/2979779571 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3b8006ea10 0x7f3b8015a9e0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f3b7c00ebe0 tx=0x7f3b7c009e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:58:07.782 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:07.769+0000 7f3b76ffd700 1 -- 172.21.15.157:0/2979779571 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b7c00c8b0 con 0x7f3b8006ea10 2023-10-16T19:58:07.782 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:07.769+0000 7f3b88645700 1 -- 172.21.15.157:0/2979779571 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b78009a70 con 0x7f3b8006ea10 2023-10-16T19:58:07.782 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:07.769+0000 7f3b76ffd700 1 -- 172.21.15.157:0/2979779571 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b7c00ca10 con 0x7f3b8006ea10 2023-10-16T19:58:07.782 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:07.769+0000 7f3b76ffd700 1 -- 172.21.15.157:0/2979779571 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b7c00cda0 con 0x7f3b8006ea10 2023-10-16T19:58:07.782 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:07.769+0000 7f3b88645700 1 -- 172.21.15.157:0/2979779571 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b8015a4c0 con 0x7f3b8006ea10 2023-10-16T19:58:07.783 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:07.770+0000 7f3b88645700 1 -- 172.21.15.157:0/2979779571 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b8015a680 con 0x7f3b8006ea10 2023-10-16T19:58:07.783 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:07.770+0000 7f3b76ffd700 1 -- 172.21.15.157:0/2979779571 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f3b7c013470 con 0x7f3b8006ea10 2023-10-16T19:58:07.783 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:07.771+0000 7f3b76ffd700 1 --2- 172.21.15.157:0/2979779571 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f3b6406af00 0x7f3b6406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:07.783 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:07.771+0000 7f3b76ffd700 1 -- 172.21.15.157:0/2979779571 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5729+0+0 (secure 0 0 0) 0x7f3b7c089720 con 0x7f3b8006ea10 2023-10-16T19:58:07.783 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:07.771+0000 7f3b85be0700 1 --2- 172.21.15.157:0/2979779571 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f3b6406af00 0x7f3b6406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:07.784 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:07.771+0000 7f3b85be0700 1 --2- 172.21.15.157:0/2979779571 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f3b6406af00 0x7f3b6406d3c0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f3b80071660 tx=0x7f3b70009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:58:07.784 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:07.775+0000 7f3b76ffd700 1 -- 172.21.15.157:0/2979779571 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3b7c0547c0 con 0x7f3b8006ea10 2023-10-16T19:58:08.010 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:08.007+0000 7f3b88645700 1 -- 172.21.15.157:0/2979779571 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "testcephfs1", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f3b8015a830 con 0x7f3b8006ea10 2023-10-16T19:58:08.619 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:08.617+0000 7f3b76ffd700 1 -- 172.21.15.157:0/2979779571 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "testcephfs1", "var": "allow_standby_replay", "val": "false"}]=0 v17) v1 ==== 127+0+0 (secure 0 0 0) 0x7f3b7c057de0 con 0x7f3b8006ea10 2023-10-16T19:58:08.622 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:08.619+0000 7f3b88645700 1 -- 172.21.15.157:0/2979779571 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f3b6406af00 msgr2=0x7f3b6406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:08.622 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:08.619+0000 7f3b88645700 1 --2- 172.21.15.157:0/2979779571 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f3b6406af00 0x7f3b6406d3c0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f3b80071660 tx=0x7f3b70009040 comp rx=0 tx=0).stop 2023-10-16T19:58:08.622 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:08.619+0000 7f3b88645700 1 -- 172.21.15.157:0/2979779571 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3b8006ea10 msgr2=0x7f3b8015a9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:08.622 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:08.619+0000 7f3b88645700 1 --2- 172.21.15.157:0/2979779571 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3b8006ea10 0x7f3b8015a9e0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f3b7c00ebe0 tx=0x7f3b7c009e20 comp rx=0 tx=0).stop 2023-10-16T19:58:08.622 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:08.619+0000 7f3b88645700 1 -- 172.21.15.157:0/2979779571 shutdown_connections 2023-10-16T19:58:08.623 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:08.619+0000 7f3b88645700 1 --2- 172.21.15.157:0/2979779571 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3b8015e090 0x7f3b80158e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:08.623 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:08.619+0000 7f3b88645700 1 --2- 172.21.15.157:0/2979779571 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3b8006ea10 0x7f3b8015a9e0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:08.623 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:08.619+0000 7f3b88645700 1 --2- 172.21.15.157:0/2979779571 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f3b6406af00 0x7f3b6406d3c0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:08.623 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:08.619+0000 7f3b88645700 1 --2- 172.21.15.157:0/2979779571 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3b800b0190 0x7f3b80160760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:08.623 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:08.619+0000 7f3b88645700 1 -- 172.21.15.157:0/2979779571 >> 172.21.15.157:0/2979779571 conn(0x7f3b800d0b30 msgr2=0x7f3b80157870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:58:08.624 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:08.619+0000 7f3b88645700 1 -- 172.21.15.157:0/2979779571 shutdown_connections 2023-10-16T19:58:08.624 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:08.619+0000 7f3b88645700 1 -- 172.21.15.157:0/2979779571 wait complete. 2023-10-16T19:58:08.634 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'testcephfs1' 2023-10-16T19:58:08.635 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-16T19:58:08.758 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:08.755+0000 7fcda8a94700 1 Processor -- start 2023-10-16T19:58:08.758 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:08.755+0000 7fcda8a94700 1 -- start start 2023-10-16T19:58:08.760 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:08.756+0000 7fcda8a94700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fcda415b130 0x7fcda4071f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:08.761 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:08.756+0000 7fcda8a94700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fcda406d0f0 0x7fcda40cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:08.761 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:08.756+0000 7fcda8a94700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcda40cbeb0 0x7fcda406eb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:08.761 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:08.756+0000 7fcda8a94700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcda40b0050 con 0x7fcda406d0f0 2023-10-16T19:58:08.761 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:08.756+0000 7fcda8a94700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcda40cefc0 con 0x7fcda415b130 2023-10-16T19:58:08.761 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:08.756+0000 7fcda8a94700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcda406e090 con 0x7fcda40cbeb0 2023-10-16T19:58:08.762 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:08.756+0000 7fcda1d9b700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fcda406d0f0 0x7fcda40cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:08.762 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:08.756+0000 7fcda1d9b700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fcda406d0f0 0x7fcda40cb970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:47622/0 (socket says 172.21.15.157:47622) 2023-10-16T19:58:08.762 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:08.756+0000 7fcda1d9b700 1 -- 172.21.15.157:0/2533342024 learned_addr learned my addr 172.21.15.157:0/2533342024 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:58:08.762 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:08.756+0000 7fcda259c700 1 --2- 172.21.15.157:0/2533342024 >> v2:172.21.15.187:3300/0 conn(0x7fcda415b130 0x7fcda4071f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:08.762 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:08.756+0000 7fcda2d9d700 1 --2- 172.21.15.157:0/2533342024 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcda40cbeb0 0x7fcda406eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:08.763 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:08.756+0000 7fcda1d9b700 1 -- 172.21.15.157:0/2533342024 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcda40cbeb0 msgr2=0x7fcda406eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:58:08.763 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:08.756+0000 7fcda1d9b700 1 --2- 172.21.15.157:0/2533342024 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcda40cbeb0 0x7fcda406eb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:08.763 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:08.756+0000 7fcda1d9b700 1 -- 172.21.15.157:0/2533342024 >> v2:172.21.15.187:3300/0 conn(0x7fcda415b130 msgr2=0x7fcda4071f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:58:08.763 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:08.756+0000 7fcda1d9b700 1 --2- 172.21.15.157:0/2533342024 >> v2:172.21.15.187:3300/0 conn(0x7fcda415b130 0x7fcda4071f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:08.763 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:08.756+0000 7fcda1d9b700 1 -- 172.21.15.157:0/2533342024 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcda406d570 con 0x7fcda406d0f0 2023-10-16T19:58:08.764 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:08.756+0000 7fcda2d9d700 1 --2- 172.21.15.157:0/2533342024 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcda40cbeb0 0x7fcda406eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T19:58:08.764 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:08.757+0000 7fcda1d9b700 1 --2- 172.21.15.157:0/2533342024 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcda406d0f0 0x7fcda40cb970 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fcda406cb70 tx=0x7fcd9400be70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=254293fdd6fa294b server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:58:08.764 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:08.757+0000 7fcda159a700 1 -- 172.21.15.157:0/2533342024 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd9400dd30 con 0x7fcda406d0f0 2023-10-16T19:58:08.764 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:08.757+0000 7fcda159a700 1 -- 172.21.15.157:0/2533342024 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd9400de90 con 0x7fcda406d0f0 2023-10-16T19:58:08.764 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:08.757+0000 7fcda159a700 1 -- 172.21.15.157:0/2533342024 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd94010690 con 0x7fcda406d0f0 2023-10-16T19:58:08.764 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:08.757+0000 7fcda8a94700 1 -- 172.21.15.157:0/2533342024 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcda406d0f0 msgr2=0x7fcda40cb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:08.765 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:08.757+0000 7fcda8a94700 1 --2- 172.21.15.157:0/2533342024 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcda406d0f0 0x7fcda40cb970 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fcda406cb70 tx=0x7fcd9400be70 comp rx=0 tx=0).stop 2023-10-16T19:58:08.765 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:08.757+0000 7fcda8a94700 1 -- 172.21.15.157:0/2533342024 shutdown_connections 2023-10-16T19:58:08.765 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:08.757+0000 7fcda8a94700 1 --2- 172.21.15.157:0/2533342024 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcda40cbeb0 0x7fcda406eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:08.765 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:08.757+0000 7fcda8a94700 1 --2- 172.21.15.157:0/2533342024 >> v2:172.21.15.187:3300/0 conn(0x7fcda415b130 0x7fcda4071f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:08.765 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:08.757+0000 7fcda8a94700 1 --2- 172.21.15.157:0/2533342024 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcda406d0f0 0x7fcda40cb970 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:08.766 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:08.757+0000 7fcda8a94700 1 -- 172.21.15.157:0/2533342024 >> 172.21.15.157:0/2533342024 conn(0x7fcda40cd4e0 msgr2=0x7fcda40cd8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:58:08.766 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:08.757+0000 7fcda8a94700 1 -- 172.21.15.157:0/2533342024 shutdown_connections 2023-10-16T19:58:08.766 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:08.757+0000 7fcda8a94700 1 -- 172.21.15.157:0/2533342024 wait complete. 2023-10-16T19:58:08.770 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:08.759+0000 7fcda8a94700 1 Processor -- start 2023-10-16T19:58:08.770 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:08.759+0000 7fcda8a94700 1 -- start start 2023-10-16T19:58:08.770 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:08.760+0000 7fcda8a94700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcda406d0f0 0x7fcda41538b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:08.771 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:08.760+0000 7fcda8a94700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcda40cbeb0 0x7fcda40b40e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:08.771 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:08.760+0000 7fcda8a94700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcda415b130 0x7fcda40b1920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:08.771 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:08.760+0000 7fcda8a94700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcda4158200 con 0x7fcda40cbeb0 2023-10-16T19:58:08.771 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:08.760+0000 7fcda8a94700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcda41575f0 con 0x7fcda415b130 2023-10-16T19:58:08.772 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:08.760+0000 7fcda8a94700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcda41578d0 con 0x7fcda406d0f0 2023-10-16T19:58:08.772 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:08.760+0000 7fcda1d9b700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcda40cbeb0 0x7fcda40b40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:08.772 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:08.760+0000 7fcda1d9b700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcda40cbeb0 0x7fcda40b40e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:47628/0 (socket says 172.21.15.157:47628) 2023-10-16T19:58:08.772 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:08.760+0000 7fcda1d9b700 1 -- 172.21.15.157:0/2020047172 learned_addr learned my addr 172.21.15.157:0/2020047172 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:58:08.772 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:08.760+0000 7fcda259c700 1 --2- 172.21.15.157:0/2020047172 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcda406d0f0 0x7fcda41538b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:08.773 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:08.760+0000 7fcda2d9d700 1 --2- 172.21.15.157:0/2020047172 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcda415b130 0x7fcda40b1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:08.773 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:08.761+0000 7fcda1d9b700 1 -- 172.21.15.157:0/2020047172 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcda406d0f0 msgr2=0x7fcda41538b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:08.773 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:08.761+0000 7fcda1d9b700 1 --2- 172.21.15.157:0/2020047172 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcda406d0f0 0x7fcda41538b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:08.773 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:08.761+0000 7fcda1d9b700 1 -- 172.21.15.157:0/2020047172 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcda415b130 msgr2=0x7fcda40b1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:08.773 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:08.761+0000 7fcda1d9b700 1 --2- 172.21.15.157:0/2020047172 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcda415b130 0x7fcda40b1920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:08.774 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:08.761+0000 7fcda1d9b700 1 -- 172.21.15.157:0/2020047172 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd9400b7f0 con 0x7fcda40cbeb0 2023-10-16T19:58:08.774 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:08.761+0000 7fcda1d9b700 1 --2- 172.21.15.157:0/2020047172 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcda40cbeb0 0x7fcda40b40e0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fcd94000c00 tx=0x7fcd94004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:58:08.774 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:08.761+0000 7fcd92ffd700 1 -- 172.21.15.157:0/2020047172 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd9401f070 con 0x7fcda40cbeb0 2023-10-16T19:58:08.774 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:08.761+0000 7fcd92ffd700 1 -- 172.21.15.157:0/2020047172 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd94003a60 con 0x7fcda40cbeb0 2023-10-16T19:58:08.775 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:08.761+0000 7fcda8a94700 1 -- 172.21.15.157:0/2020047172 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcda4157bb0 con 0x7fcda40cbeb0 2023-10-16T19:58:08.775 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:08.761+0000 7fcd92ffd700 1 -- 172.21.15.157:0/2020047172 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd94003e10 con 0x7fcda40cbeb0 2023-10-16T19:58:08.775 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:08.761+0000 7fcda8a94700 1 -- 172.21.15.157:0/2020047172 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcda4158690 con 0x7fcda40cbeb0 2023-10-16T19:58:08.775 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:08.762+0000 7fcda8a94700 1 -- 172.21.15.157:0/2020047172 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcda40cf350 con 0x7fcda40cbeb0 2023-10-16T19:58:08.776 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:08.762+0000 7fcd92ffd700 1 -- 172.21.15.157:0/2020047172 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fcd94019400 con 0x7fcda40cbeb0 2023-10-16T19:58:08.776 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:08.763+0000 7fcd92ffd700 1 --2- 172.21.15.157:0/2020047172 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fcd8406af00 0x7fcd8406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:08.776 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:08.763+0000 7fcd92ffd700 1 -- 172.21.15.157:0/2020047172 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5729+0+0 (secure 0 0 0) 0x7fcd9408c7d0 con 0x7fcda40cbeb0 2023-10-16T19:58:08.776 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:08.763+0000 7fcda259c700 1 --2- 172.21.15.157:0/2020047172 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fcd8406af00 0x7fcd8406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:08.776 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:08.763+0000 7fcda259c700 1 --2- 172.21.15.157:0/2020047172 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fcd8406af00 0x7fcd8406d3c0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fcd98009930 tx=0x7fcd98008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:58:08.777 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:08.767+0000 7fcd92ffd700 1 -- 172.21.15.157:0/2020047172 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fcd940578f0 con 0x7fcda40cbeb0 2023-10-16T19:58:09.004 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.002+0000 7fcda8a94700 1 -- 172.21.15.157:0/2020047172 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcda404f400 con 0x7fcda40cbeb0 2023-10-16T19:58:09.005 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.003+0000 7fcd92ffd700 1 -- 172.21.15.157:0/2020047172 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4930 (secure 0 0 0) 0x7fcd9405af10 con 0x7fcda40cbeb0 2023-10-16T19:58:09.005 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-10-16T19:58:09.006 INFO:teuthology.orchestra.run.smithi157.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4766,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6837/4265551180","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6835","nonce":4265551180},{"type":"v1","addr":"172.21.15.187:6837","nonce":4265551180}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4945,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6836/3773301895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6834","nonce":3773301895},{"type":"v1","addr":"172.21.15.187:6836","nonce":3773301895}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5040,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6833/2197855945","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6832","nonce":2197855945},{"type":"v1","addr":"172.21.15.157:6833","nonce":2197855945}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-16T19:58:04.972085+0000","modified":"2023-10-16T19:58:08.009196+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5043},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5043":{"gid":5043,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.157:6835/1166326737","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6834","nonce":1166326737},{"type":"v1","addr":"172.21.15.157:6835","nonce":1166326737}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"testcephfs1","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-10-16T19:58:09.008 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.005+0000 7fcda8a94700 1 -- 172.21.15.157:0/2020047172 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fcd8406af00 msgr2=0x7fcd8406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:09.008 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.005+0000 7fcda8a94700 1 --2- 172.21.15.157:0/2020047172 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fcd8406af00 0x7fcd8406d3c0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fcd98009930 tx=0x7fcd98008040 comp rx=0 tx=0).stop 2023-10-16T19:58:09.008 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.005+0000 7fcda8a94700 1 -- 172.21.15.157:0/2020047172 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcda40cbeb0 msgr2=0x7fcda40b40e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:09.008 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.005+0000 7fcda8a94700 1 --2- 172.21.15.157:0/2020047172 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcda40cbeb0 0x7fcda40b40e0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fcd94000c00 tx=0x7fcd94004750 comp rx=0 tx=0).stop 2023-10-16T19:58:09.008 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.005+0000 7fcda8a94700 1 -- 172.21.15.157:0/2020047172 shutdown_connections 2023-10-16T19:58:09.009 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.005+0000 7fcda8a94700 1 --2- 172.21.15.157:0/2020047172 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fcd8406af00 0x7fcd8406d3c0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:09.009 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.005+0000 7fcda8a94700 1 --2- 172.21.15.157:0/2020047172 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcda415b130 0x7fcda40b1920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:09.009 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.005+0000 7fcda8a94700 1 --2- 172.21.15.157:0/2020047172 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcda406d0f0 0x7fcda41538b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:09.009 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.005+0000 7fcda8a94700 1 --2- 172.21.15.157:0/2020047172 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcda40cbeb0 0x7fcda40b40e0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:09.009 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.005+0000 7fcda8a94700 1 -- 172.21.15.157:0/2020047172 >> 172.21.15.157:0/2020047172 conn(0x7fcda40cd4e0 msgr2=0x7fcda406ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:58:09.010 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.005+0000 7fcda8a94700 1 -- 172.21.15.157:0/2020047172 shutdown_connections 2023-10-16T19:58:09.010 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.005+0000 7fcda8a94700 1 -- 172.21.15.157:0/2020047172 wait complete. 2023-10-16T19:58:09.010 INFO:teuthology.orchestra.run.smithi157.stderr:dumped fsmap epoch 17 2023-10-16T19:58:09.020 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T19:58:09.140 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.138+0000 7ff9009f6700 1 Processor -- start 2023-10-16T19:58:09.140 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.138+0000 7ff9009f6700 1 -- start start 2023-10-16T19:58:09.143 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.139+0000 7ff9009f6700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff8fc15c1d0 0x7ff8fc071fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:09.143 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.139+0000 7ff9009f6700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8fc06f530 con 0x7ff8fc06af60 2023-10-16T19:58:09.143 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.139+0000 7ff9009f6700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8fc06f7d0 con 0x7ff8fc0cd0a0 2023-10-16T19:58:09.144 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.139+0000 7ff9009f6700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8fc06fab0 con 0x7ff8fc15c1d0 2023-10-16T19:58:09.144 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.139+0000 7ff8fad9d700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7ff8fc06af60 0x7ff8fc15fe50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:57310/0 (socket says 172.21.15.157:57310) 2023-10-16T19:58:09.144 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.139+0000 7ff8fad9d700 1 -- 172.21.15.157:0/168849224 learned_addr learned my addr 172.21.15.157:0/168849224 (peer_addr_for_me v1:172.21.15.157:0/0) 2023-10-16T19:58:09.144 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.139+0000 7ff8fa59c700 1 --2- 172.21.15.157:0/168849224 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff8fc15c1d0 0x7ff8fc071fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:09.144 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.139+0000 7ff8f959a700 1 -- 172.21.15.157:0/168849224 <== mon.0 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2801945770 0 0) 0x7ff8fc06f530 con 0x7ff8fc06af60 2023-10-16T19:58:09.145 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.139+0000 7ff8f959a700 1 -- 172.21.15.157:0/168849224 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff8e40035b0 con 0x7ff8fc06af60 2023-10-16T19:58:09.145 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.139+0000 7ff8f959a700 1 -- 172.21.15.157:0/168849224 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1371966416 0 0) 0x7ff8fc06f7d0 con 0x7ff8fc0cd0a0 2023-10-16T19:58:09.145 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.139+0000 7ff8f959a700 1 -- 172.21.15.157:0/168849224 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff8fc06f530 con 0x7ff8fc0cd0a0 2023-10-16T19:58:09.145 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.139+0000 7ff8f959a700 1 -- 172.21.15.157:0/168849224 <== mon.0 v1:172.21.15.157:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2910604992 0 0) 0x7ff8e40035b0 con 0x7ff8fc06af60 2023-10-16T19:58:09.145 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.139+0000 7ff8fa59c700 1 -- 172.21.15.157:0/168849224 >> v1:172.21.15.187:6789/0 conn(0x7ff8fc0cd0a0 legacy=0x7ff8fc06a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:09.146 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.139+0000 7ff8fa59c700 1 -- 172.21.15.157:0/168849224 >> v1:172.21.15.157:6789/0 conn(0x7ff8fc06af60 legacy=0x7ff8fc15fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:09.146 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.139+0000 7ff8fa59c700 1 -- 172.21.15.157:0/168849224 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8fc0cb1a0 con 0x7ff8fc15c1d0 2023-10-16T19:58:09.146 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.140+0000 7ff8fa59c700 1 --2- 172.21.15.157:0/168849224 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff8fc15c1d0 0x7ff8fc071fb0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff8ec009870 tx=0x7ff8ec009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dbaba723d6292e39 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:58:09.146 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.140+0000 7ff8f959a700 1 -- 172.21.15.157:0/168849224 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8f4001a40 con 0x7ff8fc15c1d0 2023-10-16T19:58:09.146 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.140+0000 7ff8f959a700 1 -- 172.21.15.157:0/168849224 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8ec004030 con 0x7ff8fc15c1d0 2023-10-16T19:58:09.147 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.140+0000 7ff8f959a700 1 -- 172.21.15.157:0/168849224 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8ec0043c0 con 0x7ff8fc15c1d0 2023-10-16T19:58:09.147 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.140+0000 7ff9009f6700 1 -- 172.21.15.157:0/168849224 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff8fc15c1d0 msgr2=0x7ff8fc071fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:09.147 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.140+0000 7ff9009f6700 1 --2- 172.21.15.157:0/168849224 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff8fc15c1d0 0x7ff8fc071fb0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff8ec009870 tx=0x7ff8ec009b80 comp rx=0 tx=0).stop 2023-10-16T19:58:09.147 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.140+0000 7ff9009f6700 1 -- 172.21.15.157:0/168849224 shutdown_connections 2023-10-16T19:58:09.147 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.140+0000 7ff9009f6700 1 --2- 172.21.15.157:0/168849224 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff8fc15c1d0 0x7ff8fc071fb0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:09.148 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.140+0000 7ff9009f6700 1 -- 172.21.15.157:0/168849224 >> 172.21.15.157:0/168849224 conn(0x7ff8fc0cd4e0 msgr2=0x7ff8fc0cd8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:58:09.148 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.140+0000 7ff9009f6700 1 -- 172.21.15.157:0/168849224 shutdown_connections 2023-10-16T19:58:09.148 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.140+0000 7ff9009f6700 1 -- 172.21.15.157:0/168849224 wait complete. 2023-10-16T19:58:09.151 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.142+0000 7ff9009f6700 1 Processor -- start 2023-10-16T19:58:09.151 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.142+0000 7ff9009f6700 1 -- start start 2023-10-16T19:58:09.151 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.142+0000 7ff9009f6700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff8fc06af60 0x7ff8fc155ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:09.152 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.142+0000 7ff9009f6700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff8fc0cd0a0 0x7ff8fc1571c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:09.152 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.142+0000 7ff9009f6700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff8fc15c1d0 0x7ff8fc0ca050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:09.152 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.143+0000 7ff9009f6700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8fc157e10 con 0x7ff8fc0cd0a0 2023-10-16T19:58:09.152 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.143+0000 7ff9009f6700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8fc0b3720 con 0x7ff8fc15c1d0 2023-10-16T19:58:09.152 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.143+0000 7ff9009f6700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8fc0b3f80 con 0x7ff8fc06af60 2023-10-16T19:58:09.153 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.143+0000 7ff8f9d9b700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff8fc0cd0a0 0x7ff8fc1571c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:09.153 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.143+0000 7ff8f9d9b700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff8fc0cd0a0 0x7ff8fc1571c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:47642/0 (socket says 172.21.15.157:47642) 2023-10-16T19:58:09.153 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.143+0000 7ff8f9d9b700 1 -- 172.21.15.157:0/4178643164 learned_addr learned my addr 172.21.15.157:0/4178643164 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:58:09.153 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.143+0000 7ff8fa59c700 1 --2- 172.21.15.157:0/4178643164 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff8fc06af60 0x7ff8fc155ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:09.153 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.143+0000 7ff8fad9d700 1 --2- 172.21.15.157:0/4178643164 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff8fc15c1d0 0x7ff8fc0ca050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:09.154 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.143+0000 7ff8f9d9b700 1 -- 172.21.15.157:0/4178643164 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff8fc06af60 msgr2=0x7ff8fc155ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:09.154 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.143+0000 7ff8f9d9b700 1 --2- 172.21.15.157:0/4178643164 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff8fc06af60 0x7ff8fc155ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:09.154 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.143+0000 7ff8f9d9b700 1 -- 172.21.15.157:0/4178643164 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff8fc15c1d0 msgr2=0x7ff8fc0ca050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:09.154 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.143+0000 7ff8f9d9b700 1 --2- 172.21.15.157:0/4178643164 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff8fc15c1d0 0x7ff8fc0ca050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:09.155 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.143+0000 7ff8f9d9b700 1 -- 172.21.15.157:0/4178643164 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8ec0094a0 con 0x7ff8fc0cd0a0 2023-10-16T19:58:09.155 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.143+0000 7ff8f9d9b700 1 --2- 172.21.15.157:0/4178643164 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff8fc0cd0a0 0x7ff8fc1571c0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7ff8f000c520 tx=0x7ff8f000c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:58:09.155 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.143+0000 7ff8eaffd700 1 -- 172.21.15.157:0/4178643164 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8f00052d0 con 0x7ff8fc0cd0a0 2023-10-16T19:58:09.155 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.143+0000 7ff8eaffd700 1 -- 172.21.15.157:0/4178643164 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8f0005430 con 0x7ff8fc0cd0a0 2023-10-16T19:58:09.156 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.143+0000 7ff9009f6700 1 -- 172.21.15.157:0/4178643164 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8fc157b30 con 0x7ff8fc0cd0a0 2023-10-16T19:58:09.156 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.143+0000 7ff8eaffd700 1 -- 172.21.15.157:0/4178643164 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8f00038c0 con 0x7ff8fc0cd0a0 2023-10-16T19:58:09.156 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.143+0000 7ff9009f6700 1 -- 172.21.15.157:0/4178643164 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8fc0b3c10 con 0x7ff8fc0cd0a0 2023-10-16T19:58:09.156 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.144+0000 7ff9009f6700 1 -- 172.21.15.157:0/4178643164 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8fc0b4130 con 0x7ff8fc0cd0a0 2023-10-16T19:58:09.156 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.145+0000 7ff8eaffd700 1 -- 172.21.15.157:0/4178643164 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7ff8f0003a20 con 0x7ff8fc0cd0a0 2023-10-16T19:58:09.157 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.145+0000 7ff8eaffd700 1 --2- 172.21.15.157:0/4178643164 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7ff8dc06af00 0x7ff8dc06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:09.157 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.145+0000 7ff8eaffd700 1 -- 172.21.15.157:0/4178643164 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5729+0+0 (secure 0 0 0) 0x7ff8f0088a40 con 0x7ff8fc0cd0a0 2023-10-16T19:58:09.157 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.145+0000 7ff8fa59c700 1 --2- 172.21.15.157:0/4178643164 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7ff8dc06af00 0x7ff8dc06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:09.157 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.146+0000 7ff8fa59c700 1 --2- 172.21.15.157:0/4178643164 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7ff8dc06af00 0x7ff8dc06d3c0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7ff8ec0097c0 tx=0x7ff8ec008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:58:09.158 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.149+0000 7ff8eaffd700 1 -- 172.21.15.157:0/4178643164 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff8fc0b4130 con 0x7ff8fc0cd0a0 2023-10-16T19:58:09.341 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.339+0000 7ff9009f6700 1 -- 172.21.15.157:0/4178643164 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff8fc067b30 con 0x7ff8fc0cd0a0 2023-10-16T19:58:09.342 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.340+0000 7ff8eaffd700 1 -- 172.21.15.157:0/4178643164 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+16601 (secure 0 0 0) 0x7ff8f0017090 con 0x7ff8fc0cd0a0 2023-10-16T19:58:09.343 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-10-16T19:58:09.343 INFO:teuthology.orchestra.run.smithi157.stdout:{"epoch":33,"fsid":"28199dc9-64d5-479e-83c6-21f097c33d39","created":"2023-10-16T19:56:49.201889+0000","modified":"2023-10-16T19:58:06.592936+0000","last_up_change":"2023-10-16T19:56:54.675673+0000","last_in_change":"2023-10-16T19:56:51.666728+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T19:56:56.932895+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"testcephfs1_metadata","create_time":"2023-10-16T19:58:02.774777+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"testcephfs1"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"testcephfs1_data","create_time":"2023-10-16T19:58:03.939912+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"testcephfs1"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":335785898},{"type":"v1","addr":"172.21.15.157:6809","nonce":335785898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":335785898},{"type":"v1","addr":"172.21.15.157:6811","nonce":335785898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6815","nonce":335785898},{"type":"v1","addr":"172.21.15.157:6817","nonce":335785898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":335785898},{"type":"v1","addr":"172.21.15.157:6813","nonce":335785898}]},"public_addr":"172.21.15.157:6809/335785898","cluster_addr":"172.21.15.157:6811/335785898","heartbeat_back_addr":"172.21.15.157:6817/335785898","heartbeat_front_addr":"172.21.15.157:6813/335785898","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":3482825047},{"type":"v1","addr":"172.21.15.157:6801","nonce":3482825047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":3482825047},{"type":"v1","addr":"172.21.15.157:6803","nonce":3482825047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":3482825047},{"type":"v1","addr":"172.21.15.157:6807","nonce":3482825047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":3482825047},{"type":"v1","addr":"172.21.15.157:6805","nonce":3482825047}]},"public_addr":"172.21.15.157:6801/3482825047","cluster_addr":"172.21.15.157:6803/3482825047","heartbeat_back_addr":"172.21.15.157:6807/3482825047","heartbeat_front_addr":"172.21.15.157:6805/3482825047","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":1118292389},{"type":"v1","addr":"172.21.15.157:6825","nonce":1118292389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":1118292389},{"type":"v1","addr":"172.21.15.157:6827","nonce":1118292389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":1118292389},{"type":"v1","addr":"172.21.15.157:6831","nonce":1118292389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":1118292389},{"type":"v1","addr":"172.21.15.157:6829","nonce":1118292389}]},"public_addr":"172.21.15.157:6825/1118292389","cluster_addr":"172.21.15.157:6827/1118292389","heartbeat_back_addr":"172.21.15.157:6831/1118292389","heartbeat_front_addr":"172.21.15.157:6829/1118292389","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":989329821},{"type":"v1","addr":"172.21.15.157:6816","nonce":989329821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":989329821},{"type":"v1","addr":"172.21.15.157:6819","nonce":989329821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":989329821},{"type":"v1","addr":"172.21.15.157:6823","nonce":989329821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":989329821},{"type":"v1","addr":"172.21.15.157:6821","nonce":989329821}]},"public_addr":"172.21.15.157:6816/989329821","cluster_addr":"172.21.15.157:6819/989329821","heartbeat_back_addr":"172.21.15.157:6823/989329821","heartbeat_front_addr":"172.21.15.157:6821/989329821","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":3841016811},{"type":"v1","addr":"172.21.15.187:6801","nonce":3841016811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6803","nonce":3841016811},{"type":"v1","addr":"172.21.15.187:6804","nonce":3841016811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6809","nonce":3841016811},{"type":"v1","addr":"172.21.15.187:6811","nonce":3841016811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":3841016811},{"type":"v1","addr":"172.21.15.187:6808","nonce":3841016811}]},"public_addr":"172.21.15.187:6801/3841016811","cluster_addr":"172.21.15.187:6804/3841016811","heartbeat_back_addr":"172.21.15.187:6811/3841016811","heartbeat_front_addr":"172.21.15.187:6808/3841016811","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":915130263},{"type":"v1","addr":"172.21.15.187:6805","nonce":915130263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6807","nonce":915130263},{"type":"v1","addr":"172.21.15.187:6810","nonce":915130263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":915130263},{"type":"v1","addr":"172.21.15.187:6815","nonce":915130263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":915130263},{"type":"v1","addr":"172.21.15.187:6813","nonce":915130263}]},"public_addr":"172.21.15.187:6805/915130263","cluster_addr":"172.21.15.187:6810/915130263","heartbeat_back_addr":"172.21.15.187:6815/915130263","heartbeat_front_addr":"172.21.15.187:6813/915130263","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":654976824},{"type":"v1","addr":"172.21.15.187:6817","nonce":654976824}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":654976824},{"type":"v1","addr":"172.21.15.187:6819","nonce":654976824}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":654976824},{"type":"v1","addr":"172.21.15.187:6823","nonce":654976824}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":654976824},{"type":"v1","addr":"172.21.15.187:6821","nonce":654976824}]},"public_addr":"172.21.15.187:6817/654976824","cluster_addr":"172.21.15.187:6819/654976824","heartbeat_back_addr":"172.21.15.187:6823/654976824","heartbeat_front_addr":"172.21.15.187:6821/654976824","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":4284059445},{"type":"v1","addr":"172.21.15.187:6825","nonce":4284059445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":4284059445},{"type":"v1","addr":"172.21.15.187:6827","nonce":4284059445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":4284059445},{"type":"v1","addr":"172.21.15.187:6831","nonce":4284059445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":4284059445},{"type":"v1","addr":"172.21.15.187:6829","nonce":4284059445}]},"public_addr":"172.21.15.187:6825/4284059445","cluster_addr":"172.21.15.187:6827/4284059445","heartbeat_back_addr":"172.21.15.187:6831/4284059445","heartbeat_front_addr":"172.21.15.187:6829/4284059445","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.819780+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.824193+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.849575+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.824806+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.809540+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.805093+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.866109+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.807372+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T19:58:09.345 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.342+0000 7ff9009f6700 1 -- 172.21.15.157:0/4178643164 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7ff8dc06af00 msgr2=0x7ff8dc06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:09.345 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.342+0000 7ff9009f6700 1 --2- 172.21.15.157:0/4178643164 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7ff8dc06af00 0x7ff8dc06d3c0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7ff8ec0097c0 tx=0x7ff8ec008030 comp rx=0 tx=0).stop 2023-10-16T19:58:09.345 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.342+0000 7ff9009f6700 1 -- 172.21.15.157:0/4178643164 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff8fc0cd0a0 msgr2=0x7ff8fc1571c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:09.345 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.342+0000 7ff9009f6700 1 --2- 172.21.15.157:0/4178643164 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff8fc0cd0a0 0x7ff8fc1571c0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7ff8f000c520 tx=0x7ff8f000c830 comp rx=0 tx=0).stop 2023-10-16T19:58:09.346 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.342+0000 7ff9009f6700 1 -- 172.21.15.157:0/4178643164 shutdown_connections 2023-10-16T19:58:09.346 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.342+0000 7ff9009f6700 1 --2- 172.21.15.157:0/4178643164 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7ff8dc06af00 0x7ff8dc06d3c0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:09.346 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.342+0000 7ff9009f6700 1 --2- 172.21.15.157:0/4178643164 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff8fc15c1d0 0x7ff8fc0ca050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:09.346 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.342+0000 7ff9009f6700 1 --2- 172.21.15.157:0/4178643164 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff8fc06af60 0x7ff8fc155ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:09.346 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.342+0000 7ff9009f6700 1 --2- 172.21.15.157:0/4178643164 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff8fc0cd0a0 0x7ff8fc1571c0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:09.347 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.342+0000 7ff9009f6700 1 -- 172.21.15.157:0/4178643164 >> 172.21.15.157:0/4178643164 conn(0x7ff8fc0cd4e0 msgr2=0x7ff8fc0b2730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:58:09.347 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.342+0000 7ff9009f6700 1 -- 172.21.15.157:0/4178643164 shutdown_connections 2023-10-16T19:58:09.347 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.342+0000 7ff9009f6700 1 -- 172.21.15.157:0/4178643164 wait complete. 2023-10-16T19:58:09.357 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-16T19:58:09.357 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-16T19:58:09.453 INFO:tasks.ceph.mds.a.smithi157.stderr:2023-10-16T19:58:09.450+0000 7fbfddb96700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-16T19:58:09.478 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.476+0000 7f74c35a2700 1 Processor -- start 2023-10-16T19:58:09.478 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.476+0000 7f74c35a2700 1 -- start start 2023-10-16T19:58:09.481 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.477+0000 7f74c35a2700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f74bc15b130 0x7f74bc071f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:09.481 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.477+0000 7f74c35a2700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f74bc06d0f0 0x7f74bc0cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:09.481 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.477+0000 7f74c35a2700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74bc0cefc0 con 0x7f74bc0cbeb0 2023-10-16T19:58:09.481 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.477+0000 7f74c35a2700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74bc0b0050 con 0x7f74bc15b130 2023-10-16T19:58:09.481 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.477+0000 7f74c35a2700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74bc06e090 con 0x7f74bc06d0f0 2023-10-16T19:58:09.482 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.477+0000 7f74c0b3d700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f74bc06d0f0 0x7f74bc0cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:09.482 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.477+0000 7f74c133e700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f74bc15b130 0x7f74bc071f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:09.482 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.477+0000 7f74c1b3f700 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7f74bc0cbeb0 0x7f74bc06eb20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.157:41020/0 (socket says 172.21.15.157:41020) 2023-10-16T19:58:09.482 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.477+0000 7f74c0b3d700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f74bc06d0f0 0x7f74bc0cb970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.157:56956/0 (socket says 172.21.15.157:56956) 2023-10-16T19:58:09.483 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.477+0000 7f74c0b3d700 1 -- 172.21.15.157:0/1449247298 learned_addr learned my addr 172.21.15.157:0/1449247298 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:58:09.483 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.477+0000 7f74b3fff700 1 -- 172.21.15.157:0/1449247298 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2417717185 0 0) 0x7f74bc0cefc0 con 0x7f74bc0cbeb0 2023-10-16T19:58:09.483 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.477+0000 7f74b3fff700 1 -- 172.21.15.157:0/1449247298 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f74a80035b0 con 0x7f74bc0cbeb0 2023-10-16T19:58:09.483 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.477+0000 7f74c0b3d700 1 -- 172.21.15.157:0/1449247298 >> v2:172.21.15.187:3300/0 conn(0x7f74bc15b130 msgr2=0x7f74bc071f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:58:09.483 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.477+0000 7f74c0b3d700 1 --2- 172.21.15.157:0/1449247298 >> v2:172.21.15.187:3300/0 conn(0x7f74bc15b130 0x7f74bc071f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:09.483 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.477+0000 7f74c0b3d700 1 -- 172.21.15.157:0/1449247298 >> v1:172.21.15.187:6789/0 conn(0x7f74bc0cbeb0 legacy=0x7f74bc06eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:09.484 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.477+0000 7f74c0b3d700 1 -- 172.21.15.157:0/1449247298 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74bc06d570 con 0x7f74bc06d0f0 2023-10-16T19:58:09.484 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.477+0000 7f74c133e700 1 --2- 172.21.15.157:0/1449247298 >> v2:172.21.15.187:3300/0 conn(0x7f74bc15b130 0x7f74bc071f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T19:58:09.484 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.477+0000 7f74c0b3d700 1 --2- 172.21.15.157:0/1449247298 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f74bc06d0f0 0x7f74bc0cb970 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f74ac0098f0 tx=0x7f74ac009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e3466acebb0853b server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:58:09.484 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.478+0000 7f74b3fff700 1 -- 172.21.15.157:0/1449247298 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74ac011830 con 0x7f74bc06d0f0 2023-10-16T19:58:09.484 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.478+0000 7f74b3fff700 1 -- 172.21.15.157:0/1449247298 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74ac011990 con 0x7f74bc06d0f0 2023-10-16T19:58:09.485 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.478+0000 7f74b3fff700 1 -- 172.21.15.157:0/1449247298 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74ac011d00 con 0x7f74bc06d0f0 2023-10-16T19:58:09.485 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.478+0000 7f74c35a2700 1 -- 172.21.15.157:0/1449247298 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f74bc06d0f0 msgr2=0x7f74bc0cb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:09.485 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.478+0000 7f74c35a2700 1 --2- 172.21.15.157:0/1449247298 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f74bc06d0f0 0x7f74bc0cb970 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f74ac0098f0 tx=0x7f74ac009c00 comp rx=0 tx=0).stop 2023-10-16T19:58:09.485 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.478+0000 7f74c35a2700 1 -- 172.21.15.157:0/1449247298 shutdown_connections 2023-10-16T19:58:09.485 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.478+0000 7f74c35a2700 1 --2- 172.21.15.157:0/1449247298 >> v2:172.21.15.187:3300/0 conn(0x7f74bc15b130 0x7f74bc071f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:09.485 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.478+0000 7f74c35a2700 1 --2- 172.21.15.157:0/1449247298 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f74bc06d0f0 0x7f74bc0cb970 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:09.486 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.478+0000 7f74c35a2700 1 -- 172.21.15.157:0/1449247298 >> 172.21.15.157:0/1449247298 conn(0x7f74bc0cd4e0 msgr2=0x7f74bc0cd8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:58:09.486 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.478+0000 7f74c35a2700 1 -- 172.21.15.157:0/1449247298 shutdown_connections 2023-10-16T19:58:09.486 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.478+0000 7f74c35a2700 1 -- 172.21.15.157:0/1449247298 wait complete. 2023-10-16T19:58:09.489 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.479+0000 7f74c35a2700 1 Processor -- start 2023-10-16T19:58:09.489 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.479+0000 7f74c35a2700 1 -- start start 2023-10-16T19:58:09.490 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.480+0000 7f74c35a2700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f74bc06d0f0 0x7f74bc15ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:09.490 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.480+0000 7f74c35a2700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f74bc0cbeb0 0x7f74bc0c7280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:09.490 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.480+0000 7f74c35a2700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f74bc15b130 0x7f74bc159b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:09.490 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.480+0000 7f74c35a2700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74bc15d420 con 0x7f74bc06d0f0 2023-10-16T19:58:09.491 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.480+0000 7f74c35a2700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74bc15d700 con 0x7f74bc0cbeb0 2023-10-16T19:58:09.491 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.480+0000 7f74c35a2700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74bc15d9e0 con 0x7f74bc15b130 2023-10-16T19:58:09.491 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.480+0000 7f74c133e700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f74bc06d0f0 0x7f74bc15ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:09.491 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.480+0000 7f74c133e700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f74bc06d0f0 0x7f74bc15ce40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:47654/0 (socket says 172.21.15.157:47654) 2023-10-16T19:58:09.491 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.480+0000 7f74c133e700 1 -- 172.21.15.157:0/2746106243 learned_addr learned my addr 172.21.15.157:0/2746106243 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:58:09.491 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.480+0000 7f74c1b3f700 1 --2- 172.21.15.157:0/2746106243 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f74bc15b130 0x7f74bc159b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:09.492 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.480+0000 7f74c0b3d700 1 --2- 172.21.15.157:0/2746106243 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f74bc0cbeb0 0x7f74bc0c7280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:09.492 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.481+0000 7f74c133e700 1 -- 172.21.15.157:0/2746106243 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f74bc15b130 msgr2=0x7f74bc159b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:09.492 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.481+0000 7f74c133e700 1 --2- 172.21.15.157:0/2746106243 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f74bc15b130 0x7f74bc159b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:09.492 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.481+0000 7f74c133e700 1 -- 172.21.15.157:0/2746106243 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f74bc0cbeb0 msgr2=0x7f74bc0c7280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:09.492 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.481+0000 7f74c133e700 1 --2- 172.21.15.157:0/2746106243 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f74bc0cbeb0 0x7f74bc0c7280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:09.493 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.481+0000 7f74c133e700 1 -- 172.21.15.157:0/2746106243 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74b80094a0 con 0x7f74bc06d0f0 2023-10-16T19:58:09.493 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.481+0000 7f74c1b3f700 1 --2- 172.21.15.157:0/2746106243 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f74bc15b130 0x7f74bc159b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T19:58:09.493 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.481+0000 7f74c133e700 1 --2- 172.21.15.157:0/2746106243 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f74bc06d0f0 0x7f74bc15ce40 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f74b8010df0 tx=0x7f74b800e640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:58:09.493 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.481+0000 7f74b1ffb700 1 -- 172.21.15.157:0/2746106243 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74b8011650 con 0x7f74bc06d0f0 2023-10-16T19:58:09.493 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.481+0000 7f74b1ffb700 1 -- 172.21.15.157:0/2746106243 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74b80117b0 con 0x7f74bc06d0f0 2023-10-16T19:58:09.494 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.481+0000 7f74c35a2700 1 -- 172.21.15.157:0/2746106243 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74ac009550 con 0x7f74bc06d0f0 2023-10-16T19:58:09.494 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.481+0000 7f74b1ffb700 1 -- 172.21.15.157:0/2746106243 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74b8011b40 con 0x7f74bc06d0f0 2023-10-16T19:58:09.494 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.481+0000 7f74c35a2700 1 -- 172.21.15.157:0/2746106243 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74bc15dfa0 con 0x7f74bc06d0f0 2023-10-16T19:58:09.494 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.482+0000 7f74c35a2700 1 -- 172.21.15.157:0/2746106243 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74bc04f400 con 0x7f74bc06d0f0 2023-10-16T19:58:09.494 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.483+0000 7f74b1ffb700 1 -- 172.21.15.157:0/2746106243 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f74b8011ca0 con 0x7f74bc06d0f0 2023-10-16T19:58:09.495 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.483+0000 7f74b1ffb700 1 --2- 172.21.15.157:0/2746106243 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f74a006af00 0x7f74a006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:09.495 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.483+0000 7f74b1ffb700 1 -- 172.21.15.157:0/2746106243 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5729+0+0 (secure 0 0 0) 0x7f74b808ba50 con 0x7f74bc06d0f0 2023-10-16T19:58:09.495 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.483+0000 7f74c0b3d700 1 --2- 172.21.15.157:0/2746106243 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f74a006af00 0x7f74a006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:09.495 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.484+0000 7f74c0b3d700 1 --2- 172.21.15.157:0/2746106243 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f74a006af00 0x7f74a006d3c0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f74ac000c00 tx=0x7f74ac008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:58:09.496 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.488+0000 7f74b1ffb700 1 -- 172.21.15.157:0/2746106243 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f74b8056b70 con 0x7f74bc06d0f0 2023-10-16T19:58:09.675 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.672+0000 7f74c35a2700 1 -- 172.21.15.157:0/2746106243 --> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f74bc06dad0 con 0x7f74a006af00 2023-10-16T19:58:09.683 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.681+0000 7f74b1ffb700 1 -- 172.21.15.157:0/2746106243 <== mgr.4100 v2:172.21.15.187:6832/2426285296 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+284526 (secure 0 0 0) 0x7f74ac01f070 con 0x7f74a006af00 2023-10-16T19:58:09.687 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-10-16T19:58:09.690 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.685+0000 7f74c35a2700 1 -- 172.21.15.157:0/2746106243 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f74a006af00 msgr2=0x7f74a006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:09.690 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.685+0000 7f74c35a2700 1 --2- 172.21.15.157:0/2746106243 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f74a006af00 0x7f74a006d3c0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f74ac000c00 tx=0x7f74ac008030 comp rx=0 tx=0).stop 2023-10-16T19:58:09.690 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.685+0000 7f74c35a2700 1 -- 172.21.15.157:0/2746106243 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f74bc06d0f0 msgr2=0x7f74bc15ce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:09.690 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.685+0000 7f74c35a2700 1 --2- 172.21.15.157:0/2746106243 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f74bc06d0f0 0x7f74bc15ce40 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f74b8010df0 tx=0x7f74b800e640 comp rx=0 tx=0).stop 2023-10-16T19:58:09.691 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.685+0000 7f74c35a2700 1 -- 172.21.15.157:0/2746106243 shutdown_connections 2023-10-16T19:58:09.691 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.685+0000 7f74c35a2700 1 --2- 172.21.15.157:0/2746106243 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f74bc15b130 0x7f74bc159b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:09.691 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.685+0000 7f74c35a2700 1 --2- 172.21.15.157:0/2746106243 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f74bc06d0f0 0x7f74bc15ce40 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:09.691 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.685+0000 7f74c35a2700 1 --2- 172.21.15.157:0/2746106243 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f74a006af00 0x7f74a006d3c0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:09.691 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.685+0000 7f74c35a2700 1 --2- 172.21.15.157:0/2746106243 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f74bc0cbeb0 0x7f74bc0c7280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:09.692 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.685+0000 7f74c35a2700 1 -- 172.21.15.157:0/2746106243 >> 172.21.15.157:0/2746106243 conn(0x7f74bc0cd4e0 msgr2=0x7f74bc0b0410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:58:09.692 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.685+0000 7f74c35a2700 1 -- 172.21.15.157:0/2746106243 shutdown_connections 2023-10-16T19:58:09.692 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.685+0000 7f74c35a2700 1 -- 172.21.15.157:0/2746106243 wait complete. 2023-10-16T19:58:09.692 INFO:teuthology.orchestra.run.smithi157.stderr:dumped all 2023-10-16T19:58:09.699 INFO:teuthology.orchestra.run.smithi157.stdout:{"pg_ready":true,"pg_map":{"version":60,"stamp":"2023-10-16T19:58:08.905864+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":64,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":2207,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560292,"statfs":{"total":1600000000,"available":1597739687,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.331127"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.597367+0000","last_change":"2023-10-16T19:58:05.597289+0000","last_active":"2023-10-16T19:58:05.597367+0000","last_peered":"2023-10-16T19:58:05.597367+0000","last_clean":"2023-10-16T19:58:05.597367+0000","last_became_active":"2023-10-16T19:58:05.597025+0000","last_became_peered":"2023-10-16T19:58:05.597025+0000","last_unstale":"2023-10-16T19:58:05.597367+0000","last_undegraded":"2023-10-16T19:58:05.597367+0000","last_fullsized":"2023-10-16T19:58:05.597367+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:56:22.040826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.606306+0000","last_change":"2023-10-16T19:58:05.606250+0000","last_active":"2023-10-16T19:58:05.606306+0000","last_peered":"2023-10-16T19:58:05.606306+0000","last_clean":"2023-10-16T19:58:05.606306+0000","last_became_active":"2023-10-16T19:58:05.605969+0000","last_became_peered":"2023-10-16T19:58:05.605969+0000","last_unstale":"2023-10-16T19:58:05.606306+0000","last_undegraded":"2023-10-16T19:58:05.606306+0000","last_fullsized":"2023-10-16T19:58:05.606306+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:24:38.118997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.601703+0000","last_change":"2023-10-16T19:58:05.601472+0000","last_active":"2023-10-16T19:58:05.601703+0000","last_peered":"2023-10-16T19:58:05.601703+0000","last_clean":"2023-10-16T19:58:05.601703+0000","last_became_active":"2023-10-16T19:58:05.601072+0000","last_became_peered":"2023-10-16T19:58:05.601072+0000","last_unstale":"2023-10-16T19:58:05.601703+0000","last_undegraded":"2023-10-16T19:58:05.601703+0000","last_fullsized":"2023-10-16T19:58:05.601703+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:57:59.985913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.604001+0000","last_change":"2023-10-16T19:58:05.603410+0000","last_active":"2023-10-16T19:58:05.604001+0000","last_peered":"2023-10-16T19:58:05.604001+0000","last_clean":"2023-10-16T19:58:05.604001+0000","last_became_active":"2023-10-16T19:58:05.603003+0000","last_became_peered":"2023-10-16T19:58:05.603003+0000","last_unstale":"2023-10-16T19:58:05.604001+0000","last_undegraded":"2023-10-16T19:58:05.604001+0000","last_fullsized":"2023-10-16T19:58:05.604001+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:29:55.757064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.603593+0000","last_change":"2023-10-16T19:58:05.603205+0000","last_active":"2023-10-16T19:58:05.603593+0000","last_peered":"2023-10-16T19:58:05.603593+0000","last_clean":"2023-10-16T19:58:05.603593+0000","last_became_active":"2023-10-16T19:58:05.602976+0000","last_became_peered":"2023-10-16T19:58:05.602976+0000","last_unstale":"2023-10-16T19:58:05.603593+0000","last_undegraded":"2023-10-16T19:58:05.603593+0000","last_fullsized":"2023-10-16T19:58:05.603593+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:26:34.415435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.602632+0000","last_change":"2023-10-16T19:58:05.602575+0000","last_active":"2023-10-16T19:58:05.602632+0000","last_peered":"2023-10-16T19:58:05.602632+0000","last_clean":"2023-10-16T19:58:05.602632+0000","last_became_active":"2023-10-16T19:58:05.601803+0000","last_became_peered":"2023-10-16T19:58:05.601803+0000","last_unstale":"2023-10-16T19:58:05.602632+0000","last_undegraded":"2023-10-16T19:58:05.602632+0000","last_fullsized":"2023-10-16T19:58:05.602632+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:42:51.289673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.605544+0000","last_change":"2023-10-16T19:58:05.605393+0000","last_active":"2023-10-16T19:58:05.605544+0000","last_peered":"2023-10-16T19:58:05.605544+0000","last_clean":"2023-10-16T19:58:05.605544+0000","last_became_active":"2023-10-16T19:58:05.605148+0000","last_became_peered":"2023-10-16T19:58:05.605148+0000","last_unstale":"2023-10-16T19:58:05.605544+0000","last_undegraded":"2023-10-16T19:58:05.605544+0000","last_fullsized":"2023-10-16T19:58:05.605544+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:05:23.390163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.605562+0000","last_change":"2023-10-16T19:58:05.605461+0000","last_active":"2023-10-16T19:58:05.605562+0000","last_peered":"2023-10-16T19:58:05.605562+0000","last_clean":"2023-10-16T19:58:05.605562+0000","last_became_active":"2023-10-16T19:58:05.605200+0000","last_became_peered":"2023-10-16T19:58:05.605200+0000","last_unstale":"2023-10-16T19:58:05.605562+0000","last_undegraded":"2023-10-16T19:58:05.605562+0000","last_fullsized":"2023-10-16T19:58:05.605562+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:29:55.757064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.602882+0000","last_change":"2023-10-16T19:58:05.602243+0000","last_active":"2023-10-16T19:58:05.602882+0000","last_peered":"2023-10-16T19:58:05.602882+0000","last_clean":"2023-10-16T19:58:05.602882+0000","last_became_active":"2023-10-16T19:58:05.601910+0000","last_became_peered":"2023-10-16T19:58:05.601910+0000","last_unstale":"2023-10-16T19:58:05.602882+0000","last_undegraded":"2023-10-16T19:58:05.602882+0000","last_fullsized":"2023-10-16T19:58:05.602882+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:45:26.140866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.601197+0000","last_change":"2023-10-16T19:58:05.600582+0000","last_active":"2023-10-16T19:58:05.601197+0000","last_peered":"2023-10-16T19:58:05.601197+0000","last_clean":"2023-10-16T19:58:05.601197+0000","last_became_active":"2023-10-16T19:58:05.600356+0000","last_became_peered":"2023-10-16T19:58:05.600356+0000","last_unstale":"2023-10-16T19:58:05.601197+0000","last_undegraded":"2023-10-16T19:58:05.601197+0000","last_fullsized":"2023-10-16T19:58:05.601197+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:20:13.830601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.610390+0000","last_change":"2023-10-16T19:58:05.610325+0000","last_active":"2023-10-16T19:58:05.610390+0000","last_peered":"2023-10-16T19:58:05.610390+0000","last_clean":"2023-10-16T19:58:05.610390+0000","last_became_active":"2023-10-16T19:58:05.609979+0000","last_became_peered":"2023-10-16T19:58:05.609979+0000","last_unstale":"2023-10-16T19:58:05.610390+0000","last_undegraded":"2023-10-16T19:58:05.610390+0000","last_fullsized":"2023-10-16T19:58:05.610390+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:24:38.118997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.602350+0000","last_change":"2023-10-16T19:58:05.602076+0000","last_active":"2023-10-16T19:58:05.602350+0000","last_peered":"2023-10-16T19:58:05.602350+0000","last_clean":"2023-10-16T19:58:05.602350+0000","last_became_active":"2023-10-16T19:58:05.600490+0000","last_became_peered":"2023-10-16T19:58:05.600490+0000","last_unstale":"2023-10-16T19:58:05.602350+0000","last_undegraded":"2023-10-16T19:58:05.602350+0000","last_fullsized":"2023-10-16T19:58:05.602350+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:26:46.150630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.601247+0000","last_change":"2023-10-16T19:58:05.600961+0000","last_active":"2023-10-16T19:58:05.601247+0000","last_peered":"2023-10-16T19:58:05.601247+0000","last_clean":"2023-10-16T19:58:05.601247+0000","last_became_active":"2023-10-16T19:58:05.600614+0000","last_became_peered":"2023-10-16T19:58:05.600614+0000","last_unstale":"2023-10-16T19:58:05.601247+0000","last_undegraded":"2023-10-16T19:58:05.601247+0000","last_fullsized":"2023-10-16T19:58:05.601247+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:57:11.670061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.602495+0000","last_change":"2023-10-16T19:58:05.602410+0000","last_active":"2023-10-16T19:58:05.602495+0000","last_peered":"2023-10-16T19:58:05.602495+0000","last_clean":"2023-10-16T19:58:05.602495+0000","last_became_active":"2023-10-16T19:58:05.601569+0000","last_became_peered":"2023-10-16T19:58:05.601569+0000","last_unstale":"2023-10-16T19:58:05.602495+0000","last_undegraded":"2023-10-16T19:58:05.602495+0000","last_fullsized":"2023-10-16T19:58:05.602495+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:57:59.985913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.600100+0000","last_change":"2023-10-16T19:58:05.599789+0000","last_active":"2023-10-16T19:58:05.600100+0000","last_peered":"2023-10-16T19:58:05.600100+0000","last_clean":"2023-10-16T19:58:05.600100+0000","last_became_active":"2023-10-16T19:58:05.599026+0000","last_became_peered":"2023-10-16T19:58:05.599026+0000","last_unstale":"2023-10-16T19:58:05.600100+0000","last_undegraded":"2023-10-16T19:58:05.600100+0000","last_fullsized":"2023-10-16T19:58:05.600100+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:42:51.289673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.610275+0000","last_change":"2023-10-16T19:58:05.610219+0000","last_active":"2023-10-16T19:58:05.610275+0000","last_peered":"2023-10-16T19:58:05.610275+0000","last_clean":"2023-10-16T19:58:05.610275+0000","last_became_active":"2023-10-16T19:58:05.609613+0000","last_became_peered":"2023-10-16T19:58:05.609613+0000","last_unstale":"2023-10-16T19:58:05.610275+0000","last_undegraded":"2023-10-16T19:58:05.610275+0000","last_fullsized":"2023-10-16T19:58:05.610275+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:10:06.943190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.609767+0000","last_change":"2023-10-16T19:58:05.608855+0000","last_active":"2023-10-16T19:58:05.609767+0000","last_peered":"2023-10-16T19:58:05.609767+0000","last_clean":"2023-10-16T19:58:05.609767+0000","last_became_active":"2023-10-16T19:58:05.608184+0000","last_became_peered":"2023-10-16T19:58:05.608184+0000","last_unstale":"2023-10-16T19:58:05.609767+0000","last_undegraded":"2023-10-16T19:58:05.609767+0000","last_fullsized":"2023-10-16T19:58:05.609767+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:26:46.150630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.601335+0000","last_change":"2023-10-16T19:58:05.601271+0000","last_active":"2023-10-16T19:58:05.601335+0000","last_peered":"2023-10-16T19:58:05.601335+0000","last_clean":"2023-10-16T19:58:05.601335+0000","last_became_active":"2023-10-16T19:58:05.600977+0000","last_became_peered":"2023-10-16T19:58:05.600977+0000","last_unstale":"2023-10-16T19:58:05.601335+0000","last_undegraded":"2023-10-16T19:58:05.601335+0000","last_fullsized":"2023-10-16T19:58:05.601335+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:57:53.793532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.602620+0000","last_change":"2023-10-16T19:58:05.602564+0000","last_active":"2023-10-16T19:58:05.602620+0000","last_peered":"2023-10-16T19:58:05.602620+0000","last_clean":"2023-10-16T19:58:05.602620+0000","last_became_active":"2023-10-16T19:58:05.601866+0000","last_became_peered":"2023-10-16T19:58:05.601866+0000","last_unstale":"2023-10-16T19:58:05.602620+0000","last_undegraded":"2023-10-16T19:58:05.602620+0000","last_fullsized":"2023-10-16T19:58:05.602620+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:31:32.571112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.603825+0000","last_change":"2023-10-16T19:58:05.603764+0000","last_active":"2023-10-16T19:58:05.603825+0000","last_peered":"2023-10-16T19:58:05.603825+0000","last_clean":"2023-10-16T19:58:05.603825+0000","last_became_active":"2023-10-16T19:58:05.603536+0000","last_became_peered":"2023-10-16T19:58:05.603536+0000","last_unstale":"2023-10-16T19:58:05.603825+0000","last_undegraded":"2023-10-16T19:58:05.603825+0000","last_fullsized":"2023-10-16T19:58:05.603825+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:06:17.145932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.607120+0000","last_change":"2023-10-16T19:58:05.607035+0000","last_active":"2023-10-16T19:58:05.607120+0000","last_peered":"2023-10-16T19:58:05.607120+0000","last_clean":"2023-10-16T19:58:05.607120+0000","last_became_active":"2023-10-16T19:58:05.606725+0000","last_became_peered":"2023-10-16T19:58:05.606725+0000","last_unstale":"2023-10-16T19:58:05.607120+0000","last_undegraded":"2023-10-16T19:58:05.607120+0000","last_fullsized":"2023-10-16T19:58:05.607120+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:43:32.505853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.606469+0000","last_change":"2023-10-16T19:58:05.606076+0000","last_active":"2023-10-16T19:58:05.606469+0000","last_peered":"2023-10-16T19:58:05.606469+0000","last_clean":"2023-10-16T19:58:05.606469+0000","last_became_active":"2023-10-16T19:58:05.605335+0000","last_became_peered":"2023-10-16T19:58:05.605335+0000","last_unstale":"2023-10-16T19:58:05.606469+0000","last_undegraded":"2023-10-16T19:58:05.606469+0000","last_fullsized":"2023-10-16T19:58:05.606469+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:26:34.415435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.609430+0000","last_change":"2023-10-16T19:58:05.609361+0000","last_active":"2023-10-16T19:58:05.609430+0000","last_peered":"2023-10-16T19:58:05.609430+0000","last_clean":"2023-10-16T19:58:05.609430+0000","last_became_active":"2023-10-16T19:58:05.609123+0000","last_became_peered":"2023-10-16T19:58:05.609123+0000","last_unstale":"2023-10-16T19:58:05.609430+0000","last_undegraded":"2023-10-16T19:58:05.609430+0000","last_fullsized":"2023-10-16T19:58:05.609430+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:43:32.505853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.600080+0000","last_change":"2023-10-16T19:58:05.599645+0000","last_active":"2023-10-16T19:58:05.600080+0000","last_peered":"2023-10-16T19:58:05.600080+0000","last_clean":"2023-10-16T19:58:05.600080+0000","last_became_active":"2023-10-16T19:58:05.599210+0000","last_became_peered":"2023-10-16T19:58:05.599210+0000","last_unstale":"2023-10-16T19:58:05.600080+0000","last_undegraded":"2023-10-16T19:58:05.600080+0000","last_fullsized":"2023-10-16T19:58:05.600080+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:05:23.390163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.608276+0000","last_change":"2023-10-16T19:58:05.608218+0000","last_active":"2023-10-16T19:58:05.608276+0000","last_peered":"2023-10-16T19:58:05.608276+0000","last_clean":"2023-10-16T19:58:05.608276+0000","last_became_active":"2023-10-16T19:58:05.608010+0000","last_became_peered":"2023-10-16T19:58:05.608010+0000","last_unstale":"2023-10-16T19:58:05.608276+0000","last_undegraded":"2023-10-16T19:58:05.608276+0000","last_fullsized":"2023-10-16T19:58:05.608276+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:51:00.905603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.607457+0000","last_change":"2023-10-16T19:58:05.607417+0000","last_active":"2023-10-16T19:58:05.607457+0000","last_peered":"2023-10-16T19:58:05.607457+0000","last_clean":"2023-10-16T19:58:05.607457+0000","last_became_active":"2023-10-16T19:58:05.607185+0000","last_became_peered":"2023-10-16T19:58:05.607185+0000","last_unstale":"2023-10-16T19:58:05.607457+0000","last_undegraded":"2023-10-16T19:58:05.607457+0000","last_fullsized":"2023-10-16T19:58:05.607457+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:10:06.943190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.606343+0000","last_change":"2023-10-16T19:58:05.606277+0000","last_active":"2023-10-16T19:58:05.606343+0000","last_peered":"2023-10-16T19:58:05.606343+0000","last_clean":"2023-10-16T19:58:05.606343+0000","last_became_active":"2023-10-16T19:58:05.606043+0000","last_became_peered":"2023-10-16T19:58:05.606043+0000","last_unstale":"2023-10-16T19:58:05.606343+0000","last_undegraded":"2023-10-16T19:58:05.606343+0000","last_fullsized":"2023-10-16T19:58:05.606343+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:08:51.291632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.608055+0000","last_change":"2023-10-16T19:58:05.607969+0000","last_active":"2023-10-16T19:58:05.608055+0000","last_peered":"2023-10-16T19:58:05.608055+0000","last_clean":"2023-10-16T19:58:05.608055+0000","last_became_active":"2023-10-16T19:58:05.607763+0000","last_became_peered":"2023-10-16T19:58:05.607763+0000","last_unstale":"2023-10-16T19:58:05.608055+0000","last_undegraded":"2023-10-16T19:58:05.608055+0000","last_fullsized":"2023-10-16T19:58:05.608055+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:26:33.490004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.604846+0000","last_change":"2023-10-16T19:58:05.604754+0000","last_active":"2023-10-16T19:58:05.604846+0000","last_peered":"2023-10-16T19:58:05.604846+0000","last_clean":"2023-10-16T19:58:05.604846+0000","last_became_active":"2023-10-16T19:58:05.604309+0000","last_became_peered":"2023-10-16T19:58:05.604309+0000","last_unstale":"2023-10-16T19:58:05.604846+0000","last_undegraded":"2023-10-16T19:58:05.604846+0000","last_fullsized":"2023-10-16T19:58:05.604846+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:28:20.445641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.607499+0000","last_change":"2023-10-16T19:58:05.606380+0000","last_active":"2023-10-16T19:58:05.607499+0000","last_peered":"2023-10-16T19:58:05.607499+0000","last_clean":"2023-10-16T19:58:05.607499+0000","last_became_active":"2023-10-16T19:58:05.606102+0000","last_became_peered":"2023-10-16T19:58:05.606102+0000","last_unstale":"2023-10-16T19:58:05.607499+0000","last_undegraded":"2023-10-16T19:58:05.607499+0000","last_fullsized":"2023-10-16T19:58:05.607499+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:26:33.490004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.600662+0000","last_change":"2023-10-16T19:58:05.600187+0000","last_active":"2023-10-16T19:58:05.600662+0000","last_peered":"2023-10-16T19:58:05.600662+0000","last_clean":"2023-10-16T19:58:05.600662+0000","last_became_active":"2023-10-16T19:58:05.599955+0000","last_became_peered":"2023-10-16T19:58:05.599955+0000","last_unstale":"2023-10-16T19:58:05.600662+0000","last_undegraded":"2023-10-16T19:58:05.600662+0000","last_fullsized":"2023-10-16T19:58:05.600662+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:43:32.505853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.609800+0000","last_change":"2023-10-16T19:58:05.609019+0000","last_active":"2023-10-16T19:58:05.609800+0000","last_peered":"2023-10-16T19:58:05.609800+0000","last_clean":"2023-10-16T19:58:05.609800+0000","last_became_active":"2023-10-16T19:58:05.608571+0000","last_became_peered":"2023-10-16T19:58:05.608571+0000","last_unstale":"2023-10-16T19:58:05.609800+0000","last_undegraded":"2023-10-16T19:58:05.609800+0000","last_fullsized":"2023-10-16T19:58:05.609800+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:07:11.937484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.609529+0000","last_change":"2023-10-16T19:58:05.609465+0000","last_active":"2023-10-16T19:58:05.609529+0000","last_peered":"2023-10-16T19:58:05.609529+0000","last_clean":"2023-10-16T19:58:05.609529+0000","last_became_active":"2023-10-16T19:58:05.609211+0000","last_became_peered":"2023-10-16T19:58:05.609211+0000","last_unstale":"2023-10-16T19:58:05.609529+0000","last_undegraded":"2023-10-16T19:58:05.609529+0000","last_fullsized":"2023-10-16T19:58:05.609529+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:08:51.291632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"32'4","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.616024+0000","last_change":"2023-10-16T19:58:04.587769+0000","last_active":"2023-10-16T19:58:05.616024+0000","last_peered":"2023-10-16T19:58:05.616024+0000","last_clean":"2023-10-16T19:58:05.616024+0000","last_became_active":"2023-10-16T19:58:04.587523+0000","last_became_peered":"2023-10-16T19:58:04.587523+0000","last_unstale":"2023-10-16T19:58:05.616024+0000","last_undegraded":"2023-10-16T19:58:05.616024+0000","last_fullsized":"2023-10-16T19:58:05.616024+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_clean_scrub_stamp":"2023-10-16T19:58:03.569082+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:20:12.826040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.598799+0000","last_change":"2023-10-16T19:58:05.598729+0000","last_active":"2023-10-16T19:58:05.598799+0000","last_peered":"2023-10-16T19:58:05.598799+0000","last_clean":"2023-10-16T19:58:05.598799+0000","last_became_active":"2023-10-16T19:58:05.598478+0000","last_became_peered":"2023-10-16T19:58:05.598478+0000","last_unstale":"2023-10-16T19:58:05.598799+0000","last_undegraded":"2023-10-16T19:58:05.598799+0000","last_fullsized":"2023-10-16T19:58:05.598799+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:43:51.911077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"32'1","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.616276+0000","last_change":"2023-10-16T19:58:04.589820+0000","last_active":"2023-10-16T19:58:05.616276+0000","last_peered":"2023-10-16T19:58:05.616276+0000","last_clean":"2023-10-16T19:58:05.616276+0000","last_became_active":"2023-10-16T19:58:04.589624+0000","last_became_peered":"2023-10-16T19:58:04.589624+0000","last_unstale":"2023-10-16T19:58:05.616276+0000","last_undegraded":"2023-10-16T19:58:05.616276+0000","last_fullsized":"2023-10-16T19:58:05.616276+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_clean_scrub_stamp":"2023-10-16T19:58:03.569082+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:50:59.901042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.604065+0000","last_change":"2023-10-16T19:58:05.603987+0000","last_active":"2023-10-16T19:58:05.604065+0000","last_peered":"2023-10-16T19:58:05.604065+0000","last_clean":"2023-10-16T19:58:05.604065+0000","last_became_active":"2023-10-16T19:58:05.603733+0000","last_became_peered":"2023-10-16T19:58:05.603733+0000","last_unstale":"2023-10-16T19:58:05.604065+0000","last_undegraded":"2023-10-16T19:58:05.604065+0000","last_fullsized":"2023-10-16T19:58:05.604065+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:06:17.145932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"32'2","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.618090+0000","last_change":"2023-10-16T19:58:04.587285+0000","last_active":"2023-10-16T19:58:05.618090+0000","last_peered":"2023-10-16T19:58:05.618090+0000","last_clean":"2023-10-16T19:58:05.618090+0000","last_became_active":"2023-10-16T19:58:04.587076+0000","last_became_peered":"2023-10-16T19:58:04.587076+0000","last_unstale":"2023-10-16T19:58:05.618090+0000","last_undegraded":"2023-10-16T19:58:05.618090+0000","last_fullsized":"2023-10-16T19:58:05.618090+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_clean_scrub_stamp":"2023-10-16T19:58:03.569082+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:05:22.385602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.604018+0000","last_change":"2023-10-16T19:58:05.603529+0000","last_active":"2023-10-16T19:58:05.604018+0000","last_peered":"2023-10-16T19:58:05.604018+0000","last_clean":"2023-10-16T19:58:05.604018+0000","last_became_active":"2023-10-16T19:58:05.603317+0000","last_became_peered":"2023-10-16T19:58:05.603317+0000","last_unstale":"2023-10-16T19:58:05.604018+0000","last_undegraded":"2023-10-16T19:58:05.604018+0000","last_fullsized":"2023-10-16T19:58:05.604018+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:56:22.040826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"32'2","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.615556+0000","last_change":"2023-10-16T19:58:04.581625+0000","last_active":"2023-10-16T19:58:05.615556+0000","last_peered":"2023-10-16T19:58:05.615556+0000","last_clean":"2023-10-16T19:58:05.615556+0000","last_became_active":"2023-10-16T19:58:04.580982+0000","last_became_peered":"2023-10-16T19:58:04.580982+0000","last_unstale":"2023-10-16T19:58:05.615556+0000","last_undegraded":"2023-10-16T19:58:05.615556+0000","last_fullsized":"2023-10-16T19:58:05.615556+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_clean_scrub_stamp":"2023-10-16T19:58:03.569082+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:10:41.518249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.609839+0000","last_change":"2023-10-16T19:58:05.609638+0000","last_active":"2023-10-16T19:58:05.609839+0000","last_peered":"2023-10-16T19:58:05.609839+0000","last_clean":"2023-10-16T19:58:05.609839+0000","last_became_active":"2023-10-16T19:58:05.609287+0000","last_became_peered":"2023-10-16T19:58:05.609287+0000","last_unstale":"2023-10-16T19:58:05.609839+0000","last_undegraded":"2023-10-16T19:58:05.609839+0000","last_fullsized":"2023-10-16T19:58:05.609839+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:42:51.289673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"32'1","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.618604+0000","last_change":"2023-10-16T19:58:04.592222+0000","last_active":"2023-10-16T19:58:05.618604+0000","last_peered":"2023-10-16T19:58:05.618604+0000","last_clean":"2023-10-16T19:58:05.618604+0000","last_became_active":"2023-10-16T19:58:04.591382+0000","last_became_peered":"2023-10-16T19:58:04.591382+0000","last_unstale":"2023-10-16T19:58:05.618604+0000","last_undegraded":"2023-10-16T19:58:05.618604+0000","last_fullsized":"2023-10-16T19:58:05.618604+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_clean_scrub_stamp":"2023-10-16T19:58:03.569082+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:43:50.906516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.607003+0000","last_change":"2023-10-16T19:58:05.606948+0000","last_active":"2023-10-16T19:58:05.607003+0000","last_peered":"2023-10-16T19:58:05.607003+0000","last_clean":"2023-10-16T19:58:05.607003+0000","last_became_active":"2023-10-16T19:58:05.606777+0000","last_became_peered":"2023-10-16T19:58:05.606777+0000","last_unstale":"2023-10-16T19:58:05.607003+0000","last_undegraded":"2023-10-16T19:58:05.607003+0000","last_fullsized":"2023-10-16T19:58:05.607003+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:24:38.118997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"32'1","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.618567+0000","last_change":"2023-10-16T19:58:04.584929+0000","last_active":"2023-10-16T19:58:05.618567+0000","last_peered":"2023-10-16T19:58:05.618567+0000","last_clean":"2023-10-16T19:58:05.618567+0000","last_became_active":"2023-10-16T19:58:04.584702+0000","last_became_peered":"2023-10-16T19:58:04.584702+0000","last_unstale":"2023-10-16T19:58:05.618567+0000","last_undegraded":"2023-10-16T19:58:05.618567+0000","last_fullsized":"2023-10-16T19:58:05.618567+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_clean_scrub_stamp":"2023-10-16T19:58:03.569082+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:04:37.242998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.601806+0000","last_change":"2023-10-16T19:58:05.601585+0000","last_active":"2023-10-16T19:58:05.601806+0000","last_peered":"2023-10-16T19:58:05.601806+0000","last_clean":"2023-10-16T19:58:05.601806+0000","last_became_active":"2023-10-16T19:58:05.600813+0000","last_became_peered":"2023-10-16T19:58:05.600813+0000","last_unstale":"2023-10-16T19:58:05.601806+0000","last_undegraded":"2023-10-16T19:58:05.601806+0000","last_fullsized":"2023-10-16T19:58:05.601806+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:08:51.291632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.598185+0000","last_change":"2023-10-16T19:58:04.585183+0000","last_active":"2023-10-16T19:58:05.598185+0000","last_peered":"2023-10-16T19:58:05.598185+0000","last_clean":"2023-10-16T19:58:05.598185+0000","last_became_active":"2023-10-16T19:58:04.584173+0000","last_became_peered":"2023-10-16T19:58:04.584173+0000","last_unstale":"2023-10-16T19:58:05.598185+0000","last_undegraded":"2023-10-16T19:58:05.598185+0000","last_fullsized":"2023-10-16T19:58:05.598185+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_clean_scrub_stamp":"2023-10-16T19:58:03.569082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:09:03.659551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.601708+0000","last_change":"2023-10-16T19:58:05.601649+0000","last_active":"2023-10-16T19:58:05.601708+0000","last_peered":"2023-10-16T19:58:05.601708+0000","last_clean":"2023-10-16T19:58:05.601708+0000","last_became_active":"2023-10-16T19:58:05.601416+0000","last_became_peered":"2023-10-16T19:58:05.601416+0000","last_unstale":"2023-10-16T19:58:05.601708+0000","last_undegraded":"2023-10-16T19:58:05.601708+0000","last_fullsized":"2023-10-16T19:58:05.601708+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:26:46.150630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.597691+0000","last_change":"2023-10-16T19:58:04.590433+0000","last_active":"2023-10-16T19:58:05.597691+0000","last_peered":"2023-10-16T19:58:05.597691+0000","last_clean":"2023-10-16T19:58:05.597691+0000","last_became_active":"2023-10-16T19:58:04.589891+0000","last_became_peered":"2023-10-16T19:58:04.589891+0000","last_unstale":"2023-10-16T19:58:05.597691+0000","last_undegraded":"2023-10-16T19:58:05.597691+0000","last_fullsized":"2023-10-16T19:58:05.597691+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_clean_scrub_stamp":"2023-10-16T19:58:03.569082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:31:31.566550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.603414+0000","last_change":"2023-10-16T19:58:05.603341+0000","last_active":"2023-10-16T19:58:05.603414+0000","last_peered":"2023-10-16T19:58:05.603414+0000","last_clean":"2023-10-16T19:58:05.603414+0000","last_became_active":"2023-10-16T19:58:05.603042+0000","last_became_peered":"2023-10-16T19:58:05.603042+0000","last_unstale":"2023-10-16T19:58:05.603414+0000","last_undegraded":"2023-10-16T19:58:05.603414+0000","last_fullsized":"2023-10-16T19:58:05.603414+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:41:58.386070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.599331+0000","last_change":"2023-10-16T19:58:04.589480+0000","last_active":"2023-10-16T19:58:05.599331+0000","last_peered":"2023-10-16T19:58:05.599331+0000","last_clean":"2023-10-16T19:58:05.599331+0000","last_became_active":"2023-10-16T19:58:04.589253+0000","last_became_peered":"2023-10-16T19:58:04.589253+0000","last_unstale":"2023-10-16T19:58:05.599331+0000","last_undegraded":"2023-10-16T19:58:05.599331+0000","last_fullsized":"2023-10-16T19:58:05.599331+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_clean_scrub_stamp":"2023-10-16T19:58:03.569082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:45:34.917364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.602765+0000","last_change":"2023-10-16T19:58:05.602710+0000","last_active":"2023-10-16T19:58:05.602765+0000","last_peered":"2023-10-16T19:58:05.602765+0000","last_clean":"2023-10-16T19:58:05.602765+0000","last_became_active":"2023-10-16T19:58:05.602336+0000","last_became_peered":"2023-10-16T19:58:05.602336+0000","last_unstale":"2023-10-16T19:58:05.602765+0000","last_undegraded":"2023-10-16T19:58:05.602765+0000","last_fullsized":"2023-10-16T19:58:05.602765+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:47:35.655272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.604979+0000","last_change":"2023-10-16T19:58:04.586281+0000","last_active":"2023-10-16T19:58:05.604979+0000","last_peered":"2023-10-16T19:58:05.604979+0000","last_clean":"2023-10-16T19:58:05.604979+0000","last_became_active":"2023-10-16T19:58:04.586047+0000","last_became_peered":"2023-10-16T19:58:04.586047+0000","last_unstale":"2023-10-16T19:58:05.604979+0000","last_undegraded":"2023-10-16T19:58:05.604979+0000","last_fullsized":"2023-10-16T19:58:05.604979+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_clean_scrub_stamp":"2023-10-16T19:58:03.569082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:31:31.566550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.606771+0000","last_change":"2023-10-16T19:58:05.606519+0000","last_active":"2023-10-16T19:58:05.606771+0000","last_peered":"2023-10-16T19:58:05.606771+0000","last_clean":"2023-10-16T19:58:05.606771+0000","last_became_active":"2023-10-16T19:58:05.606148+0000","last_became_peered":"2023-10-16T19:58:05.606148+0000","last_unstale":"2023-10-16T19:58:05.606771+0000","last_undegraded":"2023-10-16T19:58:05.606771+0000","last_fullsized":"2023-10-16T19:58:05.606771+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:55:49.957648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"32'3","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.615837+0000","last_change":"2023-10-16T19:58:04.589426+0000","last_active":"2023-10-16T19:58:05.615837+0000","last_peered":"2023-10-16T19:58:05.615837+0000","last_clean":"2023-10-16T19:58:05.615837+0000","last_became_active":"2023-10-16T19:58:04.589139+0000","last_became_peered":"2023-10-16T19:58:04.589139+0000","last_unstale":"2023-10-16T19:58:05.615837+0000","last_undegraded":"2023-10-16T19:58:05.615837+0000","last_fullsized":"2023-10-16T19:58:05.615837+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_clean_scrub_stamp":"2023-10-16T19:58:03.569082+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:55:48.953087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.601684+0000","last_change":"2023-10-16T19:58:05.601316+0000","last_active":"2023-10-16T19:58:05.601684+0000","last_peered":"2023-10-16T19:58:05.601684+0000","last_clean":"2023-10-16T19:58:05.601684+0000","last_became_active":"2023-10-16T19:58:05.600598+0000","last_became_peered":"2023-10-16T19:58:05.600598+0000","last_unstale":"2023-10-16T19:58:05.601684+0000","last_undegraded":"2023-10-16T19:58:05.601684+0000","last_fullsized":"2023-10-16T19:58:05.601684+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:29:55.757064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"32'6","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.619501+0000","last_change":"2023-10-16T19:58:04.585306+0000","last_active":"2023-10-16T19:58:05.619501+0000","last_peered":"2023-10-16T19:58:05.619501+0000","last_clean":"2023-10-16T19:58:05.619501+0000","last_became_active":"2023-10-16T19:58:04.584588+0000","last_became_peered":"2023-10-16T19:58:04.584588+0000","last_unstale":"2023-10-16T19:58:05.619501+0000","last_undegraded":"2023-10-16T19:58:05.619501+0000","last_fullsized":"2023-10-16T19:58:05.619501+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_clean_scrub_stamp":"2023-10-16T19:58:03.569082+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:26:32.485443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.602703+0000","last_change":"2023-10-16T19:58:05.602640+0000","last_active":"2023-10-16T19:58:05.602703+0000","last_peered":"2023-10-16T19:58:05.602703+0000","last_clean":"2023-10-16T19:58:05.602703+0000","last_became_active":"2023-10-16T19:58:05.602386+0000","last_became_peered":"2023-10-16T19:58:05.602386+0000","last_unstale":"2023-10-16T19:58:05.602703+0000","last_undegraded":"2023-10-16T19:58:05.602703+0000","last_fullsized":"2023-10-16T19:58:05.602703+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:04:38.247560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"32'2","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.616615+0000","last_change":"2023-10-16T19:58:04.586869+0000","last_active":"2023-10-16T19:58:05.616615+0000","last_peered":"2023-10-16T19:58:05.616615+0000","last_clean":"2023-10-16T19:58:05.616615+0000","last_became_active":"2023-10-16T19:58:04.586290+0000","last_became_peered":"2023-10-16T19:58:04.586290+0000","last_unstale":"2023-10-16T19:58:05.616615+0000","last_undegraded":"2023-10-16T19:58:05.616615+0000","last_fullsized":"2023-10-16T19:58:05.616615+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_clean_scrub_stamp":"2023-10-16T19:58:03.569082+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:36:39.376783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.606232+0000","last_change":"2023-10-16T19:58:05.606176+0000","last_active":"2023-10-16T19:58:05.606232+0000","last_peered":"2023-10-16T19:58:05.606232+0000","last_clean":"2023-10-16T19:58:05.606232+0000","last_became_active":"2023-10-16T19:58:05.605962+0000","last_became_peered":"2023-10-16T19:58:05.605962+0000","last_unstale":"2023-10-16T19:58:05.606232+0000","last_undegraded":"2023-10-16T19:58:05.606232+0000","last_fullsized":"2023-10-16T19:58:05.606232+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:36:40.381344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.596435+0000","last_change":"2023-10-16T19:58:04.587764+0000","last_active":"2023-10-16T19:58:05.596435+0000","last_peered":"2023-10-16T19:58:05.596435+0000","last_clean":"2023-10-16T19:58:05.596435+0000","last_became_active":"2023-10-16T19:58:04.587531+0000","last_became_peered":"2023-10-16T19:58:04.587531+0000","last_unstale":"2023-10-16T19:58:05.596435+0000","last_undegraded":"2023-10-16T19:58:05.596435+0000","last_fullsized":"2023-10-16T19:58:05.596435+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_clean_scrub_stamp":"2023-10-16T19:58:03.569082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:43:31.501292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.608254+0000","last_change":"2023-10-16T19:58:05.608149+0000","last_active":"2023-10-16T19:58:05.608254+0000","last_peered":"2023-10-16T19:58:05.608254+0000","last_clean":"2023-10-16T19:58:05.608254+0000","last_became_active":"2023-10-16T19:58:05.607449+0000","last_became_peered":"2023-10-16T19:58:05.607449+0000","last_unstale":"2023-10-16T19:58:05.608254+0000","last_undegraded":"2023-10-16T19:58:05.608254+0000","last_fullsized":"2023-10-16T19:58:05.608254+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:09:04.664112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.596710+0000","last_change":"2023-10-16T19:58:04.588496+0000","last_active":"2023-10-16T19:58:05.596710+0000","last_peered":"2023-10-16T19:58:05.596710+0000","last_clean":"2023-10-16T19:58:05.596710+0000","last_became_active":"2023-10-16T19:58:04.588305+0000","last_became_peered":"2023-10-16T19:58:04.588305+0000","last_unstale":"2023-10-16T19:58:05.596710+0000","last_undegraded":"2023-10-16T19:58:05.596710+0000","last_fullsized":"2023-10-16T19:58:05.596710+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_clean_scrub_stamp":"2023-10-16T19:58:03.569082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:29:54.752503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.600643+0000","last_change":"2023-10-16T19:58:05.599594+0000","last_active":"2023-10-16T19:58:05.600643+0000","last_peered":"2023-10-16T19:58:05.600643+0000","last_clean":"2023-10-16T19:58:05.600643+0000","last_became_active":"2023-10-16T19:58:05.599356+0000","last_became_peered":"2023-10-16T19:58:05.599356+0000","last_unstale":"2023-10-16T19:58:05.600643+0000","last_undegraded":"2023-10-16T19:58:05.600643+0000","last_fullsized":"2023-10-16T19:58:05.600643+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:11:36.806952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"32'8","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.618703+0000","last_change":"2023-10-16T19:58:04.580974+0000","last_active":"2023-10-16T19:58:05.618703+0000","last_peered":"2023-10-16T19:58:05.618703+0000","last_clean":"2023-10-16T19:58:05.618703+0000","last_became_active":"2023-10-16T19:58:04.580648+0000","last_became_peered":"2023-10-16T19:58:04.580648+0000","last_unstale":"2023-10-16T19:58:05.618703+0000","last_undegraded":"2023-10-16T19:58:05.618703+0000","last_fullsized":"2023-10-16T19:58:05.618703+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_clean_scrub_stamp":"2023-10-16T19:58:03.569082+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:26:45.146069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.601751+0000","last_change":"2023-10-16T19:58:05.600582+0000","last_active":"2023-10-16T19:58:05.601751+0000","last_peered":"2023-10-16T19:58:05.601751+0000","last_clean":"2023-10-16T19:58:05.601751+0000","last_became_active":"2023-10-16T19:58:05.600333+0000","last_became_peered":"2023-10-16T19:58:05.600333+0000","last_unstale":"2023-10-16T19:58:05.601751+0000","last_undegraded":"2023-10-16T19:58:05.601751+0000","last_fullsized":"2023-10-16T19:58:05.601751+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:20:13.830601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"32'1","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.616855+0000","last_change":"2023-10-16T19:58:04.587935+0000","last_active":"2023-10-16T19:58:05.616855+0000","last_peered":"2023-10-16T19:58:05.616855+0000","last_clean":"2023-10-16T19:58:05.616855+0000","last_became_active":"2023-10-16T19:58:04.587576+0000","last_became_peered":"2023-10-16T19:58:04.587576+0000","last_unstale":"2023-10-16T19:58:05.616855+0000","last_undegraded":"2023-10-16T19:58:05.616855+0000","last_fullsized":"2023-10-16T19:58:05.616855+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_clean_scrub_stamp":"2023-10-16T19:58:03.569082+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:05:22.385602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.600049+0000","last_change":"2023-10-16T19:58:05.599461+0000","last_active":"2023-10-16T19:58:05.600049+0000","last_peered":"2023-10-16T19:58:05.600049+0000","last_clean":"2023-10-16T19:58:05.600049+0000","last_became_active":"2023-10-16T19:58:05.598861+0000","last_became_peered":"2023-10-16T19:58:05.598861+0000","last_unstale":"2023-10-16T19:58:05.600049+0000","last_undegraded":"2023-10-16T19:58:05.600049+0000","last_fullsized":"2023-10-16T19:58:05.600049+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:07:11.937484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"32'2","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.616460+0000","last_change":"2023-10-16T19:58:04.586713+0000","last_active":"2023-10-16T19:58:05.616460+0000","last_peered":"2023-10-16T19:58:05.616460+0000","last_clean":"2023-10-16T19:58:05.616460+0000","last_became_active":"2023-10-16T19:58:04.585973+0000","last_became_peered":"2023-10-16T19:58:04.585973+0000","last_unstale":"2023-10-16T19:58:05.616460+0000","last_undegraded":"2023-10-16T19:58:05.616460+0000","last_fullsized":"2023-10-16T19:58:05.616460+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_clean_scrub_stamp":"2023-10-16T19:58:03.569082+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:55:48.953087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.607137+0000","last_change":"2023-10-16T19:58:05.606948+0000","last_active":"2023-10-16T19:58:05.607137+0000","last_peered":"2023-10-16T19:58:05.607137+0000","last_clean":"2023-10-16T19:58:05.607137+0000","last_became_active":"2023-10-16T19:58:05.606722+0000","last_became_peered":"2023-10-16T19:58:05.606722+0000","last_unstale":"2023-10-16T19:58:05.607137+0000","last_undegraded":"2023-10-16T19:58:05.607137+0000","last_fullsized":"2023-10-16T19:58:05.607137+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:31:32.571112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"32'1","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.615577+0000","last_change":"2023-10-16T19:58:04.587531+0000","last_active":"2023-10-16T19:58:05.615577+0000","last_peered":"2023-10-16T19:58:05.615577+0000","last_clean":"2023-10-16T19:58:05.615577+0000","last_became_active":"2023-10-16T19:58:04.586934+0000","last_became_peered":"2023-10-16T19:58:04.586934+0000","last_unstale":"2023-10-16T19:58:05.615577+0000","last_undegraded":"2023-10-16T19:58:05.615577+0000","last_fullsized":"2023-10-16T19:58:05.615577+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_clean_scrub_stamp":"2023-10-16T19:58:03.569082+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:50:59.901042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.607563+0000","last_change":"2023-10-16T19:58:05.607501+0000","last_active":"2023-10-16T19:58:05.607563+0000","last_peered":"2023-10-16T19:58:05.607563+0000","last_clean":"2023-10-16T19:58:05.607563+0000","last_became_active":"2023-10-16T19:58:05.607269+0000","last_became_peered":"2023-10-16T19:58:05.607269+0000","last_unstale":"2023-10-16T19:58:05.607563+0000","last_undegraded":"2023-10-16T19:58:05.607563+0000","last_fullsized":"2023-10-16T19:58:05.607563+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:56:09.202617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.596461+0000","last_change":"2023-10-16T19:58:04.592403+0000","last_active":"2023-10-16T19:58:05.596461+0000","last_peered":"2023-10-16T19:58:05.596461+0000","last_clean":"2023-10-16T19:58:05.596461+0000","last_became_active":"2023-10-16T19:58:04.591967+0000","last_became_peered":"2023-10-16T19:58:04.591967+0000","last_unstale":"2023-10-16T19:58:05.596461+0000","last_undegraded":"2023-10-16T19:58:05.596461+0000","last_fullsized":"2023-10-16T19:58:05.596461+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_clean_scrub_stamp":"2023-10-16T19:58:03.569082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:46:15.563804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.600470+0000","last_change":"2023-10-16T19:58:05.600386+0000","last_active":"2023-10-16T19:58:05.600470+0000","last_peered":"2023-10-16T19:58:05.600470+0000","last_clean":"2023-10-16T19:58:05.600470+0000","last_became_active":"2023-10-16T19:58:05.600081+0000","last_became_peered":"2023-10-16T19:58:05.600081+0000","last_unstale":"2023-10-16T19:58:05.600470+0000","last_undegraded":"2023-10-16T19:58:05.600470+0000","last_fullsized":"2023-10-16T19:58:05.600470+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:28:20.445641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"32'2","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.617478+0000","last_change":"2023-10-16T19:58:04.588001+0000","last_active":"2023-10-16T19:58:05.617478+0000","last_peered":"2023-10-16T19:58:05.617478+0000","last_clean":"2023-10-16T19:58:05.617478+0000","last_became_active":"2023-10-16T19:58:04.587629+0000","last_became_peered":"2023-10-16T19:58:04.587629+0000","last_unstale":"2023-10-16T19:58:05.617478+0000","last_undegraded":"2023-10-16T19:58:05.617478+0000","last_fullsized":"2023-10-16T19:58:05.617478+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_clean_scrub_stamp":"2023-10-16T19:58:03.569082+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:57:52.788971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.607628+0000","last_change":"2023-10-16T19:58:05.607547+0000","last_active":"2023-10-16T19:58:05.607628+0000","last_peered":"2023-10-16T19:58:05.607628+0000","last_clean":"2023-10-16T19:58:05.607628+0000","last_became_active":"2023-10-16T19:58:05.607311+0000","last_became_peered":"2023-10-16T19:58:05.607311+0000","last_unstale":"2023-10-16T19:58:05.607628+0000","last_undegraded":"2023-10-16T19:58:05.607628+0000","last_fullsized":"2023-10-16T19:58:05.607628+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:10:11.530921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.597271+0000","last_change":"2023-10-16T19:58:04.583596+0000","last_active":"2023-10-16T19:58:05.597271+0000","last_peered":"2023-10-16T19:58:05.597271+0000","last_clean":"2023-10-16T19:58:05.597271+0000","last_became_active":"2023-10-16T19:58:04.583346+0000","last_became_peered":"2023-10-16T19:58:04.583346+0000","last_unstale":"2023-10-16T19:58:05.597271+0000","last_undegraded":"2023-10-16T19:58:05.597271+0000","last_fullsized":"2023-10-16T19:58:05.597271+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_clean_scrub_stamp":"2023-10-16T19:58:03.569082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:08:50.287071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.605826+0000","last_change":"2023-10-16T19:58:05.605758+0000","last_active":"2023-10-16T19:58:05.605826+0000","last_peered":"2023-10-16T19:58:05.605826+0000","last_clean":"2023-10-16T19:58:05.605826+0000","last_became_active":"2023-10-16T19:58:05.605529+0000","last_became_peered":"2023-10-16T19:58:05.605529+0000","last_unstale":"2023-10-16T19:58:05.605826+0000","last_undegraded":"2023-10-16T19:58:05.605826+0000","last_fullsized":"2023-10-16T19:58:05.605826+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:19:02.376592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.598037+0000","last_change":"2023-10-16T19:58:04.590215+0000","last_active":"2023-10-16T19:58:05.598037+0000","last_peered":"2023-10-16T19:58:05.598037+0000","last_clean":"2023-10-16T19:58:05.598037+0000","last_became_active":"2023-10-16T19:58:04.589542+0000","last_became_peered":"2023-10-16T19:58:04.589542+0000","last_unstale":"2023-10-16T19:58:05.598037+0000","last_undegraded":"2023-10-16T19:58:05.598037+0000","last_fullsized":"2023-10-16T19:58:05.598037+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_clean_scrub_stamp":"2023-10-16T19:58:03.569082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:57:52.788971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.609785+0000","last_change":"2023-10-16T19:58:05.608889+0000","last_active":"2023-10-16T19:58:05.609785+0000","last_peered":"2023-10-16T19:58:05.609785+0000","last_clean":"2023-10-16T19:58:05.609785+0000","last_became_active":"2023-10-16T19:58:05.608517+0000","last_became_peered":"2023-10-16T19:58:05.608517+0000","last_unstale":"2023-10-16T19:58:05.609785+0000","last_undegraded":"2023-10-16T19:58:05.609785+0000","last_fullsized":"2023-10-16T19:58:05.609785+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:57:59.985913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.594423+0000","last_change":"2023-10-16T19:58:04.587619+0000","last_active":"2023-10-16T19:58:05.594423+0000","last_peered":"2023-10-16T19:58:05.594423+0000","last_clean":"2023-10-16T19:58:05.594423+0000","last_became_active":"2023-10-16T19:58:04.587332+0000","last_became_peered":"2023-10-16T19:58:04.587332+0000","last_unstale":"2023-10-16T19:58:05.594423+0000","last_undegraded":"2023-10-16T19:58:05.594423+0000","last_fullsized":"2023-10-16T19:58:05.594423+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_clean_scrub_stamp":"2023-10-16T19:58:03.569082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:09:03.659551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.601229+0000","last_change":"2023-10-16T19:58:05.600830+0000","last_active":"2023-10-16T19:58:05.601229+0000","last_peered":"2023-10-16T19:58:05.601229+0000","last_clean":"2023-10-16T19:58:05.601229+0000","last_became_active":"2023-10-16T19:58:05.600305+0000","last_became_peered":"2023-10-16T19:58:05.600305+0000","last_unstale":"2023-10-16T19:58:05.601229+0000","last_undegraded":"2023-10-16T19:58:05.601229+0000","last_fullsized":"2023-10-16T19:58:05.601229+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:03:41.842825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"32'2","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.616656+0000","last_change":"2023-10-16T19:58:04.582724+0000","last_active":"2023-10-16T19:58:05.616656+0000","last_peered":"2023-10-16T19:58:05.616656+0000","last_clean":"2023-10-16T19:58:05.616656+0000","last_became_active":"2023-10-16T19:58:04.582012+0000","last_became_peered":"2023-10-16T19:58:04.582012+0000","last_unstale":"2023-10-16T19:58:05.616656+0000","last_undegraded":"2023-10-16T19:58:05.616656+0000","last_fullsized":"2023-10-16T19:58:05.616656+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_clean_scrub_stamp":"2023-10-16T19:58:03.569082+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:55:48.953087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.602367+0000","last_change":"2023-10-16T19:58:05.602250+0000","last_active":"2023-10-16T19:58:05.602367+0000","last_peered":"2023-10-16T19:58:05.602367+0000","last_clean":"2023-10-16T19:58:05.602367+0000","last_became_active":"2023-10-16T19:58:05.600830+0000","last_became_peered":"2023-10-16T19:58:05.600830+0000","last_unstale":"2023-10-16T19:58:05.602367+0000","last_undegraded":"2023-10-16T19:58:05.602367+0000","last_fullsized":"2023-10-16T19:58:05.602367+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:10:06.943190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.605613+0000","last_change":"2023-10-16T19:58:04.587844+0000","last_active":"2023-10-16T19:58:05.605613+0000","last_peered":"2023-10-16T19:58:05.605613+0000","last_clean":"2023-10-16T19:58:05.605613+0000","last_became_active":"2023-10-16T19:58:04.587329+0000","last_became_peered":"2023-10-16T19:58:04.587329+0000","last_unstale":"2023-10-16T19:58:05.605613+0000","last_undegraded":"2023-10-16T19:58:05.605613+0000","last_fullsized":"2023-10-16T19:58:05.605613+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_clean_scrub_stamp":"2023-10-16T19:58:03.569082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:55:48.953087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.606332+0000","last_change":"2023-10-16T19:58:05.606214+0000","last_active":"2023-10-16T19:58:05.606332+0000","last_peered":"2023-10-16T19:58:05.606332+0000","last_clean":"2023-10-16T19:58:05.606332+0000","last_became_active":"2023-10-16T19:58:05.605958+0000","last_became_peered":"2023-10-16T19:58:05.605958+0000","last_unstale":"2023-10-16T19:58:05.606332+0000","last_undegraded":"2023-10-16T19:58:05.606332+0000","last_fullsized":"2023-10-16T19:58:05.606332+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:56:22.040826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.597067+0000","last_change":"2023-10-16T19:58:04.587092+0000","last_active":"2023-10-16T19:58:05.597067+0000","last_peered":"2023-10-16T19:58:05.597067+0000","last_clean":"2023-10-16T19:58:05.597067+0000","last_became_active":"2023-10-16T19:58:04.586851+0000","last_became_peered":"2023-10-16T19:58:04.586851+0000","last_unstale":"2023-10-16T19:58:05.597067+0000","last_undegraded":"2023-10-16T19:58:05.597067+0000","last_fullsized":"2023-10-16T19:58:05.597067+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_clean_scrub_stamp":"2023-10-16T19:58:03.569082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:36:39.376783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.606743+0000","last_change":"2023-10-16T19:58:05.606520+0000","last_active":"2023-10-16T19:58:05.606743+0000","last_peered":"2023-10-16T19:58:05.606743+0000","last_clean":"2023-10-16T19:58:05.606743+0000","last_became_active":"2023-10-16T19:58:05.606081+0000","last_became_peered":"2023-10-16T19:58:05.606081+0000","last_unstale":"2023-10-16T19:58:05.606743+0000","last_undegraded":"2023-10-16T19:58:05.606743+0000","last_fullsized":"2023-10-16T19:58:05.606743+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:04:38.247560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.605017+0000","last_change":"2023-10-16T19:58:04.588408+0000","last_active":"2023-10-16T19:58:05.605017+0000","last_peered":"2023-10-16T19:58:05.605017+0000","last_clean":"2023-10-16T19:58:05.605017+0000","last_became_active":"2023-10-16T19:58:04.588050+0000","last_became_peered":"2023-10-16T19:58:04.588050+0000","last_unstale":"2023-10-16T19:58:05.605017+0000","last_undegraded":"2023-10-16T19:58:05.605017+0000","last_fullsized":"2023-10-16T19:58:05.605017+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_clean_scrub_stamp":"2023-10-16T19:58:03.569082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:36:39.376783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.607582+0000","last_change":"2023-10-16T19:58:05.607522+0000","last_active":"2023-10-16T19:58:05.607582+0000","last_peered":"2023-10-16T19:58:05.607582+0000","last_clean":"2023-10-16T19:58:05.607582+0000","last_became_active":"2023-10-16T19:58:05.607381+0000","last_became_peered":"2023-10-16T19:58:05.607381+0000","last_unstale":"2023-10-16T19:58:05.607582+0000","last_undegraded":"2023-10-16T19:58:05.607582+0000","last_fullsized":"2023-10-16T19:58:05.607582+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:04:38.247560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.597179+0000","last_change":"2023-10-16T19:58:04.582574+0000","last_active":"2023-10-16T19:58:05.597179+0000","last_peered":"2023-10-16T19:58:05.597179+0000","last_clean":"2023-10-16T19:58:05.597179+0000","last_became_active":"2023-10-16T19:58:04.581711+0000","last_became_peered":"2023-10-16T19:58:04.581711+0000","last_unstale":"2023-10-16T19:58:05.597179+0000","last_undegraded":"2023-10-16T19:58:05.597179+0000","last_fullsized":"2023-10-16T19:58:05.597179+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_clean_scrub_stamp":"2023-10-16T19:58:03.569082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:57:52.788971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.602783+0000","last_change":"2023-10-16T19:58:05.602722+0000","last_active":"2023-10-16T19:58:05.602783+0000","last_peered":"2023-10-16T19:58:05.602783+0000","last_clean":"2023-10-16T19:58:05.602783+0000","last_became_active":"2023-10-16T19:58:05.602184+0000","last_became_peered":"2023-10-16T19:58:05.602184+0000","last_unstale":"2023-10-16T19:58:05.602783+0000","last_undegraded":"2023-10-16T19:58:05.602783+0000","last_fullsized":"2023-10-16T19:58:05.602783+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:07:11.937484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.597299+0000","last_change":"2023-10-16T19:58:04.589600+0000","last_active":"2023-10-16T19:58:05.597299+0000","last_peered":"2023-10-16T19:58:05.597299+0000","last_clean":"2023-10-16T19:58:05.597299+0000","last_became_active":"2023-10-16T19:58:04.587683+0000","last_became_peered":"2023-10-16T19:58:04.587683+0000","last_unstale":"2023-10-16T19:58:05.597299+0000","last_undegraded":"2023-10-16T19:58:05.597299+0000","last_fullsized":"2023-10-16T19:58:05.597299+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_clean_scrub_stamp":"2023-10-16T19:58:03.569082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:56:21.036265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.601774+0000","last_change":"2023-10-16T19:58:05.601329+0000","last_active":"2023-10-16T19:58:05.601774+0000","last_peered":"2023-10-16T19:58:05.601774+0000","last_clean":"2023-10-16T19:58:05.601774+0000","last_became_active":"2023-10-16T19:58:05.601074+0000","last_became_peered":"2023-10-16T19:58:05.601074+0000","last_unstale":"2023-10-16T19:58:05.601774+0000","last_undegraded":"2023-10-16T19:58:05.601774+0000","last_fullsized":"2023-10-16T19:58:05.601774+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:11:36.806952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.598815+0000","last_change":"2023-10-16T19:58:04.588810+0000","last_active":"2023-10-16T19:58:05.598815+0000","last_peered":"2023-10-16T19:58:05.598815+0000","last_clean":"2023-10-16T19:58:05.598815+0000","last_became_active":"2023-10-16T19:58:04.588392+0000","last_became_peered":"2023-10-16T19:58:04.588392+0000","last_unstale":"2023-10-16T19:58:05.598815+0000","last_undegraded":"2023-10-16T19:58:05.598815+0000","last_fullsized":"2023-10-16T19:58:05.598815+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_clean_scrub_stamp":"2023-10-16T19:58:03.569082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:41:57.381509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.609820+0000","last_change":"2023-10-16T19:58:05.609385+0000","last_active":"2023-10-16T19:58:05.609820+0000","last_peered":"2023-10-16T19:58:05.609820+0000","last_clean":"2023-10-16T19:58:05.609820+0000","last_became_active":"2023-10-16T19:58:05.609118+0000","last_became_peered":"2023-10-16T19:58:05.609118+0000","last_unstale":"2023-10-16T19:58:05.609820+0000","last_undegraded":"2023-10-16T19:58:05.609820+0000","last_fullsized":"2023-10-16T19:58:05.609820+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:41:58.386070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.597439+0000","last_change":"2023-10-16T19:58:04.586182+0000","last_active":"2023-10-16T19:58:05.597439+0000","last_peered":"2023-10-16T19:58:05.597439+0000","last_clean":"2023-10-16T19:58:05.597439+0000","last_became_active":"2023-10-16T19:58:04.585930+0000","last_became_peered":"2023-10-16T19:58:04.585930+0000","last_unstale":"2023-10-16T19:58:05.597439+0000","last_undegraded":"2023-10-16T19:58:05.597439+0000","last_fullsized":"2023-10-16T19:58:05.597439+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_clean_scrub_stamp":"2023-10-16T19:58:03.569082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:50:59.901042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":174,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-16T19:58:04.583225+0000","last_change":"2023-10-16T19:56:58.775782+0000","last_active":"2023-10-16T19:58:04.583225+0000","last_peered":"2023-10-16T19:58:04.583225+0000","last_clean":"2023-10-16T19:58:04.583225+0000","last_became_active":"2023-10-16T19:56:58.775567+0000","last_became_peered":"2023-10-16T19:56:58.775567+0000","last_unstale":"2023-10-16T19:58:04.583225+0000","last_undegraded":"2023-10-16T19:58:04.583225+0000","last_fullsized":"2023-10-16T19:58:04.583225+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:56:57.693332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:56:57.693332+0000","last_clean_scrub_stamp":"2023-10-16T19:56:57.693332+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:10:23.849736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574864,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":705,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194606,"statfs":{"total":200000000,"available":199277538,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 19:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.56100000000000005}]},{"osd":1,"last update":"Mon Oct 16 19:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.502}]},{"osd":2,"last update":"Mon Oct 16 19:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.629},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.52700000000000002}]},{"osd":3,"last update":"Mon Oct 16 19:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.47399999999999998}]},{"osd":4,"last update":"Mon Oct 16 19:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.61499999999999999}]},{"osd":5,"last update":"Mon Oct 16 19:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"last":0.54700000000000004}]},{"osd":6,"last update":"Mon Oct 16 19:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.68700000000000006}]}]},{"osd":6,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":128,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195183,"statfs":{"total":200000000,"available":199867906,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 19:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.65800000000000003}]},{"osd":1,"last update":"Mon Oct 16 19:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.69899999999999995}]},{"osd":2,"last update":"Mon Oct 16 19:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.58899999999999997}]},{"osd":3,"last update":"Mon Oct 16 19:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.49299999999999999}]},{"osd":4,"last update":"Mon Oct 16 19:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.71399999999999997}]},{"osd":5,"last update":"Mon Oct 16 19:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.73199999999999998}]},{"osd":7,"last update":"Mon Oct 16 19:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.628}]}]},{"osd":1,"up_from":13,"seq":55834574864,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":137,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195175,"statfs":{"total":200000000,"available":199859467,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 19:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"min":{"1min":0.19700000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"last":0.443},{"interface":"front","average":{"1min":0.309,"5min":0.309,"15min":0.309},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"last":0.5}]},{"osd":2,"last update":"Mon Oct 16 19:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.443,"5min":0.443,"15min":0.443},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"last":0.42499999999999999}]},{"osd":3,"last update":"Mon Oct 16 19:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"last":0.45700000000000002}]},{"osd":4,"last update":"Mon Oct 16 19:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.73599999999999999}]},{"osd":5,"last update":"Mon Oct 16 19:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.72599999999999998}]},{"osd":6,"last update":"Mon Oct 16 19:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.70499999999999996}]},{"osd":7,"last update":"Mon Oct 16 19:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.64200000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574864,"num_pgs":10,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":705,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194606,"statfs":{"total":200000000,"available":199277538,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 16 19:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":11.031000000000001,"5min":11.031000000000001,"15min":11.031000000000001},"last":0.39200000000000002},{"interface":"front","average":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":12.218,"5min":12.218,"15min":12.218},"last":0.40300000000000002}]},{"osd":2,"last update":"Mon Oct 16 19:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":11.058,"5min":11.058,"15min":11.058},"last":0.41799999999999998},{"interface":"front","average":{"1min":1.123,"5min":1.123,"15min":1.123},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":14.763999999999999,"5min":14.763999999999999,"15min":14.763999999999999},"last":0.35799999999999998}]},{"osd":3,"last update":"Mon Oct 16 19:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":10.935,"5min":10.935,"15min":10.935},"last":0.372},{"interface":"front","average":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":11.083,"5min":11.083,"15min":11.083},"last":0.34000000000000002}]},{"osd":4,"last update":"Mon Oct 16 19:57:58 2023","interfaces":[{"interface":"back","average":{"1min":1.196,"5min":1.196,"15min":1.196},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":12.279,"5min":12.279,"15min":12.279},"last":0.42899999999999999},{"interface":"front","average":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":10.879,"5min":10.879,"15min":10.879},"last":0.46700000000000003}]},{"osd":5,"last update":"Mon Oct 16 19:57:58 2023","interfaces":[{"interface":"back","average":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":10.907,"5min":10.907,"15min":10.907},"last":0.52800000000000002},{"interface":"front","average":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":11,"5min":11,"15min":11},"last":0.45700000000000002}]},{"osd":6,"last update":"Mon Oct 16 19:57:58 2023","interfaces":[{"interface":"back","average":{"1min":1.157,"5min":1.157,"15min":1.157},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":10.972,"5min":10.972,"15min":10.972},"last":0.53800000000000003},{"interface":"front","average":{"1min":1.24,"5min":1.24,"15min":1.24},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":12.34,"5min":12.34,"15min":12.34},"last":0.51400000000000001}]},{"osd":7,"last update":"Mon Oct 16 19:57:58 2023","interfaces":[{"interface":"back","average":{"1min":1.252,"5min":1.252,"15min":1.252},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":12.311,"5min":12.311,"15min":12.311},"last":0.54800000000000004},{"interface":"front","average":{"1min":1.167,"5min":1.167,"15min":1.167},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":10.845000000000001,"5min":10.845000000000001,"15min":10.845000000000001},"last":0.504}]}]},{"osd":2,"up_from":13,"seq":55834574864,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":128,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195183,"statfs":{"total":200000000,"available":199867906,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 19:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"min":{"1min":0.17899999999999999,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"min":{"1min":0.20100000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.29799999999999999}]},{"osd":1,"last update":"Mon Oct 16 19:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.375,"15min":0.375},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.37,"5min":0.37,"15min":0.37},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"last":0.38200000000000001}]},{"osd":3,"last update":"Mon Oct 16 19:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.439}]},{"osd":4,"last update":"Mon Oct 16 19:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.73699999999999999}]},{"osd":5,"last update":"Mon Oct 16 19:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.71699999999999997}]},{"osd":6,"last update":"Mon Oct 16 19:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.81499999999999995}]},{"osd":7,"last update":"Mon Oct 16 19:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.76700000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574864,"num_pgs":31,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":128,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195183,"statfs":{"total":200000000,"available":199867906,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 19:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"last":0.28699999999999998},{"interface":"front","average":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.498,"5min":0.498,"15min":0.498},"last":0.35099999999999998}]},{"osd":1,"last update":"Mon Oct 16 19:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"min":{"1min":0.20499999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.371}]},{"osd":2,"last update":"Mon Oct 16 19:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.41899999999999998}]},{"osd":4,"last update":"Mon Oct 16 19:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.498}]},{"osd":5,"last update":"Mon Oct 16 19:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.47599999999999998}]},{"osd":6,"last update":"Mon Oct 16 19:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.56999999999999995}]},{"osd":7,"last update":"Mon Oct 16 19:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.2030000000000001,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.438},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.139,"5min":1.139,"15min":1.139},"last":0.52800000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":135,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195176,"statfs":{"total":200000000,"available":199860997,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 19:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.41799999999999998}]},{"osd":1,"last update":"Mon Oct 16 19:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.034,"5min":1.034,"15min":1.034},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.44500000000000001}]},{"osd":2,"last update":"Mon Oct 16 19:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.103,"5min":1.103,"15min":1.103},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.53200000000000003}]},{"osd":3,"last update":"Mon Oct 16 19:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.071,"5min":1.071,"15min":1.071},"last":0.47799999999999998}]},{"osd":5,"last update":"Mon Oct 16 19:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.56000000000000005}]},{"osd":6,"last update":"Mon Oct 16 19:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.63300000000000001}]},{"osd":7,"last update":"Mon Oct 16 19:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.61799999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":136,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195176,"statfs":{"total":200000000,"available":199860429,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 19:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.41799999999999998}]},{"osd":1,"last update":"Mon Oct 16 19:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":7.9989999999999997,"5min":7.9989999999999997,"15min":7.9989999999999997},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":8.0150000000000006,"5min":8.0150000000000006,"15min":8.0150000000000006},"last":0.51900000000000002}]},{"osd":2,"last update":"Mon Oct 16 19:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":1.032,"5min":1.032,"15min":1.032},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.47899999999999998}]},{"osd":3,"last update":"Mon Oct 16 19:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":8.077,"5min":8.077,"15min":8.077},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.61599999999999999}]},{"osd":4,"last update":"Mon Oct 16 19:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.495}]},{"osd":6,"last update":"Mon Oct 16 19:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.59899999999999998}]},{"osd":7,"last update":"Mon Oct 16 19:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.63100000000000001}]}]}],"pool_statfs":[]}} 2023-10-16T19:58:09.706 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-16T19:58:09.860 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.858+0000 7f615ae8b700 1 Processor -- start 2023-10-16T19:58:09.861 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.858+0000 7f615ae8b700 1 -- start start 2023-10-16T19:58:09.871 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.859+0000 7f615ae8b700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f615415b130 0x7f6154071f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:09.871 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.859+0000 7f615ae8b700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61540cefc0 con 0x7f615406eb20 2023-10-16T19:58:09.872 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.859+0000 7f615ae8b700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f615406e090 con 0x7f615406d0f0 2023-10-16T19:58:09.872 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.859+0000 7f615ae8b700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61540b0050 con 0x7f615415b130 2023-10-16T19:58:09.872 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.859+0000 7f6159428700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f615406eb20 0x7f61540cf450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:57338/0 (socket says 172.21.15.157:57338) 2023-10-16T19:58:09.872 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.859+0000 7f6159428700 1 -- 172.21.15.157:0/1828137356 learned_addr learned my addr 172.21.15.157:0/1828137356 (peer_addr_for_me v1:172.21.15.157:0/0) 2023-10-16T19:58:09.872 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.859+0000 7f6158c27700 1 --2- 172.21.15.157:0/1828137356 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f615415b130 0x7f6154071f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:09.873 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.859+0000 7f61537fe700 1 -- 172.21.15.157:0/1828137356 <== mon.0 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2303300237 0 0) 0x7f61540cefc0 con 0x7f615406eb20 2023-10-16T19:58:09.873 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.859+0000 7f61537fe700 1 -- 172.21.15.157:0/1828137356 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f61440035b0 con 0x7f615406eb20 2023-10-16T19:58:09.873 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.859+0000 7f61537fe700 1 -- 172.21.15.157:0/1828137356 <== mon.0 v1:172.21.15.157:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4178349958 0 0) 0x7f61440035b0 con 0x7f615406eb20 2023-10-16T19:58:09.873 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.859+0000 7f61537fe700 1 -- 172.21.15.157:0/1828137356 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f615415b130 msgr2=0x7f6154071f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:58:09.873 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.859+0000 7f61537fe700 1 --2- 172.21.15.157:0/1828137356 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f615415b130 0x7f6154071f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:09.874 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.859+0000 7f61537fe700 1 -- 172.21.15.157:0/1828137356 >> v1:172.21.15.187:6789/0 conn(0x7f615406d0f0 legacy=0x7f61540cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:09.874 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.859+0000 7f61537fe700 1 -- 172.21.15.157:0/1828137356 --> v1:172.21.15.157:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f615406d570 con 0x7f615406eb20 2023-10-16T19:58:09.874 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.859+0000 7f61537fe700 1 -- 172.21.15.157:0/1828137356 <== mon.0 v1:172.21.15.157:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4021145519 0 0) 0x7f614c001a40 con 0x7f615406eb20 2023-10-16T19:58:09.875 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.860+0000 7f61537fe700 1 -- 172.21.15.157:0/1828137356 >> v1:172.21.15.157:6789/0 conn(0x7f615406eb20 legacy=0x7f61540cf450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:09.875 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.860+0000 7f61537fe700 1 --2- 172.21.15.157:0/1828137356 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6144003a30 0x7f6144003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:09.875 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.860+0000 7f61537fe700 1 --2- 172.21.15.157:0/1828137356 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f615415b130 0x7f6144004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:09.875 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.860+0000 7f61537fe700 1 --2- 172.21.15.157:0/1828137356 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6144004d90 0x7f6144005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:09.876 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.860+0000 7f61537fe700 1 -- 172.21.15.157:0/1828137356 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f614400bba0 con 0x7f6144003a30 2023-10-16T19:58:09.876 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.860+0000 7f61537fe700 1 -- 172.21.15.157:0/1828137356 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f614400bce0 con 0x7f6144004d90 2023-10-16T19:58:09.876 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.860+0000 7f61537fe700 1 -- 172.21.15.157:0/1828137356 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f614400be70 con 0x7f615415b130 2023-10-16T19:58:09.876 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.860+0000 7f6158c27700 1 --2- 172.21.15.157:0/1828137356 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6144003a30 0x7f6144003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:09.876 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.860+0000 7f6153fff700 1 --2- 172.21.15.157:0/1828137356 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f615415b130 0x7f6144004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:09.877 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.860+0000 7f6159428700 1 --2- 172.21.15.157:0/1828137356 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6144004d90 0x7f6144005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:09.877 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.860+0000 7f6158c27700 1 -- 172.21.15.157:0/1828137356 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f615415b130 msgr2=0x7f6144004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:58:09.877 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.860+0000 7f6158c27700 1 --2- 172.21.15.157:0/1828137356 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f615415b130 0x7f6144004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:09.877 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.860+0000 7f6158c27700 1 -- 172.21.15.157:0/1828137356 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6144004d90 msgr2=0x7f6144005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:58:09.877 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.860+0000 7f6158c27700 1 --2- 172.21.15.157:0/1828137356 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6144004d90 0x7f6144005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:09.878 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.860+0000 7f6158c27700 1 -- 172.21.15.157:0/1828137356 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61440035b0 con 0x7f6144003a30 2023-10-16T19:58:09.878 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.860+0000 7f6159428700 1 --2- 172.21.15.157:0/1828137356 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6144004d90 0x7f6144005210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T19:58:09.878 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.860+0000 7f6158c27700 1 --2- 172.21.15.157:0/1828137356 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6144003a30 0x7f6144003e10 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f6148009b90 tx=0x7f6144005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37922fa15ea2257c server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:58:09.878 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.860+0000 7f61537fe700 1 -- 172.21.15.157:0/1828137356 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f614800e6c0 con 0x7f6144003a30 2023-10-16T19:58:09.879 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.860+0000 7f61537fe700 1 -- 172.21.15.157:0/1828137356 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f614800e820 con 0x7f6144003a30 2023-10-16T19:58:09.879 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.860+0000 7f61537fe700 1 -- 172.21.15.157:0/1828137356 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f614800eb90 con 0x7f6144003a30 2023-10-16T19:58:09.879 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.861+0000 7f615ae8b700 1 -- 172.21.15.157:0/1828137356 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6144003a30 msgr2=0x7f6144003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:09.879 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.861+0000 7f615ae8b700 1 --2- 172.21.15.157:0/1828137356 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6144003a30 0x7f6144003e10 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f6148009b90 tx=0x7f6144005880 comp rx=0 tx=0).stop 2023-10-16T19:58:09.879 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.861+0000 7f6159428700 1 -- 172.21.15.157:0/1828137356 reap_dead start 2023-10-16T19:58:09.880 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.861+0000 7f615ae8b700 1 -- 172.21.15.157:0/1828137356 shutdown_connections 2023-10-16T19:58:09.880 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.861+0000 7f615ae8b700 1 -- 172.21.15.157:0/1828137356 >> 172.21.15.157:0/1828137356 conn(0x7f61540cd4e0 msgr2=0x7f61540cd8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:58:09.880 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.861+0000 7f615ae8b700 1 -- 172.21.15.157:0/1828137356 shutdown_connections 2023-10-16T19:58:09.880 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.861+0000 7f615ae8b700 1 -- 172.21.15.157:0/1828137356 wait complete. 2023-10-16T19:58:09.880 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.862+0000 7f615ae8b700 1 Processor -- start 2023-10-16T19:58:09.880 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.862+0000 7f615ae8b700 1 -- start start 2023-10-16T19:58:09.881 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.863+0000 7f615ae8b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6144003a30 0x7f6154152fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:09.881 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.863+0000 7f615ae8b700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f615414f190 0x7f6154153500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:09.881 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.863+0000 7f615ae8b700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6154150a30 0x7f6154150ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:09.881 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.863+0000 7f615ae8b700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6154152470 con 0x7f6154150a30 2023-10-16T19:58:09.881 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.863+0000 7f615ae8b700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61541517f0 con 0x7f6144003a30 2023-10-16T19:58:09.882 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.863+0000 7f615ae8b700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6154151ad0 con 0x7f615414f190 2023-10-16T19:58:09.882 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.863+0000 7f6159428700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6154150a30 0x7f6154150ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:09.882 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.863+0000 7f6159428700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6154150a30 0x7f6154150ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:47678/0 (socket says 172.21.15.157:47678) 2023-10-16T19:58:09.882 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.863+0000 7f6159428700 1 -- 172.21.15.157:0/828811690 learned_addr learned my addr 172.21.15.157:0/828811690 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:58:09.882 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.863+0000 7f6153fff700 1 --2- 172.21.15.157:0/828811690 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f615414f190 0x7f6154153500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:09.883 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.863+0000 7f6158c27700 1 --2- 172.21.15.157:0/828811690 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6144003a30 0x7f6154152fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:09.883 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.863+0000 7f6159428700 1 -- 172.21.15.157:0/828811690 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f615414f190 msgr2=0x7f6154153500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:09.883 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.863+0000 7f6159428700 1 --2- 172.21.15.157:0/828811690 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f615414f190 0x7f6154153500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:09.883 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.863+0000 7f6159428700 1 -- 172.21.15.157:0/828811690 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6144003a30 msgr2=0x7f6154152fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:09.883 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.863+0000 7f6159428700 1 --2- 172.21.15.157:0/828811690 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6144003a30 0x7f6154152fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:09.884 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.863+0000 7f6159428700 1 -- 172.21.15.157:0/828811690 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6154151db0 con 0x7f6154150a30 2023-10-16T19:58:09.884 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.863+0000 7f6159428700 1 --2- 172.21.15.157:0/828811690 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6154150a30 0x7f6154150ec0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f6154070ff0 tx=0x7f614c001a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:58:09.884 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.864+0000 7f61517fa700 1 -- 172.21.15.157:0/828811690 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f614c00e7f0 con 0x7f6154150a30 2023-10-16T19:58:09.884 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.864+0000 7f61517fa700 1 -- 172.21.15.157:0/828811690 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f614c00e950 con 0x7f6154150a30 2023-10-16T19:58:09.884 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.864+0000 7f615ae8b700 1 -- 172.21.15.157:0/828811690 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6154152090 con 0x7f6154150a30 2023-10-16T19:58:09.885 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.864+0000 7f61517fa700 1 -- 172.21.15.157:0/828811690 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f614c00ed00 con 0x7f6154150a30 2023-10-16T19:58:09.885 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.864+0000 7f615ae8b700 1 -- 172.21.15.157:0/828811690 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6154154980 con 0x7f6154150a30 2023-10-16T19:58:09.885 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.865+0000 7f615ae8b700 1 -- 172.21.15.157:0/828811690 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f615404f400 con 0x7f6154150a30 2023-10-16T19:58:09.885 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.865+0000 7f61517fa700 1 -- 172.21.15.157:0/828811690 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f614c007d50 con 0x7f6154150a30 2023-10-16T19:58:09.885 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.865+0000 7f61517fa700 1 --2- 172.21.15.157:0/828811690 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f613806af00 0x7f613806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:09.886 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.865+0000 7f61517fa700 1 -- 172.21.15.157:0/828811690 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5729+0+0 (secure 0 0 0) 0x7f614c089410 con 0x7f6154150a30 2023-10-16T19:58:09.886 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.866+0000 7f6158c27700 1 --2- 172.21.15.157:0/828811690 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f613806af00 0x7f613806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:09.886 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.866+0000 7f6158c27700 1 --2- 172.21.15.157:0/828811690 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f613806af00 0x7f613806d3c0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f61480090b0 tx=0x7f6148008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:58:09.887 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:09.870+0000 7f61517fa700 1 -- 172.21.15.157:0/828811690 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f614c054530 con 0x7f6154150a30 2023-10-16T19:58:10.060 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:10.057+0000 7f615ae8b700 1 -- 172.21.15.157:0/828811690 --> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f61541515e0 con 0x7f613806af00 2023-10-16T19:58:10.069 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:10.066+0000 7f61517fa700 1 -- 172.21.15.157:0/828811690 <== mgr.4100 v2:172.21.15.187:6832/2426285296 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+284526 (secure 0 0 0) 0x7f61541515e0 con 0x7f613806af00 2023-10-16T19:58:10.072 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-10-16T19:58:10.074 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:10.069+0000 7f615ae8b700 1 -- 172.21.15.157:0/828811690 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f613806af00 msgr2=0x7f613806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:10.074 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:10.069+0000 7f615ae8b700 1 --2- 172.21.15.157:0/828811690 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f613806af00 0x7f613806d3c0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f61480090b0 tx=0x7f6148008030 comp rx=0 tx=0).stop 2023-10-16T19:58:10.075 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:10.069+0000 7f615ae8b700 1 -- 172.21.15.157:0/828811690 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6154150a30 msgr2=0x7f6154150ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:10.075 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:10.069+0000 7f615ae8b700 1 --2- 172.21.15.157:0/828811690 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6154150a30 0x7f6154150ec0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f6154070ff0 tx=0x7f614c001a60 comp rx=0 tx=0).stop 2023-10-16T19:58:10.075 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:10.069+0000 7f615ae8b700 1 -- 172.21.15.157:0/828811690 shutdown_connections 2023-10-16T19:58:10.075 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:10.069+0000 7f615ae8b700 1 --2- 172.21.15.157:0/828811690 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f613806af00 0x7f613806d3c0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:10.076 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:10.069+0000 7f615ae8b700 1 --2- 172.21.15.157:0/828811690 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6144003a30 0x7f6154152fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:10.076 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:10.069+0000 7f615ae8b700 1 --2- 172.21.15.157:0/828811690 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6154150a30 0x7f6154150ec0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:10.076 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:10.069+0000 7f615ae8b700 1 --2- 172.21.15.157:0/828811690 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f615414f190 0x7f6154153500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:10.076 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:10.069+0000 7f615ae8b700 1 -- 172.21.15.157:0/828811690 >> 172.21.15.157:0/828811690 conn(0x7f61540cd4e0 msgr2=0x7f6154159e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:58:10.077 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:10.069+0000 7f615ae8b700 1 -- 172.21.15.157:0/828811690 shutdown_connections 2023-10-16T19:58:10.077 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:10.069+0000 7f615ae8b700 1 -- 172.21.15.157:0/828811690 wait complete. 2023-10-16T19:58:10.077 INFO:teuthology.orchestra.run.smithi157.stderr:dumped all 2023-10-16T19:58:10.083 INFO:teuthology.orchestra.run.smithi157.stdout:{"pg_ready":true,"pg_map":{"version":60,"stamp":"2023-10-16T19:58:08.905864+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":64,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":2207,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560292,"statfs":{"total":1600000000,"available":1597739687,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.331127"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.597367+0000","last_change":"2023-10-16T19:58:05.597289+0000","last_active":"2023-10-16T19:58:05.597367+0000","last_peered":"2023-10-16T19:58:05.597367+0000","last_clean":"2023-10-16T19:58:05.597367+0000","last_became_active":"2023-10-16T19:58:05.597025+0000","last_became_peered":"2023-10-16T19:58:05.597025+0000","last_unstale":"2023-10-16T19:58:05.597367+0000","last_undegraded":"2023-10-16T19:58:05.597367+0000","last_fullsized":"2023-10-16T19:58:05.597367+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:56:22.040826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.606306+0000","last_change":"2023-10-16T19:58:05.606250+0000","last_active":"2023-10-16T19:58:05.606306+0000","last_peered":"2023-10-16T19:58:05.606306+0000","last_clean":"2023-10-16T19:58:05.606306+0000","last_became_active":"2023-10-16T19:58:05.605969+0000","last_became_peered":"2023-10-16T19:58:05.605969+0000","last_unstale":"2023-10-16T19:58:05.606306+0000","last_undegraded":"2023-10-16T19:58:05.606306+0000","last_fullsized":"2023-10-16T19:58:05.606306+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:24:38.118997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.601703+0000","last_change":"2023-10-16T19:58:05.601472+0000","last_active":"2023-10-16T19:58:05.601703+0000","last_peered":"2023-10-16T19:58:05.601703+0000","last_clean":"2023-10-16T19:58:05.601703+0000","last_became_active":"2023-10-16T19:58:05.601072+0000","last_became_peered":"2023-10-16T19:58:05.601072+0000","last_unstale":"2023-10-16T19:58:05.601703+0000","last_undegraded":"2023-10-16T19:58:05.601703+0000","last_fullsized":"2023-10-16T19:58:05.601703+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:57:59.985913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.604001+0000","last_change":"2023-10-16T19:58:05.603410+0000","last_active":"2023-10-16T19:58:05.604001+0000","last_peered":"2023-10-16T19:58:05.604001+0000","last_clean":"2023-10-16T19:58:05.604001+0000","last_became_active":"2023-10-16T19:58:05.603003+0000","last_became_peered":"2023-10-16T19:58:05.603003+0000","last_unstale":"2023-10-16T19:58:05.604001+0000","last_undegraded":"2023-10-16T19:58:05.604001+0000","last_fullsized":"2023-10-16T19:58:05.604001+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:29:55.757064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.603593+0000","last_change":"2023-10-16T19:58:05.603205+0000","last_active":"2023-10-16T19:58:05.603593+0000","last_peered":"2023-10-16T19:58:05.603593+0000","last_clean":"2023-10-16T19:58:05.603593+0000","last_became_active":"2023-10-16T19:58:05.602976+0000","last_became_peered":"2023-10-16T19:58:05.602976+0000","last_unstale":"2023-10-16T19:58:05.603593+0000","last_undegraded":"2023-10-16T19:58:05.603593+0000","last_fullsized":"2023-10-16T19:58:05.603593+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:26:34.415435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.602632+0000","last_change":"2023-10-16T19:58:05.602575+0000","last_active":"2023-10-16T19:58:05.602632+0000","last_peered":"2023-10-16T19:58:05.602632+0000","last_clean":"2023-10-16T19:58:05.602632+0000","last_became_active":"2023-10-16T19:58:05.601803+0000","last_became_peered":"2023-10-16T19:58:05.601803+0000","last_unstale":"2023-10-16T19:58:05.602632+0000","last_undegraded":"2023-10-16T19:58:05.602632+0000","last_fullsized":"2023-10-16T19:58:05.602632+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:42:51.289673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.605544+0000","last_change":"2023-10-16T19:58:05.605393+0000","last_active":"2023-10-16T19:58:05.605544+0000","last_peered":"2023-10-16T19:58:05.605544+0000","last_clean":"2023-10-16T19:58:05.605544+0000","last_became_active":"2023-10-16T19:58:05.605148+0000","last_became_peered":"2023-10-16T19:58:05.605148+0000","last_unstale":"2023-10-16T19:58:05.605544+0000","last_undegraded":"2023-10-16T19:58:05.605544+0000","last_fullsized":"2023-10-16T19:58:05.605544+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:05:23.390163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.605562+0000","last_change":"2023-10-16T19:58:05.605461+0000","last_active":"2023-10-16T19:58:05.605562+0000","last_peered":"2023-10-16T19:58:05.605562+0000","last_clean":"2023-10-16T19:58:05.605562+0000","last_became_active":"2023-10-16T19:58:05.605200+0000","last_became_peered":"2023-10-16T19:58:05.605200+0000","last_unstale":"2023-10-16T19:58:05.605562+0000","last_undegraded":"2023-10-16T19:58:05.605562+0000","last_fullsized":"2023-10-16T19:58:05.605562+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:29:55.757064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.602882+0000","last_change":"2023-10-16T19:58:05.602243+0000","last_active":"2023-10-16T19:58:05.602882+0000","last_peered":"2023-10-16T19:58:05.602882+0000","last_clean":"2023-10-16T19:58:05.602882+0000","last_became_active":"2023-10-16T19:58:05.601910+0000","last_became_peered":"2023-10-16T19:58:05.601910+0000","last_unstale":"2023-10-16T19:58:05.602882+0000","last_undegraded":"2023-10-16T19:58:05.602882+0000","last_fullsized":"2023-10-16T19:58:05.602882+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:45:26.140866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.601197+0000","last_change":"2023-10-16T19:58:05.600582+0000","last_active":"2023-10-16T19:58:05.601197+0000","last_peered":"2023-10-16T19:58:05.601197+0000","last_clean":"2023-10-16T19:58:05.601197+0000","last_became_active":"2023-10-16T19:58:05.600356+0000","last_became_peered":"2023-10-16T19:58:05.600356+0000","last_unstale":"2023-10-16T19:58:05.601197+0000","last_undegraded":"2023-10-16T19:58:05.601197+0000","last_fullsized":"2023-10-16T19:58:05.601197+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:20:13.830601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.610390+0000","last_change":"2023-10-16T19:58:05.610325+0000","last_active":"2023-10-16T19:58:05.610390+0000","last_peered":"2023-10-16T19:58:05.610390+0000","last_clean":"2023-10-16T19:58:05.610390+0000","last_became_active":"2023-10-16T19:58:05.609979+0000","last_became_peered":"2023-10-16T19:58:05.609979+0000","last_unstale":"2023-10-16T19:58:05.610390+0000","last_undegraded":"2023-10-16T19:58:05.610390+0000","last_fullsized":"2023-10-16T19:58:05.610390+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:24:38.118997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.602350+0000","last_change":"2023-10-16T19:58:05.602076+0000","last_active":"2023-10-16T19:58:05.602350+0000","last_peered":"2023-10-16T19:58:05.602350+0000","last_clean":"2023-10-16T19:58:05.602350+0000","last_became_active":"2023-10-16T19:58:05.600490+0000","last_became_peered":"2023-10-16T19:58:05.600490+0000","last_unstale":"2023-10-16T19:58:05.602350+0000","last_undegraded":"2023-10-16T19:58:05.602350+0000","last_fullsized":"2023-10-16T19:58:05.602350+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:26:46.150630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.601247+0000","last_change":"2023-10-16T19:58:05.600961+0000","last_active":"2023-10-16T19:58:05.601247+0000","last_peered":"2023-10-16T19:58:05.601247+0000","last_clean":"2023-10-16T19:58:05.601247+0000","last_became_active":"2023-10-16T19:58:05.600614+0000","last_became_peered":"2023-10-16T19:58:05.600614+0000","last_unstale":"2023-10-16T19:58:05.601247+0000","last_undegraded":"2023-10-16T19:58:05.601247+0000","last_fullsized":"2023-10-16T19:58:05.601247+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:57:11.670061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.602495+0000","last_change":"2023-10-16T19:58:05.602410+0000","last_active":"2023-10-16T19:58:05.602495+0000","last_peered":"2023-10-16T19:58:05.602495+0000","last_clean":"2023-10-16T19:58:05.602495+0000","last_became_active":"2023-10-16T19:58:05.601569+0000","last_became_peered":"2023-10-16T19:58:05.601569+0000","last_unstale":"2023-10-16T19:58:05.602495+0000","last_undegraded":"2023-10-16T19:58:05.602495+0000","last_fullsized":"2023-10-16T19:58:05.602495+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:57:59.985913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.600100+0000","last_change":"2023-10-16T19:58:05.599789+0000","last_active":"2023-10-16T19:58:05.600100+0000","last_peered":"2023-10-16T19:58:05.600100+0000","last_clean":"2023-10-16T19:58:05.600100+0000","last_became_active":"2023-10-16T19:58:05.599026+0000","last_became_peered":"2023-10-16T19:58:05.599026+0000","last_unstale":"2023-10-16T19:58:05.600100+0000","last_undegraded":"2023-10-16T19:58:05.600100+0000","last_fullsized":"2023-10-16T19:58:05.600100+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:42:51.289673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.610275+0000","last_change":"2023-10-16T19:58:05.610219+0000","last_active":"2023-10-16T19:58:05.610275+0000","last_peered":"2023-10-16T19:58:05.610275+0000","last_clean":"2023-10-16T19:58:05.610275+0000","last_became_active":"2023-10-16T19:58:05.609613+0000","last_became_peered":"2023-10-16T19:58:05.609613+0000","last_unstale":"2023-10-16T19:58:05.610275+0000","last_undegraded":"2023-10-16T19:58:05.610275+0000","last_fullsized":"2023-10-16T19:58:05.610275+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:10:06.943190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.609767+0000","last_change":"2023-10-16T19:58:05.608855+0000","last_active":"2023-10-16T19:58:05.609767+0000","last_peered":"2023-10-16T19:58:05.609767+0000","last_clean":"2023-10-16T19:58:05.609767+0000","last_became_active":"2023-10-16T19:58:05.608184+0000","last_became_peered":"2023-10-16T19:58:05.608184+0000","last_unstale":"2023-10-16T19:58:05.609767+0000","last_undegraded":"2023-10-16T19:58:05.609767+0000","last_fullsized":"2023-10-16T19:58:05.609767+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:26:46.150630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.601335+0000","last_change":"2023-10-16T19:58:05.601271+0000","last_active":"2023-10-16T19:58:05.601335+0000","last_peered":"2023-10-16T19:58:05.601335+0000","last_clean":"2023-10-16T19:58:05.601335+0000","last_became_active":"2023-10-16T19:58:05.600977+0000","last_became_peered":"2023-10-16T19:58:05.600977+0000","last_unstale":"2023-10-16T19:58:05.601335+0000","last_undegraded":"2023-10-16T19:58:05.601335+0000","last_fullsized":"2023-10-16T19:58:05.601335+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:57:53.793532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.602620+0000","last_change":"2023-10-16T19:58:05.602564+0000","last_active":"2023-10-16T19:58:05.602620+0000","last_peered":"2023-10-16T19:58:05.602620+0000","last_clean":"2023-10-16T19:58:05.602620+0000","last_became_active":"2023-10-16T19:58:05.601866+0000","last_became_peered":"2023-10-16T19:58:05.601866+0000","last_unstale":"2023-10-16T19:58:05.602620+0000","last_undegraded":"2023-10-16T19:58:05.602620+0000","last_fullsized":"2023-10-16T19:58:05.602620+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:31:32.571112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.603825+0000","last_change":"2023-10-16T19:58:05.603764+0000","last_active":"2023-10-16T19:58:05.603825+0000","last_peered":"2023-10-16T19:58:05.603825+0000","last_clean":"2023-10-16T19:58:05.603825+0000","last_became_active":"2023-10-16T19:58:05.603536+0000","last_became_peered":"2023-10-16T19:58:05.603536+0000","last_unstale":"2023-10-16T19:58:05.603825+0000","last_undegraded":"2023-10-16T19:58:05.603825+0000","last_fullsized":"2023-10-16T19:58:05.603825+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:06:17.145932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.607120+0000","last_change":"2023-10-16T19:58:05.607035+0000","last_active":"2023-10-16T19:58:05.607120+0000","last_peered":"2023-10-16T19:58:05.607120+0000","last_clean":"2023-10-16T19:58:05.607120+0000","last_became_active":"2023-10-16T19:58:05.606725+0000","last_became_peered":"2023-10-16T19:58:05.606725+0000","last_unstale":"2023-10-16T19:58:05.607120+0000","last_undegraded":"2023-10-16T19:58:05.607120+0000","last_fullsized":"2023-10-16T19:58:05.607120+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:43:32.505853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.606469+0000","last_change":"2023-10-16T19:58:05.606076+0000","last_active":"2023-10-16T19:58:05.606469+0000","last_peered":"2023-10-16T19:58:05.606469+0000","last_clean":"2023-10-16T19:58:05.606469+0000","last_became_active":"2023-10-16T19:58:05.605335+0000","last_became_peered":"2023-10-16T19:58:05.605335+0000","last_unstale":"2023-10-16T19:58:05.606469+0000","last_undegraded":"2023-10-16T19:58:05.606469+0000","last_fullsized":"2023-10-16T19:58:05.606469+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:26:34.415435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.609430+0000","last_change":"2023-10-16T19:58:05.609361+0000","last_active":"2023-10-16T19:58:05.609430+0000","last_peered":"2023-10-16T19:58:05.609430+0000","last_clean":"2023-10-16T19:58:05.609430+0000","last_became_active":"2023-10-16T19:58:05.609123+0000","last_became_peered":"2023-10-16T19:58:05.609123+0000","last_unstale":"2023-10-16T19:58:05.609430+0000","last_undegraded":"2023-10-16T19:58:05.609430+0000","last_fullsized":"2023-10-16T19:58:05.609430+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:43:32.505853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.600080+0000","last_change":"2023-10-16T19:58:05.599645+0000","last_active":"2023-10-16T19:58:05.600080+0000","last_peered":"2023-10-16T19:58:05.600080+0000","last_clean":"2023-10-16T19:58:05.600080+0000","last_became_active":"2023-10-16T19:58:05.599210+0000","last_became_peered":"2023-10-16T19:58:05.599210+0000","last_unstale":"2023-10-16T19:58:05.600080+0000","last_undegraded":"2023-10-16T19:58:05.600080+0000","last_fullsized":"2023-10-16T19:58:05.600080+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:05:23.390163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.608276+0000","last_change":"2023-10-16T19:58:05.608218+0000","last_active":"2023-10-16T19:58:05.608276+0000","last_peered":"2023-10-16T19:58:05.608276+0000","last_clean":"2023-10-16T19:58:05.608276+0000","last_became_active":"2023-10-16T19:58:05.608010+0000","last_became_peered":"2023-10-16T19:58:05.608010+0000","last_unstale":"2023-10-16T19:58:05.608276+0000","last_undegraded":"2023-10-16T19:58:05.608276+0000","last_fullsized":"2023-10-16T19:58:05.608276+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:51:00.905603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.607457+0000","last_change":"2023-10-16T19:58:05.607417+0000","last_active":"2023-10-16T19:58:05.607457+0000","last_peered":"2023-10-16T19:58:05.607457+0000","last_clean":"2023-10-16T19:58:05.607457+0000","last_became_active":"2023-10-16T19:58:05.607185+0000","last_became_peered":"2023-10-16T19:58:05.607185+0000","last_unstale":"2023-10-16T19:58:05.607457+0000","last_undegraded":"2023-10-16T19:58:05.607457+0000","last_fullsized":"2023-10-16T19:58:05.607457+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:10:06.943190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.606343+0000","last_change":"2023-10-16T19:58:05.606277+0000","last_active":"2023-10-16T19:58:05.606343+0000","last_peered":"2023-10-16T19:58:05.606343+0000","last_clean":"2023-10-16T19:58:05.606343+0000","last_became_active":"2023-10-16T19:58:05.606043+0000","last_became_peered":"2023-10-16T19:58:05.606043+0000","last_unstale":"2023-10-16T19:58:05.606343+0000","last_undegraded":"2023-10-16T19:58:05.606343+0000","last_fullsized":"2023-10-16T19:58:05.606343+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:08:51.291632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.608055+0000","last_change":"2023-10-16T19:58:05.607969+0000","last_active":"2023-10-16T19:58:05.608055+0000","last_peered":"2023-10-16T19:58:05.608055+0000","last_clean":"2023-10-16T19:58:05.608055+0000","last_became_active":"2023-10-16T19:58:05.607763+0000","last_became_peered":"2023-10-16T19:58:05.607763+0000","last_unstale":"2023-10-16T19:58:05.608055+0000","last_undegraded":"2023-10-16T19:58:05.608055+0000","last_fullsized":"2023-10-16T19:58:05.608055+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:26:33.490004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.604846+0000","last_change":"2023-10-16T19:58:05.604754+0000","last_active":"2023-10-16T19:58:05.604846+0000","last_peered":"2023-10-16T19:58:05.604846+0000","last_clean":"2023-10-16T19:58:05.604846+0000","last_became_active":"2023-10-16T19:58:05.604309+0000","last_became_peered":"2023-10-16T19:58:05.604309+0000","last_unstale":"2023-10-16T19:58:05.604846+0000","last_undegraded":"2023-10-16T19:58:05.604846+0000","last_fullsized":"2023-10-16T19:58:05.604846+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:28:20.445641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.607499+0000","last_change":"2023-10-16T19:58:05.606380+0000","last_active":"2023-10-16T19:58:05.607499+0000","last_peered":"2023-10-16T19:58:05.607499+0000","last_clean":"2023-10-16T19:58:05.607499+0000","last_became_active":"2023-10-16T19:58:05.606102+0000","last_became_peered":"2023-10-16T19:58:05.606102+0000","last_unstale":"2023-10-16T19:58:05.607499+0000","last_undegraded":"2023-10-16T19:58:05.607499+0000","last_fullsized":"2023-10-16T19:58:05.607499+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:26:33.490004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.600662+0000","last_change":"2023-10-16T19:58:05.600187+0000","last_active":"2023-10-16T19:58:05.600662+0000","last_peered":"2023-10-16T19:58:05.600662+0000","last_clean":"2023-10-16T19:58:05.600662+0000","last_became_active":"2023-10-16T19:58:05.599955+0000","last_became_peered":"2023-10-16T19:58:05.599955+0000","last_unstale":"2023-10-16T19:58:05.600662+0000","last_undegraded":"2023-10-16T19:58:05.600662+0000","last_fullsized":"2023-10-16T19:58:05.600662+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:43:32.505853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.609800+0000","last_change":"2023-10-16T19:58:05.609019+0000","last_active":"2023-10-16T19:58:05.609800+0000","last_peered":"2023-10-16T19:58:05.609800+0000","last_clean":"2023-10-16T19:58:05.609800+0000","last_became_active":"2023-10-16T19:58:05.608571+0000","last_became_peered":"2023-10-16T19:58:05.608571+0000","last_unstale":"2023-10-16T19:58:05.609800+0000","last_undegraded":"2023-10-16T19:58:05.609800+0000","last_fullsized":"2023-10-16T19:58:05.609800+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:07:11.937484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.609529+0000","last_change":"2023-10-16T19:58:05.609465+0000","last_active":"2023-10-16T19:58:05.609529+0000","last_peered":"2023-10-16T19:58:05.609529+0000","last_clean":"2023-10-16T19:58:05.609529+0000","last_became_active":"2023-10-16T19:58:05.609211+0000","last_became_peered":"2023-10-16T19:58:05.609211+0000","last_unstale":"2023-10-16T19:58:05.609529+0000","last_undegraded":"2023-10-16T19:58:05.609529+0000","last_fullsized":"2023-10-16T19:58:05.609529+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:08:51.291632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"32'4","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.616024+0000","last_change":"2023-10-16T19:58:04.587769+0000","last_active":"2023-10-16T19:58:05.616024+0000","last_peered":"2023-10-16T19:58:05.616024+0000","last_clean":"2023-10-16T19:58:05.616024+0000","last_became_active":"2023-10-16T19:58:04.587523+0000","last_became_peered":"2023-10-16T19:58:04.587523+0000","last_unstale":"2023-10-16T19:58:05.616024+0000","last_undegraded":"2023-10-16T19:58:05.616024+0000","last_fullsized":"2023-10-16T19:58:05.616024+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_clean_scrub_stamp":"2023-10-16T19:58:03.569082+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:20:12.826040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.598799+0000","last_change":"2023-10-16T19:58:05.598729+0000","last_active":"2023-10-16T19:58:05.598799+0000","last_peered":"2023-10-16T19:58:05.598799+0000","last_clean":"2023-10-16T19:58:05.598799+0000","last_became_active":"2023-10-16T19:58:05.598478+0000","last_became_peered":"2023-10-16T19:58:05.598478+0000","last_unstale":"2023-10-16T19:58:05.598799+0000","last_undegraded":"2023-10-16T19:58:05.598799+0000","last_fullsized":"2023-10-16T19:58:05.598799+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:43:51.911077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"32'1","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.616276+0000","last_change":"2023-10-16T19:58:04.589820+0000","last_active":"2023-10-16T19:58:05.616276+0000","last_peered":"2023-10-16T19:58:05.616276+0000","last_clean":"2023-10-16T19:58:05.616276+0000","last_became_active":"2023-10-16T19:58:04.589624+0000","last_became_peered":"2023-10-16T19:58:04.589624+0000","last_unstale":"2023-10-16T19:58:05.616276+0000","last_undegraded":"2023-10-16T19:58:05.616276+0000","last_fullsized":"2023-10-16T19:58:05.616276+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_clean_scrub_stamp":"2023-10-16T19:58:03.569082+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:50:59.901042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.604065+0000","last_change":"2023-10-16T19:58:05.603987+0000","last_active":"2023-10-16T19:58:05.604065+0000","last_peered":"2023-10-16T19:58:05.604065+0000","last_clean":"2023-10-16T19:58:05.604065+0000","last_became_active":"2023-10-16T19:58:05.603733+0000","last_became_peered":"2023-10-16T19:58:05.603733+0000","last_unstale":"2023-10-16T19:58:05.604065+0000","last_undegraded":"2023-10-16T19:58:05.604065+0000","last_fullsized":"2023-10-16T19:58:05.604065+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:06:17.145932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"32'2","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.618090+0000","last_change":"2023-10-16T19:58:04.587285+0000","last_active":"2023-10-16T19:58:05.618090+0000","last_peered":"2023-10-16T19:58:05.618090+0000","last_clean":"2023-10-16T19:58:05.618090+0000","last_became_active":"2023-10-16T19:58:04.587076+0000","last_became_peered":"2023-10-16T19:58:04.587076+0000","last_unstale":"2023-10-16T19:58:05.618090+0000","last_undegraded":"2023-10-16T19:58:05.618090+0000","last_fullsized":"2023-10-16T19:58:05.618090+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_clean_scrub_stamp":"2023-10-16T19:58:03.569082+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:05:22.385602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.604018+0000","last_change":"2023-10-16T19:58:05.603529+0000","last_active":"2023-10-16T19:58:05.604018+0000","last_peered":"2023-10-16T19:58:05.604018+0000","last_clean":"2023-10-16T19:58:05.604018+0000","last_became_active":"2023-10-16T19:58:05.603317+0000","last_became_peered":"2023-10-16T19:58:05.603317+0000","last_unstale":"2023-10-16T19:58:05.604018+0000","last_undegraded":"2023-10-16T19:58:05.604018+0000","last_fullsized":"2023-10-16T19:58:05.604018+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:56:22.040826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"32'2","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.615556+0000","last_change":"2023-10-16T19:58:04.581625+0000","last_active":"2023-10-16T19:58:05.615556+0000","last_peered":"2023-10-16T19:58:05.615556+0000","last_clean":"2023-10-16T19:58:05.615556+0000","last_became_active":"2023-10-16T19:58:04.580982+0000","last_became_peered":"2023-10-16T19:58:04.580982+0000","last_unstale":"2023-10-16T19:58:05.615556+0000","last_undegraded":"2023-10-16T19:58:05.615556+0000","last_fullsized":"2023-10-16T19:58:05.615556+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_clean_scrub_stamp":"2023-10-16T19:58:03.569082+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:10:41.518249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.609839+0000","last_change":"2023-10-16T19:58:05.609638+0000","last_active":"2023-10-16T19:58:05.609839+0000","last_peered":"2023-10-16T19:58:05.609839+0000","last_clean":"2023-10-16T19:58:05.609839+0000","last_became_active":"2023-10-16T19:58:05.609287+0000","last_became_peered":"2023-10-16T19:58:05.609287+0000","last_unstale":"2023-10-16T19:58:05.609839+0000","last_undegraded":"2023-10-16T19:58:05.609839+0000","last_fullsized":"2023-10-16T19:58:05.609839+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:42:51.289673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"32'1","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.618604+0000","last_change":"2023-10-16T19:58:04.592222+0000","last_active":"2023-10-16T19:58:05.618604+0000","last_peered":"2023-10-16T19:58:05.618604+0000","last_clean":"2023-10-16T19:58:05.618604+0000","last_became_active":"2023-10-16T19:58:04.591382+0000","last_became_peered":"2023-10-16T19:58:04.591382+0000","last_unstale":"2023-10-16T19:58:05.618604+0000","last_undegraded":"2023-10-16T19:58:05.618604+0000","last_fullsized":"2023-10-16T19:58:05.618604+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_clean_scrub_stamp":"2023-10-16T19:58:03.569082+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:43:50.906516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.607003+0000","last_change":"2023-10-16T19:58:05.606948+0000","last_active":"2023-10-16T19:58:05.607003+0000","last_peered":"2023-10-16T19:58:05.607003+0000","last_clean":"2023-10-16T19:58:05.607003+0000","last_became_active":"2023-10-16T19:58:05.606777+0000","last_became_peered":"2023-10-16T19:58:05.606777+0000","last_unstale":"2023-10-16T19:58:05.607003+0000","last_undegraded":"2023-10-16T19:58:05.607003+0000","last_fullsized":"2023-10-16T19:58:05.607003+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:24:38.118997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"32'1","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.618567+0000","last_change":"2023-10-16T19:58:04.584929+0000","last_active":"2023-10-16T19:58:05.618567+0000","last_peered":"2023-10-16T19:58:05.618567+0000","last_clean":"2023-10-16T19:58:05.618567+0000","last_became_active":"2023-10-16T19:58:04.584702+0000","last_became_peered":"2023-10-16T19:58:04.584702+0000","last_unstale":"2023-10-16T19:58:05.618567+0000","last_undegraded":"2023-10-16T19:58:05.618567+0000","last_fullsized":"2023-10-16T19:58:05.618567+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_clean_scrub_stamp":"2023-10-16T19:58:03.569082+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:04:37.242998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.601806+0000","last_change":"2023-10-16T19:58:05.601585+0000","last_active":"2023-10-16T19:58:05.601806+0000","last_peered":"2023-10-16T19:58:05.601806+0000","last_clean":"2023-10-16T19:58:05.601806+0000","last_became_active":"2023-10-16T19:58:05.600813+0000","last_became_peered":"2023-10-16T19:58:05.600813+0000","last_unstale":"2023-10-16T19:58:05.601806+0000","last_undegraded":"2023-10-16T19:58:05.601806+0000","last_fullsized":"2023-10-16T19:58:05.601806+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:08:51.291632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.598185+0000","last_change":"2023-10-16T19:58:04.585183+0000","last_active":"2023-10-16T19:58:05.598185+0000","last_peered":"2023-10-16T19:58:05.598185+0000","last_clean":"2023-10-16T19:58:05.598185+0000","last_became_active":"2023-10-16T19:58:04.584173+0000","last_became_peered":"2023-10-16T19:58:04.584173+0000","last_unstale":"2023-10-16T19:58:05.598185+0000","last_undegraded":"2023-10-16T19:58:05.598185+0000","last_fullsized":"2023-10-16T19:58:05.598185+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_clean_scrub_stamp":"2023-10-16T19:58:03.569082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:09:03.659551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.601708+0000","last_change":"2023-10-16T19:58:05.601649+0000","last_active":"2023-10-16T19:58:05.601708+0000","last_peered":"2023-10-16T19:58:05.601708+0000","last_clean":"2023-10-16T19:58:05.601708+0000","last_became_active":"2023-10-16T19:58:05.601416+0000","last_became_peered":"2023-10-16T19:58:05.601416+0000","last_unstale":"2023-10-16T19:58:05.601708+0000","last_undegraded":"2023-10-16T19:58:05.601708+0000","last_fullsized":"2023-10-16T19:58:05.601708+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:26:46.150630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.597691+0000","last_change":"2023-10-16T19:58:04.590433+0000","last_active":"2023-10-16T19:58:05.597691+0000","last_peered":"2023-10-16T19:58:05.597691+0000","last_clean":"2023-10-16T19:58:05.597691+0000","last_became_active":"2023-10-16T19:58:04.589891+0000","last_became_peered":"2023-10-16T19:58:04.589891+0000","last_unstale":"2023-10-16T19:58:05.597691+0000","last_undegraded":"2023-10-16T19:58:05.597691+0000","last_fullsized":"2023-10-16T19:58:05.597691+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_clean_scrub_stamp":"2023-10-16T19:58:03.569082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:31:31.566550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.603414+0000","last_change":"2023-10-16T19:58:05.603341+0000","last_active":"2023-10-16T19:58:05.603414+0000","last_peered":"2023-10-16T19:58:05.603414+0000","last_clean":"2023-10-16T19:58:05.603414+0000","last_became_active":"2023-10-16T19:58:05.603042+0000","last_became_peered":"2023-10-16T19:58:05.603042+0000","last_unstale":"2023-10-16T19:58:05.603414+0000","last_undegraded":"2023-10-16T19:58:05.603414+0000","last_fullsized":"2023-10-16T19:58:05.603414+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:41:58.386070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.599331+0000","last_change":"2023-10-16T19:58:04.589480+0000","last_active":"2023-10-16T19:58:05.599331+0000","last_peered":"2023-10-16T19:58:05.599331+0000","last_clean":"2023-10-16T19:58:05.599331+0000","last_became_active":"2023-10-16T19:58:04.589253+0000","last_became_peered":"2023-10-16T19:58:04.589253+0000","last_unstale":"2023-10-16T19:58:05.599331+0000","last_undegraded":"2023-10-16T19:58:05.599331+0000","last_fullsized":"2023-10-16T19:58:05.599331+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_clean_scrub_stamp":"2023-10-16T19:58:03.569082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:45:34.917364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.602765+0000","last_change":"2023-10-16T19:58:05.602710+0000","last_active":"2023-10-16T19:58:05.602765+0000","last_peered":"2023-10-16T19:58:05.602765+0000","last_clean":"2023-10-16T19:58:05.602765+0000","last_became_active":"2023-10-16T19:58:05.602336+0000","last_became_peered":"2023-10-16T19:58:05.602336+0000","last_unstale":"2023-10-16T19:58:05.602765+0000","last_undegraded":"2023-10-16T19:58:05.602765+0000","last_fullsized":"2023-10-16T19:58:05.602765+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:47:35.655272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.604979+0000","last_change":"2023-10-16T19:58:04.586281+0000","last_active":"2023-10-16T19:58:05.604979+0000","last_peered":"2023-10-16T19:58:05.604979+0000","last_clean":"2023-10-16T19:58:05.604979+0000","last_became_active":"2023-10-16T19:58:04.586047+0000","last_became_peered":"2023-10-16T19:58:04.586047+0000","last_unstale":"2023-10-16T19:58:05.604979+0000","last_undegraded":"2023-10-16T19:58:05.604979+0000","last_fullsized":"2023-10-16T19:58:05.604979+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_clean_scrub_stamp":"2023-10-16T19:58:03.569082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:31:31.566550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.606771+0000","last_change":"2023-10-16T19:58:05.606519+0000","last_active":"2023-10-16T19:58:05.606771+0000","last_peered":"2023-10-16T19:58:05.606771+0000","last_clean":"2023-10-16T19:58:05.606771+0000","last_became_active":"2023-10-16T19:58:05.606148+0000","last_became_peered":"2023-10-16T19:58:05.606148+0000","last_unstale":"2023-10-16T19:58:05.606771+0000","last_undegraded":"2023-10-16T19:58:05.606771+0000","last_fullsized":"2023-10-16T19:58:05.606771+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:55:49.957648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"32'3","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.615837+0000","last_change":"2023-10-16T19:58:04.589426+0000","last_active":"2023-10-16T19:58:05.615837+0000","last_peered":"2023-10-16T19:58:05.615837+0000","last_clean":"2023-10-16T19:58:05.615837+0000","last_became_active":"2023-10-16T19:58:04.589139+0000","last_became_peered":"2023-10-16T19:58:04.589139+0000","last_unstale":"2023-10-16T19:58:05.615837+0000","last_undegraded":"2023-10-16T19:58:05.615837+0000","last_fullsized":"2023-10-16T19:58:05.615837+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_clean_scrub_stamp":"2023-10-16T19:58:03.569082+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:55:48.953087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.601684+0000","last_change":"2023-10-16T19:58:05.601316+0000","last_active":"2023-10-16T19:58:05.601684+0000","last_peered":"2023-10-16T19:58:05.601684+0000","last_clean":"2023-10-16T19:58:05.601684+0000","last_became_active":"2023-10-16T19:58:05.600598+0000","last_became_peered":"2023-10-16T19:58:05.600598+0000","last_unstale":"2023-10-16T19:58:05.601684+0000","last_undegraded":"2023-10-16T19:58:05.601684+0000","last_fullsized":"2023-10-16T19:58:05.601684+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:29:55.757064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"32'6","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.619501+0000","last_change":"2023-10-16T19:58:04.585306+0000","last_active":"2023-10-16T19:58:05.619501+0000","last_peered":"2023-10-16T19:58:05.619501+0000","last_clean":"2023-10-16T19:58:05.619501+0000","last_became_active":"2023-10-16T19:58:04.584588+0000","last_became_peered":"2023-10-16T19:58:04.584588+0000","last_unstale":"2023-10-16T19:58:05.619501+0000","last_undegraded":"2023-10-16T19:58:05.619501+0000","last_fullsized":"2023-10-16T19:58:05.619501+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_clean_scrub_stamp":"2023-10-16T19:58:03.569082+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:26:32.485443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.602703+0000","last_change":"2023-10-16T19:58:05.602640+0000","last_active":"2023-10-16T19:58:05.602703+0000","last_peered":"2023-10-16T19:58:05.602703+0000","last_clean":"2023-10-16T19:58:05.602703+0000","last_became_active":"2023-10-16T19:58:05.602386+0000","last_became_peered":"2023-10-16T19:58:05.602386+0000","last_unstale":"2023-10-16T19:58:05.602703+0000","last_undegraded":"2023-10-16T19:58:05.602703+0000","last_fullsized":"2023-10-16T19:58:05.602703+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:04:38.247560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"32'2","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.616615+0000","last_change":"2023-10-16T19:58:04.586869+0000","last_active":"2023-10-16T19:58:05.616615+0000","last_peered":"2023-10-16T19:58:05.616615+0000","last_clean":"2023-10-16T19:58:05.616615+0000","last_became_active":"2023-10-16T19:58:04.586290+0000","last_became_peered":"2023-10-16T19:58:04.586290+0000","last_unstale":"2023-10-16T19:58:05.616615+0000","last_undegraded":"2023-10-16T19:58:05.616615+0000","last_fullsized":"2023-10-16T19:58:05.616615+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_clean_scrub_stamp":"2023-10-16T19:58:03.569082+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:36:39.376783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.606232+0000","last_change":"2023-10-16T19:58:05.606176+0000","last_active":"2023-10-16T19:58:05.606232+0000","last_peered":"2023-10-16T19:58:05.606232+0000","last_clean":"2023-10-16T19:58:05.606232+0000","last_became_active":"2023-10-16T19:58:05.605962+0000","last_became_peered":"2023-10-16T19:58:05.605962+0000","last_unstale":"2023-10-16T19:58:05.606232+0000","last_undegraded":"2023-10-16T19:58:05.606232+0000","last_fullsized":"2023-10-16T19:58:05.606232+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:36:40.381344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.596435+0000","last_change":"2023-10-16T19:58:04.587764+0000","last_active":"2023-10-16T19:58:05.596435+0000","last_peered":"2023-10-16T19:58:05.596435+0000","last_clean":"2023-10-16T19:58:05.596435+0000","last_became_active":"2023-10-16T19:58:04.587531+0000","last_became_peered":"2023-10-16T19:58:04.587531+0000","last_unstale":"2023-10-16T19:58:05.596435+0000","last_undegraded":"2023-10-16T19:58:05.596435+0000","last_fullsized":"2023-10-16T19:58:05.596435+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_clean_scrub_stamp":"2023-10-16T19:58:03.569082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:43:31.501292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.608254+0000","last_change":"2023-10-16T19:58:05.608149+0000","last_active":"2023-10-16T19:58:05.608254+0000","last_peered":"2023-10-16T19:58:05.608254+0000","last_clean":"2023-10-16T19:58:05.608254+0000","last_became_active":"2023-10-16T19:58:05.607449+0000","last_became_peered":"2023-10-16T19:58:05.607449+0000","last_unstale":"2023-10-16T19:58:05.608254+0000","last_undegraded":"2023-10-16T19:58:05.608254+0000","last_fullsized":"2023-10-16T19:58:05.608254+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:09:04.664112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.596710+0000","last_change":"2023-10-16T19:58:04.588496+0000","last_active":"2023-10-16T19:58:05.596710+0000","last_peered":"2023-10-16T19:58:05.596710+0000","last_clean":"2023-10-16T19:58:05.596710+0000","last_became_active":"2023-10-16T19:58:04.588305+0000","last_became_peered":"2023-10-16T19:58:04.588305+0000","last_unstale":"2023-10-16T19:58:05.596710+0000","last_undegraded":"2023-10-16T19:58:05.596710+0000","last_fullsized":"2023-10-16T19:58:05.596710+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_clean_scrub_stamp":"2023-10-16T19:58:03.569082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:29:54.752503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.600643+0000","last_change":"2023-10-16T19:58:05.599594+0000","last_active":"2023-10-16T19:58:05.600643+0000","last_peered":"2023-10-16T19:58:05.600643+0000","last_clean":"2023-10-16T19:58:05.600643+0000","last_became_active":"2023-10-16T19:58:05.599356+0000","last_became_peered":"2023-10-16T19:58:05.599356+0000","last_unstale":"2023-10-16T19:58:05.600643+0000","last_undegraded":"2023-10-16T19:58:05.600643+0000","last_fullsized":"2023-10-16T19:58:05.600643+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:11:36.806952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"32'8","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.618703+0000","last_change":"2023-10-16T19:58:04.580974+0000","last_active":"2023-10-16T19:58:05.618703+0000","last_peered":"2023-10-16T19:58:05.618703+0000","last_clean":"2023-10-16T19:58:05.618703+0000","last_became_active":"2023-10-16T19:58:04.580648+0000","last_became_peered":"2023-10-16T19:58:04.580648+0000","last_unstale":"2023-10-16T19:58:05.618703+0000","last_undegraded":"2023-10-16T19:58:05.618703+0000","last_fullsized":"2023-10-16T19:58:05.618703+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_clean_scrub_stamp":"2023-10-16T19:58:03.569082+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:26:45.146069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.601751+0000","last_change":"2023-10-16T19:58:05.600582+0000","last_active":"2023-10-16T19:58:05.601751+0000","last_peered":"2023-10-16T19:58:05.601751+0000","last_clean":"2023-10-16T19:58:05.601751+0000","last_became_active":"2023-10-16T19:58:05.600333+0000","last_became_peered":"2023-10-16T19:58:05.600333+0000","last_unstale":"2023-10-16T19:58:05.601751+0000","last_undegraded":"2023-10-16T19:58:05.601751+0000","last_fullsized":"2023-10-16T19:58:05.601751+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:20:13.830601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"32'1","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.616855+0000","last_change":"2023-10-16T19:58:04.587935+0000","last_active":"2023-10-16T19:58:05.616855+0000","last_peered":"2023-10-16T19:58:05.616855+0000","last_clean":"2023-10-16T19:58:05.616855+0000","last_became_active":"2023-10-16T19:58:04.587576+0000","last_became_peered":"2023-10-16T19:58:04.587576+0000","last_unstale":"2023-10-16T19:58:05.616855+0000","last_undegraded":"2023-10-16T19:58:05.616855+0000","last_fullsized":"2023-10-16T19:58:05.616855+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_clean_scrub_stamp":"2023-10-16T19:58:03.569082+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:05:22.385602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.600049+0000","last_change":"2023-10-16T19:58:05.599461+0000","last_active":"2023-10-16T19:58:05.600049+0000","last_peered":"2023-10-16T19:58:05.600049+0000","last_clean":"2023-10-16T19:58:05.600049+0000","last_became_active":"2023-10-16T19:58:05.598861+0000","last_became_peered":"2023-10-16T19:58:05.598861+0000","last_unstale":"2023-10-16T19:58:05.600049+0000","last_undegraded":"2023-10-16T19:58:05.600049+0000","last_fullsized":"2023-10-16T19:58:05.600049+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:07:11.937484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"32'2","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.616460+0000","last_change":"2023-10-16T19:58:04.586713+0000","last_active":"2023-10-16T19:58:05.616460+0000","last_peered":"2023-10-16T19:58:05.616460+0000","last_clean":"2023-10-16T19:58:05.616460+0000","last_became_active":"2023-10-16T19:58:04.585973+0000","last_became_peered":"2023-10-16T19:58:04.585973+0000","last_unstale":"2023-10-16T19:58:05.616460+0000","last_undegraded":"2023-10-16T19:58:05.616460+0000","last_fullsized":"2023-10-16T19:58:05.616460+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_clean_scrub_stamp":"2023-10-16T19:58:03.569082+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:55:48.953087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.607137+0000","last_change":"2023-10-16T19:58:05.606948+0000","last_active":"2023-10-16T19:58:05.607137+0000","last_peered":"2023-10-16T19:58:05.607137+0000","last_clean":"2023-10-16T19:58:05.607137+0000","last_became_active":"2023-10-16T19:58:05.606722+0000","last_became_peered":"2023-10-16T19:58:05.606722+0000","last_unstale":"2023-10-16T19:58:05.607137+0000","last_undegraded":"2023-10-16T19:58:05.607137+0000","last_fullsized":"2023-10-16T19:58:05.607137+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:31:32.571112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"32'1","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.615577+0000","last_change":"2023-10-16T19:58:04.587531+0000","last_active":"2023-10-16T19:58:05.615577+0000","last_peered":"2023-10-16T19:58:05.615577+0000","last_clean":"2023-10-16T19:58:05.615577+0000","last_became_active":"2023-10-16T19:58:04.586934+0000","last_became_peered":"2023-10-16T19:58:04.586934+0000","last_unstale":"2023-10-16T19:58:05.615577+0000","last_undegraded":"2023-10-16T19:58:05.615577+0000","last_fullsized":"2023-10-16T19:58:05.615577+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_clean_scrub_stamp":"2023-10-16T19:58:03.569082+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:50:59.901042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.607563+0000","last_change":"2023-10-16T19:58:05.607501+0000","last_active":"2023-10-16T19:58:05.607563+0000","last_peered":"2023-10-16T19:58:05.607563+0000","last_clean":"2023-10-16T19:58:05.607563+0000","last_became_active":"2023-10-16T19:58:05.607269+0000","last_became_peered":"2023-10-16T19:58:05.607269+0000","last_unstale":"2023-10-16T19:58:05.607563+0000","last_undegraded":"2023-10-16T19:58:05.607563+0000","last_fullsized":"2023-10-16T19:58:05.607563+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:56:09.202617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.596461+0000","last_change":"2023-10-16T19:58:04.592403+0000","last_active":"2023-10-16T19:58:05.596461+0000","last_peered":"2023-10-16T19:58:05.596461+0000","last_clean":"2023-10-16T19:58:05.596461+0000","last_became_active":"2023-10-16T19:58:04.591967+0000","last_became_peered":"2023-10-16T19:58:04.591967+0000","last_unstale":"2023-10-16T19:58:05.596461+0000","last_undegraded":"2023-10-16T19:58:05.596461+0000","last_fullsized":"2023-10-16T19:58:05.596461+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_clean_scrub_stamp":"2023-10-16T19:58:03.569082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:46:15.563804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.600470+0000","last_change":"2023-10-16T19:58:05.600386+0000","last_active":"2023-10-16T19:58:05.600470+0000","last_peered":"2023-10-16T19:58:05.600470+0000","last_clean":"2023-10-16T19:58:05.600470+0000","last_became_active":"2023-10-16T19:58:05.600081+0000","last_became_peered":"2023-10-16T19:58:05.600081+0000","last_unstale":"2023-10-16T19:58:05.600470+0000","last_undegraded":"2023-10-16T19:58:05.600470+0000","last_fullsized":"2023-10-16T19:58:05.600470+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:28:20.445641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"32'2","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.617478+0000","last_change":"2023-10-16T19:58:04.588001+0000","last_active":"2023-10-16T19:58:05.617478+0000","last_peered":"2023-10-16T19:58:05.617478+0000","last_clean":"2023-10-16T19:58:05.617478+0000","last_became_active":"2023-10-16T19:58:04.587629+0000","last_became_peered":"2023-10-16T19:58:04.587629+0000","last_unstale":"2023-10-16T19:58:05.617478+0000","last_undegraded":"2023-10-16T19:58:05.617478+0000","last_fullsized":"2023-10-16T19:58:05.617478+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_clean_scrub_stamp":"2023-10-16T19:58:03.569082+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:57:52.788971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.607628+0000","last_change":"2023-10-16T19:58:05.607547+0000","last_active":"2023-10-16T19:58:05.607628+0000","last_peered":"2023-10-16T19:58:05.607628+0000","last_clean":"2023-10-16T19:58:05.607628+0000","last_became_active":"2023-10-16T19:58:05.607311+0000","last_became_peered":"2023-10-16T19:58:05.607311+0000","last_unstale":"2023-10-16T19:58:05.607628+0000","last_undegraded":"2023-10-16T19:58:05.607628+0000","last_fullsized":"2023-10-16T19:58:05.607628+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:10:11.530921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.597271+0000","last_change":"2023-10-16T19:58:04.583596+0000","last_active":"2023-10-16T19:58:05.597271+0000","last_peered":"2023-10-16T19:58:05.597271+0000","last_clean":"2023-10-16T19:58:05.597271+0000","last_became_active":"2023-10-16T19:58:04.583346+0000","last_became_peered":"2023-10-16T19:58:04.583346+0000","last_unstale":"2023-10-16T19:58:05.597271+0000","last_undegraded":"2023-10-16T19:58:05.597271+0000","last_fullsized":"2023-10-16T19:58:05.597271+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_clean_scrub_stamp":"2023-10-16T19:58:03.569082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:08:50.287071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.605826+0000","last_change":"2023-10-16T19:58:05.605758+0000","last_active":"2023-10-16T19:58:05.605826+0000","last_peered":"2023-10-16T19:58:05.605826+0000","last_clean":"2023-10-16T19:58:05.605826+0000","last_became_active":"2023-10-16T19:58:05.605529+0000","last_became_peered":"2023-10-16T19:58:05.605529+0000","last_unstale":"2023-10-16T19:58:05.605826+0000","last_undegraded":"2023-10-16T19:58:05.605826+0000","last_fullsized":"2023-10-16T19:58:05.605826+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:19:02.376592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.598037+0000","last_change":"2023-10-16T19:58:04.590215+0000","last_active":"2023-10-16T19:58:05.598037+0000","last_peered":"2023-10-16T19:58:05.598037+0000","last_clean":"2023-10-16T19:58:05.598037+0000","last_became_active":"2023-10-16T19:58:04.589542+0000","last_became_peered":"2023-10-16T19:58:04.589542+0000","last_unstale":"2023-10-16T19:58:05.598037+0000","last_undegraded":"2023-10-16T19:58:05.598037+0000","last_fullsized":"2023-10-16T19:58:05.598037+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_clean_scrub_stamp":"2023-10-16T19:58:03.569082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:57:52.788971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.609785+0000","last_change":"2023-10-16T19:58:05.608889+0000","last_active":"2023-10-16T19:58:05.609785+0000","last_peered":"2023-10-16T19:58:05.609785+0000","last_clean":"2023-10-16T19:58:05.609785+0000","last_became_active":"2023-10-16T19:58:05.608517+0000","last_became_peered":"2023-10-16T19:58:05.608517+0000","last_unstale":"2023-10-16T19:58:05.609785+0000","last_undegraded":"2023-10-16T19:58:05.609785+0000","last_fullsized":"2023-10-16T19:58:05.609785+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:57:59.985913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.594423+0000","last_change":"2023-10-16T19:58:04.587619+0000","last_active":"2023-10-16T19:58:05.594423+0000","last_peered":"2023-10-16T19:58:05.594423+0000","last_clean":"2023-10-16T19:58:05.594423+0000","last_became_active":"2023-10-16T19:58:04.587332+0000","last_became_peered":"2023-10-16T19:58:04.587332+0000","last_unstale":"2023-10-16T19:58:05.594423+0000","last_undegraded":"2023-10-16T19:58:05.594423+0000","last_fullsized":"2023-10-16T19:58:05.594423+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_clean_scrub_stamp":"2023-10-16T19:58:03.569082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:09:03.659551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.601229+0000","last_change":"2023-10-16T19:58:05.600830+0000","last_active":"2023-10-16T19:58:05.601229+0000","last_peered":"2023-10-16T19:58:05.601229+0000","last_clean":"2023-10-16T19:58:05.601229+0000","last_became_active":"2023-10-16T19:58:05.600305+0000","last_became_peered":"2023-10-16T19:58:05.600305+0000","last_unstale":"2023-10-16T19:58:05.601229+0000","last_undegraded":"2023-10-16T19:58:05.601229+0000","last_fullsized":"2023-10-16T19:58:05.601229+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:03:41.842825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"32'2","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.616656+0000","last_change":"2023-10-16T19:58:04.582724+0000","last_active":"2023-10-16T19:58:05.616656+0000","last_peered":"2023-10-16T19:58:05.616656+0000","last_clean":"2023-10-16T19:58:05.616656+0000","last_became_active":"2023-10-16T19:58:04.582012+0000","last_became_peered":"2023-10-16T19:58:04.582012+0000","last_unstale":"2023-10-16T19:58:05.616656+0000","last_undegraded":"2023-10-16T19:58:05.616656+0000","last_fullsized":"2023-10-16T19:58:05.616656+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_clean_scrub_stamp":"2023-10-16T19:58:03.569082+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:55:48.953087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.602367+0000","last_change":"2023-10-16T19:58:05.602250+0000","last_active":"2023-10-16T19:58:05.602367+0000","last_peered":"2023-10-16T19:58:05.602367+0000","last_clean":"2023-10-16T19:58:05.602367+0000","last_became_active":"2023-10-16T19:58:05.600830+0000","last_became_peered":"2023-10-16T19:58:05.600830+0000","last_unstale":"2023-10-16T19:58:05.602367+0000","last_undegraded":"2023-10-16T19:58:05.602367+0000","last_fullsized":"2023-10-16T19:58:05.602367+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:10:06.943190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.605613+0000","last_change":"2023-10-16T19:58:04.587844+0000","last_active":"2023-10-16T19:58:05.605613+0000","last_peered":"2023-10-16T19:58:05.605613+0000","last_clean":"2023-10-16T19:58:05.605613+0000","last_became_active":"2023-10-16T19:58:04.587329+0000","last_became_peered":"2023-10-16T19:58:04.587329+0000","last_unstale":"2023-10-16T19:58:05.605613+0000","last_undegraded":"2023-10-16T19:58:05.605613+0000","last_fullsized":"2023-10-16T19:58:05.605613+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_clean_scrub_stamp":"2023-10-16T19:58:03.569082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:55:48.953087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.606332+0000","last_change":"2023-10-16T19:58:05.606214+0000","last_active":"2023-10-16T19:58:05.606332+0000","last_peered":"2023-10-16T19:58:05.606332+0000","last_clean":"2023-10-16T19:58:05.606332+0000","last_became_active":"2023-10-16T19:58:05.605958+0000","last_became_peered":"2023-10-16T19:58:05.605958+0000","last_unstale":"2023-10-16T19:58:05.606332+0000","last_undegraded":"2023-10-16T19:58:05.606332+0000","last_fullsized":"2023-10-16T19:58:05.606332+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:56:22.040826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.597067+0000","last_change":"2023-10-16T19:58:04.587092+0000","last_active":"2023-10-16T19:58:05.597067+0000","last_peered":"2023-10-16T19:58:05.597067+0000","last_clean":"2023-10-16T19:58:05.597067+0000","last_became_active":"2023-10-16T19:58:04.586851+0000","last_became_peered":"2023-10-16T19:58:04.586851+0000","last_unstale":"2023-10-16T19:58:05.597067+0000","last_undegraded":"2023-10-16T19:58:05.597067+0000","last_fullsized":"2023-10-16T19:58:05.597067+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_clean_scrub_stamp":"2023-10-16T19:58:03.569082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:36:39.376783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.606743+0000","last_change":"2023-10-16T19:58:05.606520+0000","last_active":"2023-10-16T19:58:05.606743+0000","last_peered":"2023-10-16T19:58:05.606743+0000","last_clean":"2023-10-16T19:58:05.606743+0000","last_became_active":"2023-10-16T19:58:05.606081+0000","last_became_peered":"2023-10-16T19:58:05.606081+0000","last_unstale":"2023-10-16T19:58:05.606743+0000","last_undegraded":"2023-10-16T19:58:05.606743+0000","last_fullsized":"2023-10-16T19:58:05.606743+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:04:38.247560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.605017+0000","last_change":"2023-10-16T19:58:04.588408+0000","last_active":"2023-10-16T19:58:05.605017+0000","last_peered":"2023-10-16T19:58:05.605017+0000","last_clean":"2023-10-16T19:58:05.605017+0000","last_became_active":"2023-10-16T19:58:04.588050+0000","last_became_peered":"2023-10-16T19:58:04.588050+0000","last_unstale":"2023-10-16T19:58:05.605017+0000","last_undegraded":"2023-10-16T19:58:05.605017+0000","last_fullsized":"2023-10-16T19:58:05.605017+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_clean_scrub_stamp":"2023-10-16T19:58:03.569082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:36:39.376783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.607582+0000","last_change":"2023-10-16T19:58:05.607522+0000","last_active":"2023-10-16T19:58:05.607582+0000","last_peered":"2023-10-16T19:58:05.607582+0000","last_clean":"2023-10-16T19:58:05.607582+0000","last_became_active":"2023-10-16T19:58:05.607381+0000","last_became_peered":"2023-10-16T19:58:05.607381+0000","last_unstale":"2023-10-16T19:58:05.607582+0000","last_undegraded":"2023-10-16T19:58:05.607582+0000","last_fullsized":"2023-10-16T19:58:05.607582+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:04:38.247560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.597179+0000","last_change":"2023-10-16T19:58:04.582574+0000","last_active":"2023-10-16T19:58:05.597179+0000","last_peered":"2023-10-16T19:58:05.597179+0000","last_clean":"2023-10-16T19:58:05.597179+0000","last_became_active":"2023-10-16T19:58:04.581711+0000","last_became_peered":"2023-10-16T19:58:04.581711+0000","last_unstale":"2023-10-16T19:58:05.597179+0000","last_undegraded":"2023-10-16T19:58:05.597179+0000","last_fullsized":"2023-10-16T19:58:05.597179+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_clean_scrub_stamp":"2023-10-16T19:58:03.569082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:57:52.788971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.602783+0000","last_change":"2023-10-16T19:58:05.602722+0000","last_active":"2023-10-16T19:58:05.602783+0000","last_peered":"2023-10-16T19:58:05.602783+0000","last_clean":"2023-10-16T19:58:05.602783+0000","last_became_active":"2023-10-16T19:58:05.602184+0000","last_became_peered":"2023-10-16T19:58:05.602184+0000","last_unstale":"2023-10-16T19:58:05.602783+0000","last_undegraded":"2023-10-16T19:58:05.602783+0000","last_fullsized":"2023-10-16T19:58:05.602783+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:07:11.937484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.597299+0000","last_change":"2023-10-16T19:58:04.589600+0000","last_active":"2023-10-16T19:58:05.597299+0000","last_peered":"2023-10-16T19:58:05.597299+0000","last_clean":"2023-10-16T19:58:05.597299+0000","last_became_active":"2023-10-16T19:58:04.587683+0000","last_became_peered":"2023-10-16T19:58:04.587683+0000","last_unstale":"2023-10-16T19:58:05.597299+0000","last_undegraded":"2023-10-16T19:58:05.597299+0000","last_fullsized":"2023-10-16T19:58:05.597299+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_clean_scrub_stamp":"2023-10-16T19:58:03.569082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:56:21.036265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.601774+0000","last_change":"2023-10-16T19:58:05.601329+0000","last_active":"2023-10-16T19:58:05.601774+0000","last_peered":"2023-10-16T19:58:05.601774+0000","last_clean":"2023-10-16T19:58:05.601774+0000","last_became_active":"2023-10-16T19:58:05.601074+0000","last_became_peered":"2023-10-16T19:58:05.601074+0000","last_unstale":"2023-10-16T19:58:05.601774+0000","last_undegraded":"2023-10-16T19:58:05.601774+0000","last_fullsized":"2023-10-16T19:58:05.601774+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:11:36.806952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.598815+0000","last_change":"2023-10-16T19:58:04.588810+0000","last_active":"2023-10-16T19:58:05.598815+0000","last_peered":"2023-10-16T19:58:05.598815+0000","last_clean":"2023-10-16T19:58:05.598815+0000","last_became_active":"2023-10-16T19:58:04.588392+0000","last_became_peered":"2023-10-16T19:58:04.588392+0000","last_unstale":"2023-10-16T19:58:05.598815+0000","last_undegraded":"2023-10-16T19:58:05.598815+0000","last_fullsized":"2023-10-16T19:58:05.598815+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_clean_scrub_stamp":"2023-10-16T19:58:03.569082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:41:57.381509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.609820+0000","last_change":"2023-10-16T19:58:05.609385+0000","last_active":"2023-10-16T19:58:05.609820+0000","last_peered":"2023-10-16T19:58:05.609820+0000","last_clean":"2023-10-16T19:58:05.609820+0000","last_became_active":"2023-10-16T19:58:05.609118+0000","last_became_peered":"2023-10-16T19:58:05.609118+0000","last_unstale":"2023-10-16T19:58:05.609820+0000","last_undegraded":"2023-10-16T19:58:05.609820+0000","last_fullsized":"2023-10-16T19:58:05.609820+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:41:58.386070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.597439+0000","last_change":"2023-10-16T19:58:04.586182+0000","last_active":"2023-10-16T19:58:05.597439+0000","last_peered":"2023-10-16T19:58:05.597439+0000","last_clean":"2023-10-16T19:58:05.597439+0000","last_became_active":"2023-10-16T19:58:04.585930+0000","last_became_peered":"2023-10-16T19:58:04.585930+0000","last_unstale":"2023-10-16T19:58:05.597439+0000","last_undegraded":"2023-10-16T19:58:05.597439+0000","last_fullsized":"2023-10-16T19:58:05.597439+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_clean_scrub_stamp":"2023-10-16T19:58:03.569082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:50:59.901042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":174,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-16T19:58:04.583225+0000","last_change":"2023-10-16T19:56:58.775782+0000","last_active":"2023-10-16T19:58:04.583225+0000","last_peered":"2023-10-16T19:58:04.583225+0000","last_clean":"2023-10-16T19:58:04.583225+0000","last_became_active":"2023-10-16T19:56:58.775567+0000","last_became_peered":"2023-10-16T19:56:58.775567+0000","last_unstale":"2023-10-16T19:58:04.583225+0000","last_undegraded":"2023-10-16T19:58:04.583225+0000","last_fullsized":"2023-10-16T19:58:04.583225+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:56:57.693332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:56:57.693332+0000","last_clean_scrub_stamp":"2023-10-16T19:56:57.693332+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:10:23.849736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574864,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":705,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194606,"statfs":{"total":200000000,"available":199277538,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 19:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.56100000000000005}]},{"osd":1,"last update":"Mon Oct 16 19:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.502}]},{"osd":2,"last update":"Mon Oct 16 19:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.629},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.52700000000000002}]},{"osd":3,"last update":"Mon Oct 16 19:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.47399999999999998}]},{"osd":4,"last update":"Mon Oct 16 19:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.61499999999999999}]},{"osd":5,"last update":"Mon Oct 16 19:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"last":0.54700000000000004}]},{"osd":6,"last update":"Mon Oct 16 19:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.68700000000000006}]}]},{"osd":6,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":128,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195183,"statfs":{"total":200000000,"available":199867906,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 19:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.65800000000000003}]},{"osd":1,"last update":"Mon Oct 16 19:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.69899999999999995}]},{"osd":2,"last update":"Mon Oct 16 19:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.58899999999999997}]},{"osd":3,"last update":"Mon Oct 16 19:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.49299999999999999}]},{"osd":4,"last update":"Mon Oct 16 19:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.71399999999999997}]},{"osd":5,"last update":"Mon Oct 16 19:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.73199999999999998}]},{"osd":7,"last update":"Mon Oct 16 19:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.628}]}]},{"osd":1,"up_from":13,"seq":55834574864,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":137,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195175,"statfs":{"total":200000000,"available":199859467,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 19:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"min":{"1min":0.19700000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"last":0.443},{"interface":"front","average":{"1min":0.309,"5min":0.309,"15min":0.309},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"last":0.5}]},{"osd":2,"last update":"Mon Oct 16 19:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.443,"5min":0.443,"15min":0.443},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"last":0.42499999999999999}]},{"osd":3,"last update":"Mon Oct 16 19:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"last":0.45700000000000002}]},{"osd":4,"last update":"Mon Oct 16 19:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.73599999999999999}]},{"osd":5,"last update":"Mon Oct 16 19:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.72599999999999998}]},{"osd":6,"last update":"Mon Oct 16 19:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.70499999999999996}]},{"osd":7,"last update":"Mon Oct 16 19:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.64200000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574864,"num_pgs":10,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":705,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194606,"statfs":{"total":200000000,"available":199277538,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 16 19:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":11.031000000000001,"5min":11.031000000000001,"15min":11.031000000000001},"last":0.39200000000000002},{"interface":"front","average":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":12.218,"5min":12.218,"15min":12.218},"last":0.40300000000000002}]},{"osd":2,"last update":"Mon Oct 16 19:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":11.058,"5min":11.058,"15min":11.058},"last":0.41799999999999998},{"interface":"front","average":{"1min":1.123,"5min":1.123,"15min":1.123},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":14.763999999999999,"5min":14.763999999999999,"15min":14.763999999999999},"last":0.35799999999999998}]},{"osd":3,"last update":"Mon Oct 16 19:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":10.935,"5min":10.935,"15min":10.935},"last":0.372},{"interface":"front","average":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":11.083,"5min":11.083,"15min":11.083},"last":0.34000000000000002}]},{"osd":4,"last update":"Mon Oct 16 19:57:58 2023","interfaces":[{"interface":"back","average":{"1min":1.196,"5min":1.196,"15min":1.196},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":12.279,"5min":12.279,"15min":12.279},"last":0.42899999999999999},{"interface":"front","average":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":10.879,"5min":10.879,"15min":10.879},"last":0.46700000000000003}]},{"osd":5,"last update":"Mon Oct 16 19:57:58 2023","interfaces":[{"interface":"back","average":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":10.907,"5min":10.907,"15min":10.907},"last":0.52800000000000002},{"interface":"front","average":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":11,"5min":11,"15min":11},"last":0.45700000000000002}]},{"osd":6,"last update":"Mon Oct 16 19:57:58 2023","interfaces":[{"interface":"back","average":{"1min":1.157,"5min":1.157,"15min":1.157},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":10.972,"5min":10.972,"15min":10.972},"last":0.53800000000000003},{"interface":"front","average":{"1min":1.24,"5min":1.24,"15min":1.24},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":12.34,"5min":12.34,"15min":12.34},"last":0.51400000000000001}]},{"osd":7,"last update":"Mon Oct 16 19:57:58 2023","interfaces":[{"interface":"back","average":{"1min":1.252,"5min":1.252,"15min":1.252},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":12.311,"5min":12.311,"15min":12.311},"last":0.54800000000000004},{"interface":"front","average":{"1min":1.167,"5min":1.167,"15min":1.167},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":10.845000000000001,"5min":10.845000000000001,"15min":10.845000000000001},"last":0.504}]}]},{"osd":2,"up_from":13,"seq":55834574864,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":128,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195183,"statfs":{"total":200000000,"available":199867906,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 19:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"min":{"1min":0.17899999999999999,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"min":{"1min":0.20100000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.29799999999999999}]},{"osd":1,"last update":"Mon Oct 16 19:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.375,"15min":0.375},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.37,"5min":0.37,"15min":0.37},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"last":0.38200000000000001}]},{"osd":3,"last update":"Mon Oct 16 19:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.439}]},{"osd":4,"last update":"Mon Oct 16 19:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.73699999999999999}]},{"osd":5,"last update":"Mon Oct 16 19:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.71699999999999997}]},{"osd":6,"last update":"Mon Oct 16 19:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.81499999999999995}]},{"osd":7,"last update":"Mon Oct 16 19:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.76700000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574864,"num_pgs":31,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":128,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195183,"statfs":{"total":200000000,"available":199867906,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 19:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"last":0.28699999999999998},{"interface":"front","average":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.498,"5min":0.498,"15min":0.498},"last":0.35099999999999998}]},{"osd":1,"last update":"Mon Oct 16 19:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"min":{"1min":0.20499999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.371}]},{"osd":2,"last update":"Mon Oct 16 19:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.41899999999999998}]},{"osd":4,"last update":"Mon Oct 16 19:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.498}]},{"osd":5,"last update":"Mon Oct 16 19:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.47599999999999998}]},{"osd":6,"last update":"Mon Oct 16 19:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.56999999999999995}]},{"osd":7,"last update":"Mon Oct 16 19:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.2030000000000001,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.438},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.139,"5min":1.139,"15min":1.139},"last":0.52800000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":135,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195176,"statfs":{"total":200000000,"available":199860997,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 19:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.41799999999999998}]},{"osd":1,"last update":"Mon Oct 16 19:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.034,"5min":1.034,"15min":1.034},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.44500000000000001}]},{"osd":2,"last update":"Mon Oct 16 19:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.103,"5min":1.103,"15min":1.103},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.53200000000000003}]},{"osd":3,"last update":"Mon Oct 16 19:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.071,"5min":1.071,"15min":1.071},"last":0.47799999999999998}]},{"osd":5,"last update":"Mon Oct 16 19:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.56000000000000005}]},{"osd":6,"last update":"Mon Oct 16 19:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.63300000000000001}]},{"osd":7,"last update":"Mon Oct 16 19:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.61799999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":136,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195176,"statfs":{"total":200000000,"available":199860429,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 19:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.41799999999999998}]},{"osd":1,"last update":"Mon Oct 16 19:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":7.9989999999999997,"5min":7.9989999999999997,"15min":7.9989999999999997},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":8.0150000000000006,"5min":8.0150000000000006,"15min":8.0150000000000006},"last":0.51900000000000002}]},{"osd":2,"last update":"Mon Oct 16 19:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":1.032,"5min":1.032,"15min":1.032},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.47899999999999998}]},{"osd":3,"last update":"Mon Oct 16 19:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":8.077,"5min":8.077,"15min":8.077},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.61599999999999999}]},{"osd":4,"last update":"Mon Oct 16 19:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.495}]},{"osd":6,"last update":"Mon Oct 16 19:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.59899999999999998}]},{"osd":7,"last update":"Mon Oct 16 19:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.63100000000000001}]}]}],"pool_statfs":[]}} 2023-10-16T19:58:10.089 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-16T19:58:10.090 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=testcephfs1' mds allow 2023-10-16T19:58:10.251 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:10.249+0000 7f585be3c700 1 Processor -- start 2023-10-16T19:58:10.252 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:10.249+0000 7f585be3c700 1 -- start start 2023-10-16T19:58:10.254 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:10.250+0000 7f585be3c700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f585415bed0 0x7f58540b36b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:10.255 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:10.250+0000 7f585be3c700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f58540b3bf0 0x7f58540d0f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:10.255 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:10.250+0000 7f585be3c700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f58540d1440 0x7f58540cf800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:10.255 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:10.250+0000 7f585be3c700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58540b4070 con 0x7f585415bed0 2023-10-16T19:58:10.255 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:10.250+0000 7f585be3c700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f585415c2b0 con 0x7f58540b3bf0 2023-10-16T19:58:10.256 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:10.250+0000 7f585be3c700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f585415f9e0 con 0x7f58540d1440 2023-10-16T19:58:10.256 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:10.250+0000 7f5859bd8700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f585415bed0 0x7f58540b36b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:10.256 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:10.250+0000 7f5859bd8700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f585415bed0 0x7f58540b36b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:47682/0 (socket says 172.21.15.157:47682) 2023-10-16T19:58:10.256 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:10.250+0000 7f5859bd8700 1 -- 172.21.15.157:0/1696499273 learned_addr learned my addr 172.21.15.157:0/1696499273 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:58:10.257 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:10.250+0000 7f585a3d9700 1 --2- 172.21.15.157:0/1696499273 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f58540d1440 0x7f58540cf800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:10.257 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:10.250+0000 7f58593d7700 1 --2- 172.21.15.157:0/1696499273 >> v2:172.21.15.187:3300/0 conn(0x7f58540b3bf0 0x7f58540d0f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:10.257 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:10.250+0000 7f5859bd8700 1 -- 172.21.15.157:0/1696499273 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f58540d1440 msgr2=0x7f58540cf800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:58:10.257 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:10.250+0000 7f5859bd8700 1 --2- 172.21.15.157:0/1696499273 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f58540d1440 0x7f58540cf800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:10.258 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:10.250+0000 7f5859bd8700 1 -- 172.21.15.157:0/1696499273 >> v2:172.21.15.187:3300/0 conn(0x7f58540b3bf0 msgr2=0x7f58540d0f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:58:10.258 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:10.250+0000 7f5859bd8700 1 --2- 172.21.15.157:0/1696499273 >> v2:172.21.15.187:3300/0 conn(0x7f58540b3bf0 0x7f58540d0f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:10.258 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:10.250+0000 7f5859bd8700 1 -- 172.21.15.157:0/1696499273 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f585415fcc0 con 0x7f585415bed0 2023-10-16T19:58:10.258 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:10.251+0000 7f5859bd8700 1 --2- 172.21.15.157:0/1696499273 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f585415bed0 0x7f58540b36b0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f5854067540 tx=0x7f5844009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72be62b2978b9d0a server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:58:10.258 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:10.251+0000 7f5858bd6700 1 -- 172.21.15.157:0/1696499273 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f584400b870 con 0x7f585415bed0 2023-10-16T19:58:10.259 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:10.251+0000 7f5858bd6700 1 -- 172.21.15.157:0/1696499273 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f584400b9d0 con 0x7f585415bed0 2023-10-16T19:58:10.259 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:10.251+0000 7f5858bd6700 1 -- 172.21.15.157:0/1696499273 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f584400bd60 con 0x7f585415bed0 2023-10-16T19:58:10.259 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:10.251+0000 7f585be3c700 1 -- 172.21.15.157:0/1696499273 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f585415bed0 msgr2=0x7f58540b36b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:10.259 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:10.251+0000 7f585be3c700 1 --2- 172.21.15.157:0/1696499273 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f585415bed0 0x7f58540b36b0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f5854067540 tx=0x7f5844009bd0 comp rx=0 tx=0).stop 2023-10-16T19:58:10.260 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:10.251+0000 7f585be3c700 1 -- 172.21.15.157:0/1696499273 shutdown_connections 2023-10-16T19:58:10.260 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:10.251+0000 7f585be3c700 1 --2- 172.21.15.157:0/1696499273 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f58540d1440 0x7f58540cf800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:10.260 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:10.251+0000 7f585be3c700 1 --2- 172.21.15.157:0/1696499273 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f585415bed0 0x7f58540b36b0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:10.260 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:10.251+0000 7f585be3c700 1 --2- 172.21.15.157:0/1696499273 >> v2:172.21.15.187:3300/0 conn(0x7f58540b3bf0 0x7f58540d0f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:10.261 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:10.251+0000 7f585be3c700 1 -- 172.21.15.157:0/1696499273 >> 172.21.15.157:0/1696499273 conn(0x7f58540ce6b0 msgr2=0x7f58540ceac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:58:10.261 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:10.251+0000 7f585be3c700 1 -- 172.21.15.157:0/1696499273 shutdown_connections 2023-10-16T19:58:10.262 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:10.252+0000 7f585be3c700 1 -- 172.21.15.157:0/1696499273 wait complete. 2023-10-16T19:58:10.264 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:10.253+0000 7f585be3c700 1 Processor -- start 2023-10-16T19:58:10.264 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:10.253+0000 7f585be3c700 1 -- start start 2023-10-16T19:58:10.265 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:10.253+0000 7f585be3c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f58540b3bf0 0x7f58540ca820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:10.265 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:10.253+0000 7f585be3c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f58540d1440 0x7f58541511c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:10.265 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:10.253+0000 7f585be3c700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f585415bed0 0x7f58540c8d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:10.265 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:10.253+0000 7f585be3c700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58540ca390 con 0x7f58540d1440 2023-10-16T19:58:10.265 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:10.253+0000 7f585be3c700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5854151700 con 0x7f58540b3bf0 2023-10-16T19:58:10.266 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:10.253+0000 7f585be3c700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58540c9780 con 0x7f585415bed0 2023-10-16T19:58:10.266 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:10.254+0000 7f58593d7700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f58540d1440 0x7f58541511c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:10.266 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:10.254+0000 7f58593d7700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f58540d1440 0x7f58541511c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:47688/0 (socket says 172.21.15.157:47688) 2023-10-16T19:58:10.266 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:10.254+0000 7f58593d7700 1 -- 172.21.15.157:0/2577689318 learned_addr learned my addr 172.21.15.157:0/2577689318 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:58:10.266 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:10.254+0000 7f5859bd8700 1 --2- 172.21.15.157:0/2577689318 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f58540b3bf0 0x7f58540ca820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:10.267 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:10.254+0000 7f585a3d9700 1 --2- 172.21.15.157:0/2577689318 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f585415bed0 0x7f58540c8d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:10.267 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:10.254+0000 7f58593d7700 1 -- 172.21.15.157:0/2577689318 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f585415bed0 msgr2=0x7f58540c8d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:10.267 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:10.254+0000 7f58593d7700 1 --2- 172.21.15.157:0/2577689318 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f585415bed0 0x7f58540c8d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:10.267 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:10.254+0000 7f58593d7700 1 -- 172.21.15.157:0/2577689318 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f58540b3bf0 msgr2=0x7f58540ca820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:10.267 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:10.254+0000 7f58593d7700 1 --2- 172.21.15.157:0/2577689318 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f58540b3bf0 0x7f58540ca820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:10.268 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:10.254+0000 7f58593d7700 1 -- 172.21.15.157:0/2577689318 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5844009550 con 0x7f58540d1440 2023-10-16T19:58:10.268 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:10.254+0000 7f58593d7700 1 --2- 172.21.15.157:0/2577689318 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f58540d1440 0x7f58541511c0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f585000d800 tx=0x7f585000db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:58:10.268 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:10.254+0000 7f584a7fc700 1 -- 172.21.15.157:0/2577689318 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58500125f0 con 0x7f58540d1440 2023-10-16T19:58:10.268 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:10.254+0000 7f584a7fc700 1 -- 172.21.15.157:0/2577689318 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5850012750 con 0x7f58540d1440 2023-10-16T19:58:10.268 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:10.254+0000 7f585be3c700 1 -- 172.21.15.157:0/2577689318 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58540c9a60 con 0x7f58540d1440 2023-10-16T19:58:10.269 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:10.254+0000 7f584a7fc700 1 -- 172.21.15.157:0/2577689318 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5850012ae0 con 0x7f58540d1440 2023-10-16T19:58:10.269 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:10.254+0000 7f585be3c700 1 -- 172.21.15.157:0/2577689318 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58540ca020 con 0x7f58540d1440 2023-10-16T19:58:10.269 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:10.255+0000 7f585be3c700 1 -- 172.21.15.157:0/2577689318 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f585406b300 con 0x7f58540d1440 2023-10-16T19:58:10.269 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:10.255+0000 7f584a7fc700 1 -- 172.21.15.157:0/2577689318 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f5850012c40 con 0x7f58540d1440 2023-10-16T19:58:10.269 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:10.256+0000 7f584a7fc700 1 --2- 172.21.15.157:0/2577689318 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f583806af00 0x7f583806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:10.270 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:10.256+0000 7f584a7fc700 1 -- 172.21.15.157:0/2577689318 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5729+0+0 (secure 0 0 0) 0x7f5850089610 con 0x7f58540d1440 2023-10-16T19:58:10.270 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:10.256+0000 7f5859bd8700 1 --2- 172.21.15.157:0/2577689318 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f583806af00 0x7f583806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:10.270 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:10.256+0000 7f5859bd8700 1 --2- 172.21.15.157:0/2577689318 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f583806af00 0x7f583806d3c0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f5844014040 tx=0x7f5844008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:58:10.270 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:10.260+0000 7f584a7fc700 1 -- 172.21.15.157:0/2577689318 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5850054750 con 0x7f58540d1440 2023-10-16T19:58:10.527 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:10.525+0000 7f585be3c700 1 -- 172.21.15.157:0/2577689318 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=testcephfs1", "mds", "allow"]} v 0) v1 -- 0x7f585404f400 con 0x7f58540d1440 2023-10-16T19:58:10.529 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:10.527+0000 7f584a7fc700 1 -- 172.21.15.157:0/2577689318 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=testcephfs1", "mds", "allow"]}]=0 updated caps for client.0 v15) v1 ==== 195+0+152 (secure 0 0 0) 0x7f5850057d70 con 0x7f58540d1440 2023-10-16T19:58:10.530 INFO:teuthology.orchestra.run.smithi157.stdout:[client.0] 2023-10-16T19:58:10.530 INFO:teuthology.orchestra.run.smithi157.stdout: key = AQB4lS1lDEZnABAAgwyj245ITd68cbde9kGXLg== 2023-10-16T19:58:10.530 INFO:teuthology.orchestra.run.smithi157.stdout: caps mds = "allow" 2023-10-16T19:58:10.530 INFO:teuthology.orchestra.run.smithi157.stdout: caps mon = "allow r" 2023-10-16T19:58:10.530 INFO:teuthology.orchestra.run.smithi157.stdout: caps osd = "allow rw tag cephfs data=testcephfs1" 2023-10-16T19:58:10.532 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:10.529+0000 7f585be3c700 1 -- 172.21.15.157:0/2577689318 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f583806af00 msgr2=0x7f583806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:10.532 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:10.529+0000 7f585be3c700 1 --2- 172.21.15.157:0/2577689318 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f583806af00 0x7f583806d3c0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f5844014040 tx=0x7f5844008030 comp rx=0 tx=0).stop 2023-10-16T19:58:10.533 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:10.529+0000 7f585be3c700 1 -- 172.21.15.157:0/2577689318 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f58540d1440 msgr2=0x7f58541511c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:10.533 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:10.529+0000 7f585be3c700 1 --2- 172.21.15.157:0/2577689318 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f58540d1440 0x7f58541511c0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f585000d800 tx=0x7f585000db10 comp rx=0 tx=0).stop 2023-10-16T19:58:10.533 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:10.530+0000 7f585be3c700 1 -- 172.21.15.157:0/2577689318 shutdown_connections 2023-10-16T19:58:10.533 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:10.530+0000 7f585be3c700 1 --2- 172.21.15.157:0/2577689318 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f583806af00 0x7f583806d3c0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:10.533 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:10.530+0000 7f585be3c700 1 --2- 172.21.15.157:0/2577689318 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f58540b3bf0 0x7f58540ca820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:10.534 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:10.530+0000 7f585be3c700 1 --2- 172.21.15.157:0/2577689318 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f585415bed0 0x7f58540c8d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:10.534 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:10.530+0000 7f585be3c700 1 --2- 172.21.15.157:0/2577689318 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f58540d1440 0x7f58541511c0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:10.534 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:10.530+0000 7f585be3c700 1 -- 172.21.15.157:0/2577689318 >> 172.21.15.157:0/2577689318 conn(0x7f58540ce6b0 msgr2=0x7f585415b0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:58:10.534 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:10.530+0000 7f585be3c700 1 -- 172.21.15.157:0/2577689318 shutdown_connections 2023-10-16T19:58:10.534 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:10.530+0000 7f585be3c700 1 -- 172.21.15.157:0/2577689318 wait complete. 2023-10-16T19:58:10.535 INFO:teuthology.orchestra.run.smithi157.stderr:updated caps for client.0 2023-10-16T19:58:10.544 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-16T19:58:10.665 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:10.663+0000 7f4c008ee700 1 Processor -- start 2023-10-16T19:58:10.666 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:10.663+0000 7f4c008ee700 1 -- start start 2023-10-16T19:58:10.668 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:10.664+0000 7f4c008ee700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f4bfc06af60 0x7f4bfc06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:10.668 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:10.664+0000 7f4c008ee700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bfc0d08b0 con 0x7f4bfc15e2f0 2023-10-16T19:58:10.668 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:10.664+0000 7f4c008ee700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bfc1628f0 con 0x7f4bfc06de00 2023-10-16T19:58:10.668 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:10.664+0000 7f4c008ee700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4bfc162bd0 con 0x7f4bfc06af60 2023-10-16T19:58:10.668 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:10.664+0000 7f4bf9d9b700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f4bfc06af60 0x7f4bfc06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:10.669 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:10.664+0000 7f4bfa59c700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f4bfc15e2f0 0x7f4bfc06a850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:57366/0 (socket says 172.21.15.157:57366) 2023-10-16T19:58:10.669 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:10.664+0000 7f4bfa59c700 1 -- 172.21.15.157:0/873633950 learned_addr learned my addr 172.21.15.157:0/873633950 (peer_addr_for_me v1:172.21.15.157:0/0) 2023-10-16T19:58:10.669 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:10.664+0000 7f4bf9d9b700 1 -- 172.21.15.157:0/873633950 >> v1:172.21.15.187:6789/0 conn(0x7f4bfc06de00 legacy=0x7f4bfc070f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:58:10.669 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:10.664+0000 7f4bf9d9b700 1 -- 172.21.15.157:0/873633950 >> v1:172.21.15.157:6789/0 conn(0x7f4bfc15e2f0 legacy=0x7f4bfc06a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:10.669 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:10.664+0000 7f4bf9d9b700 1 -- 172.21.15.157:0/873633950 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bfc0d05d0 con 0x7f4bfc06af60 2023-10-16T19:58:10.670 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:10.664+0000 7f4bf959a700 1 -- 172.21.15.157:0/873633950 <== mon.0 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 93677816 0 0) 0x7f4bfc0d08b0 con 0x7f4bfc15e2f0 2023-10-16T19:58:10.670 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:10.665+0000 7f4bf9d9b700 1 --2- 172.21.15.157:0/873633950 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4bfc06af60 0x7f4bfc06d0f0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f4bec009840 tx=0x7f4bec009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c38d9219f8b2e298 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:58:10.670 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:10.665+0000 7f4bf959a700 1 -- 172.21.15.157:0/873633950 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bec004230 con 0x7f4bfc06af60 2023-10-16T19:58:10.670 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:10.665+0000 7f4bf959a700 1 -- 172.21.15.157:0/873633950 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bec004390 con 0x7f4bfc06af60 2023-10-16T19:58:10.671 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:10.665+0000 7f4bf959a700 1 -- 172.21.15.157:0/873633950 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bec0036a0 con 0x7f4bfc06af60 2023-10-16T19:58:10.671 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:10.665+0000 7f4c008ee700 1 -- 172.21.15.157:0/873633950 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4bfc06af60 msgr2=0x7f4bfc06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:10.671 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:10.665+0000 7f4c008ee700 1 --2- 172.21.15.157:0/873633950 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4bfc06af60 0x7f4bfc06d0f0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f4bec009840 tx=0x7f4bec009b50 comp rx=0 tx=0).stop 2023-10-16T19:58:10.671 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:10.665+0000 7f4c008ee700 1 -- 172.21.15.157:0/873633950 shutdown_connections 2023-10-16T19:58:10.672 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:10.665+0000 7f4c008ee700 1 --2- 172.21.15.157:0/873633950 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4bfc06af60 0x7f4bfc06d0f0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:10.672 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:10.665+0000 7f4c008ee700 1 -- 172.21.15.157:0/873633950 >> 172.21.15.157:0/873633950 conn(0x7f4bfc0cd4e0 msgr2=0x7f4bfc0cd8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:58:10.672 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:10.665+0000 7f4c008ee700 1 -- 172.21.15.157:0/873633950 shutdown_connections 2023-10-16T19:58:10.672 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:10.665+0000 7f4c008ee700 1 -- 172.21.15.157:0/873633950 wait complete. 2023-10-16T19:58:10.675 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:10.667+0000 7f4c008ee700 1 Processor -- start 2023-10-16T19:58:10.675 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:10.667+0000 7f4c008ee700 1 -- start start 2023-10-16T19:58:10.675 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:10.667+0000 7f4c008ee700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4bfc06af60 0x7f4bfc0b5f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:10.676 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:10.667+0000 7f4c008ee700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4bfc06de00 0x7f4bfc0c4300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:10.676 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:10.667+0000 7f4c008ee700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4bfc15e2f0 0x7f4bfc159180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:10.676 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:10.667+0000 7f4c008ee700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bfc1f7f10 con 0x7f4bfc15e2f0 2023-10-16T19:58:10.677 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:10.667+0000 7f4c008ee700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bfc1f7290 con 0x7f4bfc06af60 2023-10-16T19:58:10.677 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:10.667+0000 7f4c008ee700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bfc1f7570 con 0x7f4bfc06de00 2023-10-16T19:58:10.677 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:10.668+0000 7f4bfad9d700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4bfc15e2f0 0x7f4bfc159180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:10.677 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:10.668+0000 7f4bfad9d700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4bfc15e2f0 0x7f4bfc159180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:47704/0 (socket says 172.21.15.157:47704) 2023-10-16T19:58:10.678 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:10.668+0000 7f4bfad9d700 1 -- 172.21.15.157:0/3729400884 learned_addr learned my addr 172.21.15.157:0/3729400884 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:58:10.678 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:10.668+0000 7f4bfa59c700 1 --2- 172.21.15.157:0/3729400884 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4bfc06af60 0x7f4bfc0b5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:10.678 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:10.668+0000 7f4bfad9d700 1 -- 172.21.15.157:0/3729400884 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4bfc06de00 msgr2=0x7f4bfc0c4300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:10.679 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:10.668+0000 7f4bfad9d700 1 --2- 172.21.15.157:0/3729400884 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4bfc06de00 0x7f4bfc0c4300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:10.679 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:10.668+0000 7f4bfad9d700 1 -- 172.21.15.157:0/3729400884 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4bfc06af60 msgr2=0x7f4bfc0b5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:10.679 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:10.668+0000 7f4bfad9d700 1 --2- 172.21.15.157:0/3729400884 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4bfc06af60 0x7f4bfc0b5f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:10.679 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:10.668+0000 7f4bfad9d700 1 -- 172.21.15.157:0/3729400884 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bec0094a0 con 0x7f4bfc15e2f0 2023-10-16T19:58:10.679 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:10.668+0000 7f4bfad9d700 1 --2- 172.21.15.157:0/3729400884 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4bfc15e2f0 0x7f4bfc159180 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f4bf400b9e0 tx=0x7f4bf400bda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:58:10.680 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:10.668+0000 7f4beaffd700 1 -- 172.21.15.157:0/3729400884 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bf400c9b0 con 0x7f4bfc15e2f0 2023-10-16T19:58:10.680 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:10.668+0000 7f4beaffd700 1 -- 172.21.15.157:0/3729400884 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bf400cb10 con 0x7f4bfc15e2f0 2023-10-16T19:58:10.680 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:10.668+0000 7f4c008ee700 1 -- 172.21.15.157:0/3729400884 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bfc1f7850 con 0x7f4bfc15e2f0 2023-10-16T19:58:10.680 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:10.668+0000 7f4beaffd700 1 -- 172.21.15.157:0/3729400884 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bf4014440 con 0x7f4bfc15e2f0 2023-10-16T19:58:10.680 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:10.668+0000 7f4c008ee700 1 -- 172.21.15.157:0/3729400884 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bfc0b6450 con 0x7f4bfc15e2f0 2023-10-16T19:58:10.681 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:10.669+0000 7f4c008ee700 1 -- 172.21.15.157:0/3729400884 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bfc1f8050 con 0x7f4bfc15e2f0 2023-10-16T19:58:10.681 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:10.670+0000 7f4beaffd700 1 -- 172.21.15.157:0/3729400884 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f4bf401d3b0 con 0x7f4bfc15e2f0 2023-10-16T19:58:10.681 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:10.670+0000 7f4beaffd700 1 --2- 172.21.15.157:0/3729400884 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f4bdc06af00 0x7f4bdc06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:10.681 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:10.670+0000 7f4beaffd700 1 -- 172.21.15.157:0/3729400884 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5729+0+0 (secure 0 0 0) 0x7f4bf40893b0 con 0x7f4bfc15e2f0 2023-10-16T19:58:10.681 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:10.670+0000 7f4bfa59c700 1 --2- 172.21.15.157:0/3729400884 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f4bdc06af00 0x7f4bdc06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:10.682 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:10.671+0000 7f4bfa59c700 1 --2- 172.21.15.157:0/3729400884 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f4bdc06af00 0x7f4bdc06d3c0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f4bf0000f60 tx=0x7f4bf0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:58:10.682 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:10.674+0000 7f4beaffd700 1 -- 172.21.15.157:0/3729400884 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4bfc1f8050 con 0x7f4bfc15e2f0 2023-10-16T19:58:10.905 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:10.903+0000 7f4c008ee700 1 -- 172.21.15.157:0/3729400884 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4bfc1f8050 con 0x7f4bfc15e2f0 2023-10-16T19:58:10.906 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:10.904+0000 7f4beaffd700 1 -- 172.21.15.157:0/3729400884 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4930 (secure 0 0 0) 0x7f4bfc1f8050 con 0x7f4bfc15e2f0 2023-10-16T19:58:10.907 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-10-16T19:58:10.907 INFO:teuthology.orchestra.run.smithi157.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4766,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6837/4265551180","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6835","nonce":4265551180},{"type":"v1","addr":"172.21.15.187:6837","nonce":4265551180}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4945,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6836/3773301895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6834","nonce":3773301895},{"type":"v1","addr":"172.21.15.187:6836","nonce":3773301895}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5040,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6833/2197855945","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6832","nonce":2197855945},{"type":"v1","addr":"172.21.15.157:6833","nonce":2197855945}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-16T19:58:04.972085+0000","modified":"2023-10-16T19:58:08.009196+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5043},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5043":{"gid":5043,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.157:6835/1166326737","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6834","nonce":1166326737},{"type":"v1","addr":"172.21.15.157:6835","nonce":1166326737}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"testcephfs1","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-10-16T19:58:10.908 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:10.906+0000 7f4c008ee700 1 -- 172.21.15.157:0/3729400884 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f4bdc06af00 msgr2=0x7f4bdc06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:10.909 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:10.906+0000 7f4c008ee700 1 --2- 172.21.15.157:0/3729400884 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f4bdc06af00 0x7f4bdc06d3c0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f4bf0000f60 tx=0x7f4bf0009040 comp rx=0 tx=0).stop 2023-10-16T19:58:10.909 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:10.906+0000 7f4c008ee700 1 -- 172.21.15.157:0/3729400884 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4bfc15e2f0 msgr2=0x7f4bfc159180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:10.909 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:10.906+0000 7f4c008ee700 1 --2- 172.21.15.157:0/3729400884 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4bfc15e2f0 0x7f4bfc159180 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f4bf400b9e0 tx=0x7f4bf400bda0 comp rx=0 tx=0).stop 2023-10-16T19:58:10.909 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:10.906+0000 7f4c008ee700 1 -- 172.21.15.157:0/3729400884 shutdown_connections 2023-10-16T19:58:10.909 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:10.906+0000 7f4c008ee700 1 --2- 172.21.15.157:0/3729400884 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f4bdc06af00 0x7f4bdc06d3c0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:10.910 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:10.906+0000 7f4c008ee700 1 --2- 172.21.15.157:0/3729400884 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4bfc06af60 0x7f4bfc0b5f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:10.910 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:10.906+0000 7f4c008ee700 1 --2- 172.21.15.157:0/3729400884 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4bfc15e2f0 0x7f4bfc159180 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:10.910 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:10.906+0000 7f4c008ee700 1 --2- 172.21.15.157:0/3729400884 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4bfc06de00 0x7f4bfc0c4300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:10.910 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:10.906+0000 7f4c008ee700 1 -- 172.21.15.157:0/3729400884 >> 172.21.15.157:0/3729400884 conn(0x7f4bfc0cd4e0 msgr2=0x7f4bfc0b2610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:58:10.910 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:10.906+0000 7f4c008ee700 1 -- 172.21.15.157:0/3729400884 shutdown_connections 2023-10-16T19:58:10.911 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:10.906+0000 7f4c008ee700 1 -- 172.21.15.157:0/3729400884 wait complete. 2023-10-16T19:58:10.911 INFO:teuthology.orchestra.run.smithi157.stderr:dumped fsmap epoch 17 2023-10-16T19:58:11.323 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-16T19:58:04.972085+0000', 'modified': '2023-10-16T19:58:08.009196+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5043}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5043': {'gid': 5043, 'name': 'a', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.157:6835/1166326737', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.157:6834', 'nonce': 1166326737}, {'type': 'v1', 'addr': '172.21.15.157:6835', 'nonce': 1166326737}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'testcephfs1', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-10-16T19:58:11.324 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-16T19:58:11.324 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-10-16T19:58:11.447 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.445+0000 7f4dcc82f700 1 Processor -- start 2023-10-16T19:58:11.448 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.445+0000 7f4dcc82f700 1 -- start start 2023-10-16T19:58:11.450 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.446+0000 7f4dcc82f700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f4dc815e2f0 0x7f4dc806d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:11.451 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.446+0000 7f4dcc82f700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f4dc806de00 0x7f4dc80ce910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:11.451 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.446+0000 7f4dcc82f700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4dc80d08b0 con 0x7f4dc806a850 2023-10-16T19:58:11.451 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.446+0000 7f4dcc82f700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4dc81628f0 con 0x7f4dc806de00 2023-10-16T19:58:11.451 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.446+0000 7f4dcc82f700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4dc8162bd0 con 0x7f4dc815e2f0 2023-10-16T19:58:11.451 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.446+0000 7f4dc5d9b700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f4dc806de00 0x7f4dc80ce910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:11.452 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.446+0000 7f4dc6d9d700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f4dc806a850 0x7f4dc8070f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:57384/0 (socket says 172.21.15.157:57384) 2023-10-16T19:58:11.452 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.446+0000 7f4dc6d9d700 1 -- 172.21.15.157:0/2022261910 learned_addr learned my addr 172.21.15.157:0/2022261910 (peer_addr_for_me v1:172.21.15.157:0/0) 2023-10-16T19:58:11.452 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.446+0000 7f4dc659c700 1 --2- 172.21.15.157:0/2022261910 >> v2:172.21.15.187:3300/0 conn(0x7f4dc815e2f0 0x7f4dc806d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:11.452 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.446+0000 7f4dc5d9b700 1 -- 172.21.15.157:0/2022261910 >> v2:172.21.15.187:3300/0 conn(0x7f4dc815e2f0 msgr2=0x7f4dc806d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:58:11.452 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.446+0000 7f4dc5d9b700 1 --2- 172.21.15.157:0/2022261910 >> v2:172.21.15.187:3300/0 conn(0x7f4dc815e2f0 0x7f4dc806d0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:11.453 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.446+0000 7f4dc5d9b700 1 -- 172.21.15.157:0/2022261910 >> v1:172.21.15.157:6789/0 conn(0x7f4dc806a850 legacy=0x7f4dc8070f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:11.453 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.446+0000 7f4dc559a700 1 -- 172.21.15.157:0/2022261910 <== mon.0 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3153195086 0 0) 0x7f4dc80d08b0 con 0x7f4dc806a850 2023-10-16T19:58:11.453 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.446+0000 7f4dc5d9b700 1 -- 172.21.15.157:0/2022261910 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dc80d05d0 con 0x7f4dc806de00 2023-10-16T19:58:11.453 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.447+0000 7f4dc5d9b700 1 --2- 172.21.15.157:0/2022261910 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4dc806de00 0x7f4dc80ce910 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f4dc80d1ad0 tx=0x7f4db8009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=171a018c7c4fb176 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:58:11.453 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.447+0000 7f4dc559a700 1 -- 172.21.15.157:0/2022261910 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4db8011830 con 0x7f4dc806de00 2023-10-16T19:58:11.454 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.447+0000 7f4dc559a700 1 -- 172.21.15.157:0/2022261910 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4db8011990 con 0x7f4dc806de00 2023-10-16T19:58:11.454 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.447+0000 7f4dc559a700 1 -- 172.21.15.157:0/2022261910 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4db8011d20 con 0x7f4dc806de00 2023-10-16T19:58:11.454 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.447+0000 7f4dcc82f700 1 -- 172.21.15.157:0/2022261910 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4dc806de00 msgr2=0x7f4dc80ce910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:11.454 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.447+0000 7f4dcc82f700 1 --2- 172.21.15.157:0/2022261910 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4dc806de00 0x7f4dc80ce910 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f4dc80d1ad0 tx=0x7f4db8009b20 comp rx=0 tx=0).stop 2023-10-16T19:58:11.455 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.447+0000 7f4dcc82f700 1 -- 172.21.15.157:0/2022261910 shutdown_connections 2023-10-16T19:58:11.455 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.447+0000 7f4dcc82f700 1 --2- 172.21.15.157:0/2022261910 >> v2:172.21.15.187:3300/0 conn(0x7f4dc815e2f0 0x7f4dc806d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:11.455 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.447+0000 7f4dcc82f700 1 --2- 172.21.15.157:0/2022261910 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4dc806de00 0x7f4dc80ce910 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:11.455 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.447+0000 7f4dcc82f700 1 -- 172.21.15.157:0/2022261910 >> 172.21.15.157:0/2022261910 conn(0x7f4dc80cd4e0 msgr2=0x7f4dc80cd8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:58:11.455 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.447+0000 7f4dcc82f700 1 -- 172.21.15.157:0/2022261910 shutdown_connections 2023-10-16T19:58:11.456 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.447+0000 7f4dcc82f700 1 -- 172.21.15.157:0/2022261910 wait complete. 2023-10-16T19:58:11.465 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.449+0000 7f4dcc82f700 1 Processor -- start 2023-10-16T19:58:11.465 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.449+0000 7f4dcc82f700 1 -- start start 2023-10-16T19:58:11.465 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.450+0000 7f4dcc82f700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4dc806a850 0x7f4dc81525e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:11.465 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.450+0000 7f4dcc82f700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4dc806de00 0x7f4dc8161f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:11.466 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.450+0000 7f4dcc82f700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4dc815e2f0 0x7f4dc80b48f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:11.466 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.450+0000 7f4dcc82f700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dc8152b20 con 0x7f4dc806a850 2023-10-16T19:58:11.466 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.450+0000 7f4dcc82f700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dc80b4460 con 0x7f4dc806de00 2023-10-16T19:58:11.466 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.450+0000 7f4dcc82f700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dc80b3850 con 0x7f4dc815e2f0 2023-10-16T19:58:11.466 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.450+0000 7f4dc659c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4dc806a850 0x7f4dc81525e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:11.467 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.450+0000 7f4dc659c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4dc806a850 0x7f4dc81525e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:47714/0 (socket says 172.21.15.157:47714) 2023-10-16T19:58:11.467 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.450+0000 7f4dc659c700 1 -- 172.21.15.157:0/827180916 learned_addr learned my addr 172.21.15.157:0/827180916 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:58:11.467 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.450+0000 7f4dc5d9b700 1 --2- 172.21.15.157:0/827180916 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4dc806de00 0x7f4dc8161f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:11.467 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.450+0000 7f4dc6d9d700 1 --2- 172.21.15.157:0/827180916 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4dc815e2f0 0x7f4dc80b48f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:11.467 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.450+0000 7f4dc659c700 1 -- 172.21.15.157:0/827180916 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4dc815e2f0 msgr2=0x7f4dc80b48f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:11.468 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.450+0000 7f4dc659c700 1 --2- 172.21.15.157:0/827180916 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4dc815e2f0 0x7f4dc80b48f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:11.468 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.450+0000 7f4dc659c700 1 -- 172.21.15.157:0/827180916 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4dc806de00 msgr2=0x7f4dc8161f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:11.468 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.450+0000 7f4dc659c700 1 --2- 172.21.15.157:0/827180916 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4dc806de00 0x7f4dc8161f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:11.468 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.450+0000 7f4dc659c700 1 -- 172.21.15.157:0/827180916 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4db80094a0 con 0x7f4dc806a850 2023-10-16T19:58:11.468 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.450+0000 7f4dc659c700 1 --2- 172.21.15.157:0/827180916 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4dc806a850 0x7f4dc81525e0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f4dbc00c7f0 tx=0x7f4dbc00cb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:58:11.469 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.450+0000 7f4db6ffd700 1 -- 172.21.15.157:0/827180916 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dbc004220 con 0x7f4dc806a850 2023-10-16T19:58:11.469 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.450+0000 7f4dcc82f700 1 -- 172.21.15.157:0/827180916 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4dc80b3b30 con 0x7f4dc806a850 2023-10-16T19:58:11.469 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.451+0000 7f4dcc82f700 1 -- 172.21.15.157:0/827180916 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4dc80b40f0 con 0x7f4dc806a850 2023-10-16T19:58:11.469 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.451+0000 7f4db6ffd700 1 -- 172.21.15.157:0/827180916 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dbc004380 con 0x7f4dc806a850 2023-10-16T19:58:11.469 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.451+0000 7f4db6ffd700 1 -- 172.21.15.157:0/827180916 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dbc0036a0 con 0x7f4dc806a850 2023-10-16T19:58:11.469 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.452+0000 7f4db6ffd700 1 -- 172.21.15.157:0/827180916 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f4dbc003800 con 0x7f4dc806a850 2023-10-16T19:58:11.470 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.452+0000 7f4db6ffd700 1 --2- 172.21.15.157:0/827180916 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f4da806af00 0x7f4da806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:11.470 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.452+0000 7f4db6ffd700 1 -- 172.21.15.157:0/827180916 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5729+0+0 (secure 0 0 0) 0x7f4dbc0893e0 con 0x7f4dc806a850 2023-10-16T19:58:11.470 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.453+0000 7f4dc5d9b700 1 --2- 172.21.15.157:0/827180916 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f4da806af00 0x7f4da806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:11.470 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.453+0000 7f4dc5d9b700 1 --2- 172.21.15.157:0/827180916 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f4da806af00 0x7f4da806d3c0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f4db80090b0 tx=0x7f4db801c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:58:11.470 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.454+0000 7f4dd8a19b80 1 Processor -- start 2023-10-16T19:58:11.471 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.454+0000 7f4dd8a19b80 1 -- start start 2023-10-16T19:58:11.471 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.455+0000 7f4dd8a19b80 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55bd95c30220 0x55bd95c37a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:11.471 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.455+0000 7f4dd8a19b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55bd95c35630 0x55bd95c37fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:11.471 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.455+0000 7f4dd8a19b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55bd95c0b010 0x55bd95c0b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:11.471 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.455+0000 7f4dd8a19b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bd95b81c20 con 0x55bd95c0b010 2023-10-16T19:58:11.472 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.455+0000 7f4dd8a19b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bd95b66c10 con 0x55bd95c35630 2023-10-16T19:58:11.472 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.455+0000 7f4dd8a19b80 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x55bd95b64530 con 0x55bd95c30220 2023-10-16T19:58:11.472 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.455+0000 7f4dc6d9d700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55bd95c0b010 0x55bd95c0b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:11.472 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.455+0000 7f4dc6d9d700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55bd95c0b010 0x55bd95c0b6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:47726/0 (socket says 172.21.15.157:47726) 2023-10-16T19:58:11.473 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.455+0000 7f4dc6d9d700 1 -- 172.21.15.157:0/1130510926 learned_addr learned my addr 172.21.15.157:0/1130510926 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:58:11.473 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.455+0000 7f4dc5d9b700 1 --2- 172.21.15.157:0/1130510926 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55bd95c35630 0x55bd95c37fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:11.473 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.455+0000 7f4dc659c700 1 --2- 172.21.15.157:0/1130510926 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55bd95c30220 0x55bd95c37a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:11.473 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.455+0000 7f4dc6d9d700 1 -- 172.21.15.157:0/1130510926 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55bd95c30220 msgr2=0x55bd95c37a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:58:11.473 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.455+0000 7f4dc6d9d700 1 --2- 172.21.15.157:0/1130510926 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55bd95c30220 0x55bd95c37a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:11.474 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.456+0000 7f4dc6d9d700 1 -- 172.21.15.157:0/1130510926 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55bd95c35630 msgr2=0x55bd95c37fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:58:11.474 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.456+0000 7f4dc6d9d700 1 --2- 172.21.15.157:0/1130510926 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55bd95c35630 0x55bd95c37fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:11.474 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.456+0000 7f4dc6d9d700 1 -- 172.21.15.157:0/1130510926 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bd95b1d3a0 con 0x55bd95c0b010 2023-10-16T19:58:11.474 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.456+0000 7f4dc659c700 1 --2- 172.21.15.157:0/1130510926 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55bd95c30220 0x55bd95c37a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T19:58:11.474 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.456+0000 7f4dc6d9d700 1 --2- 172.21.15.157:0/1130510926 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55bd95c0b010 0x55bd95c0b6c0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f4dc0007130 tx=0x7f4dc0007440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70871aeba9d6063e server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:58:11.475 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.456+0000 7f4da7fff700 1 -- 172.21.15.157:0/1130510926 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dc0001e70 con 0x55bd95c0b010 2023-10-16T19:58:11.475 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.456+0000 7f4da7fff700 1 -- 172.21.15.157:0/1130510926 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dc0007ab0 con 0x55bd95c0b010 2023-10-16T19:58:11.475 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.456+0000 7f4da7fff700 1 -- 172.21.15.157:0/1130510926 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dc0012780 con 0x55bd95c0b010 2023-10-16T19:58:11.475 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.456+0000 7f4dd8a19b80 1 -- 172.21.15.157:0/1130510926 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55bd95c0b010 msgr2=0x55bd95c0b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:11.475 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.456+0000 7f4dd8a19b80 1 --2- 172.21.15.157:0/1130510926 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55bd95c0b010 0x55bd95c0b6c0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f4dc0007130 tx=0x7f4dc0007440 comp rx=0 tx=0).stop 2023-10-16T19:58:11.476 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.456+0000 7f4dd8a19b80 1 -- 172.21.15.157:0/1130510926 shutdown_connections 2023-10-16T19:58:11.476 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.456+0000 7f4dd8a19b80 1 --2- 172.21.15.157:0/1130510926 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55bd95c0b010 0x55bd95c0b6c0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:11.476 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.456+0000 7f4dd8a19b80 1 --2- 172.21.15.157:0/1130510926 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55bd95c30220 0x55bd95c37a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:11.476 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.456+0000 7f4dd8a19b80 1 --2- 172.21.15.157:0/1130510926 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55bd95c35630 0x55bd95c37fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:11.476 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.456+0000 7f4dd8a19b80 1 -- 172.21.15.157:0/1130510926 >> 172.21.15.157:0/1130510926 conn(0x55bd95b3ad80 msgr2=0x55bd95c55ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:58:11.476 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.457+0000 7f4dd8a19b80 1 -- 172.21.15.157:0/1130510926 shutdown_connections 2023-10-16T19:58:11.477 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.457+0000 7f4dd8a19b80 1 -- 172.21.15.157:0/1130510926 wait complete. 2023-10-16T19:58:11.477 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.457+0000 7f4dd8a19b80 1 -- start start 2023-10-16T19:58:11.477 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.457+0000 7f4dd8a19b80 1 Processor -- start 2023-10-16T19:58:11.477 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.458+0000 7f4dd8a19b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55bd95c0b010 0x55bd95c2dce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:11.478 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.458+0000 7f4dd8a19b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55bd95c30220 0x55bd95c33c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:11.479 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.458+0000 7f4dd8a19b80 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55bd95c35630 0x55bd95c37310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:11.479 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.458+0000 7f4dd8a19b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bd95b5fe20 con 0x55bd95c30220 2023-10-16T19:58:11.479 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.458+0000 7f4dd8a19b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bd95afc6c0 con 0x55bd95c0b010 2023-10-16T19:58:11.479 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.458+0000 7f4dd8a19b80 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x55bd95afc360 con 0x55bd95c35630 2023-10-16T19:58:11.480 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.458+0000 7f4dd8a19b80 10 client.0 _ll_register_callbacks cb 0x55bd959597b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-16T19:58:11.480 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.458+0000 7f4dc5d9b700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55bd95c30220 0x55bd95c33c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:11.480 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.458+0000 7f4dc5d9b700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55bd95c30220 0x55bd95c33c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:47730/0 (socket says 172.21.15.157:47730) 2023-10-16T19:58:11.480 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.458+0000 7f4dc5d9b700 1 -- 172.21.15.157:0/3714352247 learned_addr learned my addr 172.21.15.157:0/3714352247 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:58:11.480 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.458+0000 7f4dc6d9d700 1 --2- 172.21.15.157:0/3714352247 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55bd95c35630 0x55bd95c37310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:11.481 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.458+0000 7f4dc5d9b700 1 -- 172.21.15.157:0/3714352247 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55bd95c35630 msgr2=0x55bd95c37310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:58:11.481 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.458+0000 7f4dc659c700 1 --2- 172.21.15.157:0/3714352247 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55bd95c0b010 0x55bd95c2dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:11.481 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.458+0000 7f4dc5d9b700 1 --2- 172.21.15.157:0/3714352247 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55bd95c35630 0x55bd95c37310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:11.481 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.458+0000 7f4dc5d9b700 1 -- 172.21.15.157:0/3714352247 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55bd95c0b010 msgr2=0x55bd95c2dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:58:11.482 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.458+0000 7f4dc5d9b700 1 --2- 172.21.15.157:0/3714352247 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55bd95c0b010 0x55bd95c2dce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:11.482 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.458+0000 7f4dc5d9b700 1 -- 172.21.15.157:0/3714352247 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4dc0001fd0 con 0x55bd95c30220 2023-10-16T19:58:11.482 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.458+0000 7f4dc6d9d700 1 --2- 172.21.15.157:0/3714352247 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55bd95c35630 0x55bd95c37310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T19:58:11.483 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.459+0000 7f4dc659c700 1 --2- 172.21.15.157:0/3714352247 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55bd95c0b010 0x55bd95c2dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T19:58:11.483 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.459+0000 7f4dc5d9b700 1 --2- 172.21.15.157:0/3714352247 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55bd95c30220 0x55bd95c33c70 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f4db8013000 tx=0x7f4db800e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a4b64afce529e81 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:58:11.483 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.459+0000 7f4da57fa700 10 client.0 ms_handle_connect on v2:172.21.15.157:3300/0 2023-10-16T19:58:11.484 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.459+0000 7f4da57fa700 1 -- 172.21.15.157:0/3714352247 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4db8030670 con 0x55bd95c30220 2023-10-16T19:58:11.484 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.459+0000 7f4da57fa700 1 -- 172.21.15.157:0/3714352247 <== mon.0 v2:172.21.15.157:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 5729+0+0 (secure 0 0 0) 0x7f4db801f070 con 0x55bd95c30220 2023-10-16T19:58:11.484 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.459+0000 7f4dd8a19b80 1 -- 172.21.15.157:0/3714352247 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55bd95c005b0 con 0x55bd95c30220 2023-10-16T19:58:11.484 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.459+0000 7f4da57fa700 1 -- 172.21.15.157:0/3714352247 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4db80307d0 con 0x55bd95c30220 2023-10-16T19:58:11.484 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.459+0000 7f4dd8a19b80 10 client.5223 fetch_fsmap learned FSMap version 17 2023-10-16T19:58:11.484 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.459+0000 7f4dd8a19b80 1 -- 172.21.15.157:0/3714352247 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55bd9598ad90 con 0x55bd95c30220 2023-10-16T19:58:11.485 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.459+0000 7f4da57fa700 1 -- 172.21.15.157:0/3714352247 <== mon.0 v2:172.21.15.157:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55bd95c005b0 con 0x55bd95c30220 2023-10-16T19:58:11.485 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.459+0000 7f4da57fa700 1 -- 172.21.15.157:0/3714352247 <== mon.0 v2:172.21.15.157:3300/0 5 ==== fsmap(e 17) v1 ==== 3299+0+0 (secure 0 0 0) 0x7f4db8030930 con 0x55bd95c30220 2023-10-16T19:58:11.485 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.459+0000 7f4dd8a19b80 10 client.5223 fetch_fsmap finished waiting for FSMap version 17 2023-10-16T19:58:11.485 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.459+0000 7f4dd8a19b80 10 client.5223 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-16T19:58:11.485 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.459+0000 7f4dd8a19b80 20 client.5223 populate_metadata read hostname 'smithi157' 2023-10-16T19:58:11.486 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.459+0000 7f4dd8a19b80 1 --2- 172.21.15.157:0/3714352247 >> [v2:172.21.15.157:6834/1166326737,v1:172.21.15.157:6835/1166326737] conn(0x55bd95c30b00 0x55bd95c30ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:11.486 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.459+0000 7f4dd8a19b80 4 client.5223 mds_command: new command op to 5043 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-16T19:58:11.486 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.459+0000 7f4dd8a19b80 1 -- 172.21.15.157:0/3714352247 --> [v2:172.21.15.157:6834/1166326737,v1:172.21.15.157:6835/1166326737] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55bd95b58e00 con 0x55bd95c30b00 2023-10-16T19:58:11.486 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.459+0000 7f4dc659c700 1 --2- 172.21.15.157:0/3714352247 >> [v2:172.21.15.157:6834/1166326737,v1:172.21.15.157:6835/1166326737] conn(0x55bd95c30b00 0x55bd95c30ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:11.486 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.460+0000 7f4da57fa700 10 client.5223 ms_handle_connect on v2:172.21.15.157:6834/1166326737 2023-10-16T19:58:11.487 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.460+0000 7f4dc659c700 1 --2- 172.21.15.157:0/3714352247 >> [v2:172.21.15.157:6834/1166326737,v1:172.21.15.157:6835/1166326737] conn(0x55bd95c30b00 0x55bd95c30ee0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=380d7787980fa076 server_cookie=97a57e7c8592ac95 in_seq=0 out_seq=0 2023-10-16T19:58:11.487 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.460+0000 7f4da57fa700 1 -- 172.21.15.157:0/3714352247 <== mds.0 v2:172.21.15.157:6834/1166326737 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55bd95b58e00 con 0x55bd95c30b00 2023-10-16T19:58:11.487 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.460+0000 7f4da57fa700 10 client.5223 handle_command_reply: tid=0 2023-10-16T19:58:11.487 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.460+0000 7f4dd8a19b80 1 client.5223 shutdown 2023-10-16T19:58:11.487 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.460+0000 7f4dd8a19b80 1 -- 172.21.15.157:0/3714352247 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55bd95c30220 msgr2=0x55bd95c33c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:11.488 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.460+0000 7f4dd8a19b80 1 --2- 172.21.15.157:0/3714352247 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55bd95c30220 0x55bd95c33c70 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f4db8013000 tx=0x7f4db800e000 comp rx=0 tx=0).stop 2023-10-16T19:58:11.488 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.460+0000 7f4dd8a19b80 1 -- 172.21.15.157:0/3714352247 shutdown_connections 2023-10-16T19:58:11.488 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.460+0000 7f4dd8a19b80 1 --2- 172.21.15.157:0/3714352247 >> [v2:172.21.15.157:6834/1166326737,v1:172.21.15.157:6835/1166326737] conn(0x55bd95c30b00 0x55bd95c30ee0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:11.488 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.461+0000 7f4dd8a19b80 1 --2- 172.21.15.157:0/3714352247 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55bd95c0b010 0x55bd95c2dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:11.489 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.461+0000 7f4dd8a19b80 1 --2- 172.21.15.157:0/3714352247 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55bd95c35630 0x55bd95c37310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:11.489 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.461+0000 7f4dd8a19b80 1 --2- 172.21.15.157:0/3714352247 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55bd95c30220 0x55bd95c33c70 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:11.489 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.461+0000 7f4da57fa700 0 client.5223 ms_handle_reset on v2:172.21.15.157:6834/1166326737 2023-10-16T19:58:11.489 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.461+0000 7f4dd8a19b80 1 -- 172.21.15.157:0/3714352247 >> 172.21.15.157:0/3714352247 conn(0x55bd95b3ad80 msgr2=0x55bd95c53450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:58:11.489 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.461+0000 7f4dd8a19b80 1 -- 172.21.15.157:0/3714352247 shutdown_connections 2023-10-16T19:58:11.490 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.461+0000 7f4dd8a19b80 1 -- 172.21.15.157:0/3714352247 wait complete. 2023-10-16T19:58:11.490 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.461+0000 7f4dd8a19b80 20 client.5223 trim_cache size 0 max 16384 2023-10-16T19:58:11.497 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.478+0000 7f4dd8a19b80 1 Processor -- start 2023-10-16T19:58:11.497 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.478+0000 7f4dd8a19b80 1 -- start start 2023-10-16T19:58:11.497 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.479+0000 7f4dd8a19b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55bd95c0b010 0x55bd95c36cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:11.498 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.479+0000 7f4dd8a19b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55bd95c30220 0x55bd95c08470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:11.498 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.479+0000 7f4dd8a19b80 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55bd95c35630 0x55bd95c34500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:11.498 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.479+0000 7f4dd8a19b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bd959e08d0 con 0x55bd95c0b010 2023-10-16T19:58:11.498 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.479+0000 7f4dd8a19b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bd95c38290 con 0x55bd95c30220 2023-10-16T19:58:11.499 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.479+0000 7f4dd8a19b80 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x55bd95c3b640 con 0x55bd95c35630 2023-10-16T19:58:11.499 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.479+0000 7f4dc659c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55bd95c0b010 0x55bd95c36cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:11.499 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.479+0000 7f4dc659c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55bd95c0b010 0x55bd95c36cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:47736/0 (socket says 172.21.15.157:47736) 2023-10-16T19:58:11.499 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.479+0000 7f4dc659c700 1 -- 172.21.15.157:0/2733782711 learned_addr learned my addr 172.21.15.157:0/2733782711 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:58:11.499 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.479+0000 7f4dc5d9b700 1 --2- 172.21.15.157:0/2733782711 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55bd95c30220 0x55bd95c08470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:11.500 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.479+0000 7f4dc659c700 1 -- 172.21.15.157:0/2733782711 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55bd95c35630 msgr2=0x55bd95c34500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:58:11.500 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.479+0000 7f4dc6d9d700 1 --2- 172.21.15.157:0/2733782711 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55bd95c35630 0x55bd95c34500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:11.500 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.479+0000 7f4dc659c700 1 --2- 172.21.15.157:0/2733782711 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55bd95c35630 0x55bd95c34500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:11.500 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.479+0000 7f4dc659c700 1 -- 172.21.15.157:0/2733782711 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55bd95c30220 msgr2=0x55bd95c08470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:58:11.500 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.479+0000 7f4dc659c700 1 --2- 172.21.15.157:0/2733782711 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55bd95c30220 0x55bd95c08470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:11.501 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.479+0000 7f4dc659c700 1 -- 172.21.15.157:0/2733782711 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bd95973c10 con 0x55bd95c0b010 2023-10-16T19:58:11.501 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.479+0000 7f4dc5d9b700 1 --2- 172.21.15.157:0/2733782711 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55bd95c30220 0x55bd95c08470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T19:58:11.501 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.480+0000 7f4dc659c700 1 --2- 172.21.15.157:0/2733782711 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55bd95c0b010 0x55bd95c36cf0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f4dbc057ec0 tx=0x7f4dbc013040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49c8923776cdfcd3 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:58:11.501 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.480+0000 7f4db4ff9700 1 -- 172.21.15.157:0/2733782711 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dbc0604c0 con 0x55bd95c0b010 2023-10-16T19:58:11.501 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.480+0000 7f4db4ff9700 1 -- 172.21.15.157:0/2733782711 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dbc056300 con 0x55bd95c0b010 2023-10-16T19:58:11.502 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.480+0000 7f4db4ff9700 1 -- 172.21.15.157:0/2733782711 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dbc0548d0 con 0x55bd95c0b010 2023-10-16T19:58:11.502 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.480+0000 7f4dd8a19b80 1 -- 172.21.15.157:0/2733782711 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55bd95c0b010 msgr2=0x55bd95c36cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:11.502 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.480+0000 7f4dd8a19b80 1 --2- 172.21.15.157:0/2733782711 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55bd95c0b010 0x55bd95c36cf0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f4dbc057ec0 tx=0x7f4dbc013040 comp rx=0 tx=0).stop 2023-10-16T19:58:11.502 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.480+0000 7f4dd8a19b80 1 -- 172.21.15.157:0/2733782711 shutdown_connections 2023-10-16T19:58:11.502 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.480+0000 7f4dd8a19b80 1 --2- 172.21.15.157:0/2733782711 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55bd95c35630 0x55bd95c34500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:11.503 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.480+0000 7f4dd8a19b80 1 --2- 172.21.15.157:0/2733782711 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55bd95c0b010 0x55bd95c36cf0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:11.503 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.480+0000 7f4dd8a19b80 1 --2- 172.21.15.157:0/2733782711 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55bd95c30220 0x55bd95c08470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:11.503 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.480+0000 7f4dd8a19b80 1 -- 172.21.15.157:0/2733782711 >> 172.21.15.157:0/2733782711 conn(0x55bd95b3ad80 msgr2=0x55bd95c2daf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:58:11.503 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.480+0000 7f4dd8a19b80 1 -- 172.21.15.157:0/2733782711 shutdown_connections 2023-10-16T19:58:11.503 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.480+0000 7f4dd8a19b80 1 -- 172.21.15.157:0/2733782711 wait complete. 2023-10-16T19:58:11.503 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.481+0000 7f4dd8a19b80 1 -- start start 2023-10-16T19:58:11.504 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.481+0000 7f4dd8a19b80 1 Processor -- start 2023-10-16T19:58:11.504 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.482+0000 7f4dd8a19b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55bd95c0b010 0x55bd95cb9300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:11.504 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.482+0000 7f4dd8a19b80 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55bd95c30220 0x55bd95c0b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:11.504 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.482+0000 7f4dd8a19b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55bd95c35630 0x55bd95c0b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:11.504 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.482+0000 7f4dd8a19b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bd95cb9ce0 con 0x55bd95c35630 2023-10-16T19:58:11.505 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.482+0000 7f4dd8a19b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bd95c0e380 con 0x55bd95c0b010 2023-10-16T19:58:11.505 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.482+0000 7f4dd8a19b80 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x55bd95cb9840 con 0x55bd95c30220 2023-10-16T19:58:11.505 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.482+0000 7f4dd8a19b80 10 client.0 _ll_register_callbacks cb 0x7f4db80040f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-16T19:58:11.505 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.482+0000 7f4dc6d9d700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55bd95c35630 0x55bd95c0b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:11.505 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.482+0000 7f4dc6d9d700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55bd95c35630 0x55bd95c0b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:47746/0 (socket says 172.21.15.157:47746) 2023-10-16T19:58:11.506 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.482+0000 7f4dc6d9d700 1 -- 172.21.15.157:0/1044103563 learned_addr learned my addr 172.21.15.157:0/1044103563 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:58:11.506 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.482+0000 7f4dc659c700 1 --2- 172.21.15.157:0/1044103563 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55bd95c0b010 0x55bd95cb9300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:11.507 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.482+0000 7f4dc5d9b700 1 --2- 172.21.15.157:0/1044103563 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55bd95c30220 0x55bd95c0b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:11.508 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.482+0000 7f4dc6d9d700 1 -- 172.21.15.157:0/1044103563 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55bd95c30220 msgr2=0x55bd95c0b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:58:11.508 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.482+0000 7f4dc6d9d700 1 --2- 172.21.15.157:0/1044103563 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55bd95c30220 0x55bd95c0b480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:11.508 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.482+0000 7f4dc6d9d700 1 -- 172.21.15.157:0/1044103563 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55bd95c0b010 msgr2=0x55bd95cb9300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:58:11.509 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.482+0000 7f4dc6d9d700 1 --2- 172.21.15.157:0/1044103563 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55bd95c0b010 0x55bd95cb9300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:11.509 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.482+0000 7f4dc6d9d700 1 -- 172.21.15.157:0/1044103563 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4dc80b40f0 con 0x55bd95c35630 2023-10-16T19:58:11.509 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.482+0000 7f4dc6d9d700 1 --2- 172.21.15.157:0/1044103563 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55bd95c35630 0x55bd95c0b9c0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f4dc0001330 tx=0x7f4dc00012a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1272bb140ae5a45b server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:58:11.510 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.482+0000 7f4da57fa700 10 client.0 ms_handle_connect on v2:172.21.15.157:3300/0 2023-10-16T19:58:11.510 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.482+0000 7f4da57fa700 1 -- 172.21.15.157:0/1044103563 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dc0001e70 con 0x55bd95c35630 2023-10-16T19:58:11.510 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.482+0000 7f4da57fa700 1 -- 172.21.15.157:0/1044103563 <== mon.0 v2:172.21.15.157:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 5729+0+0 (secure 0 0 0) 0x7f4dc001fce0 con 0x55bd95c35630 2023-10-16T19:58:11.511 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.482+0000 7f4dd8a19b80 1 -- 172.21.15.157:0/1044103563 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4dc0007ab0 con 0x55bd95c35630 2023-10-16T19:58:11.511 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.483+0000 7f4da57fa700 1 -- 172.21.15.157:0/1044103563 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4dc0001750 con 0x55bd95c35630 2023-10-16T19:58:11.512 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.483+0000 7f4dd8a19b80 10 client.5229 fetch_fsmap learned FSMap version 17 2023-10-16T19:58:11.512 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.483+0000 7f4dd8a19b80 1 -- 172.21.15.157:0/1044103563 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55bd959b1200 con 0x55bd95c35630 2023-10-16T19:58:11.512 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.483+0000 7f4da57fa700 1 -- 172.21.15.157:0/1044103563 <== mon.0 v2:172.21.15.157:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dc0007ab0 con 0x55bd95c35630 2023-10-16T19:58:11.513 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.483+0000 7f4da57fa700 1 -- 172.21.15.157:0/1044103563 <== mon.0 v2:172.21.15.157:3300/0 5 ==== fsmap(e 17) v1 ==== 3299+0+0 (secure 0 0 0) 0x7f4dc0012070 con 0x55bd95c35630 2023-10-16T19:58:11.513 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.483+0000 7f4dd8a19b80 10 client.5229 fetch_fsmap finished waiting for FSMap version 17 2023-10-16T19:58:11.514 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.483+0000 7f4dd8a19b80 10 client.5229 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-16T19:58:11.514 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.483+0000 7f4dd8a19b80 20 client.5229 populate_metadata read hostname 'smithi157' 2023-10-16T19:58:11.515 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.483+0000 7f4dd8a19b80 1 --2- 172.21.15.157:0/1044103563 >> [v2:172.21.15.157:6834/1166326737,v1:172.21.15.157:6835/1166326737] conn(0x55bd95c38d90 0x55bd95c39170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:11.515 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.483+0000 7f4dd8a19b80 4 client.5229 mds_command: new command op to 5043 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-16T19:58:11.515 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.483+0000 7f4dd8a19b80 1 -- 172.21.15.157:0/1044103563 --> [v2:172.21.15.157:6834/1166326737,v1:172.21.15.157:6835/1166326737] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55bd95b58b20 con 0x55bd95c38d90 2023-10-16T19:58:11.516 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.483+0000 7f4dc659c700 1 --2- 172.21.15.157:0/1044103563 >> [v2:172.21.15.157:6834/1166326737,v1:172.21.15.157:6835/1166326737] conn(0x55bd95c38d90 0x55bd95c39170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:11.516 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.483+0000 7f4da57fa700 10 client.5229 ms_handle_connect on v2:172.21.15.157:6834/1166326737 2023-10-16T19:58:11.516 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.483+0000 7f4dc659c700 1 --2- 172.21.15.157:0/1044103563 >> [v2:172.21.15.157:6834/1166326737,v1:172.21.15.157:6835/1166326737] conn(0x55bd95c38d90 0x55bd95c39170 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=38b8076b10fea368 server_cookie=5c5bf4c040d4a67b in_seq=0 out_seq=0 2023-10-16T19:58:11.517 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.484+0000 7f4da57fa700 1 -- 172.21.15.157:0/1044103563 <== mds.0 v2:172.21.15.157:6834/1166326737 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x55bd95b58b20 con 0x55bd95c38d90 2023-10-16T19:58:11.517 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.484+0000 7f4da57fa700 10 client.5229 handle_command_reply: tid=0 2023-10-16T19:58:11.518 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.484+0000 7f4dd8a19b80 1 client.5229 shutdown 2023-10-16T19:58:11.518 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.484+0000 7f4dd8a19b80 1 -- 172.21.15.157:0/1044103563 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55bd95c35630 msgr2=0x55bd95c0b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:11.518 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.484+0000 7f4dd8a19b80 1 --2- 172.21.15.157:0/1044103563 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55bd95c35630 0x55bd95c0b9c0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f4dc0001330 tx=0x7f4dc00012a0 comp rx=0 tx=0).stop 2023-10-16T19:58:11.519 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.484+0000 7f4dd8a19b80 1 -- 172.21.15.157:0/1044103563 shutdown_connections 2023-10-16T19:58:11.519 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.484+0000 7f4dd8a19b80 1 --2- 172.21.15.157:0/1044103563 >> [v2:172.21.15.157:6834/1166326737,v1:172.21.15.157:6835/1166326737] conn(0x55bd95c38d90 0x55bd95c39170 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:11.520 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.484+0000 7f4dd8a19b80 1 --2- 172.21.15.157:0/1044103563 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55bd95c0b010 0x55bd95cb9300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:11.520 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.484+0000 7f4da57fa700 0 client.5229 ms_handle_reset on v2:172.21.15.157:6834/1166326737 2023-10-16T19:58:11.520 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.484+0000 7f4dd8a19b80 1 --2- 172.21.15.157:0/1044103563 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55bd95c35630 0x55bd95c0b9c0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:11.521 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.484+0000 7f4dd8a19b80 1 --2- 172.21.15.157:0/1044103563 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55bd95c30220 0x55bd95c0b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:11.521 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.484+0000 7f4dd8a19b80 1 -- 172.21.15.157:0/1044103563 >> 172.21.15.157:0/1044103563 conn(0x55bd95b3ad80 msgr2=0x55bd95c55f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:58:11.522 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.484+0000 7f4dd8a19b80 1 -- 172.21.15.157:0/1044103563 shutdown_connections 2023-10-16T19:58:11.522 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.484+0000 7f4dd8a19b80 1 -- 172.21.15.157:0/1044103563 wait complete. 2023-10-16T19:58:11.522 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.484+0000 7f4dd8a19b80 20 client.5229 trim_cache size 0 max 16384 2023-10-16T19:58:11.523 INFO:teuthology.orchestra.run.smithi157.stdout:{ 2023-10-16T19:58:11.524 INFO:teuthology.orchestra.run.smithi157.stdout: "cluster_fsid": "28199dc9-64d5-479e-83c6-21f097c33d39", 2023-10-16T19:58:11.524 INFO:teuthology.orchestra.run.smithi157.stdout: "whoami": 0, 2023-10-16T19:58:11.525 INFO:teuthology.orchestra.run.smithi157.stdout: "id": 5043, 2023-10-16T19:58:11.525 INFO:teuthology.orchestra.run.smithi157.stdout: "want_state": "up:active", 2023-10-16T19:58:11.525 INFO:teuthology.orchestra.run.smithi157.stdout: "state": "up:active", 2023-10-16T19:58:11.526 INFO:teuthology.orchestra.run.smithi157.stdout: "fs_name": "testcephfs1", 2023-10-16T19:58:11.526 INFO:teuthology.orchestra.run.smithi157.stdout: "rank_uptime": 5.8760616780000001, 2023-10-16T19:58:11.527 INFO:teuthology.orchestra.run.smithi157.stdout: "mdsmap_epoch": 17, 2023-10-16T19:58:11.527 INFO:teuthology.orchestra.run.smithi157.stdout: "osdmap_epoch": 33, 2023-10-16T19:58:11.527 INFO:teuthology.orchestra.run.smithi157.stdout: "osdmap_epoch_barrier": 33, 2023-10-16T19:58:11.528 INFO:teuthology.orchestra.run.smithi157.stdout: "uptime": 13.896562591 2023-10-16T19:58:11.528 INFO:teuthology.orchestra.run.smithi157.stdout:} 2023-10-16T19:58:11.531 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.484+0000 7f4dcc82f700 1 -- 172.21.15.157:0/827180916 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f4da806af00 msgr2=0x7f4da806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:11.532 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.484+0000 7f4dcc82f700 1 --2- 172.21.15.157:0/827180916 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f4da806af00 0x7f4da806d3c0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f4db80090b0 tx=0x7f4db801c040 comp rx=0 tx=0).stop 2023-10-16T19:58:11.532 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.484+0000 7f4dcc82f700 1 -- 172.21.15.157:0/827180916 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4dc806a850 msgr2=0x7f4dc81525e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:11.532 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.484+0000 7f4dcc82f700 1 --2- 172.21.15.157:0/827180916 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4dc806a850 0x7f4dc81525e0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f4dbc00c7f0 tx=0x7f4dbc00cb00 comp rx=0 tx=0).stop 2023-10-16T19:58:11.533 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.484+0000 7f4dcc82f700 1 -- 172.21.15.157:0/827180916 shutdown_connections 2023-10-16T19:58:11.533 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.484+0000 7f4dcc82f700 1 --2- 172.21.15.157:0/827180916 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4dc815e2f0 0x7f4dc80b48f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:11.534 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.484+0000 7f4dcc82f700 1 --2- 172.21.15.157:0/827180916 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4dc806a850 0x7f4dc81525e0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:11.534 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.484+0000 7f4dcc82f700 1 --2- 172.21.15.157:0/827180916 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f4da806af00 0x7f4da806d3c0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:11.534 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.484+0000 7f4dcc82f700 1 --2- 172.21.15.157:0/827180916 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4dc806de00 0x7f4dc8161f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:11.537 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.484+0000 7f4dcc82f700 1 -- 172.21.15.157:0/827180916 >> 172.21.15.157:0/827180916 conn(0x7f4dc80cd4e0 msgr2=0x7f4dc815d330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:58:11.538 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.485+0000 7f4dcc82f700 1 -- 172.21.15.157:0/827180916 shutdown_connections 2023-10-16T19:58:11.538 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.485+0000 7f4dcc82f700 1 -- 172.21.15.157:0/827180916 wait complete. 2023-10-16T19:58:11.539 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-16T19:58:11.661 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.659+0000 7f4ab3198700 1 Processor -- start 2023-10-16T19:58:11.662 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.659+0000 7f4ab3198700 1 -- start start 2023-10-16T19:58:11.665 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.660+0000 7f4ab3198700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f4aac15b130 0x7f4aac071f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:11.665 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.660+0000 7f4ab3198700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f4aac06d0f0 0x7f4aac0cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:11.665 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.660+0000 7f4ab3198700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4aac0cbeb0 0x7f4aac06eb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:11.666 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.660+0000 7f4ab3198700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4aac0b0050 con 0x7f4aac06d0f0 2023-10-16T19:58:11.666 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.660+0000 7f4ab3198700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4aac0cefc0 con 0x7f4aac15b130 2023-10-16T19:58:11.666 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.660+0000 7f4ab3198700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4aac06e090 con 0x7f4aac0cbeb0 2023-10-16T19:58:11.666 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.660+0000 7f4aabfff700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f4aac06d0f0 0x7f4aac0cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:11.667 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.660+0000 7f4aabfff700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f4aac06d0f0 0x7f4aac0cb970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:47750/0 (socket says 172.21.15.157:47750) 2023-10-16T19:58:11.667 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.660+0000 7f4aabfff700 1 -- 172.21.15.157:0/1892157960 learned_addr learned my addr 172.21.15.157:0/1892157960 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:58:11.667 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.661+0000 7f4ab0f34700 1 --2- 172.21.15.157:0/1892157960 >> v2:172.21.15.187:3300/0 conn(0x7f4aac15b130 0x7f4aac071f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:11.668 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.661+0000 7f4ab1735700 1 --2- 172.21.15.157:0/1892157960 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4aac0cbeb0 0x7f4aac06eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:11.668 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.661+0000 7f4aabfff700 1 -- 172.21.15.157:0/1892157960 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4aac0cbeb0 msgr2=0x7f4aac06eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:58:11.668 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.661+0000 7f4aabfff700 1 --2- 172.21.15.157:0/1892157960 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4aac0cbeb0 0x7f4aac06eb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:11.668 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.661+0000 7f4aabfff700 1 -- 172.21.15.157:0/1892157960 >> v2:172.21.15.187:3300/0 conn(0x7f4aac15b130 msgr2=0x7f4aac071f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:58:11.669 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.661+0000 7f4aabfff700 1 --2- 172.21.15.157:0/1892157960 >> v2:172.21.15.187:3300/0 conn(0x7f4aac15b130 0x7f4aac071f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:11.669 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.661+0000 7f4aabfff700 1 -- 172.21.15.157:0/1892157960 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4aac06d570 con 0x7f4aac06d0f0 2023-10-16T19:58:11.669 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.661+0000 7f4ab0f34700 1 --2- 172.21.15.157:0/1892157960 >> v2:172.21.15.187:3300/0 conn(0x7f4aac15b130 0x7f4aac071f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T19:58:11.669 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.661+0000 7f4ab1735700 1 --2- 172.21.15.157:0/1892157960 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4aac0cbeb0 0x7f4aac06eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T19:58:11.669 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.661+0000 7f4aabfff700 1 --2- 172.21.15.157:0/1892157960 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4aac06d0f0 0x7f4aac0cb970 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f4aac06cb70 tx=0x7f4a9800be70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17c1cfbc8b53dc02 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:58:11.670 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.661+0000 7f4aab7fe700 1 -- 172.21.15.157:0/1892157960 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a9800dd30 con 0x7f4aac06d0f0 2023-10-16T19:58:11.670 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.661+0000 7f4aab7fe700 1 -- 172.21.15.157:0/1892157960 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a9800de90 con 0x7f4aac06d0f0 2023-10-16T19:58:11.670 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.661+0000 7f4aab7fe700 1 -- 172.21.15.157:0/1892157960 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a98010690 con 0x7f4aac06d0f0 2023-10-16T19:58:11.670 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.661+0000 7f4ab3198700 1 -- 172.21.15.157:0/1892157960 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4aac06d0f0 msgr2=0x7f4aac0cb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:11.670 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.661+0000 7f4ab3198700 1 --2- 172.21.15.157:0/1892157960 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4aac06d0f0 0x7f4aac0cb970 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f4aac06cb70 tx=0x7f4a9800be70 comp rx=0 tx=0).stop 2023-10-16T19:58:11.671 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.662+0000 7f4ab3198700 1 -- 172.21.15.157:0/1892157960 shutdown_connections 2023-10-16T19:58:11.671 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.662+0000 7f4ab3198700 1 --2- 172.21.15.157:0/1892157960 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4aac0cbeb0 0x7f4aac06eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:11.671 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.662+0000 7f4ab3198700 1 --2- 172.21.15.157:0/1892157960 >> v2:172.21.15.187:3300/0 conn(0x7f4aac15b130 0x7f4aac071f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:11.672 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.662+0000 7f4ab3198700 1 --2- 172.21.15.157:0/1892157960 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4aac06d0f0 0x7f4aac0cb970 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:11.672 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.662+0000 7f4ab3198700 1 -- 172.21.15.157:0/1892157960 >> 172.21.15.157:0/1892157960 conn(0x7f4aac0cd4e0 msgr2=0x7f4aac0cd8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:58:11.672 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.662+0000 7f4ab3198700 1 -- 172.21.15.157:0/1892157960 shutdown_connections 2023-10-16T19:58:11.672 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.662+0000 7f4ab3198700 1 -- 172.21.15.157:0/1892157960 wait complete. 2023-10-16T19:58:11.675 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.663+0000 7f4ab3198700 1 Processor -- start 2023-10-16T19:58:11.675 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.663+0000 7f4ab3198700 1 -- start start 2023-10-16T19:58:11.676 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.664+0000 7f4ab3198700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4aac06d0f0 0x7f4aac15df40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:11.676 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.664+0000 7f4ab3198700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4aac0cbeb0 0x7f4aac1f3140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:11.676 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.664+0000 7f4ab3198700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4aac15b130 0x7f4aac0b5d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:11.676 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.664+0000 7f4ab3198700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4aac15cea0 con 0x7f4aac15b130 2023-10-16T19:58:11.676 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.664+0000 7f4ab3198700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4aac15c290 con 0x7f4aac06d0f0 2023-10-16T19:58:11.677 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.664+0000 7f4ab3198700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4aac15c570 con 0x7f4aac0cbeb0 2023-10-16T19:58:11.677 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.664+0000 7f4ab1735700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4aac15b130 0x7f4aac0b5d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:11.677 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.664+0000 7f4ab1735700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4aac15b130 0x7f4aac0b5d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:47758/0 (socket says 172.21.15.157:47758) 2023-10-16T19:58:11.677 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.664+0000 7f4ab1735700 1 -- 172.21.15.157:0/1022341511 learned_addr learned my addr 172.21.15.157:0/1022341511 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:58:11.677 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.665+0000 7f4aabfff700 1 --2- 172.21.15.157:0/1022341511 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4aac0cbeb0 0x7f4aac1f3140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:11.678 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.665+0000 7f4ab0f34700 1 --2- 172.21.15.157:0/1022341511 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4aac06d0f0 0x7f4aac15df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:11.678 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.665+0000 7f4ab1735700 1 -- 172.21.15.157:0/1022341511 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4aac0cbeb0 msgr2=0x7f4aac1f3140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:11.678 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.665+0000 7f4ab1735700 1 --2- 172.21.15.157:0/1022341511 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4aac0cbeb0 0x7f4aac1f3140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:11.678 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.665+0000 7f4ab1735700 1 -- 172.21.15.157:0/1022341511 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4aac06d0f0 msgr2=0x7f4aac15df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:11.679 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.665+0000 7f4ab1735700 1 --2- 172.21.15.157:0/1022341511 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4aac06d0f0 0x7f4aac15df40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:11.679 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.665+0000 7f4ab1735700 1 -- 172.21.15.157:0/1022341511 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a9800b7f0 con 0x7f4aac15b130 2023-10-16T19:58:11.679 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.665+0000 7f4ab0f34700 1 --2- 172.21.15.157:0/1022341511 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4aac06d0f0 0x7f4aac15df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T19:58:11.679 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.665+0000 7f4ab1735700 1 --2- 172.21.15.157:0/1022341511 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4aac15b130 0x7f4aac0b5d00 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f4aa400cd10 tx=0x7f4aa400a560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:58:11.680 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.665+0000 7f4aa97fa700 1 -- 172.21.15.157:0/1022341511 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4aa400f480 con 0x7f4aac15b130 2023-10-16T19:58:11.680 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.665+0000 7f4aa97fa700 1 -- 172.21.15.157:0/1022341511 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4aa400f600 con 0x7f4aac15b130 2023-10-16T19:58:11.680 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.665+0000 7f4ab3198700 1 -- 172.21.15.157:0/1022341511 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4aac15c850 con 0x7f4aac15b130 2023-10-16T19:58:11.680 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.665+0000 7f4aa97fa700 1 -- 172.21.15.157:0/1022341511 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4aa400f9b0 con 0x7f4aac15b130 2023-10-16T19:58:11.680 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.665+0000 7f4ab3198700 1 -- 172.21.15.157:0/1022341511 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4aac15bef0 con 0x7f4aac15b130 2023-10-16T19:58:11.681 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.666+0000 7f4ab3198700 1 -- 172.21.15.157:0/1022341511 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4aac0cf350 con 0x7f4aac15b130 2023-10-16T19:58:11.681 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.666+0000 7f4aa97fa700 1 -- 172.21.15.157:0/1022341511 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f4aa400b040 con 0x7f4aac15b130 2023-10-16T19:58:11.681 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.667+0000 7f4aa97fa700 1 --2- 172.21.15.157:0/1022341511 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f4a9006af00 0x7f4a9006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:11.681 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.667+0000 7f4aa97fa700 1 -- 172.21.15.157:0/1022341511 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5729+0+0 (secure 0 0 0) 0x7f4aa4089e30 con 0x7f4aac15b130 2023-10-16T19:58:11.681 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.667+0000 7f4ab0f34700 1 --2- 172.21.15.157:0/1022341511 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f4a9006af00 0x7f4a9006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:11.682 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.668+0000 7f4ab0f34700 1 --2- 172.21.15.157:0/1022341511 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f4a9006af00 0x7f4a9006d3c0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f4aa00089b0 tx=0x7f4aa0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:58:11.682 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.671+0000 7f4aa97fa700 1 -- 172.21.15.157:0/1022341511 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4aa4054e20 con 0x7f4aac15b130 2023-10-16T19:58:11.907 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.904+0000 7f4ab3198700 1 -- 172.21.15.157:0/1022341511 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f4aac04f400 con 0x7f4aac15b130 2023-10-16T19:58:11.907 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.905+0000 7f4aa97fa700 1 -- 172.21.15.157:0/1022341511 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) v1 ==== 53+0+88 (secure 0 0 0) 0x7f4aa401d070 con 0x7f4aac15b130 2023-10-16T19:58:11.907 INFO:teuthology.orchestra.run.smithi157.stdout:name: testcephfs1, metadata pool: testcephfs1_metadata, data pools: [testcephfs1_data ] 2023-10-16T19:58:11.909 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.906+0000 7f4ab3198700 1 -- 172.21.15.157:0/1022341511 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f4a9006af00 msgr2=0x7f4a9006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:11.909 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.906+0000 7f4ab3198700 1 --2- 172.21.15.157:0/1022341511 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f4a9006af00 0x7f4a9006d3c0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f4aa00089b0 tx=0x7f4aa0008040 comp rx=0 tx=0).stop 2023-10-16T19:58:11.910 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.907+0000 7f4ab3198700 1 -- 172.21.15.157:0/1022341511 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4aac15b130 msgr2=0x7f4aac0b5d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:11.910 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.907+0000 7f4ab3198700 1 --2- 172.21.15.157:0/1022341511 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4aac15b130 0x7f4aac0b5d00 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f4aa400cd10 tx=0x7f4aa400a560 comp rx=0 tx=0).stop 2023-10-16T19:58:11.910 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.907+0000 7f4ab3198700 1 -- 172.21.15.157:0/1022341511 shutdown_connections 2023-10-16T19:58:11.910 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.907+0000 7f4ab3198700 1 --2- 172.21.15.157:0/1022341511 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f4a9006af00 0x7f4a9006d3c0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:11.910 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.907+0000 7f4ab3198700 1 --2- 172.21.15.157:0/1022341511 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4aac06d0f0 0x7f4aac15df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:11.911 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.907+0000 7f4ab3198700 1 --2- 172.21.15.157:0/1022341511 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4aac15b130 0x7f4aac0b5d00 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:11.911 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.907+0000 7f4ab3198700 1 --2- 172.21.15.157:0/1022341511 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4aac0cbeb0 0x7f4aac1f3140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:11.911 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.907+0000 7f4ab3198700 1 -- 172.21.15.157:0/1022341511 >> 172.21.15.157:0/1022341511 conn(0x7f4aac0cd4e0 msgr2=0x7f4aac06aaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:58:11.911 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.907+0000 7f4ab3198700 1 -- 172.21.15.157:0/1022341511 shutdown_connections 2023-10-16T19:58:11.911 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:11.907+0000 7f4ab3198700 1 -- 172.21.15.157:0/1022341511 wait complete. 2023-10-16T19:58:11.921 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-16T19:58:11.921 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-16T19:58:11.922 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi157.front.sepia.ceph.com 2023-10-16T19:58:11.922 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-16T19:58:11.923 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-16T19:58:11.923 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-16T19:58:11.923 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-16T19:58:11.924 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-16T19:58:11.924 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-16T19:58:11.925 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T19:58:11.925 DEBUG:teuthology.orchestra.run.smithi157:> ip addr 2023-10-16T19:58:11.943 INFO:teuthology.orchestra.run.smithi157.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-16T19:58:11.943 INFO:teuthology.orchestra.run.smithi157.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-16T19:58:11.944 INFO:teuthology.orchestra.run.smithi157.stdout: inet 127.0.0.1/8 scope host lo 2023-10-16T19:58:11.944 INFO:teuthology.orchestra.run.smithi157.stdout: valid_lft forever preferred_lft forever 2023-10-16T19:58:11.944 INFO:teuthology.orchestra.run.smithi157.stdout: inet6 ::1/128 scope host 2023-10-16T19:58:11.944 INFO:teuthology.orchestra.run.smithi157.stdout: valid_lft forever preferred_lft forever 2023-10-16T19:58:11.944 INFO:teuthology.orchestra.run.smithi157.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-16T19:58:11.945 INFO:teuthology.orchestra.run.smithi157.stdout: link/ether 0c:c4:7a:d9:37:98 brd ff:ff:ff:ff:ff:ff 2023-10-16T19:58:11.945 INFO:teuthology.orchestra.run.smithi157.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-16T19:58:11.945 INFO:teuthology.orchestra.run.smithi157.stdout: link/ether 0c:c4:7a:d9:37:99 brd ff:ff:ff:ff:ff:ff 2023-10-16T19:58:11.945 INFO:teuthology.orchestra.run.smithi157.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-16T19:58:11.945 INFO:teuthology.orchestra.run.smithi157.stdout: link/ether 0c:c4:7a:88:7e:a0 brd ff:ff:ff:ff:ff:ff 2023-10-16T19:58:11.946 INFO:teuthology.orchestra.run.smithi157.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-16T19:58:11.946 INFO:teuthology.orchestra.run.smithi157.stdout: link/ether 0c:c4:7a:88:7e:a1 brd ff:ff:ff:ff:ff:ff 2023-10-16T19:58:11.946 INFO:teuthology.orchestra.run.smithi157.stdout: inet 172.21.15.157/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-16T19:58:11.946 INFO:teuthology.orchestra.run.smithi157.stdout: valid_lft 42426sec preferred_lft 42426sec 2023-10-16T19:58:11.946 INFO:teuthology.orchestra.run.smithi157.stdout: inet6 fe80::7dc:e005:a3f1:bd3a/64 scope link noprefixroute 2023-10-16T19:58:11.947 INFO:teuthology.orchestra.run.smithi157.stdout: valid_lft forever preferred_lft forever 2023-10-16T19:58:11.947 INFO:teuthology.orchestra.run.smithi157.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-16T19:58:11.947 INFO:teuthology.orchestra.run.smithi157.stdout: link/ether 1a:b8:ba:55:6f:34 brd ff:ff:ff:ff:ff:ff 2023-10-16T19:58:11.947 INFO:teuthology.orchestra.run.smithi157.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-16T19:58:11.947 INFO:teuthology.orchestra.run.smithi157.stdout: valid_lft forever preferred_lft forever 2023-10-16T19:58:11.948 INFO:teuthology.orchestra.run.smithi157.stdout: inet6 fe80::5ca8:fff:fec3:4d85/64 scope link 2023-10-16T19:58:11.948 INFO:teuthology.orchestra.run.smithi157.stdout: valid_lft forever preferred_lft forever 2023-10-16T19:58:11.948 INFO:teuthology.orchestra.run.smithi157.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-16T19:58:11.948 INFO:teuthology.orchestra.run.smithi157.stdout: link/ether 5a:6d:a2:1e:d1:b2 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-16T19:58:11.948 INFO:teuthology.orchestra.run.smithi157.stdout: inet6 fe80::586d:a2ff:fe1e:d1b2/64 scope link 2023-10-16T19:58:11.949 INFO:teuthology.orchestra.run.smithi157.stdout: valid_lft forever preferred_lft forever 2023-10-16T19:58:11.949 INFO:teuthology.orchestra.run.smithi157.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-16T19:58:11.949 INFO:teuthology.orchestra.run.smithi157.stdout: link/ether 1a:b8:ba:55:6f:34 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-16T19:58:11.949 INFO:teuthology.orchestra.run.smithi157.stdout: inet6 fe80::18b8:baff:fe55:6f34/64 scope link 2023-10-16T19:58:11.949 INFO:teuthology.orchestra.run.smithi157.stdout: valid_lft forever preferred_lft forever 2023-10-16T19:58:11.950 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T19:58:11.950 DEBUG:teuthology.orchestra.run.smithi157:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-16T19:58:12.008 INFO:teuthology.orchestra.run.smithi157.stdout:1 2023-10-16T19:58:12.009 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T19:58:12.010 DEBUG:teuthology.orchestra.run.smithi157:> route 2023-10-16T19:58:12.069 INFO:teuthology.orchestra.run.smithi157.stdout:Kernel IP routing table 2023-10-16T19:58:12.069 INFO:teuthology.orchestra.run.smithi157.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-16T19:58:12.069 INFO:teuthology.orchestra.run.smithi157.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-16T19:58:12.070 INFO:teuthology.orchestra.run.smithi157.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-16T19:58:12.070 INFO:teuthology.orchestra.run.smithi157.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-16T19:58:12.070 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T19:58:12.071 DEBUG:teuthology.orchestra.run.smithi157:> (cd / && exec bash -c ' 2023-10-16T19:58:12.071 DEBUG:teuthology.orchestra.run.smithi157:> set -e 2023-10-16T19:58:12.071 DEBUG:teuthology.orchestra.run.smithi157:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-16T19:58:12.072 DEBUG:teuthology.orchestra.run.smithi157:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-16T19:58:12.072 DEBUG:teuthology.orchestra.run.smithi157:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-16T19:58:12.072 DEBUG:teuthology.orchestra.run.smithi157:> ') 2023-10-16T19:58:12.173 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T19:58:12.174 DEBUG:teuthology.orchestra.run.smithi157:> ip netns list 2023-10-16T19:58:12.190 INFO:teuthology.orchestra.run.smithi157.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-16T19:58:12.191 INFO:teuthology.orchestra.run.smithi157.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-16T19:58:12.191 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-16T19:58:12.191 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T19:58:12.192 DEBUG:teuthology.orchestra.run.smithi157:> sudo ip link set brx.0 up 2023-10-16T19:58:12.258 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-16T19:58:12.259 DEBUG:teuthology.orchestra.run.smithi157:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-16T19:58:12.315 INFO:teuthology.orchestra.run.smithi157.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-16T19:58:12.315 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-16T19:58:12.316 DEBUG:teuthology.orchestra.run.smithi157:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-16T19:58:12.371 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-10-16T19:58:12.372 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T19:58:12.372 DEBUG:teuthology.orchestra.run.smithi157:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-16T19:58:12.456 INFO:teuthology.orchestra.run.smithi157.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-16T19:58:12.457 INFO:teuthology.orchestra.run.smithi157.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-16T19:58:12.484 INFO:teuthology.orchestra.run.smithi157.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-16T19:58:12.484 INFO:teuthology.orchestra.run.smithi157.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-16T19:58:12.485 INFO:teuthology.orchestra.run.smithi157.stdout:mount.ceph: resolved to: "172.21.15.157:3300,172.21.15.187:3300,172.21.15.187:3301" 2023-10-16T19:58:12.485 INFO:teuthology.orchestra.run.smithi157.stdout:mount.ceph: trying mount with new device syntax: 0@28199dc9-64d5-479e-83c6-21f097c33d39.cephfs=/ 2023-10-16T19:58:12.485 INFO:teuthology.orchestra.run.smithi157.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.157:3300/172.21.15.187:3300/172.21.15.187:3301" will pass to kernel 2023-10-16T19:58:12.485 INFO:teuthology.orchestra.run.smithi157.stdout:mount.ceph: v2 mount support check returned 2 2023-10-16T19:58:12.485 INFO:teuthology.orchestra.run.smithi157.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-16T19:58:12.486 INFO:teuthology.orchestra.run.smithi157.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-16T19:58:12.512 INFO:teuthology.orchestra.run.smithi157.stderr:mount error 2 = No such file or directory 2023-10-16T19:58:12.513 INFO:teuthology.orchestra.run.smithi157.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-16T19:58:12.513 INFO:teuthology.orchestra.run.smithi157.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-16T19:58:12.513 INFO:teuthology.orchestra.run.smithi157.stdout:mount.ceph: resolved to: "172.21.15.157:3300,172.21.15.187:3300,172.21.15.187:3301" 2023-10-16T19:58:12.513 INFO:teuthology.orchestra.run.smithi157.stdout:mount.ceph: trying mount with new device syntax: 0@28199dc9-64d5-479e-83c6-21f097c33d39.cephfs=/ 2023-10-16T19:58:12.514 INFO:teuthology.orchestra.run.smithi157.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.157:3300/172.21.15.187:3300/172.21.15.187:3301" will pass to kernel 2023-10-16T19:58:12.514 INFO:teuthology.orchestra.run.smithi157.stdout:mount.ceph: v2 mount support check returned 2 2023-10-16T19:58:12.514 INFO:teuthology.orchestra.run.smithi157.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-16T19:58:12.514 INFO:teuthology.orchestra.run.smithi157.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-16T19:58:12.514 INFO:teuthology.orchestra.run.smithi157.stdout:mount.ceph: resolved to: "172.21.15.157:6789,172.21.15.187:6789,172.21.15.187:6790" 2023-10-16T19:58:12.514 INFO:teuthology.orchestra.run.smithi157.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.157:6789,172.21.15.187:6789,172.21.15.187:6790:/ 2023-10-16T19:58:12.515 INFO:teuthology.orchestra.run.smithi157.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,key=0,mds_namespace=cephfs,fsid=28199dc9-64d5-479e-83c6-21f097c33d39" will pass to kernel 2023-10-16T19:58:12.515 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-16T19:58:12.516 INFO:tasks.cephfs.kernel_mount:mount command failed 2023-10-16T19:58:12.517 INFO:tasks.cephfs_test_runner:That when an OSD epoch barrier is set on an MDS, subsequently ... ERROR 2023-10-16T19:58:12.517 INFO:tasks.cephfs_test_runner: 2023-10-16T19:58:12.518 INFO:tasks.cephfs_test_runner:====================================================================== 2023-10-16T19:58:12.518 INFO:tasks.cephfs_test_runner:ERROR: test_barrier (tasks.cephfs.test_full.TestClusterFull) 2023-10-16T19:58:12.518 INFO:tasks.cephfs_test_runner:That when an OSD epoch barrier is set on an MDS, subsequently 2023-10-16T19:58:12.519 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-10-16T19:58:12.519 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-10-16T19:58:12.519 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_19fd96fe3581520b6d9f50ffdabf29051aee5d4d/qa/tasks/cephfs/test_full.py", line 391, in setUp 2023-10-16T19:58:12.519 INFO:tasks.cephfs_test_runner: super(TestClusterFull, self).setUp() 2023-10-16T19:58:12.520 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_19fd96fe3581520b6d9f50ffdabf29051aee5d4d/qa/tasks/cephfs/test_full.py", line 28, in setUp 2023-10-16T19:58:12.520 INFO:tasks.cephfs_test_runner: CephFSTestCase.setUp(self) 2023-10-16T19:58:12.520 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_19fd96fe3581520b6d9f50ffdabf29051aee5d4d/qa/tasks/cephfs/cephfs_test_case.py", line 184, in setUp 2023-10-16T19:58:12.521 INFO:tasks.cephfs_test_runner: self.mounts[i].mount_wait() 2023-10-16T19:58:12.521 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_19fd96fe3581520b6d9f50ffdabf29051aee5d4d/qa/tasks/cephfs/mount.py", line 505, in mount_wait 2023-10-16T19:58:12.521 INFO:tasks.cephfs_test_runner: self.mount(**kwargs) 2023-10-16T19:58:12.522 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_19fd96fe3581520b6d9f50ffdabf29051aee5d4d/qa/tasks/cephfs/kernel_mount.py", line 59, in mount 2023-10-16T19:58:12.522 INFO:tasks.cephfs_test_runner: retval = self._run_mount_cmd(mntopts, check_status) 2023-10-16T19:58:12.522 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_19fd96fe3581520b6d9f50ffdabf29051aee5d4d/qa/tasks/cephfs/kernel_mount.py", line 83, in _run_mount_cmd 2023-10-16T19:58:12.522 INFO:tasks.cephfs_test_runner: self.client_remote.run(args=mount_cmd, timeout=300, 2023-10-16T19:58:12.523 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/remote.py", line 522, in run 2023-10-16T19:58:12.523 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2023-10-16T19:58:12.523 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 455, in run 2023-10-16T19:58:12.523 INFO:tasks.cephfs_test_runner: r.wait() 2023-10-16T19:58:12.524 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait 2023-10-16T19:58:12.524 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2023-10-16T19:58:12.524 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 181, in _raise_for_status 2023-10-16T19:58:12.524 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2023-10-16T19:58:12.525 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi157 with status 32: 'sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback' 2023-10-16T19:58:12.525 INFO:tasks.cephfs_test_runner: 2023-10-16T19:58:12.525 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-10-16T19:58:12.526 INFO:tasks.cephfs_test_runner:Ran 1 test in 32.394s 2023-10-16T19:58:12.526 INFO:tasks.cephfs_test_runner: 2023-10-16T19:58:12.526 INFO:tasks.cephfs_test_runner:FAILED (errors=1) 2023-10-16T19:58:12.526 INFO:tasks.cephfs_test_runner: 2023-10-16T19:58:12.527 INFO:tasks.cephfs_test_runner:====================================================================== 2023-10-16T19:58:12.527 INFO:tasks.cephfs_test_runner:ERROR: test_barrier (tasks.cephfs.test_full.TestClusterFull) 2023-10-16T19:58:12.527 INFO:tasks.cephfs_test_runner:That when an OSD epoch barrier is set on an MDS, subsequently 2023-10-16T19:58:12.527 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-10-16T19:58:12.528 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-10-16T19:58:12.528 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_19fd96fe3581520b6d9f50ffdabf29051aee5d4d/qa/tasks/cephfs/test_full.py", line 391, in setUp 2023-10-16T19:58:12.528 INFO:tasks.cephfs_test_runner: super(TestClusterFull, self).setUp() 2023-10-16T19:58:12.528 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_19fd96fe3581520b6d9f50ffdabf29051aee5d4d/qa/tasks/cephfs/test_full.py", line 28, in setUp 2023-10-16T19:58:12.529 INFO:tasks.cephfs_test_runner: CephFSTestCase.setUp(self) 2023-10-16T19:58:12.529 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_19fd96fe3581520b6d9f50ffdabf29051aee5d4d/qa/tasks/cephfs/cephfs_test_case.py", line 184, in setUp 2023-10-16T19:58:12.529 INFO:tasks.cephfs_test_runner: self.mounts[i].mount_wait() 2023-10-16T19:58:12.529 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_19fd96fe3581520b6d9f50ffdabf29051aee5d4d/qa/tasks/cephfs/mount.py", line 505, in mount_wait 2023-10-16T19:58:12.530 INFO:tasks.cephfs_test_runner: self.mount(**kwargs) 2023-10-16T19:58:12.530 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_19fd96fe3581520b6d9f50ffdabf29051aee5d4d/qa/tasks/cephfs/kernel_mount.py", line 59, in mount 2023-10-16T19:58:12.530 INFO:tasks.cephfs_test_runner: retval = self._run_mount_cmd(mntopts, check_status) 2023-10-16T19:58:12.530 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_19fd96fe3581520b6d9f50ffdabf29051aee5d4d/qa/tasks/cephfs/kernel_mount.py", line 83, in _run_mount_cmd 2023-10-16T19:58:12.531 INFO:tasks.cephfs_test_runner: self.client_remote.run(args=mount_cmd, timeout=300, 2023-10-16T19:58:12.531 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/remote.py", line 522, in run 2023-10-16T19:58:12.531 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2023-10-16T19:58:12.531 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 455, in run 2023-10-16T19:58:12.532 INFO:tasks.cephfs_test_runner: r.wait() 2023-10-16T19:58:12.532 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait 2023-10-16T19:58:12.532 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2023-10-16T19:58:12.532 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 181, in _raise_for_status 2023-10-16T19:58:12.533 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2023-10-16T19:58:12.533 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi157 with status 32: 'sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback' 2023-10-16T19:58:12.533 INFO:tasks.cephfs_test_runner: 2023-10-16T19:58:12.534 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_19fd96fe3581520b6d9f50ffdabf29051aee5d4d/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_barrier (tasks.cephfs.test_full.TestClusterFull) 2023-10-16T19:58:12.601 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=1dbcf339a7d24ace89e00b82e5fe3635 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_19fd96fe3581520b6d9f50ffdabf29051aee5d4d/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_barrier (tasks.cephfs.test_full.TestClusterFull) 2023-10-16T19:58:12.603 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2023-10-16T19:58:12.613 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2023-10-16T19:58:12.633 INFO:tasks.kclient:Unmounting kernel clients... 2023-10-16T19:58:12.634 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2023-10-16T19:58:12.634 DEBUG:teuthology.orchestra.run.smithi157:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T19:58:12.655 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284272k,nr_inodes=4071068,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=44,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18956 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260552k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 2023-10-16T19:58:12.656 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2023-10-16T19:58:12.656 DEBUG:teuthology.orchestra.run.smithi157:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T19:58:12.712 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284272k,nr_inodes=4071068,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=44,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18956 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260552k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 2023-10-16T19:58:12.713 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-10-16T19:58:12.713 DEBUG:teuthology.orchestra.run.smithi187:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T19:58:12.735 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284224k,nr_inodes=4071056,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=38,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14331 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260544k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-10-16T19:58:12.735 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-10-16T19:58:12.735 DEBUG:teuthology.orchestra.run.smithi187:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T19:58:12.795 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284224k,nr_inodes=4071056,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=38,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14331 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260544k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-10-16T19:58:12.796 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T19:58:12.796 DEBUG:teuthology.orchestra.run.smithi157:> ip netns list 2023-10-16T19:58:12.813 INFO:teuthology.orchestra.run.smithi157.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-16T19:58:12.814 INFO:teuthology.orchestra.run.smithi157.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-16T19:58:12.815 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T19:58:12.815 DEBUG:teuthology.orchestra.run.smithi157:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-16T19:58:12.892 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T19:58:12.893 DEBUG:teuthology.orchestra.run.smithi157:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-16T19:58:12.987 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T19:58:12.988 DEBUG:teuthology.orchestra.run.smithi157:> sudo ip link delete ceph-brx 2023-10-16T19:58:13.077 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T19:58:13.078 DEBUG:teuthology.orchestra.run.smithi157:> ip netns list 2023-10-16T19:58:13.096 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T19:58:13.096 DEBUG:teuthology.orchestra.run.smithi157:> sudo ip link delete ceph-brx 2023-10-16T19:58:13.166 INFO:teuthology.orchestra.run.smithi157.stderr:Cannot find device "ceph-brx" 2023-10-16T19:58:13.167 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-16T19:58:13.168 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T19:58:13.168 DEBUG:teuthology.orchestra.run.smithi187:> ip netns list 2023-10-16T19:58:13.189 INFO:teuthology.orchestra.run.smithi187.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-16T19:58:13.190 INFO:teuthology.orchestra.run.smithi187.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-16T19:58:13.190 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T19:58:13.190 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-16T19:58:13.279 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T19:58:13.279 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-16T19:58:13.359 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T19:58:13.360 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip link delete ceph-brx 2023-10-16T19:58:13.456 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T19:58:13.456 DEBUG:teuthology.orchestra.run.smithi187:> ip netns list 2023-10-16T19:58:13.474 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T19:58:13.475 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip link delete ceph-brx 2023-10-16T19:58:13.545 INFO:teuthology.orchestra.run.smithi187.stderr:Cannot find device "ceph-brx" 2023-10-16T19:58:13.546 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-16T19:58:13.547 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-10-16T19:58:13.556 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-10-16T19:58:13.557 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-16T19:58:13.685 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:13.683+0000 7fae13feb700 1 Processor -- start 2023-10-16T19:58:13.686 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:13.683+0000 7fae13feb700 1 -- start start 2023-10-16T19:58:13.688 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:13.684+0000 7fae13feb700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fae0c160540 0x7fae0c071730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:13.689 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:13.684+0000 7fae13feb700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae0c0cb350 con 0x7fae0c071c70 2023-10-16T19:58:13.689 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:13.684+0000 7fae13feb700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae0c0ca7b0 con 0x7fae0c0aec60 2023-10-16T19:58:13.689 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:13.684+0000 7fae13feb700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae0c0caa90 con 0x7fae0c160540 2023-10-16T19:58:13.689 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:13.684+0000 7fae12588700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7fae0c071c70 0x7fae0c15b5c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:57440/0 (socket says 172.21.15.157:57440) 2023-10-16T19:58:13.690 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:13.684+0000 7fae12588700 1 -- 172.21.15.157:0/4109794441 learned_addr learned my addr 172.21.15.157:0/4109794441 (peer_addr_for_me v1:172.21.15.157:0/0) 2023-10-16T19:58:13.690 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:13.684+0000 7fae11586700 1 --2- 172.21.15.157:0/4109794441 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fae0c160540 0x7fae0c071730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:13.690 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:13.684+0000 7fae10d85700 1 -- 172.21.15.157:0/4109794441 <== mon.0 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3756403021 0 0) 0x7fae0c0cb350 con 0x7fae0c071c70 2023-10-16T19:58:13.691 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:13.684+0000 7fae10d85700 1 -- 172.21.15.157:0/4109794441 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fadf80035b0 con 0x7fae0c071c70 2023-10-16T19:58:13.691 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:13.685+0000 7fae10d85700 1 -- 172.21.15.157:0/4109794441 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3998078207 0 0) 0x7fae0c0ca7b0 con 0x7fae0c0aec60 2023-10-16T19:58:13.691 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:13.685+0000 7fae10d85700 1 -- 172.21.15.157:0/4109794441 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fae0c0cb350 con 0x7fae0c0aec60 2023-10-16T19:58:13.691 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:13.685+0000 7fae11586700 1 -- 172.21.15.157:0/4109794441 >> v1:172.21.15.187:6789/0 conn(0x7fae0c0aec60 legacy=0x7fae0c0c9fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:13.692 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:13.685+0000 7fae11586700 1 -- 172.21.15.157:0/4109794441 >> v1:172.21.15.157:6789/0 conn(0x7fae0c071c70 legacy=0x7fae0c15b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:13.692 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:13.685+0000 7fae11586700 1 -- 172.21.15.157:0/4109794441 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae0c0cad70 con 0x7fae0c160540 2023-10-16T19:58:13.692 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:13.685+0000 7fae11586700 1 --2- 172.21.15.157:0/4109794441 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fae0c160540 0x7fae0c071730 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fadfc009870 tx=0x7fadfc009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=31b928a11f50d7d7 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:58:13.693 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:13.685+0000 7fae10d85700 1 -- 172.21.15.157:0/4109794441 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadfc011830 con 0x7fae0c160540 2023-10-16T19:58:13.693 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:13.685+0000 7fae10d85700 1 -- 172.21.15.157:0/4109794441 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadfc011990 con 0x7fae0c160540 2023-10-16T19:58:13.693 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:13.685+0000 7fae10d85700 1 -- 172.21.15.157:0/4109794441 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadfc011d20 con 0x7fae0c160540 2023-10-16T19:58:13.693 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:13.685+0000 7fae13feb700 1 -- 172.21.15.157:0/4109794441 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fae0c160540 msgr2=0x7fae0c071730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:13.694 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:13.685+0000 7fae13feb700 1 --2- 172.21.15.157:0/4109794441 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fae0c160540 0x7fae0c071730 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fadfc009870 tx=0x7fadfc009b80 comp rx=0 tx=0).stop 2023-10-16T19:58:13.694 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:13.686+0000 7fae13feb700 1 -- 172.21.15.157:0/4109794441 shutdown_connections 2023-10-16T19:58:13.694 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:13.686+0000 7fae13feb700 1 --2- 172.21.15.157:0/4109794441 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fae0c160540 0x7fae0c071730 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:13.695 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:13.686+0000 7fae13feb700 1 -- 172.21.15.157:0/4109794441 >> 172.21.15.157:0/4109794441 conn(0x7fae0c0b1540 msgr2=0x7fae0c0b1920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:58:13.695 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:13.686+0000 7fae13feb700 1 -- 172.21.15.157:0/4109794441 shutdown_connections 2023-10-16T19:58:13.695 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:13.686+0000 7fae13feb700 1 -- 172.21.15.157:0/4109794441 wait complete. 2023-10-16T19:58:13.698 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:13.687+0000 7fae13feb700 1 Processor -- start 2023-10-16T19:58:13.698 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:13.687+0000 7fae13feb700 1 -- start start 2023-10-16T19:58:13.698 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:13.687+0000 7fae13feb700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fae0c071c70 0x7fae0c15a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:13.699 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:13.687+0000 7fae13feb700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fae0c0aec60 0x7fae0c0c7400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:13.699 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:13.687+0000 7fae13feb700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fae0c160540 0x7fae0c0c7ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:13.699 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:13.688+0000 7fae13feb700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae0c159290 con 0x7fae0c160540 2023-10-16T19:58:13.700 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:13.688+0000 7fae13feb700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae0c159790 con 0x7fae0c071c70 2023-10-16T19:58:13.700 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:13.688+0000 7fae13feb700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae0c159a70 con 0x7fae0c0aec60 2023-10-16T19:58:13.700 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:13.688+0000 7fae12588700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fae0c160540 0x7fae0c0c7ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:13.700 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:13.688+0000 7fae12588700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fae0c160540 0x7fae0c0c7ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:47774/0 (socket says 172.21.15.157:47774) 2023-10-16T19:58:13.701 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:13.688+0000 7fae12588700 1 -- 172.21.15.157:0/3559403298 learned_addr learned my addr 172.21.15.157:0/3559403298 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:58:13.701 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:13.688+0000 7fae11586700 1 --2- 172.21.15.157:0/3559403298 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fae0c0aec60 0x7fae0c0c7400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:13.701 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:13.688+0000 7fae11d87700 1 --2- 172.21.15.157:0/3559403298 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fae0c071c70 0x7fae0c15a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:13.701 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:13.688+0000 7fae12588700 1 -- 172.21.15.157:0/3559403298 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fae0c0aec60 msgr2=0x7fae0c0c7400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:13.702 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:13.688+0000 7fae12588700 1 --2- 172.21.15.157:0/3559403298 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fae0c0aec60 0x7fae0c0c7400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:13.702 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:13.688+0000 7fae12588700 1 -- 172.21.15.157:0/3559403298 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fae0c071c70 msgr2=0x7fae0c15a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:13.702 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:13.688+0000 7fae12588700 1 --2- 172.21.15.157:0/3559403298 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fae0c071c70 0x7fae0c15a550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:13.703 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:13.688+0000 7fae12588700 1 -- 172.21.15.157:0/3559403298 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadfc0094a0 con 0x7fae0c160540 2023-10-16T19:58:13.703 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:13.688+0000 7fae12588700 1 --2- 172.21.15.157:0/3559403298 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fae0c160540 0x7fae0c0c7ec0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fae0400caa0 tx=0x7fae0400cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:58:13.703 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:13.688+0000 7fae027fc700 1 -- 172.21.15.157:0/3559403298 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae0400a9e0 con 0x7fae0c160540 2023-10-16T19:58:13.703 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:13.688+0000 7fae027fc700 1 -- 172.21.15.157:0/3559403298 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae0400ab40 con 0x7fae0c160540 2023-10-16T19:58:13.704 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:13.688+0000 7fae027fc700 1 -- 172.21.15.157:0/3559403298 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae04012400 con 0x7fae0c160540 2023-10-16T19:58:13.704 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:13.688+0000 7fae13feb700 1 -- 172.21.15.157:0/3559403298 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae0c159d50 con 0x7fae0c160540 2023-10-16T19:58:13.704 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:13.688+0000 7fae13feb700 1 -- 172.21.15.157:0/3559403298 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae0c0c7940 con 0x7fae0c160540 2023-10-16T19:58:13.704 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:13.689+0000 7fae13feb700 1 -- 172.21.15.157:0/3559403298 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae0c15a270 con 0x7fae0c160540 2023-10-16T19:58:13.705 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:13.690+0000 7fae027fc700 1 -- 172.21.15.157:0/3559403298 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fae0401b3b0 con 0x7fae0c160540 2023-10-16T19:58:13.705 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:13.690+0000 7fae027fc700 1 --2- 172.21.15.157:0/3559403298 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fadf006af00 0x7fadf006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:13.705 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:13.690+0000 7fae027fc700 1 -- 172.21.15.157:0/3559403298 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5729+0+0 (secure 0 0 0) 0x7fae04089080 con 0x7fae0c160540 2023-10-16T19:58:13.706 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:13.690+0000 7fae11d87700 1 --2- 172.21.15.157:0/3559403298 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fadf006af00 0x7fadf006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:13.706 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:13.691+0000 7fae11d87700 1 --2- 172.21.15.157:0/3559403298 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fadf006af00 0x7fadf006d3c0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fae080011e0 tx=0x7fae08009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:58:13.706 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:13.694+0000 7fae027fc700 1 -- 172.21.15.157:0/3559403298 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fae0c15a270 con 0x7fae0c160540 2023-10-16T19:58:13.882 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:13.880+0000 7fae13feb700 1 -- 172.21.15.157:0/3559403298 --> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fae0c0c7b90 con 0x7fadf006af00 2023-10-16T19:58:13.890 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:13.888+0000 7fae027fc700 1 -- 172.21.15.157:0/3559403298 <== mgr.4100 v2:172.21.15.187:6832/2426285296 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+284555 (secure 0 0 0) 0x7fae0c0c7b90 con 0x7fadf006af00 2023-10-16T19:58:13.894 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-10-16T19:58:13.897 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:13.891+0000 7fae13feb700 1 -- 172.21.15.157:0/3559403298 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fadf006af00 msgr2=0x7fadf006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:13.897 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:13.891+0000 7fae13feb700 1 --2- 172.21.15.157:0/3559403298 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fadf006af00 0x7fadf006d3c0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fae080011e0 tx=0x7fae08009040 comp rx=0 tx=0).stop 2023-10-16T19:58:13.897 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:13.891+0000 7fae13feb700 1 -- 172.21.15.157:0/3559403298 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fae0c160540 msgr2=0x7fae0c0c7ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:13.898 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:13.891+0000 7fae13feb700 1 --2- 172.21.15.157:0/3559403298 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fae0c160540 0x7fae0c0c7ec0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fae0400caa0 tx=0x7fae0400cdb0 comp rx=0 tx=0).stop 2023-10-16T19:58:13.898 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:13.891+0000 7fae13feb700 1 -- 172.21.15.157:0/3559403298 shutdown_connections 2023-10-16T19:58:13.898 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:13.891+0000 7fae13feb700 1 --2- 172.21.15.157:0/3559403298 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fadf006af00 0x7fadf006d3c0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:13.898 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:13.891+0000 7fae13feb700 1 --2- 172.21.15.157:0/3559403298 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fae0c071c70 0x7fae0c15a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:13.899 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:13.891+0000 7fae13feb700 1 --2- 172.21.15.157:0/3559403298 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fae0c160540 0x7fae0c0c7ec0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:13.899 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:13.891+0000 7fae13feb700 1 --2- 172.21.15.157:0/3559403298 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fae0c0aec60 0x7fae0c0c7400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:13.899 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:13.891+0000 7fae13feb700 1 -- 172.21.15.157:0/3559403298 >> 172.21.15.157:0/3559403298 conn(0x7fae0c0b1540 msgr2=0x7fae0c0b2600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:58:13.899 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:13.892+0000 7fae13feb700 1 -- 172.21.15.157:0/3559403298 shutdown_connections 2023-10-16T19:58:13.900 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:13.892+0000 7fae13feb700 1 -- 172.21.15.157:0/3559403298 wait complete. 2023-10-16T19:58:13.900 INFO:teuthology.orchestra.run.smithi157.stderr:dumped all 2023-10-16T19:58:13.906 INFO:teuthology.orchestra.run.smithi157.stdout:{"pg_ready":true,"pg_map":{"version":62,"stamp":"2023-10-16T19:58:12.906917+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":2292,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560207,"statfs":{"total":1600000000,"available":1597652652,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002016"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:07.027378+0000","last_change":"2023-10-16T19:58:05.597289+0000","last_active":"2023-10-16T19:58:07.027378+0000","last_peered":"2023-10-16T19:58:07.027378+0000","last_clean":"2023-10-16T19:58:07.027378+0000","last_became_active":"2023-10-16T19:58:05.597025+0000","last_became_peered":"2023-10-16T19:58:05.597025+0000","last_unstale":"2023-10-16T19:58:07.027378+0000","last_undegraded":"2023-10-16T19:58:07.027378+0000","last_fullsized":"2023-10-16T19:58:07.027378+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:57:53.793532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:07.027896+0000","last_change":"2023-10-16T19:58:05.606250+0000","last_active":"2023-10-16T19:58:07.027896+0000","last_peered":"2023-10-16T19:58:07.027896+0000","last_clean":"2023-10-16T19:58:07.027896+0000","last_became_active":"2023-10-16T19:58:05.605969+0000","last_became_peered":"2023-10-16T19:58:05.605969+0000","last_unstale":"2023-10-16T19:58:07.027896+0000","last_undegraded":"2023-10-16T19:58:07.027896+0000","last_fullsized":"2023-10-16T19:58:07.027896+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:25:36.321203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:06.908178+0000","last_change":"2023-10-16T19:58:05.601472+0000","last_active":"2023-10-16T19:58:06.908178+0000","last_peered":"2023-10-16T19:58:06.908178+0000","last_clean":"2023-10-16T19:58:06.908178+0000","last_became_active":"2023-10-16T19:58:05.601072+0000","last_became_peered":"2023-10-16T19:58:05.601072+0000","last_unstale":"2023-10-16T19:58:06.908178+0000","last_undegraded":"2023-10-16T19:58:06.908178+0000","last_fullsized":"2023-10-16T19:58:06.908178+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:16:44.802078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:06.907743+0000","last_change":"2023-10-16T19:58:05.603410+0000","last_active":"2023-10-16T19:58:06.907743+0000","last_peered":"2023-10-16T19:58:06.907743+0000","last_clean":"2023-10-16T19:58:06.907743+0000","last_became_active":"2023-10-16T19:58:05.603003+0000","last_became_peered":"2023-10-16T19:58:05.603003+0000","last_unstale":"2023-10-16T19:58:06.907743+0000","last_undegraded":"2023-10-16T19:58:06.907743+0000","last_fullsized":"2023-10-16T19:58:06.907743+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:45:35.921925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:06.599174+0000","last_change":"2023-10-16T19:58:05.603205+0000","last_active":"2023-10-16T19:58:06.599174+0000","last_peered":"2023-10-16T19:58:06.599174+0000","last_clean":"2023-10-16T19:58:06.599174+0000","last_became_active":"2023-10-16T19:58:05.602976+0000","last_became_peered":"2023-10-16T19:58:05.602976+0000","last_unstale":"2023-10-16T19:58:06.599174+0000","last_undegraded":"2023-10-16T19:58:06.599174+0000","last_fullsized":"2023-10-16T19:58:06.599174+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:45:26.140866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:07.027617+0000","last_change":"2023-10-16T19:58:05.602575+0000","last_active":"2023-10-16T19:58:07.027617+0000","last_peered":"2023-10-16T19:58:07.027617+0000","last_clean":"2023-10-16T19:58:07.027617+0000","last_became_active":"2023-10-16T19:58:05.601803+0000","last_became_peered":"2023-10-16T19:58:05.601803+0000","last_unstale":"2023-10-16T19:58:07.027617+0000","last_undegraded":"2023-10-16T19:58:07.027617+0000","last_fullsized":"2023-10-16T19:58:07.027617+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:16:05.497063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:08.048629+0000","last_change":"2023-10-16T19:58:05.605393+0000","last_active":"2023-10-16T19:58:08.048629+0000","last_peered":"2023-10-16T19:58:08.048629+0000","last_clean":"2023-10-16T19:58:08.048629+0000","last_became_active":"2023-10-16T19:58:05.605148+0000","last_became_peered":"2023-10-16T19:58:05.605148+0000","last_unstale":"2023-10-16T19:58:08.048629+0000","last_undegraded":"2023-10-16T19:58:08.048629+0000","last_fullsized":"2023-10-16T19:58:08.048629+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:22:44.892357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:08.048675+0000","last_change":"2023-10-16T19:58:05.605461+0000","last_active":"2023-10-16T19:58:08.048675+0000","last_peered":"2023-10-16T19:58:08.048675+0000","last_clean":"2023-10-16T19:58:08.048675+0000","last_became_active":"2023-10-16T19:58:05.605200+0000","last_became_peered":"2023-10-16T19:58:05.605200+0000","last_unstale":"2023-10-16T19:58:08.048675+0000","last_undegraded":"2023-10-16T19:58:08.048675+0000","last_fullsized":"2023-10-16T19:58:08.048675+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:47:35.655272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:06.600844+0000","last_change":"2023-10-16T19:58:05.602243+0000","last_active":"2023-10-16T19:58:06.600844+0000","last_peered":"2023-10-16T19:58:06.600844+0000","last_clean":"2023-10-16T19:58:06.600844+0000","last_became_active":"2023-10-16T19:58:05.601910+0000","last_became_peered":"2023-10-16T19:58:05.601910+0000","last_unstale":"2023-10-16T19:58:06.600844+0000","last_undegraded":"2023-10-16T19:58:06.600844+0000","last_fullsized":"2023-10-16T19:58:06.600844+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:07:11.937484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:06.907450+0000","last_change":"2023-10-16T19:58:05.600582+0000","last_active":"2023-10-16T19:58:06.907450+0000","last_peered":"2023-10-16T19:58:06.907450+0000","last_clean":"2023-10-16T19:58:06.907450+0000","last_became_active":"2023-10-16T19:58:05.600356+0000","last_became_peered":"2023-10-16T19:58:05.600356+0000","last_unstale":"2023-10-16T19:58:06.907450+0000","last_undegraded":"2023-10-16T19:58:06.907450+0000","last_fullsized":"2023-10-16T19:58:06.907450+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:26:33.490004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:08.048860+0000","last_change":"2023-10-16T19:58:05.610325+0000","last_active":"2023-10-16T19:58:08.048860+0000","last_peered":"2023-10-16T19:58:08.048860+0000","last_clean":"2023-10-16T19:58:08.048860+0000","last_became_active":"2023-10-16T19:58:05.609979+0000","last_became_peered":"2023-10-16T19:58:05.609979+0000","last_unstale":"2023-10-16T19:58:08.048860+0000","last_undegraded":"2023-10-16T19:58:08.048860+0000","last_fullsized":"2023-10-16T19:58:08.048860+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:30:57.464645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:06.907718+0000","last_change":"2023-10-16T19:58:05.602076+0000","last_active":"2023-10-16T19:58:06.907718+0000","last_peered":"2023-10-16T19:58:06.907718+0000","last_clean":"2023-10-16T19:58:06.907718+0000","last_became_active":"2023-10-16T19:58:05.600490+0000","last_became_peered":"2023-10-16T19:58:05.600490+0000","last_unstale":"2023-10-16T19:58:06.907718+0000","last_undegraded":"2023-10-16T19:58:06.907718+0000","last_fullsized":"2023-10-16T19:58:06.907718+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:45:35.921925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:06.599132+0000","last_change":"2023-10-16T19:58:05.600961+0000","last_active":"2023-10-16T19:58:06.599132+0000","last_peered":"2023-10-16T19:58:06.599132+0000","last_clean":"2023-10-16T19:58:06.599132+0000","last_became_active":"2023-10-16T19:58:05.600614+0000","last_became_peered":"2023-10-16T19:58:05.600614+0000","last_unstale":"2023-10-16T19:58:06.599132+0000","last_undegraded":"2023-10-16T19:58:06.599132+0000","last_fullsized":"2023-10-16T19:58:06.599132+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:46:16.568366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:07.028165+0000","last_change":"2023-10-16T19:58:05.602410+0000","last_active":"2023-10-16T19:58:07.028165+0000","last_peered":"2023-10-16T19:58:07.028165+0000","last_clean":"2023-10-16T19:58:07.028165+0000","last_became_active":"2023-10-16T19:58:05.601569+0000","last_became_peered":"2023-10-16T19:58:05.601569+0000","last_unstale":"2023-10-16T19:58:07.028165+0000","last_undegraded":"2023-10-16T19:58:07.028165+0000","last_fullsized":"2023-10-16T19:58:07.028165+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:15:53.489096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:06.908030+0000","last_change":"2023-10-16T19:58:05.599789+0000","last_active":"2023-10-16T19:58:06.908030+0000","last_peered":"2023-10-16T19:58:06.908030+0000","last_clean":"2023-10-16T19:58:06.908030+0000","last_became_active":"2023-10-16T19:58:05.599026+0000","last_became_peered":"2023-10-16T19:58:05.599026+0000","last_unstale":"2023-10-16T19:58:06.908030+0000","last_undegraded":"2023-10-16T19:58:06.908030+0000","last_fullsized":"2023-10-16T19:58:06.908030+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:04:03.788625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:08.048995+0000","last_change":"2023-10-16T19:58:05.610219+0000","last_active":"2023-10-16T19:58:08.048995+0000","last_peered":"2023-10-16T19:58:08.048995+0000","last_clean":"2023-10-16T19:58:08.048995+0000","last_became_active":"2023-10-16T19:58:05.609613+0000","last_became_peered":"2023-10-16T19:58:05.609613+0000","last_unstale":"2023-10-16T19:58:08.048995+0000","last_undegraded":"2023-10-16T19:58:08.048995+0000","last_fullsized":"2023-10-16T19:58:08.048995+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:03:27.064265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:08.048854+0000","last_change":"2023-10-16T19:58:05.608855+0000","last_active":"2023-10-16T19:58:08.048854+0000","last_peered":"2023-10-16T19:58:08.048854+0000","last_clean":"2023-10-16T19:58:08.048854+0000","last_became_active":"2023-10-16T19:58:05.608184+0000","last_became_peered":"2023-10-16T19:58:05.608184+0000","last_unstale":"2023-10-16T19:58:08.048854+0000","last_undegraded":"2023-10-16T19:58:08.048854+0000","last_fullsized":"2023-10-16T19:58:08.048854+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:15:51.793903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:07.027692+0000","last_change":"2023-10-16T19:58:05.601271+0000","last_active":"2023-10-16T19:58:07.027692+0000","last_peered":"2023-10-16T19:58:07.027692+0000","last_clean":"2023-10-16T19:58:07.027692+0000","last_became_active":"2023-10-16T19:58:05.600977+0000","last_became_peered":"2023-10-16T19:58:05.600977+0000","last_unstale":"2023-10-16T19:58:07.027692+0000","last_undegraded":"2023-10-16T19:58:07.027692+0000","last_fullsized":"2023-10-16T19:58:07.027692+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:04:03.788625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:07.027493+0000","last_change":"2023-10-16T19:58:05.602564+0000","last_active":"2023-10-16T19:58:07.027493+0000","last_peered":"2023-10-16T19:58:07.027493+0000","last_clean":"2023-10-16T19:58:07.027493+0000","last_became_active":"2023-10-16T19:58:05.601866+0000","last_became_peered":"2023-10-16T19:58:05.601866+0000","last_unstale":"2023-10-16T19:58:07.027493+0000","last_undegraded":"2023-10-16T19:58:07.027493+0000","last_fullsized":"2023-10-16T19:58:07.027493+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:15:51.793903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:06.599266+0000","last_change":"2023-10-16T19:58:05.603764+0000","last_active":"2023-10-16T19:58:06.599266+0000","last_peered":"2023-10-16T19:58:06.599266+0000","last_clean":"2023-10-16T19:58:06.599266+0000","last_became_active":"2023-10-16T19:58:05.603536+0000","last_became_peered":"2023-10-16T19:58:05.603536+0000","last_unstale":"2023-10-16T19:58:06.599266+0000","last_undegraded":"2023-10-16T19:58:06.599266+0000","last_fullsized":"2023-10-16T19:58:06.599266+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:20:13.830601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:06.600643+0000","last_change":"2023-10-16T19:58:05.607035+0000","last_active":"2023-10-16T19:58:06.600643+0000","last_peered":"2023-10-16T19:58:06.600643+0000","last_clean":"2023-10-16T19:58:06.600643+0000","last_became_active":"2023-10-16T19:58:05.606725+0000","last_became_peered":"2023-10-16T19:58:05.606725+0000","last_unstale":"2023-10-16T19:58:06.600643+0000","last_undegraded":"2023-10-16T19:58:06.600643+0000","last_fullsized":"2023-10-16T19:58:06.600643+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:05:23.390163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:06.600926+0000","last_change":"2023-10-16T19:58:05.606076+0000","last_active":"2023-10-16T19:58:06.600926+0000","last_peered":"2023-10-16T19:58:06.600926+0000","last_clean":"2023-10-16T19:58:06.600926+0000","last_became_active":"2023-10-16T19:58:05.605335+0000","last_became_peered":"2023-10-16T19:58:05.605335+0000","last_unstale":"2023-10-16T19:58:06.600926+0000","last_undegraded":"2023-10-16T19:58:06.600926+0000","last_fullsized":"2023-10-16T19:58:06.600926+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:09:04.664112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:06.600504+0000","last_change":"2023-10-16T19:58:05.609361+0000","last_active":"2023-10-16T19:58:06.600504+0000","last_peered":"2023-10-16T19:58:06.600504+0000","last_clean":"2023-10-16T19:58:06.600504+0000","last_became_active":"2023-10-16T19:58:05.609123+0000","last_became_peered":"2023-10-16T19:58:05.609123+0000","last_unstale":"2023-10-16T19:58:06.600504+0000","last_undegraded":"2023-10-16T19:58:06.600504+0000","last_fullsized":"2023-10-16T19:58:06.600504+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:29:55.757064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:06.907737+0000","last_change":"2023-10-16T19:58:05.599645+0000","last_active":"2023-10-16T19:58:06.907737+0000","last_peered":"2023-10-16T19:58:06.907737+0000","last_clean":"2023-10-16T19:58:06.907737+0000","last_became_active":"2023-10-16T19:58:05.599210+0000","last_became_peered":"2023-10-16T19:58:05.599210+0000","last_unstale":"2023-10-16T19:58:06.907737+0000","last_undegraded":"2023-10-16T19:58:06.907737+0000","last_fullsized":"2023-10-16T19:58:06.907737+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:47:35.655272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:06.907710+0000","last_change":"2023-10-16T19:58:05.608218+0000","last_active":"2023-10-16T19:58:06.907710+0000","last_peered":"2023-10-16T19:58:06.907710+0000","last_clean":"2023-10-16T19:58:06.907710+0000","last_became_active":"2023-10-16T19:58:05.608010+0000","last_became_peered":"2023-10-16T19:58:05.608010+0000","last_unstale":"2023-10-16T19:58:06.907710+0000","last_undegraded":"2023-10-16T19:58:06.907710+0000","last_fullsized":"2023-10-16T19:58:06.907710+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:10:06.943190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:07.027753+0000","last_change":"2023-10-16T19:58:05.607417+0000","last_active":"2023-10-16T19:58:07.027753+0000","last_peered":"2023-10-16T19:58:07.027753+0000","last_clean":"2023-10-16T19:58:07.027753+0000","last_became_active":"2023-10-16T19:58:05.607185+0000","last_became_peered":"2023-10-16T19:58:05.607185+0000","last_unstale":"2023-10-16T19:58:07.027753+0000","last_undegraded":"2023-10-16T19:58:07.027753+0000","last_fullsized":"2023-10-16T19:58:07.027753+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:03:27.064265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:06.907334+0000","last_change":"2023-10-16T19:58:05.606277+0000","last_active":"2023-10-16T19:58:06.907334+0000","last_peered":"2023-10-16T19:58:06.907334+0000","last_clean":"2023-10-16T19:58:06.907334+0000","last_became_active":"2023-10-16T19:58:05.606043+0000","last_became_peered":"2023-10-16T19:58:05.606043+0000","last_unstale":"2023-10-16T19:58:06.907334+0000","last_undegraded":"2023-10-16T19:58:06.907334+0000","last_fullsized":"2023-10-16T19:58:06.907334+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:09:04.664112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:06.907996+0000","last_change":"2023-10-16T19:58:05.607969+0000","last_active":"2023-10-16T19:58:06.907996+0000","last_peered":"2023-10-16T19:58:06.907996+0000","last_clean":"2023-10-16T19:58:06.907996+0000","last_became_active":"2023-10-16T19:58:05.607763+0000","last_became_peered":"2023-10-16T19:58:05.607763+0000","last_unstale":"2023-10-16T19:58:06.907996+0000","last_undegraded":"2023-10-16T19:58:06.907996+0000","last_fullsized":"2023-10-16T19:58:06.907996+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:30:57.464645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:06.601107+0000","last_change":"2023-10-16T19:58:05.604754+0000","last_active":"2023-10-16T19:58:06.601107+0000","last_peered":"2023-10-16T19:58:06.601107+0000","last_clean":"2023-10-16T19:58:06.601107+0000","last_became_active":"2023-10-16T19:58:05.604309+0000","last_became_peered":"2023-10-16T19:58:05.604309+0000","last_unstale":"2023-10-16T19:58:06.601107+0000","last_undegraded":"2023-10-16T19:58:06.601107+0000","last_fullsized":"2023-10-16T19:58:06.601107+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:26:33.490004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:08.048842+0000","last_change":"2023-10-16T19:58:05.606380+0000","last_active":"2023-10-16T19:58:08.048842+0000","last_peered":"2023-10-16T19:58:08.048842+0000","last_clean":"2023-10-16T19:58:08.048842+0000","last_became_active":"2023-10-16T19:58:05.606102+0000","last_became_peered":"2023-10-16T19:58:05.606102+0000","last_unstale":"2023-10-16T19:58:08.048842+0000","last_undegraded":"2023-10-16T19:58:08.048842+0000","last_fullsized":"2023-10-16T19:58:08.048842+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:04:03.788625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:07.027526+0000","last_change":"2023-10-16T19:58:05.600187+0000","last_active":"2023-10-16T19:58:07.027526+0000","last_peered":"2023-10-16T19:58:07.027526+0000","last_clean":"2023-10-16T19:58:07.027526+0000","last_became_active":"2023-10-16T19:58:05.599955+0000","last_became_peered":"2023-10-16T19:58:05.599955+0000","last_unstale":"2023-10-16T19:58:07.027526+0000","last_undegraded":"2023-10-16T19:58:07.027526+0000","last_fullsized":"2023-10-16T19:58:07.027526+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:05:23.390163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:08.049001+0000","last_change":"2023-10-16T19:58:05.609019+0000","last_active":"2023-10-16T19:58:08.049001+0000","last_peered":"2023-10-16T19:58:08.049001+0000","last_clean":"2023-10-16T19:58:08.049001+0000","last_became_active":"2023-10-16T19:58:05.608571+0000","last_became_peered":"2023-10-16T19:58:05.608571+0000","last_unstale":"2023-10-16T19:58:08.049001+0000","last_undegraded":"2023-10-16T19:58:08.049001+0000","last_fullsized":"2023-10-16T19:58:08.049001+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:17:36.021934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:06.600335+0000","last_change":"2023-10-16T19:58:05.609465+0000","last_active":"2023-10-16T19:58:06.600335+0000","last_peered":"2023-10-16T19:58:06.600335+0000","last_clean":"2023-10-16T19:58:06.600335+0000","last_became_active":"2023-10-16T19:58:05.609211+0000","last_became_peered":"2023-10-16T19:58:05.609211+0000","last_unstale":"2023-10-16T19:58:06.600335+0000","last_undegraded":"2023-10-16T19:58:06.600335+0000","last_fullsized":"2023-10-16T19:58:06.600335+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:05:23.390163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"32'4","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.904227+0000","last_change":"2023-10-16T19:58:04.587769+0000","last_active":"2023-10-16T19:58:05.904227+0000","last_peered":"2023-10-16T19:58:05.904227+0000","last_clean":"2023-10-16T19:58:05.904227+0000","last_became_active":"2023-10-16T19:58:04.587523+0000","last_became_peered":"2023-10-16T19:58:04.587523+0000","last_unstale":"2023-10-16T19:58:05.904227+0000","last_undegraded":"2023-10-16T19:58:05.904227+0000","last_fullsized":"2023-10-16T19:58:05.904227+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_clean_scrub_stamp":"2023-10-16T19:58:03.569082+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:20:12.826040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:07.027183+0000","last_change":"2023-10-16T19:58:05.598729+0000","last_active":"2023-10-16T19:58:07.027183+0000","last_peered":"2023-10-16T19:58:07.027183+0000","last_clean":"2023-10-16T19:58:07.027183+0000","last_became_active":"2023-10-16T19:58:05.598478+0000","last_became_peered":"2023-10-16T19:58:05.598478+0000","last_unstale":"2023-10-16T19:58:07.027183+0000","last_undegraded":"2023-10-16T19:58:07.027183+0000","last_fullsized":"2023-10-16T19:58:07.027183+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:36:40.381344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"32'1","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.902612+0000","last_change":"2023-10-16T19:58:04.589820+0000","last_active":"2023-10-16T19:58:05.902612+0000","last_peered":"2023-10-16T19:58:05.902612+0000","last_clean":"2023-10-16T19:58:05.902612+0000","last_became_active":"2023-10-16T19:58:04.589624+0000","last_became_peered":"2023-10-16T19:58:04.589624+0000","last_unstale":"2023-10-16T19:58:05.902612+0000","last_undegraded":"2023-10-16T19:58:05.902612+0000","last_fullsized":"2023-10-16T19:58:05.902612+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_clean_scrub_stamp":"2023-10-16T19:58:03.569082+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:50:59.901042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:06.600772+0000","last_change":"2023-10-16T19:58:05.603987+0000","last_active":"2023-10-16T19:58:06.600772+0000","last_peered":"2023-10-16T19:58:06.600772+0000","last_clean":"2023-10-16T19:58:06.600772+0000","last_became_active":"2023-10-16T19:58:05.603733+0000","last_became_peered":"2023-10-16T19:58:05.603733+0000","last_unstale":"2023-10-16T19:58:06.600772+0000","last_undegraded":"2023-10-16T19:58:06.600772+0000","last_fullsized":"2023-10-16T19:58:06.600772+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:29:55.757064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"32'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.900393+0000","last_change":"2023-10-16T19:58:04.587285+0000","last_active":"2023-10-16T19:58:05.900393+0000","last_peered":"2023-10-16T19:58:05.900393+0000","last_clean":"2023-10-16T19:58:05.900393+0000","last_became_active":"2023-10-16T19:58:04.587076+0000","last_became_peered":"2023-10-16T19:58:04.587076+0000","last_unstale":"2023-10-16T19:58:05.900393+0000","last_undegraded":"2023-10-16T19:58:05.900393+0000","last_fullsized":"2023-10-16T19:58:05.900393+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_clean_scrub_stamp":"2023-10-16T19:58:03.569082+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:05:22.385602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:06.907582+0000","last_change":"2023-10-16T19:58:05.603529+0000","last_active":"2023-10-16T19:58:06.907582+0000","last_peered":"2023-10-16T19:58:06.907582+0000","last_clean":"2023-10-16T19:58:06.907582+0000","last_became_active":"2023-10-16T19:58:05.603317+0000","last_became_peered":"2023-10-16T19:58:05.603317+0000","last_unstale":"2023-10-16T19:58:06.907582+0000","last_undegraded":"2023-10-16T19:58:06.907582+0000","last_fullsized":"2023-10-16T19:58:06.907582+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:57:59.985913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"32'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.900113+0000","last_change":"2023-10-16T19:58:04.581625+0000","last_active":"2023-10-16T19:58:05.900113+0000","last_peered":"2023-10-16T19:58:05.900113+0000","last_clean":"2023-10-16T19:58:05.900113+0000","last_became_active":"2023-10-16T19:58:04.580982+0000","last_became_peered":"2023-10-16T19:58:04.580982+0000","last_unstale":"2023-10-16T19:58:05.900113+0000","last_undegraded":"2023-10-16T19:58:05.900113+0000","last_fullsized":"2023-10-16T19:58:05.900113+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_clean_scrub_stamp":"2023-10-16T19:58:03.569082+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:10:41.518249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:08.048999+0000","last_change":"2023-10-16T19:58:05.609638+0000","last_active":"2023-10-16T19:58:08.048999+0000","last_peered":"2023-10-16T19:58:08.048999+0000","last_clean":"2023-10-16T19:58:08.048999+0000","last_became_active":"2023-10-16T19:58:05.609287+0000","last_became_peered":"2023-10-16T19:58:05.609287+0000","last_unstale":"2023-10-16T19:58:08.048999+0000","last_undegraded":"2023-10-16T19:58:08.048999+0000","last_fullsized":"2023-10-16T19:58:08.048999+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:16:44.802078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"32'1","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.903123+0000","last_change":"2023-10-16T19:58:04.592222+0000","last_active":"2023-10-16T19:58:05.903123+0000","last_peered":"2023-10-16T19:58:05.903123+0000","last_clean":"2023-10-16T19:58:05.903123+0000","last_became_active":"2023-10-16T19:58:04.591382+0000","last_became_peered":"2023-10-16T19:58:04.591382+0000","last_unstale":"2023-10-16T19:58:05.903123+0000","last_undegraded":"2023-10-16T19:58:05.903123+0000","last_fullsized":"2023-10-16T19:58:05.903123+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_clean_scrub_stamp":"2023-10-16T19:58:03.569082+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:43:50.906516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:06.907902+0000","last_change":"2023-10-16T19:58:05.606948+0000","last_active":"2023-10-16T19:58:06.907902+0000","last_peered":"2023-10-16T19:58:06.907902+0000","last_clean":"2023-10-16T19:58:06.907902+0000","last_became_active":"2023-10-16T19:58:05.606777+0000","last_became_peered":"2023-10-16T19:58:05.606777+0000","last_unstale":"2023-10-16T19:58:06.907902+0000","last_undegraded":"2023-10-16T19:58:06.907902+0000","last_fullsized":"2023-10-16T19:58:06.907902+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:16:05.497063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"32'1","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.903086+0000","last_change":"2023-10-16T19:58:04.584929+0000","last_active":"2023-10-16T19:58:05.903086+0000","last_peered":"2023-10-16T19:58:05.903086+0000","last_clean":"2023-10-16T19:58:05.903086+0000","last_became_active":"2023-10-16T19:58:04.584702+0000","last_became_peered":"2023-10-16T19:58:04.584702+0000","last_unstale":"2023-10-16T19:58:05.903086+0000","last_undegraded":"2023-10-16T19:58:05.903086+0000","last_fullsized":"2023-10-16T19:58:05.903086+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_clean_scrub_stamp":"2023-10-16T19:58:03.569082+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:04:37.242998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:06.601149+0000","last_change":"2023-10-16T19:58:05.601585+0000","last_active":"2023-10-16T19:58:06.601149+0000","last_peered":"2023-10-16T19:58:06.601149+0000","last_clean":"2023-10-16T19:58:06.601149+0000","last_became_active":"2023-10-16T19:58:05.600813+0000","last_became_peered":"2023-10-16T19:58:05.600813+0000","last_unstale":"2023-10-16T19:58:06.601149+0000","last_undegraded":"2023-10-16T19:58:06.601149+0000","last_fullsized":"2023-10-16T19:58:06.601149+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:42:51.289673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.900155+0000","last_change":"2023-10-16T19:58:04.585183+0000","last_active":"2023-10-16T19:58:05.900155+0000","last_peered":"2023-10-16T19:58:05.900155+0000","last_clean":"2023-10-16T19:58:05.900155+0000","last_became_active":"2023-10-16T19:58:04.584173+0000","last_became_peered":"2023-10-16T19:58:04.584173+0000","last_unstale":"2023-10-16T19:58:05.900155+0000","last_undegraded":"2023-10-16T19:58:05.900155+0000","last_fullsized":"2023-10-16T19:58:05.900155+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_clean_scrub_stamp":"2023-10-16T19:58:03.569082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:09:03.659551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:06.907620+0000","last_change":"2023-10-16T19:58:05.601649+0000","last_active":"2023-10-16T19:58:06.907620+0000","last_peered":"2023-10-16T19:58:06.907620+0000","last_clean":"2023-10-16T19:58:06.907620+0000","last_became_active":"2023-10-16T19:58:05.601416+0000","last_became_peered":"2023-10-16T19:58:05.601416+0000","last_unstale":"2023-10-16T19:58:06.907620+0000","last_undegraded":"2023-10-16T19:58:06.907620+0000","last_fullsized":"2023-10-16T19:58:06.907620+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:41:58.386070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.903214+0000","last_change":"2023-10-16T19:58:04.590433+0000","last_active":"2023-10-16T19:58:05.903214+0000","last_peered":"2023-10-16T19:58:05.903214+0000","last_clean":"2023-10-16T19:58:05.903214+0000","last_became_active":"2023-10-16T19:58:04.589891+0000","last_became_peered":"2023-10-16T19:58:04.589891+0000","last_unstale":"2023-10-16T19:58:05.903214+0000","last_undegraded":"2023-10-16T19:58:05.903214+0000","last_fullsized":"2023-10-16T19:58:05.903214+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_clean_scrub_stamp":"2023-10-16T19:58:03.569082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:31:31.566550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:06.908068+0000","last_change":"2023-10-16T19:58:05.603341+0000","last_active":"2023-10-16T19:58:06.908068+0000","last_peered":"2023-10-16T19:58:06.908068+0000","last_clean":"2023-10-16T19:58:06.908068+0000","last_became_active":"2023-10-16T19:58:05.603042+0000","last_became_peered":"2023-10-16T19:58:05.603042+0000","last_unstale":"2023-10-16T19:58:06.908068+0000","last_undegraded":"2023-10-16T19:58:06.908068+0000","last_fullsized":"2023-10-16T19:58:06.908068+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:03:27.064265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.900339+0000","last_change":"2023-10-16T19:58:04.589480+0000","last_active":"2023-10-16T19:58:05.900339+0000","last_peered":"2023-10-16T19:58:05.900339+0000","last_clean":"2023-10-16T19:58:05.900339+0000","last_became_active":"2023-10-16T19:58:04.589253+0000","last_became_peered":"2023-10-16T19:58:04.589253+0000","last_unstale":"2023-10-16T19:58:05.900339+0000","last_undegraded":"2023-10-16T19:58:05.900339+0000","last_fullsized":"2023-10-16T19:58:05.900339+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_clean_scrub_stamp":"2023-10-16T19:58:03.569082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:45:34.917364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:07.028095+0000","last_change":"2023-10-16T19:58:05.602710+0000","last_active":"2023-10-16T19:58:07.028095+0000","last_peered":"2023-10-16T19:58:07.028095+0000","last_clean":"2023-10-16T19:58:07.028095+0000","last_became_active":"2023-10-16T19:58:05.602336+0000","last_became_peered":"2023-10-16T19:58:05.602336+0000","last_unstale":"2023-10-16T19:58:07.028095+0000","last_undegraded":"2023-10-16T19:58:07.028095+0000","last_fullsized":"2023-10-16T19:58:07.028095+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:23:18.475974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.902719+0000","last_change":"2023-10-16T19:58:04.586281+0000","last_active":"2023-10-16T19:58:05.902719+0000","last_peered":"2023-10-16T19:58:05.902719+0000","last_clean":"2023-10-16T19:58:05.902719+0000","last_became_active":"2023-10-16T19:58:04.586047+0000","last_became_peered":"2023-10-16T19:58:04.586047+0000","last_unstale":"2023-10-16T19:58:05.902719+0000","last_undegraded":"2023-10-16T19:58:05.902719+0000","last_fullsized":"2023-10-16T19:58:05.902719+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_clean_scrub_stamp":"2023-10-16T19:58:03.569082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:31:31.566550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:07.027615+0000","last_change":"2023-10-16T19:58:05.606519+0000","last_active":"2023-10-16T19:58:07.027615+0000","last_peered":"2023-10-16T19:58:07.027615+0000","last_clean":"2023-10-16T19:58:07.027615+0000","last_became_active":"2023-10-16T19:58:05.606148+0000","last_became_peered":"2023-10-16T19:58:05.606148+0000","last_unstale":"2023-10-16T19:58:07.027615+0000","last_undegraded":"2023-10-16T19:58:07.027615+0000","last_fullsized":"2023-10-16T19:58:07.027615+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:30:57.464645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"32'3","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.903980+0000","last_change":"2023-10-16T19:58:04.589426+0000","last_active":"2023-10-16T19:58:05.903980+0000","last_peered":"2023-10-16T19:58:05.903980+0000","last_clean":"2023-10-16T19:58:05.903980+0000","last_became_active":"2023-10-16T19:58:04.589139+0000","last_became_peered":"2023-10-16T19:58:04.589139+0000","last_unstale":"2023-10-16T19:58:05.903980+0000","last_undegraded":"2023-10-16T19:58:05.903980+0000","last_fullsized":"2023-10-16T19:58:05.903980+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_clean_scrub_stamp":"2023-10-16T19:58:03.569082+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:55:48.953087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:06.907817+0000","last_change":"2023-10-16T19:58:05.601316+0000","last_active":"2023-10-16T19:58:06.907817+0000","last_peered":"2023-10-16T19:58:06.907817+0000","last_clean":"2023-10-16T19:58:06.907817+0000","last_became_active":"2023-10-16T19:58:05.600598+0000","last_became_peered":"2023-10-16T19:58:05.600598+0000","last_unstale":"2023-10-16T19:58:06.907817+0000","last_undegraded":"2023-10-16T19:58:06.907817+0000","last_fullsized":"2023-10-16T19:58:06.907817+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:22:44.892357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"32'6","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.900175+0000","last_change":"2023-10-16T19:58:04.585306+0000","last_active":"2023-10-16T19:58:05.900175+0000","last_peered":"2023-10-16T19:58:05.900175+0000","last_clean":"2023-10-16T19:58:05.900175+0000","last_became_active":"2023-10-16T19:58:04.584588+0000","last_became_peered":"2023-10-16T19:58:04.584588+0000","last_unstale":"2023-10-16T19:58:05.900175+0000","last_undegraded":"2023-10-16T19:58:05.900175+0000","last_fullsized":"2023-10-16T19:58:05.900175+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_clean_scrub_stamp":"2023-10-16T19:58:03.569082+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:26:32.485443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:06.907587+0000","last_change":"2023-10-16T19:58:05.602640+0000","last_active":"2023-10-16T19:58:06.907587+0000","last_peered":"2023-10-16T19:58:06.907587+0000","last_clean":"2023-10-16T19:58:06.907587+0000","last_became_active":"2023-10-16T19:58:05.602386+0000","last_became_peered":"2023-10-16T19:58:05.602386+0000","last_unstale":"2023-10-16T19:58:06.907587+0000","last_undegraded":"2023-10-16T19:58:06.907587+0000","last_fullsized":"2023-10-16T19:58:06.907587+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:24:38.118997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"32'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.903229+0000","last_change":"2023-10-16T19:58:04.586869+0000","last_active":"2023-10-16T19:58:05.903229+0000","last_peered":"2023-10-16T19:58:05.903229+0000","last_clean":"2023-10-16T19:58:05.903229+0000","last_became_active":"2023-10-16T19:58:04.586290+0000","last_became_peered":"2023-10-16T19:58:04.586290+0000","last_unstale":"2023-10-16T19:58:05.903229+0000","last_undegraded":"2023-10-16T19:58:05.903229+0000","last_fullsized":"2023-10-16T19:58:05.903229+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_clean_scrub_stamp":"2023-10-16T19:58:03.569082+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:36:39.376783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:07.027826+0000","last_change":"2023-10-16T19:58:05.606176+0000","last_active":"2023-10-16T19:58:07.027826+0000","last_peered":"2023-10-16T19:58:07.027826+0000","last_clean":"2023-10-16T19:58:07.027826+0000","last_became_active":"2023-10-16T19:58:05.605962+0000","last_became_peered":"2023-10-16T19:58:05.605962+0000","last_unstale":"2023-10-16T19:58:07.027826+0000","last_undegraded":"2023-10-16T19:58:07.027826+0000","last_fullsized":"2023-10-16T19:58:07.027826+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:17:36.021934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.900285+0000","last_change":"2023-10-16T19:58:04.587764+0000","last_active":"2023-10-16T19:58:05.900285+0000","last_peered":"2023-10-16T19:58:05.900285+0000","last_clean":"2023-10-16T19:58:05.900285+0000","last_became_active":"2023-10-16T19:58:04.587531+0000","last_became_peered":"2023-10-16T19:58:04.587531+0000","last_unstale":"2023-10-16T19:58:05.900285+0000","last_undegraded":"2023-10-16T19:58:05.900285+0000","last_fullsized":"2023-10-16T19:58:05.900285+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_clean_scrub_stamp":"2023-10-16T19:58:03.569082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:43:31.501292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:08.048860+0000","last_change":"2023-10-16T19:58:05.608149+0000","last_active":"2023-10-16T19:58:08.048860+0000","last_peered":"2023-10-16T19:58:08.048860+0000","last_clean":"2023-10-16T19:58:08.048860+0000","last_became_active":"2023-10-16T19:58:05.607449+0000","last_became_peered":"2023-10-16T19:58:05.607449+0000","last_unstale":"2023-10-16T19:58:08.048860+0000","last_undegraded":"2023-10-16T19:58:08.048860+0000","last_fullsized":"2023-10-16T19:58:08.048860+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:16:05.497063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.900269+0000","last_change":"2023-10-16T19:58:04.588496+0000","last_active":"2023-10-16T19:58:05.900269+0000","last_peered":"2023-10-16T19:58:05.900269+0000","last_clean":"2023-10-16T19:58:05.900269+0000","last_became_active":"2023-10-16T19:58:04.588305+0000","last_became_peered":"2023-10-16T19:58:04.588305+0000","last_unstale":"2023-10-16T19:58:05.900269+0000","last_undegraded":"2023-10-16T19:58:05.900269+0000","last_fullsized":"2023-10-16T19:58:05.900269+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_clean_scrub_stamp":"2023-10-16T19:58:03.569082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:29:54.752503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:07.027380+0000","last_change":"2023-10-16T19:58:05.599594+0000","last_active":"2023-10-16T19:58:07.027380+0000","last_peered":"2023-10-16T19:58:07.027380+0000","last_clean":"2023-10-16T19:58:07.027380+0000","last_became_active":"2023-10-16T19:58:05.599356+0000","last_became_peered":"2023-10-16T19:58:05.599356+0000","last_unstale":"2023-10-16T19:58:07.027380+0000","last_undegraded":"2023-10-16T19:58:07.027380+0000","last_fullsized":"2023-10-16T19:58:07.027380+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:55:49.957648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"32'8","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.900249+0000","last_change":"2023-10-16T19:58:04.580974+0000","last_active":"2023-10-16T19:58:05.900249+0000","last_peered":"2023-10-16T19:58:05.900249+0000","last_clean":"2023-10-16T19:58:05.900249+0000","last_became_active":"2023-10-16T19:58:04.580648+0000","last_became_peered":"2023-10-16T19:58:04.580648+0000","last_unstale":"2023-10-16T19:58:05.900249+0000","last_undegraded":"2023-10-16T19:58:05.900249+0000","last_fullsized":"2023-10-16T19:58:05.900249+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_clean_scrub_stamp":"2023-10-16T19:58:03.569082+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:26:45.146069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:06.601286+0000","last_change":"2023-10-16T19:58:05.600582+0000","last_active":"2023-10-16T19:58:06.601286+0000","last_peered":"2023-10-16T19:58:06.601286+0000","last_clean":"2023-10-16T19:58:06.601286+0000","last_became_active":"2023-10-16T19:58:05.600333+0000","last_became_peered":"2023-10-16T19:58:05.600333+0000","last_unstale":"2023-10-16T19:58:06.601286+0000","last_undegraded":"2023-10-16T19:58:06.601286+0000","last_fullsized":"2023-10-16T19:58:06.601286+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:57:59.985913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"32'1","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.900190+0000","last_change":"2023-10-16T19:58:04.587935+0000","last_active":"2023-10-16T19:58:05.900190+0000","last_peered":"2023-10-16T19:58:05.900190+0000","last_clean":"2023-10-16T19:58:05.900190+0000","last_became_active":"2023-10-16T19:58:04.587576+0000","last_became_peered":"2023-10-16T19:58:04.587576+0000","last_unstale":"2023-10-16T19:58:05.900190+0000","last_undegraded":"2023-10-16T19:58:05.900190+0000","last_fullsized":"2023-10-16T19:58:05.900190+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_clean_scrub_stamp":"2023-10-16T19:58:03.569082+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:05:22.385602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:06.907877+0000","last_change":"2023-10-16T19:58:05.599461+0000","last_active":"2023-10-16T19:58:06.907877+0000","last_peered":"2023-10-16T19:58:06.907877+0000","last_clean":"2023-10-16T19:58:06.907877+0000","last_became_active":"2023-10-16T19:58:05.598861+0000","last_became_peered":"2023-10-16T19:58:05.598861+0000","last_unstale":"2023-10-16T19:58:06.907877+0000","last_undegraded":"2023-10-16T19:58:06.907877+0000","last_fullsized":"2023-10-16T19:58:06.907877+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:15:51.793903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"32'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.903256+0000","last_change":"2023-10-16T19:58:04.586713+0000","last_active":"2023-10-16T19:58:05.903256+0000","last_peered":"2023-10-16T19:58:05.903256+0000","last_clean":"2023-10-16T19:58:05.903256+0000","last_became_active":"2023-10-16T19:58:04.585973+0000","last_became_peered":"2023-10-16T19:58:04.585973+0000","last_unstale":"2023-10-16T19:58:05.903256+0000","last_undegraded":"2023-10-16T19:58:05.903256+0000","last_fullsized":"2023-10-16T19:58:05.903256+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_clean_scrub_stamp":"2023-10-16T19:58:03.569082+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:55:48.953087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:06.907571+0000","last_change":"2023-10-16T19:58:05.606948+0000","last_active":"2023-10-16T19:58:06.907571+0000","last_peered":"2023-10-16T19:58:06.907571+0000","last_clean":"2023-10-16T19:58:06.907571+0000","last_became_active":"2023-10-16T19:58:05.606722+0000","last_became_peered":"2023-10-16T19:58:05.606722+0000","last_unstale":"2023-10-16T19:58:06.907571+0000","last_undegraded":"2023-10-16T19:58:06.907571+0000","last_fullsized":"2023-10-16T19:58:06.907571+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:42:51.289673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"32'1","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.903176+0000","last_change":"2023-10-16T19:58:04.587531+0000","last_active":"2023-10-16T19:58:05.903176+0000","last_peered":"2023-10-16T19:58:05.903176+0000","last_clean":"2023-10-16T19:58:05.903176+0000","last_became_active":"2023-10-16T19:58:04.586934+0000","last_became_peered":"2023-10-16T19:58:04.586934+0000","last_unstale":"2023-10-16T19:58:05.903176+0000","last_undegraded":"2023-10-16T19:58:05.903176+0000","last_fullsized":"2023-10-16T19:58:05.903176+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_clean_scrub_stamp":"2023-10-16T19:58:03.569082+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:50:59.901042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:06.599160+0000","last_change":"2023-10-16T19:58:05.607501+0000","last_active":"2023-10-16T19:58:06.599160+0000","last_peered":"2023-10-16T19:58:06.599160+0000","last_clean":"2023-10-16T19:58:06.599160+0000","last_became_active":"2023-10-16T19:58:05.607269+0000","last_became_peered":"2023-10-16T19:58:05.607269+0000","last_unstale":"2023-10-16T19:58:06.599160+0000","last_undegraded":"2023-10-16T19:58:06.599160+0000","last_fullsized":"2023-10-16T19:58:06.599160+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:43:51.911077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.903109+0000","last_change":"2023-10-16T19:58:04.592403+0000","last_active":"2023-10-16T19:58:05.903109+0000","last_peered":"2023-10-16T19:58:05.903109+0000","last_clean":"2023-10-16T19:58:05.903109+0000","last_became_active":"2023-10-16T19:58:04.591967+0000","last_became_peered":"2023-10-16T19:58:04.591967+0000","last_unstale":"2023-10-16T19:58:05.903109+0000","last_undegraded":"2023-10-16T19:58:05.903109+0000","last_fullsized":"2023-10-16T19:58:05.903109+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_clean_scrub_stamp":"2023-10-16T19:58:03.569082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:46:15.563804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:06.599199+0000","last_change":"2023-10-16T19:58:05.600386+0000","last_active":"2023-10-16T19:58:06.599199+0000","last_peered":"2023-10-16T19:58:06.599199+0000","last_clean":"2023-10-16T19:58:06.599199+0000","last_became_active":"2023-10-16T19:58:05.600081+0000","last_became_peered":"2023-10-16T19:58:05.600081+0000","last_unstale":"2023-10-16T19:58:06.599199+0000","last_undegraded":"2023-10-16T19:58:06.599199+0000","last_fullsized":"2023-10-16T19:58:06.599199+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:11:36.806952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"32'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.902674+0000","last_change":"2023-10-16T19:58:04.588001+0000","last_active":"2023-10-16T19:58:05.902674+0000","last_peered":"2023-10-16T19:58:05.902674+0000","last_clean":"2023-10-16T19:58:05.902674+0000","last_became_active":"2023-10-16T19:58:04.587629+0000","last_became_peered":"2023-10-16T19:58:04.587629+0000","last_unstale":"2023-10-16T19:58:05.902674+0000","last_undegraded":"2023-10-16T19:58:05.902674+0000","last_fullsized":"2023-10-16T19:58:05.902674+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_clean_scrub_stamp":"2023-10-16T19:58:03.569082+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:57:52.788971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:06.599279+0000","last_change":"2023-10-16T19:58:05.607547+0000","last_active":"2023-10-16T19:58:06.599279+0000","last_peered":"2023-10-16T19:58:06.599279+0000","last_clean":"2023-10-16T19:58:06.599279+0000","last_became_active":"2023-10-16T19:58:05.607311+0000","last_became_peered":"2023-10-16T19:58:05.607311+0000","last_unstale":"2023-10-16T19:58:06.599279+0000","last_undegraded":"2023-10-16T19:58:06.599279+0000","last_fullsized":"2023-10-16T19:58:06.599279+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:04:38.247560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.904154+0000","last_change":"2023-10-16T19:58:04.583596+0000","last_active":"2023-10-16T19:58:05.904154+0000","last_peered":"2023-10-16T19:58:05.904154+0000","last_clean":"2023-10-16T19:58:05.904154+0000","last_became_active":"2023-10-16T19:58:04.583346+0000","last_became_peered":"2023-10-16T19:58:04.583346+0000","last_unstale":"2023-10-16T19:58:05.904154+0000","last_undegraded":"2023-10-16T19:58:05.904154+0000","last_fullsized":"2023-10-16T19:58:05.904154+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_clean_scrub_stamp":"2023-10-16T19:58:03.569082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:08:50.287071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:06.599374+0000","last_change":"2023-10-16T19:58:05.605758+0000","last_active":"2023-10-16T19:58:06.599374+0000","last_peered":"2023-10-16T19:58:06.599374+0000","last_clean":"2023-10-16T19:58:06.599374+0000","last_became_active":"2023-10-16T19:58:05.605529+0000","last_became_peered":"2023-10-16T19:58:05.605529+0000","last_unstale":"2023-10-16T19:58:06.599374+0000","last_undegraded":"2023-10-16T19:58:06.599374+0000","last_fullsized":"2023-10-16T19:58:06.599374+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:56:22.040826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.903243+0000","last_change":"2023-10-16T19:58:04.590215+0000","last_active":"2023-10-16T19:58:05.903243+0000","last_peered":"2023-10-16T19:58:05.903243+0000","last_clean":"2023-10-16T19:58:05.903243+0000","last_became_active":"2023-10-16T19:58:04.589542+0000","last_became_peered":"2023-10-16T19:58:04.589542+0000","last_unstale":"2023-10-16T19:58:05.903243+0000","last_undegraded":"2023-10-16T19:58:05.903243+0000","last_fullsized":"2023-10-16T19:58:05.903243+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_clean_scrub_stamp":"2023-10-16T19:58:03.569082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:57:52.788971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:08.049050+0000","last_change":"2023-10-16T19:58:05.608889+0000","last_active":"2023-10-16T19:58:08.049050+0000","last_peered":"2023-10-16T19:58:08.049050+0000","last_clean":"2023-10-16T19:58:08.049050+0000","last_became_active":"2023-10-16T19:58:05.608517+0000","last_became_peered":"2023-10-16T19:58:05.608517+0000","last_unstale":"2023-10-16T19:58:08.049050+0000","last_undegraded":"2023-10-16T19:58:08.049050+0000","last_fullsized":"2023-10-16T19:58:08.049050+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:25:36.321203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.904109+0000","last_change":"2023-10-16T19:58:04.587619+0000","last_active":"2023-10-16T19:58:05.904109+0000","last_peered":"2023-10-16T19:58:05.904109+0000","last_clean":"2023-10-16T19:58:05.904109+0000","last_became_active":"2023-10-16T19:58:04.587332+0000","last_became_peered":"2023-10-16T19:58:04.587332+0000","last_unstale":"2023-10-16T19:58:05.904109+0000","last_undegraded":"2023-10-16T19:58:05.904109+0000","last_fullsized":"2023-10-16T19:58:05.904109+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_clean_scrub_stamp":"2023-10-16T19:58:03.569082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:09:03.659551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:06.599401+0000","last_change":"2023-10-16T19:58:05.600830+0000","last_active":"2023-10-16T19:58:06.599401+0000","last_peered":"2023-10-16T19:58:06.599401+0000","last_clean":"2023-10-16T19:58:06.599401+0000","last_became_active":"2023-10-16T19:58:05.600305+0000","last_became_peered":"2023-10-16T19:58:05.600305+0000","last_unstale":"2023-10-16T19:58:06.599401+0000","last_undegraded":"2023-10-16T19:58:06.599401+0000","last_fullsized":"2023-10-16T19:58:06.599401+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:43:32.505853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"32'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.900264+0000","last_change":"2023-10-16T19:58:04.582724+0000","last_active":"2023-10-16T19:58:05.900264+0000","last_peered":"2023-10-16T19:58:05.900264+0000","last_clean":"2023-10-16T19:58:05.900264+0000","last_became_active":"2023-10-16T19:58:04.582012+0000","last_became_peered":"2023-10-16T19:58:04.582012+0000","last_unstale":"2023-10-16T19:58:05.900264+0000","last_undegraded":"2023-10-16T19:58:05.900264+0000","last_fullsized":"2023-10-16T19:58:05.900264+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_clean_scrub_stamp":"2023-10-16T19:58:03.569082+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:55:48.953087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:06.908225+0000","last_change":"2023-10-16T19:58:05.602250+0000","last_active":"2023-10-16T19:58:06.908225+0000","last_peered":"2023-10-16T19:58:06.908225+0000","last_clean":"2023-10-16T19:58:06.908225+0000","last_became_active":"2023-10-16T19:58:05.600830+0000","last_became_peered":"2023-10-16T19:58:05.600830+0000","last_unstale":"2023-10-16T19:58:06.908225+0000","last_undegraded":"2023-10-16T19:58:06.908225+0000","last_fullsized":"2023-10-16T19:58:06.908225+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:17:36.021934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"33'1","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:06.600649+0000","last_change":"2023-10-16T19:58:04.587844+0000","last_active":"2023-10-16T19:58:06.600649+0000","last_peered":"2023-10-16T19:58:06.600649+0000","last_clean":"2023-10-16T19:58:06.600649+0000","last_became_active":"2023-10-16T19:58:04.587329+0000","last_became_peered":"2023-10-16T19:58:04.587329+0000","last_unstale":"2023-10-16T19:58:06.600649+0000","last_undegraded":"2023-10-16T19:58:06.600649+0000","last_fullsized":"2023-10-16T19:58:06.600649+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_clean_scrub_stamp":"2023-10-16T19:58:03.569082+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:55:48.953087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:06.600449+0000","last_change":"2023-10-16T19:58:05.606214+0000","last_active":"2023-10-16T19:58:06.600449+0000","last_peered":"2023-10-16T19:58:06.600449+0000","last_clean":"2023-10-16T19:58:06.600449+0000","last_became_active":"2023-10-16T19:58:05.605958+0000","last_became_peered":"2023-10-16T19:58:05.605958+0000","last_unstale":"2023-10-16T19:58:06.600449+0000","last_undegraded":"2023-10-16T19:58:06.600449+0000","last_fullsized":"2023-10-16T19:58:06.600449+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:26:46.150630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.900321+0000","last_change":"2023-10-16T19:58:04.587092+0000","last_active":"2023-10-16T19:58:05.900321+0000","last_peered":"2023-10-16T19:58:05.900321+0000","last_clean":"2023-10-16T19:58:05.900321+0000","last_became_active":"2023-10-16T19:58:04.586851+0000","last_became_peered":"2023-10-16T19:58:04.586851+0000","last_unstale":"2023-10-16T19:58:05.900321+0000","last_undegraded":"2023-10-16T19:58:05.900321+0000","last_fullsized":"2023-10-16T19:58:05.900321+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_clean_scrub_stamp":"2023-10-16T19:58:03.569082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:36:39.376783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:07.027640+0000","last_change":"2023-10-16T19:58:05.606520+0000","last_active":"2023-10-16T19:58:07.027640+0000","last_peered":"2023-10-16T19:58:07.027640+0000","last_clean":"2023-10-16T19:58:07.027640+0000","last_became_active":"2023-10-16T19:58:05.606081+0000","last_became_peered":"2023-10-16T19:58:05.606081+0000","last_unstale":"2023-10-16T19:58:07.027640+0000","last_undegraded":"2023-10-16T19:58:07.027640+0000","last_fullsized":"2023-10-16T19:58:07.027640+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:26:46.150630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.902760+0000","last_change":"2023-10-16T19:58:04.588408+0000","last_active":"2023-10-16T19:58:05.902760+0000","last_peered":"2023-10-16T19:58:05.902760+0000","last_clean":"2023-10-16T19:58:05.902760+0000","last_became_active":"2023-10-16T19:58:04.588050+0000","last_became_peered":"2023-10-16T19:58:04.588050+0000","last_unstale":"2023-10-16T19:58:05.902760+0000","last_undegraded":"2023-10-16T19:58:05.902760+0000","last_fullsized":"2023-10-16T19:58:05.902760+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_clean_scrub_stamp":"2023-10-16T19:58:03.569082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:36:39.376783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:06.600631+0000","last_change":"2023-10-16T19:58:05.607522+0000","last_active":"2023-10-16T19:58:06.600631+0000","last_peered":"2023-10-16T19:58:06.600631+0000","last_clean":"2023-10-16T19:58:06.600631+0000","last_became_active":"2023-10-16T19:58:05.607381+0000","last_became_peered":"2023-10-16T19:58:05.607381+0000","last_unstale":"2023-10-16T19:58:06.600631+0000","last_undegraded":"2023-10-16T19:58:06.600631+0000","last_fullsized":"2023-10-16T19:58:06.600631+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:07:11.937484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.900254+0000","last_change":"2023-10-16T19:58:04.582574+0000","last_active":"2023-10-16T19:58:05.900254+0000","last_peered":"2023-10-16T19:58:05.900254+0000","last_clean":"2023-10-16T19:58:05.900254+0000","last_became_active":"2023-10-16T19:58:04.581711+0000","last_became_peered":"2023-10-16T19:58:04.581711+0000","last_unstale":"2023-10-16T19:58:05.900254+0000","last_undegraded":"2023-10-16T19:58:05.900254+0000","last_fullsized":"2023-10-16T19:58:05.900254+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_clean_scrub_stamp":"2023-10-16T19:58:03.569082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:57:52.788971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:07.027751+0000","last_change":"2023-10-16T19:58:05.602722+0000","last_active":"2023-10-16T19:58:07.027751+0000","last_peered":"2023-10-16T19:58:07.027751+0000","last_clean":"2023-10-16T19:58:07.027751+0000","last_became_active":"2023-10-16T19:58:05.602184+0000","last_became_peered":"2023-10-16T19:58:05.602184+0000","last_unstale":"2023-10-16T19:58:07.027751+0000","last_undegraded":"2023-10-16T19:58:07.027751+0000","last_fullsized":"2023-10-16T19:58:07.027751+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:16:44.802078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.903097+0000","last_change":"2023-10-16T19:58:04.589600+0000","last_active":"2023-10-16T19:58:05.903097+0000","last_peered":"2023-10-16T19:58:05.903097+0000","last_clean":"2023-10-16T19:58:05.903097+0000","last_became_active":"2023-10-16T19:58:04.587683+0000","last_became_peered":"2023-10-16T19:58:04.587683+0000","last_unstale":"2023-10-16T19:58:05.903097+0000","last_undegraded":"2023-10-16T19:58:05.903097+0000","last_fullsized":"2023-10-16T19:58:05.903097+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_clean_scrub_stamp":"2023-10-16T19:58:03.569082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:56:21.036265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:06.600727+0000","last_change":"2023-10-16T19:58:05.601329+0000","last_active":"2023-10-16T19:58:06.600727+0000","last_peered":"2023-10-16T19:58:06.600727+0000","last_clean":"2023-10-16T19:58:06.600727+0000","last_became_active":"2023-10-16T19:58:05.601074+0000","last_became_peered":"2023-10-16T19:58:05.601074+0000","last_unstale":"2023-10-16T19:58:06.600727+0000","last_undegraded":"2023-10-16T19:58:06.600727+0000","last_fullsized":"2023-10-16T19:58:06.600727+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:26:46.150630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.900213+0000","last_change":"2023-10-16T19:58:04.588810+0000","last_active":"2023-10-16T19:58:05.900213+0000","last_peered":"2023-10-16T19:58:05.900213+0000","last_clean":"2023-10-16T19:58:05.900213+0000","last_became_active":"2023-10-16T19:58:04.588392+0000","last_became_peered":"2023-10-16T19:58:04.588392+0000","last_unstale":"2023-10-16T19:58:05.900213+0000","last_undegraded":"2023-10-16T19:58:05.900213+0000","last_fullsized":"2023-10-16T19:58:05.900213+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_clean_scrub_stamp":"2023-10-16T19:58:03.569082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:41:57.381509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:08.049197+0000","last_change":"2023-10-16T19:58:05.609385+0000","last_active":"2023-10-16T19:58:08.049197+0000","last_peered":"2023-10-16T19:58:08.049197+0000","last_clean":"2023-10-16T19:58:08.049197+0000","last_became_active":"2023-10-16T19:58:05.609118+0000","last_became_peered":"2023-10-16T19:58:05.609118+0000","last_unstale":"2023-10-16T19:58:08.049197+0000","last_undegraded":"2023-10-16T19:58:08.049197+0000","last_fullsized":"2023-10-16T19:58:08.049197+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:23:18.475974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.904186+0000","last_change":"2023-10-16T19:58:04.586182+0000","last_active":"2023-10-16T19:58:05.904186+0000","last_peered":"2023-10-16T19:58:05.904186+0000","last_clean":"2023-10-16T19:58:05.904186+0000","last_became_active":"2023-10-16T19:58:04.585930+0000","last_became_peered":"2023-10-16T19:58:04.585930+0000","last_unstale":"2023-10-16T19:58:05.904186+0000","last_undegraded":"2023-10-16T19:58:05.904186+0000","last_fullsized":"2023-10-16T19:58:05.904186+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_clean_scrub_stamp":"2023-10-16T19:58:03.569082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:50:59.901042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":175,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.602583+0000","last_change":"2023-10-16T19:56:58.775782+0000","last_active":"2023-10-16T19:58:05.602583+0000","last_peered":"2023-10-16T19:58:05.602583+0000","last_clean":"2023-10-16T19:58:05.602583+0000","last_became_active":"2023-10-16T19:56:58.775567+0000","last_became_peered":"2023-10-16T19:56:58.775567+0000","last_unstale":"2023-10-16T19:58:05.602583+0000","last_undegraded":"2023-10-16T19:58:05.602583+0000","last_fullsized":"2023-10-16T19:58:05.602583+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:56:57.693332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:56:57.693332+0000","last_clean_scrub_stamp":"2023-10-16T19:56:57.693332+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:10:23.849736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574865,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":718,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194594,"statfs":{"total":200000000,"available":199264318,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 19:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.40799999999999997}]},{"osd":1,"last update":"Mon Oct 16 19:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.54200000000000004}]},{"osd":2,"last update":"Mon Oct 16 19:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.60499999999999998}]},{"osd":3,"last update":"Mon Oct 16 19:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.498},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.57099999999999995}]},{"osd":4,"last update":"Mon Oct 16 19:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.59299999999999997}]},{"osd":5,"last update":"Mon Oct 16 19:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"last":0.61699999999999999}]},{"osd":6,"last update":"Mon Oct 16 19:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.63400000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574865,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":142,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195170,"statfs":{"total":200000000,"available":199854160,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 19:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.58299999999999996}]},{"osd":1,"last update":"Mon Oct 16 19:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.64700000000000002}]},{"osd":2,"last update":"Mon Oct 16 19:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.70099999999999996}]},{"osd":3,"last update":"Mon Oct 16 19:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.746},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.52500000000000002}]},{"osd":4,"last update":"Mon Oct 16 19:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.50700000000000001}]},{"osd":5,"last update":"Mon Oct 16 19:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.72799999999999998}]},{"osd":7,"last update":"Mon Oct 16 19:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.624},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.56999999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574865,"num_pgs":32,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":143,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195169,"statfs":{"total":200000000,"available":199853142,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 19:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"min":{"1min":0.19700000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.309,"5min":0.309,"15min":0.309},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"last":0.30599999999999999}]},{"osd":2,"last update":"Mon Oct 16 19:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.443,"5min":0.443,"15min":0.443},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"last":0.41499999999999998}]},{"osd":3,"last update":"Mon Oct 16 19:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"last":0.32600000000000001}]},{"osd":4,"last update":"Mon Oct 16 19:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.44800000000000001}]},{"osd":5,"last update":"Mon Oct 16 19:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.59699999999999998}]},{"osd":6,"last update":"Mon Oct 16 19:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.54500000000000004}]},{"osd":7,"last update":"Mon Oct 16 19:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.502}]}]},{"osd":0,"up_from":13,"seq":55834574865,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":718,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194594,"statfs":{"total":200000000,"available":199264408,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 16 19:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":11.031000000000001,"5min":11.031000000000001,"15min":11.031000000000001},"last":0.26200000000000001},{"interface":"front","average":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":12.218,"5min":12.218,"15min":12.218},"last":0.36199999999999999}]},{"osd":2,"last update":"Mon Oct 16 19:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":11.058,"5min":11.058,"15min":11.058},"last":0.32100000000000001},{"interface":"front","average":{"1min":1.123,"5min":1.123,"15min":1.123},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":14.763999999999999,"5min":14.763999999999999,"15min":14.763999999999999},"last":0.29799999999999999}]},{"osd":3,"last update":"Mon Oct 16 19:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":10.935,"5min":10.935,"15min":10.935},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":11.083,"5min":11.083,"15min":11.083},"last":0.39000000000000001}]},{"osd":4,"last update":"Mon Oct 16 19:57:58 2023","interfaces":[{"interface":"back","average":{"1min":1.196,"5min":1.196,"15min":1.196},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":12.279,"5min":12.279,"15min":12.279},"last":0.51700000000000002},{"interface":"front","average":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":10.879,"5min":10.879,"15min":10.879},"last":0.40300000000000002}]},{"osd":5,"last update":"Mon Oct 16 19:57:58 2023","interfaces":[{"interface":"back","average":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":10.907,"5min":10.907,"15min":10.907},"last":0.38100000000000001},{"interface":"front","average":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":11,"5min":11,"15min":11},"last":0.48099999999999998}]},{"osd":6,"last update":"Mon Oct 16 19:57:58 2023","interfaces":[{"interface":"back","average":{"1min":1.157,"5min":1.157,"15min":1.157},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":10.972,"5min":10.972,"15min":10.972},"last":0.41999999999999998},{"interface":"front","average":{"1min":1.24,"5min":1.24,"15min":1.24},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":12.34,"5min":12.34,"15min":12.34},"last":0.45200000000000001}]},{"osd":7,"last update":"Mon Oct 16 19:57:58 2023","interfaces":[{"interface":"back","average":{"1min":1.252,"5min":1.252,"15min":1.252},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":12.311,"5min":12.311,"15min":12.311},"last":0.48799999999999999},{"interface":"front","average":{"1min":1.167,"5min":1.167,"15min":1.167},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":10.845000000000001,"5min":10.845000000000001,"15min":10.845000000000001},"last":0.432}]}]},{"osd":2,"up_from":13,"seq":55834574865,"num_pgs":17,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":141,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195170,"statfs":{"total":200000000,"available":199854706,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 19:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"min":{"1min":0.17899999999999999,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"last":0.26400000000000001},{"interface":"front","average":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"min":{"1min":0.20100000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.36799999999999999}]},{"osd":1,"last update":"Mon Oct 16 19:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.375,"15min":0.375},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"last":0.30199999999999999},{"interface":"front","average":{"1min":0.37,"5min":0.37,"15min":0.37},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"last":0.28799999999999998}]},{"osd":3,"last update":"Mon Oct 16 19:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.34499999999999997}]},{"osd":4,"last update":"Mon Oct 16 19:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.48599999999999999}]},{"osd":5,"last update":"Mon Oct 16 19:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.38400000000000001}]},{"osd":6,"last update":"Mon Oct 16 19:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.433}]},{"osd":7,"last update":"Mon Oct 16 19:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.45900000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574865,"num_pgs":31,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":143,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195169,"statfs":{"total":200000000,"available":199853142,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 19:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"last":0.246},{"interface":"front","average":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.498,"5min":0.498,"15min":0.498},"last":0.38}]},{"osd":1,"last update":"Mon Oct 16 19:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"last":0.313},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"min":{"1min":0.20499999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.32600000000000001}]},{"osd":2,"last update":"Mon Oct 16 19:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.36299999999999999}]},{"osd":4,"last update":"Mon Oct 16 19:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.63},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.51200000000000001}]},{"osd":5,"last update":"Mon Oct 16 19:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.58699999999999997}]},{"osd":6,"last update":"Mon Oct 16 19:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.501}]},{"osd":7,"last update":"Mon Oct 16 19:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.2030000000000001,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.139,"5min":1.139,"15min":1.139},"last":0.47999999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574865,"num_pgs":29,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":141,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195170,"statfs":{"total":200000000,"available":199854672,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 19:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.46600000000000003}]},{"osd":1,"last update":"Mon Oct 16 19:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.034,"5min":1.034,"15min":1.034},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.40400000000000003}]},{"osd":2,"last update":"Mon Oct 16 19:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.103,"5min":1.103,"15min":1.103},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.50900000000000001}]},{"osd":3,"last update":"Mon Oct 16 19:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.071,"5min":1.071,"15min":1.071},"last":0.56999999999999995}]},{"osd":5,"last update":"Mon Oct 16 19:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.49099999999999999}]},{"osd":6,"last update":"Mon Oct 16 19:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.44900000000000001}]},{"osd":7,"last update":"Mon Oct 16 19:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.441},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.59399999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574865,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":142,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195170,"statfs":{"total":200000000,"available":199854104,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 19:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.45100000000000001}]},{"osd":1,"last update":"Mon Oct 16 19:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":7.9989999999999997,"5min":7.9989999999999997,"15min":7.9989999999999997},"last":0.435},{"interface":"front","average":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":8.0150000000000006,"5min":8.0150000000000006,"15min":8.0150000000000006},"last":0.53400000000000003}]},{"osd":2,"last update":"Mon Oct 16 19:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":1.032,"5min":1.032,"15min":1.032},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.379}]},{"osd":3,"last update":"Mon Oct 16 19:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":8.077,"5min":8.077,"15min":8.077},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.58299999999999996}]},{"osd":4,"last update":"Mon Oct 16 19:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.65100000000000002}]},{"osd":6,"last update":"Mon Oct 16 19:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.63600000000000001}]},{"osd":7,"last update":"Mon Oct 16 19:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.625},{"interface":"front","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.61399999999999999}]}]}],"pool_statfs":[]}} 2023-10-16T19:58:13.913 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-16T19:58:14.067 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.064+0000 7f6c98ac0700 1 Processor -- start 2023-10-16T19:58:14.067 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.065+0000 7f6c98ac0700 1 -- start start 2023-10-16T19:58:14.070 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.065+0000 7f6c98ac0700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f6c9415de00 0x7f6c94161a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:14.071 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.065+0000 7f6c98ac0700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6c94161f50 0x7f6c940d2200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:14.071 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.065+0000 7f6c98ac0700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f6c940d2740 0x7f6c940ced00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:14.071 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.065+0000 7f6c98ac0700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c940ce870 con 0x7f6c940d2740 2023-10-16T19:58:14.071 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.065+0000 7f6c98ac0700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c94162990 con 0x7f6c9415de00 2023-10-16T19:58:14.072 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.065+0000 7f6c98ac0700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c941623d0 con 0x7f6c94161f50 2023-10-16T19:58:14.072 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.066+0000 7f6c92d9d700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f6c940d2740 0x7f6c940ced00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:14.072 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.066+0000 7f6c92d9d700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f6c940d2740 0x7f6c940ced00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:47782/0 (socket says 172.21.15.157:47782) 2023-10-16T19:58:14.073 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.066+0000 7f6c92d9d700 1 -- 172.21.15.157:0/71295284 learned_addr learned my addr 172.21.15.157:0/71295284 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:58:14.073 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.066+0000 7f6c9259c700 1 --2- 172.21.15.157:0/71295284 >> v2:172.21.15.187:3300/0 conn(0x7f6c9415de00 0x7f6c94161a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:14.073 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.066+0000 7f6c91d9b700 1 --2- 172.21.15.157:0/71295284 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6c94161f50 0x7f6c940d2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:14.073 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.066+0000 7f6c92d9d700 1 -- 172.21.15.157:0/71295284 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6c94161f50 msgr2=0x7f6c940d2200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:58:14.074 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.066+0000 7f6c92d9d700 1 --2- 172.21.15.157:0/71295284 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6c94161f50 0x7f6c940d2200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:14.074 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.066+0000 7f6c92d9d700 1 -- 172.21.15.157:0/71295284 >> v2:172.21.15.187:3300/0 conn(0x7f6c9415de00 msgr2=0x7f6c94161a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:58:14.074 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.066+0000 7f6c92d9d700 1 --2- 172.21.15.157:0/71295284 >> v2:172.21.15.187:3300/0 conn(0x7f6c9415de00 0x7f6c94161a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:14.075 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.066+0000 7f6c92d9d700 1 -- 172.21.15.157:0/71295284 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c941626b0 con 0x7f6c940d2740 2023-10-16T19:58:14.075 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.066+0000 7f6c91d9b700 1 --2- 172.21.15.157:0/71295284 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6c94161f50 0x7f6c940d2200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T19:58:14.075 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.066+0000 7f6c9259c700 1 --2- 172.21.15.157:0/71295284 >> v2:172.21.15.187:3300/0 conn(0x7f6c9415de00 0x7f6c94161a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T19:58:14.080 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.066+0000 7f6c92d9d700 1 --2- 172.21.15.157:0/71295284 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6c940d2740 0x7f6c940ced00 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f6c940675b0 tx=0x7f6c8c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6ed5ad2f6199688 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:58:14.080 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.066+0000 7f6c9159a700 1 -- 172.21.15.157:0/71295284 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c8c00e070 con 0x7f6c940d2740 2023-10-16T19:58:14.081 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.066+0000 7f6c9159a700 1 -- 172.21.15.157:0/71295284 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c8c00b9c0 con 0x7f6c940d2740 2023-10-16T19:58:14.081 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.066+0000 7f6c9159a700 1 -- 172.21.15.157:0/71295284 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c8c00bd70 con 0x7f6c940d2740 2023-10-16T19:58:14.081 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.067+0000 7f6c98ac0700 1 -- 172.21.15.157:0/71295284 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6c940d2740 msgr2=0x7f6c940ced00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:14.082 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.067+0000 7f6c98ac0700 1 --2- 172.21.15.157:0/71295284 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6c940d2740 0x7f6c940ced00 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f6c940675b0 tx=0x7f6c8c00b330 comp rx=0 tx=0).stop 2023-10-16T19:58:14.082 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.067+0000 7f6c98ac0700 1 -- 172.21.15.157:0/71295284 shutdown_connections 2023-10-16T19:58:14.082 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.067+0000 7f6c98ac0700 1 --2- 172.21.15.157:0/71295284 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6c940d2740 0x7f6c940ced00 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:14.083 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.067+0000 7f6c98ac0700 1 --2- 172.21.15.157:0/71295284 >> v2:172.21.15.187:3300/0 conn(0x7f6c9415de00 0x7f6c94161a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:14.083 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.067+0000 7f6c98ac0700 1 --2- 172.21.15.157:0/71295284 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6c94161f50 0x7f6c940d2200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:14.083 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.067+0000 7f6c98ac0700 1 -- 172.21.15.157:0/71295284 >> 172.21.15.157:0/71295284 conn(0x7f6c940665a0 msgr2=0x7f6c94066980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:58:14.083 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.067+0000 7f6c98ac0700 1 -- 172.21.15.157:0/71295284 shutdown_connections 2023-10-16T19:58:14.084 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.067+0000 7f6c98ac0700 1 -- 172.21.15.157:0/71295284 wait complete. 2023-10-16T19:58:14.084 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.068+0000 7f6c98ac0700 1 Processor -- start 2023-10-16T19:58:14.084 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.068+0000 7f6c98ac0700 1 -- start start 2023-10-16T19:58:14.087 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.069+0000 7f6c98ac0700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6c940d2740 0x7f6c940b3800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:14.087 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.069+0000 7f6c98ac0700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6c9415de00 0x7f6c941584f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:14.087 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.069+0000 7f6c98ac0700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6c94161f50 0x7f6c940caf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:14.088 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.069+0000 7f6c98ac0700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c940b4030 con 0x7f6c9415de00 2023-10-16T19:58:14.088 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.069+0000 7f6c98ac0700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c940b4310 con 0x7f6c94161f50 2023-10-16T19:58:14.088 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.069+0000 7f6c98ac0700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c940b45f0 con 0x7f6c940d2740 2023-10-16T19:58:14.088 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.069+0000 7f6c91d9b700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6c9415de00 0x7f6c941584f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:14.089 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.069+0000 7f6c91d9b700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6c9415de00 0x7f6c941584f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:47786/0 (socket says 172.21.15.157:47786) 2023-10-16T19:58:14.089 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.069+0000 7f6c91d9b700 1 -- 172.21.15.157:0/385674236 learned_addr learned my addr 172.21.15.157:0/385674236 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:58:14.089 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.069+0000 7f6c9259c700 1 --2- 172.21.15.157:0/385674236 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6c940d2740 0x7f6c940b3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:14.089 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.069+0000 7f6c91d9b700 1 -- 172.21.15.157:0/385674236 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6c940d2740 msgr2=0x7f6c940b3800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:14.090 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.069+0000 7f6c92d9d700 1 --2- 172.21.15.157:0/385674236 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6c94161f50 0x7f6c940caf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:14.090 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.069+0000 7f6c91d9b700 1 --2- 172.21.15.157:0/385674236 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6c940d2740 0x7f6c940b3800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:14.090 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.069+0000 7f6c91d9b700 1 -- 172.21.15.157:0/385674236 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6c94161f50 msgr2=0x7f6c940caf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:14.091 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.069+0000 7f6c91d9b700 1 --2- 172.21.15.157:0/385674236 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6c94161f50 0x7f6c940caf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:14.091 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.069+0000 7f6c91d9b700 1 -- 172.21.15.157:0/385674236 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c8c009b30 con 0x7f6c9415de00 2023-10-16T19:58:14.091 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.070+0000 7f6c91d9b700 1 --2- 172.21.15.157:0/385674236 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6c9415de00 0x7f6c941584f0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f6c7c00e810 tx=0x7f6c7c00ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:58:14.091 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.070+0000 7f6c8affd700 1 -- 172.21.15.157:0/385674236 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c7c00c020 con 0x7f6c9415de00 2023-10-16T19:58:14.092 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.070+0000 7f6c8affd700 1 -- 172.21.15.157:0/385674236 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c7c004250 con 0x7f6c9415de00 2023-10-16T19:58:14.092 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.070+0000 7f6c98ac0700 1 -- 172.21.15.157:0/385674236 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c940b48d0 con 0x7f6c9415de00 2023-10-16T19:58:14.092 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.070+0000 7f6c8affd700 1 -- 172.21.15.157:0/385674236 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c7c0036a0 con 0x7f6c9415de00 2023-10-16T19:58:14.093 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.070+0000 7f6c98ac0700 1 -- 172.21.15.157:0/385674236 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c940b3d40 con 0x7f6c9415de00 2023-10-16T19:58:14.093 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.071+0000 7f6c98ac0700 1 -- 172.21.15.157:0/385674236 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c940b4df0 con 0x7f6c9415de00 2023-10-16T19:58:14.093 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.071+0000 7f6c8affd700 1 -- 172.21.15.157:0/385674236 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f6c7c003800 con 0x7f6c9415de00 2023-10-16T19:58:14.093 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.071+0000 7f6c8affd700 1 --2- 172.21.15.157:0/385674236 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f6c7406af00 0x7f6c7406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:14.094 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.072+0000 7f6c8affd700 1 -- 172.21.15.157:0/385674236 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5729+0+0 (secure 0 0 0) 0x7f6c7c089310 con 0x7f6c9415de00 2023-10-16T19:58:14.094 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.072+0000 7f6c9259c700 1 --2- 172.21.15.157:0/385674236 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f6c7406af00 0x7f6c7406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:14.094 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.072+0000 7f6c9259c700 1 --2- 172.21.15.157:0/385674236 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f6c7406af00 0x7f6c7406d3c0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f6c84009910 tx=0x7f6c84008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:58:14.095 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.076+0000 7f6c8affd700 1 -- 172.21.15.157:0/385674236 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6c940b4df0 con 0x7f6c9415de00 2023-10-16T19:58:14.261 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.258+0000 7f6c98ac0700 1 -- 172.21.15.157:0/385674236 --> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6c9415e1e0 con 0x7f6c7406af00 2023-10-16T19:58:14.269 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.266+0000 7f6c8affd700 1 -- 172.21.15.157:0/385674236 <== mgr.4100 v2:172.21.15.187:6832/2426285296 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+284555 (secure 0 0 0) 0x7f6c8400c050 con 0x7f6c7406af00 2023-10-16T19:58:14.273 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-10-16T19:58:14.275 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.270+0000 7f6c98ac0700 1 -- 172.21.15.157:0/385674236 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f6c7406af00 msgr2=0x7f6c7406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:14.275 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.270+0000 7f6c98ac0700 1 --2- 172.21.15.157:0/385674236 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f6c7406af00 0x7f6c7406d3c0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f6c84009910 tx=0x7f6c84008040 comp rx=0 tx=0).stop 2023-10-16T19:58:14.276 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.270+0000 7f6c98ac0700 1 -- 172.21.15.157:0/385674236 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6c9415de00 msgr2=0x7f6c941584f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:14.276 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.270+0000 7f6c98ac0700 1 --2- 172.21.15.157:0/385674236 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6c9415de00 0x7f6c941584f0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f6c7c00e810 tx=0x7f6c7c00ebd0 comp rx=0 tx=0).stop 2023-10-16T19:58:14.277 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.270+0000 7f6c98ac0700 1 -- 172.21.15.157:0/385674236 shutdown_connections 2023-10-16T19:58:14.277 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.270+0000 7f6c98ac0700 1 --2- 172.21.15.157:0/385674236 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f6c7406af00 0x7f6c7406d3c0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:14.277 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.270+0000 7f6c98ac0700 1 --2- 172.21.15.157:0/385674236 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6c94161f50 0x7f6c940caf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:14.278 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.270+0000 7f6c98ac0700 1 --2- 172.21.15.157:0/385674236 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6c940d2740 0x7f6c940b3800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:14.278 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.270+0000 7f6c98ac0700 1 --2- 172.21.15.157:0/385674236 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6c9415de00 0x7f6c941584f0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:14.278 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.270+0000 7f6c98ac0700 1 -- 172.21.15.157:0/385674236 >> 172.21.15.157:0/385674236 conn(0x7f6c940665a0 msgr2=0x7f6c9415bc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:58:14.278 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.270+0000 7f6c98ac0700 1 -- 172.21.15.157:0/385674236 shutdown_connections 2023-10-16T19:58:14.279 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.270+0000 7f6c98ac0700 1 -- 172.21.15.157:0/385674236 wait complete. 2023-10-16T19:58:14.279 INFO:teuthology.orchestra.run.smithi157.stderr:dumped all 2023-10-16T19:58:14.284 INFO:teuthology.orchestra.run.smithi157.stdout:{"pg_ready":true,"pg_map":{"version":62,"stamp":"2023-10-16T19:58:12.906917+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":2292,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560207,"statfs":{"total":1600000000,"available":1597652652,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002016"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:07.027378+0000","last_change":"2023-10-16T19:58:05.597289+0000","last_active":"2023-10-16T19:58:07.027378+0000","last_peered":"2023-10-16T19:58:07.027378+0000","last_clean":"2023-10-16T19:58:07.027378+0000","last_became_active":"2023-10-16T19:58:05.597025+0000","last_became_peered":"2023-10-16T19:58:05.597025+0000","last_unstale":"2023-10-16T19:58:07.027378+0000","last_undegraded":"2023-10-16T19:58:07.027378+0000","last_fullsized":"2023-10-16T19:58:07.027378+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:57:53.793532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:07.027896+0000","last_change":"2023-10-16T19:58:05.606250+0000","last_active":"2023-10-16T19:58:07.027896+0000","last_peered":"2023-10-16T19:58:07.027896+0000","last_clean":"2023-10-16T19:58:07.027896+0000","last_became_active":"2023-10-16T19:58:05.605969+0000","last_became_peered":"2023-10-16T19:58:05.605969+0000","last_unstale":"2023-10-16T19:58:07.027896+0000","last_undegraded":"2023-10-16T19:58:07.027896+0000","last_fullsized":"2023-10-16T19:58:07.027896+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:25:36.321203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:06.908178+0000","last_change":"2023-10-16T19:58:05.601472+0000","last_active":"2023-10-16T19:58:06.908178+0000","last_peered":"2023-10-16T19:58:06.908178+0000","last_clean":"2023-10-16T19:58:06.908178+0000","last_became_active":"2023-10-16T19:58:05.601072+0000","last_became_peered":"2023-10-16T19:58:05.601072+0000","last_unstale":"2023-10-16T19:58:06.908178+0000","last_undegraded":"2023-10-16T19:58:06.908178+0000","last_fullsized":"2023-10-16T19:58:06.908178+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:16:44.802078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:06.907743+0000","last_change":"2023-10-16T19:58:05.603410+0000","last_active":"2023-10-16T19:58:06.907743+0000","last_peered":"2023-10-16T19:58:06.907743+0000","last_clean":"2023-10-16T19:58:06.907743+0000","last_became_active":"2023-10-16T19:58:05.603003+0000","last_became_peered":"2023-10-16T19:58:05.603003+0000","last_unstale":"2023-10-16T19:58:06.907743+0000","last_undegraded":"2023-10-16T19:58:06.907743+0000","last_fullsized":"2023-10-16T19:58:06.907743+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:45:35.921925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:06.599174+0000","last_change":"2023-10-16T19:58:05.603205+0000","last_active":"2023-10-16T19:58:06.599174+0000","last_peered":"2023-10-16T19:58:06.599174+0000","last_clean":"2023-10-16T19:58:06.599174+0000","last_became_active":"2023-10-16T19:58:05.602976+0000","last_became_peered":"2023-10-16T19:58:05.602976+0000","last_unstale":"2023-10-16T19:58:06.599174+0000","last_undegraded":"2023-10-16T19:58:06.599174+0000","last_fullsized":"2023-10-16T19:58:06.599174+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:45:26.140866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:07.027617+0000","last_change":"2023-10-16T19:58:05.602575+0000","last_active":"2023-10-16T19:58:07.027617+0000","last_peered":"2023-10-16T19:58:07.027617+0000","last_clean":"2023-10-16T19:58:07.027617+0000","last_became_active":"2023-10-16T19:58:05.601803+0000","last_became_peered":"2023-10-16T19:58:05.601803+0000","last_unstale":"2023-10-16T19:58:07.027617+0000","last_undegraded":"2023-10-16T19:58:07.027617+0000","last_fullsized":"2023-10-16T19:58:07.027617+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:16:05.497063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:08.048629+0000","last_change":"2023-10-16T19:58:05.605393+0000","last_active":"2023-10-16T19:58:08.048629+0000","last_peered":"2023-10-16T19:58:08.048629+0000","last_clean":"2023-10-16T19:58:08.048629+0000","last_became_active":"2023-10-16T19:58:05.605148+0000","last_became_peered":"2023-10-16T19:58:05.605148+0000","last_unstale":"2023-10-16T19:58:08.048629+0000","last_undegraded":"2023-10-16T19:58:08.048629+0000","last_fullsized":"2023-10-16T19:58:08.048629+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:22:44.892357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:08.048675+0000","last_change":"2023-10-16T19:58:05.605461+0000","last_active":"2023-10-16T19:58:08.048675+0000","last_peered":"2023-10-16T19:58:08.048675+0000","last_clean":"2023-10-16T19:58:08.048675+0000","last_became_active":"2023-10-16T19:58:05.605200+0000","last_became_peered":"2023-10-16T19:58:05.605200+0000","last_unstale":"2023-10-16T19:58:08.048675+0000","last_undegraded":"2023-10-16T19:58:08.048675+0000","last_fullsized":"2023-10-16T19:58:08.048675+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:47:35.655272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:06.600844+0000","last_change":"2023-10-16T19:58:05.602243+0000","last_active":"2023-10-16T19:58:06.600844+0000","last_peered":"2023-10-16T19:58:06.600844+0000","last_clean":"2023-10-16T19:58:06.600844+0000","last_became_active":"2023-10-16T19:58:05.601910+0000","last_became_peered":"2023-10-16T19:58:05.601910+0000","last_unstale":"2023-10-16T19:58:06.600844+0000","last_undegraded":"2023-10-16T19:58:06.600844+0000","last_fullsized":"2023-10-16T19:58:06.600844+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:07:11.937484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:06.907450+0000","last_change":"2023-10-16T19:58:05.600582+0000","last_active":"2023-10-16T19:58:06.907450+0000","last_peered":"2023-10-16T19:58:06.907450+0000","last_clean":"2023-10-16T19:58:06.907450+0000","last_became_active":"2023-10-16T19:58:05.600356+0000","last_became_peered":"2023-10-16T19:58:05.600356+0000","last_unstale":"2023-10-16T19:58:06.907450+0000","last_undegraded":"2023-10-16T19:58:06.907450+0000","last_fullsized":"2023-10-16T19:58:06.907450+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:26:33.490004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:08.048860+0000","last_change":"2023-10-16T19:58:05.610325+0000","last_active":"2023-10-16T19:58:08.048860+0000","last_peered":"2023-10-16T19:58:08.048860+0000","last_clean":"2023-10-16T19:58:08.048860+0000","last_became_active":"2023-10-16T19:58:05.609979+0000","last_became_peered":"2023-10-16T19:58:05.609979+0000","last_unstale":"2023-10-16T19:58:08.048860+0000","last_undegraded":"2023-10-16T19:58:08.048860+0000","last_fullsized":"2023-10-16T19:58:08.048860+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:30:57.464645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:06.907718+0000","last_change":"2023-10-16T19:58:05.602076+0000","last_active":"2023-10-16T19:58:06.907718+0000","last_peered":"2023-10-16T19:58:06.907718+0000","last_clean":"2023-10-16T19:58:06.907718+0000","last_became_active":"2023-10-16T19:58:05.600490+0000","last_became_peered":"2023-10-16T19:58:05.600490+0000","last_unstale":"2023-10-16T19:58:06.907718+0000","last_undegraded":"2023-10-16T19:58:06.907718+0000","last_fullsized":"2023-10-16T19:58:06.907718+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:45:35.921925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:06.599132+0000","last_change":"2023-10-16T19:58:05.600961+0000","last_active":"2023-10-16T19:58:06.599132+0000","last_peered":"2023-10-16T19:58:06.599132+0000","last_clean":"2023-10-16T19:58:06.599132+0000","last_became_active":"2023-10-16T19:58:05.600614+0000","last_became_peered":"2023-10-16T19:58:05.600614+0000","last_unstale":"2023-10-16T19:58:06.599132+0000","last_undegraded":"2023-10-16T19:58:06.599132+0000","last_fullsized":"2023-10-16T19:58:06.599132+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:46:16.568366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:07.028165+0000","last_change":"2023-10-16T19:58:05.602410+0000","last_active":"2023-10-16T19:58:07.028165+0000","last_peered":"2023-10-16T19:58:07.028165+0000","last_clean":"2023-10-16T19:58:07.028165+0000","last_became_active":"2023-10-16T19:58:05.601569+0000","last_became_peered":"2023-10-16T19:58:05.601569+0000","last_unstale":"2023-10-16T19:58:07.028165+0000","last_undegraded":"2023-10-16T19:58:07.028165+0000","last_fullsized":"2023-10-16T19:58:07.028165+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:15:53.489096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:06.908030+0000","last_change":"2023-10-16T19:58:05.599789+0000","last_active":"2023-10-16T19:58:06.908030+0000","last_peered":"2023-10-16T19:58:06.908030+0000","last_clean":"2023-10-16T19:58:06.908030+0000","last_became_active":"2023-10-16T19:58:05.599026+0000","last_became_peered":"2023-10-16T19:58:05.599026+0000","last_unstale":"2023-10-16T19:58:06.908030+0000","last_undegraded":"2023-10-16T19:58:06.908030+0000","last_fullsized":"2023-10-16T19:58:06.908030+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:04:03.788625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:08.048995+0000","last_change":"2023-10-16T19:58:05.610219+0000","last_active":"2023-10-16T19:58:08.048995+0000","last_peered":"2023-10-16T19:58:08.048995+0000","last_clean":"2023-10-16T19:58:08.048995+0000","last_became_active":"2023-10-16T19:58:05.609613+0000","last_became_peered":"2023-10-16T19:58:05.609613+0000","last_unstale":"2023-10-16T19:58:08.048995+0000","last_undegraded":"2023-10-16T19:58:08.048995+0000","last_fullsized":"2023-10-16T19:58:08.048995+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:03:27.064265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:08.048854+0000","last_change":"2023-10-16T19:58:05.608855+0000","last_active":"2023-10-16T19:58:08.048854+0000","last_peered":"2023-10-16T19:58:08.048854+0000","last_clean":"2023-10-16T19:58:08.048854+0000","last_became_active":"2023-10-16T19:58:05.608184+0000","last_became_peered":"2023-10-16T19:58:05.608184+0000","last_unstale":"2023-10-16T19:58:08.048854+0000","last_undegraded":"2023-10-16T19:58:08.048854+0000","last_fullsized":"2023-10-16T19:58:08.048854+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:15:51.793903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:07.027692+0000","last_change":"2023-10-16T19:58:05.601271+0000","last_active":"2023-10-16T19:58:07.027692+0000","last_peered":"2023-10-16T19:58:07.027692+0000","last_clean":"2023-10-16T19:58:07.027692+0000","last_became_active":"2023-10-16T19:58:05.600977+0000","last_became_peered":"2023-10-16T19:58:05.600977+0000","last_unstale":"2023-10-16T19:58:07.027692+0000","last_undegraded":"2023-10-16T19:58:07.027692+0000","last_fullsized":"2023-10-16T19:58:07.027692+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:04:03.788625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:07.027493+0000","last_change":"2023-10-16T19:58:05.602564+0000","last_active":"2023-10-16T19:58:07.027493+0000","last_peered":"2023-10-16T19:58:07.027493+0000","last_clean":"2023-10-16T19:58:07.027493+0000","last_became_active":"2023-10-16T19:58:05.601866+0000","last_became_peered":"2023-10-16T19:58:05.601866+0000","last_unstale":"2023-10-16T19:58:07.027493+0000","last_undegraded":"2023-10-16T19:58:07.027493+0000","last_fullsized":"2023-10-16T19:58:07.027493+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:15:51.793903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:06.599266+0000","last_change":"2023-10-16T19:58:05.603764+0000","last_active":"2023-10-16T19:58:06.599266+0000","last_peered":"2023-10-16T19:58:06.599266+0000","last_clean":"2023-10-16T19:58:06.599266+0000","last_became_active":"2023-10-16T19:58:05.603536+0000","last_became_peered":"2023-10-16T19:58:05.603536+0000","last_unstale":"2023-10-16T19:58:06.599266+0000","last_undegraded":"2023-10-16T19:58:06.599266+0000","last_fullsized":"2023-10-16T19:58:06.599266+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:20:13.830601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:06.600643+0000","last_change":"2023-10-16T19:58:05.607035+0000","last_active":"2023-10-16T19:58:06.600643+0000","last_peered":"2023-10-16T19:58:06.600643+0000","last_clean":"2023-10-16T19:58:06.600643+0000","last_became_active":"2023-10-16T19:58:05.606725+0000","last_became_peered":"2023-10-16T19:58:05.606725+0000","last_unstale":"2023-10-16T19:58:06.600643+0000","last_undegraded":"2023-10-16T19:58:06.600643+0000","last_fullsized":"2023-10-16T19:58:06.600643+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:05:23.390163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:06.600926+0000","last_change":"2023-10-16T19:58:05.606076+0000","last_active":"2023-10-16T19:58:06.600926+0000","last_peered":"2023-10-16T19:58:06.600926+0000","last_clean":"2023-10-16T19:58:06.600926+0000","last_became_active":"2023-10-16T19:58:05.605335+0000","last_became_peered":"2023-10-16T19:58:05.605335+0000","last_unstale":"2023-10-16T19:58:06.600926+0000","last_undegraded":"2023-10-16T19:58:06.600926+0000","last_fullsized":"2023-10-16T19:58:06.600926+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:09:04.664112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:06.600504+0000","last_change":"2023-10-16T19:58:05.609361+0000","last_active":"2023-10-16T19:58:06.600504+0000","last_peered":"2023-10-16T19:58:06.600504+0000","last_clean":"2023-10-16T19:58:06.600504+0000","last_became_active":"2023-10-16T19:58:05.609123+0000","last_became_peered":"2023-10-16T19:58:05.609123+0000","last_unstale":"2023-10-16T19:58:06.600504+0000","last_undegraded":"2023-10-16T19:58:06.600504+0000","last_fullsized":"2023-10-16T19:58:06.600504+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:29:55.757064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:06.907737+0000","last_change":"2023-10-16T19:58:05.599645+0000","last_active":"2023-10-16T19:58:06.907737+0000","last_peered":"2023-10-16T19:58:06.907737+0000","last_clean":"2023-10-16T19:58:06.907737+0000","last_became_active":"2023-10-16T19:58:05.599210+0000","last_became_peered":"2023-10-16T19:58:05.599210+0000","last_unstale":"2023-10-16T19:58:06.907737+0000","last_undegraded":"2023-10-16T19:58:06.907737+0000","last_fullsized":"2023-10-16T19:58:06.907737+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:47:35.655272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:06.907710+0000","last_change":"2023-10-16T19:58:05.608218+0000","last_active":"2023-10-16T19:58:06.907710+0000","last_peered":"2023-10-16T19:58:06.907710+0000","last_clean":"2023-10-16T19:58:06.907710+0000","last_became_active":"2023-10-16T19:58:05.608010+0000","last_became_peered":"2023-10-16T19:58:05.608010+0000","last_unstale":"2023-10-16T19:58:06.907710+0000","last_undegraded":"2023-10-16T19:58:06.907710+0000","last_fullsized":"2023-10-16T19:58:06.907710+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:10:06.943190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:07.027753+0000","last_change":"2023-10-16T19:58:05.607417+0000","last_active":"2023-10-16T19:58:07.027753+0000","last_peered":"2023-10-16T19:58:07.027753+0000","last_clean":"2023-10-16T19:58:07.027753+0000","last_became_active":"2023-10-16T19:58:05.607185+0000","last_became_peered":"2023-10-16T19:58:05.607185+0000","last_unstale":"2023-10-16T19:58:07.027753+0000","last_undegraded":"2023-10-16T19:58:07.027753+0000","last_fullsized":"2023-10-16T19:58:07.027753+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:03:27.064265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:06.907334+0000","last_change":"2023-10-16T19:58:05.606277+0000","last_active":"2023-10-16T19:58:06.907334+0000","last_peered":"2023-10-16T19:58:06.907334+0000","last_clean":"2023-10-16T19:58:06.907334+0000","last_became_active":"2023-10-16T19:58:05.606043+0000","last_became_peered":"2023-10-16T19:58:05.606043+0000","last_unstale":"2023-10-16T19:58:06.907334+0000","last_undegraded":"2023-10-16T19:58:06.907334+0000","last_fullsized":"2023-10-16T19:58:06.907334+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:09:04.664112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:06.907996+0000","last_change":"2023-10-16T19:58:05.607969+0000","last_active":"2023-10-16T19:58:06.907996+0000","last_peered":"2023-10-16T19:58:06.907996+0000","last_clean":"2023-10-16T19:58:06.907996+0000","last_became_active":"2023-10-16T19:58:05.607763+0000","last_became_peered":"2023-10-16T19:58:05.607763+0000","last_unstale":"2023-10-16T19:58:06.907996+0000","last_undegraded":"2023-10-16T19:58:06.907996+0000","last_fullsized":"2023-10-16T19:58:06.907996+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:30:57.464645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:06.601107+0000","last_change":"2023-10-16T19:58:05.604754+0000","last_active":"2023-10-16T19:58:06.601107+0000","last_peered":"2023-10-16T19:58:06.601107+0000","last_clean":"2023-10-16T19:58:06.601107+0000","last_became_active":"2023-10-16T19:58:05.604309+0000","last_became_peered":"2023-10-16T19:58:05.604309+0000","last_unstale":"2023-10-16T19:58:06.601107+0000","last_undegraded":"2023-10-16T19:58:06.601107+0000","last_fullsized":"2023-10-16T19:58:06.601107+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:26:33.490004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:08.048842+0000","last_change":"2023-10-16T19:58:05.606380+0000","last_active":"2023-10-16T19:58:08.048842+0000","last_peered":"2023-10-16T19:58:08.048842+0000","last_clean":"2023-10-16T19:58:08.048842+0000","last_became_active":"2023-10-16T19:58:05.606102+0000","last_became_peered":"2023-10-16T19:58:05.606102+0000","last_unstale":"2023-10-16T19:58:08.048842+0000","last_undegraded":"2023-10-16T19:58:08.048842+0000","last_fullsized":"2023-10-16T19:58:08.048842+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:04:03.788625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:07.027526+0000","last_change":"2023-10-16T19:58:05.600187+0000","last_active":"2023-10-16T19:58:07.027526+0000","last_peered":"2023-10-16T19:58:07.027526+0000","last_clean":"2023-10-16T19:58:07.027526+0000","last_became_active":"2023-10-16T19:58:05.599955+0000","last_became_peered":"2023-10-16T19:58:05.599955+0000","last_unstale":"2023-10-16T19:58:07.027526+0000","last_undegraded":"2023-10-16T19:58:07.027526+0000","last_fullsized":"2023-10-16T19:58:07.027526+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:05:23.390163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:08.049001+0000","last_change":"2023-10-16T19:58:05.609019+0000","last_active":"2023-10-16T19:58:08.049001+0000","last_peered":"2023-10-16T19:58:08.049001+0000","last_clean":"2023-10-16T19:58:08.049001+0000","last_became_active":"2023-10-16T19:58:05.608571+0000","last_became_peered":"2023-10-16T19:58:05.608571+0000","last_unstale":"2023-10-16T19:58:08.049001+0000","last_undegraded":"2023-10-16T19:58:08.049001+0000","last_fullsized":"2023-10-16T19:58:08.049001+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:17:36.021934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:06.600335+0000","last_change":"2023-10-16T19:58:05.609465+0000","last_active":"2023-10-16T19:58:06.600335+0000","last_peered":"2023-10-16T19:58:06.600335+0000","last_clean":"2023-10-16T19:58:06.600335+0000","last_became_active":"2023-10-16T19:58:05.609211+0000","last_became_peered":"2023-10-16T19:58:05.609211+0000","last_unstale":"2023-10-16T19:58:06.600335+0000","last_undegraded":"2023-10-16T19:58:06.600335+0000","last_fullsized":"2023-10-16T19:58:06.600335+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:05:23.390163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"32'4","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.904227+0000","last_change":"2023-10-16T19:58:04.587769+0000","last_active":"2023-10-16T19:58:05.904227+0000","last_peered":"2023-10-16T19:58:05.904227+0000","last_clean":"2023-10-16T19:58:05.904227+0000","last_became_active":"2023-10-16T19:58:04.587523+0000","last_became_peered":"2023-10-16T19:58:04.587523+0000","last_unstale":"2023-10-16T19:58:05.904227+0000","last_undegraded":"2023-10-16T19:58:05.904227+0000","last_fullsized":"2023-10-16T19:58:05.904227+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_clean_scrub_stamp":"2023-10-16T19:58:03.569082+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:20:12.826040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:07.027183+0000","last_change":"2023-10-16T19:58:05.598729+0000","last_active":"2023-10-16T19:58:07.027183+0000","last_peered":"2023-10-16T19:58:07.027183+0000","last_clean":"2023-10-16T19:58:07.027183+0000","last_became_active":"2023-10-16T19:58:05.598478+0000","last_became_peered":"2023-10-16T19:58:05.598478+0000","last_unstale":"2023-10-16T19:58:07.027183+0000","last_undegraded":"2023-10-16T19:58:07.027183+0000","last_fullsized":"2023-10-16T19:58:07.027183+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:36:40.381344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"32'1","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.902612+0000","last_change":"2023-10-16T19:58:04.589820+0000","last_active":"2023-10-16T19:58:05.902612+0000","last_peered":"2023-10-16T19:58:05.902612+0000","last_clean":"2023-10-16T19:58:05.902612+0000","last_became_active":"2023-10-16T19:58:04.589624+0000","last_became_peered":"2023-10-16T19:58:04.589624+0000","last_unstale":"2023-10-16T19:58:05.902612+0000","last_undegraded":"2023-10-16T19:58:05.902612+0000","last_fullsized":"2023-10-16T19:58:05.902612+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_clean_scrub_stamp":"2023-10-16T19:58:03.569082+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:50:59.901042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:06.600772+0000","last_change":"2023-10-16T19:58:05.603987+0000","last_active":"2023-10-16T19:58:06.600772+0000","last_peered":"2023-10-16T19:58:06.600772+0000","last_clean":"2023-10-16T19:58:06.600772+0000","last_became_active":"2023-10-16T19:58:05.603733+0000","last_became_peered":"2023-10-16T19:58:05.603733+0000","last_unstale":"2023-10-16T19:58:06.600772+0000","last_undegraded":"2023-10-16T19:58:06.600772+0000","last_fullsized":"2023-10-16T19:58:06.600772+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:29:55.757064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"32'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.900393+0000","last_change":"2023-10-16T19:58:04.587285+0000","last_active":"2023-10-16T19:58:05.900393+0000","last_peered":"2023-10-16T19:58:05.900393+0000","last_clean":"2023-10-16T19:58:05.900393+0000","last_became_active":"2023-10-16T19:58:04.587076+0000","last_became_peered":"2023-10-16T19:58:04.587076+0000","last_unstale":"2023-10-16T19:58:05.900393+0000","last_undegraded":"2023-10-16T19:58:05.900393+0000","last_fullsized":"2023-10-16T19:58:05.900393+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_clean_scrub_stamp":"2023-10-16T19:58:03.569082+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:05:22.385602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:06.907582+0000","last_change":"2023-10-16T19:58:05.603529+0000","last_active":"2023-10-16T19:58:06.907582+0000","last_peered":"2023-10-16T19:58:06.907582+0000","last_clean":"2023-10-16T19:58:06.907582+0000","last_became_active":"2023-10-16T19:58:05.603317+0000","last_became_peered":"2023-10-16T19:58:05.603317+0000","last_unstale":"2023-10-16T19:58:06.907582+0000","last_undegraded":"2023-10-16T19:58:06.907582+0000","last_fullsized":"2023-10-16T19:58:06.907582+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:57:59.985913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"32'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.900113+0000","last_change":"2023-10-16T19:58:04.581625+0000","last_active":"2023-10-16T19:58:05.900113+0000","last_peered":"2023-10-16T19:58:05.900113+0000","last_clean":"2023-10-16T19:58:05.900113+0000","last_became_active":"2023-10-16T19:58:04.580982+0000","last_became_peered":"2023-10-16T19:58:04.580982+0000","last_unstale":"2023-10-16T19:58:05.900113+0000","last_undegraded":"2023-10-16T19:58:05.900113+0000","last_fullsized":"2023-10-16T19:58:05.900113+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_clean_scrub_stamp":"2023-10-16T19:58:03.569082+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:10:41.518249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:08.048999+0000","last_change":"2023-10-16T19:58:05.609638+0000","last_active":"2023-10-16T19:58:08.048999+0000","last_peered":"2023-10-16T19:58:08.048999+0000","last_clean":"2023-10-16T19:58:08.048999+0000","last_became_active":"2023-10-16T19:58:05.609287+0000","last_became_peered":"2023-10-16T19:58:05.609287+0000","last_unstale":"2023-10-16T19:58:08.048999+0000","last_undegraded":"2023-10-16T19:58:08.048999+0000","last_fullsized":"2023-10-16T19:58:08.048999+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:16:44.802078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"32'1","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.903123+0000","last_change":"2023-10-16T19:58:04.592222+0000","last_active":"2023-10-16T19:58:05.903123+0000","last_peered":"2023-10-16T19:58:05.903123+0000","last_clean":"2023-10-16T19:58:05.903123+0000","last_became_active":"2023-10-16T19:58:04.591382+0000","last_became_peered":"2023-10-16T19:58:04.591382+0000","last_unstale":"2023-10-16T19:58:05.903123+0000","last_undegraded":"2023-10-16T19:58:05.903123+0000","last_fullsized":"2023-10-16T19:58:05.903123+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_clean_scrub_stamp":"2023-10-16T19:58:03.569082+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:43:50.906516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:06.907902+0000","last_change":"2023-10-16T19:58:05.606948+0000","last_active":"2023-10-16T19:58:06.907902+0000","last_peered":"2023-10-16T19:58:06.907902+0000","last_clean":"2023-10-16T19:58:06.907902+0000","last_became_active":"2023-10-16T19:58:05.606777+0000","last_became_peered":"2023-10-16T19:58:05.606777+0000","last_unstale":"2023-10-16T19:58:06.907902+0000","last_undegraded":"2023-10-16T19:58:06.907902+0000","last_fullsized":"2023-10-16T19:58:06.907902+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:16:05.497063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"32'1","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.903086+0000","last_change":"2023-10-16T19:58:04.584929+0000","last_active":"2023-10-16T19:58:05.903086+0000","last_peered":"2023-10-16T19:58:05.903086+0000","last_clean":"2023-10-16T19:58:05.903086+0000","last_became_active":"2023-10-16T19:58:04.584702+0000","last_became_peered":"2023-10-16T19:58:04.584702+0000","last_unstale":"2023-10-16T19:58:05.903086+0000","last_undegraded":"2023-10-16T19:58:05.903086+0000","last_fullsized":"2023-10-16T19:58:05.903086+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_clean_scrub_stamp":"2023-10-16T19:58:03.569082+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:04:37.242998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:06.601149+0000","last_change":"2023-10-16T19:58:05.601585+0000","last_active":"2023-10-16T19:58:06.601149+0000","last_peered":"2023-10-16T19:58:06.601149+0000","last_clean":"2023-10-16T19:58:06.601149+0000","last_became_active":"2023-10-16T19:58:05.600813+0000","last_became_peered":"2023-10-16T19:58:05.600813+0000","last_unstale":"2023-10-16T19:58:06.601149+0000","last_undegraded":"2023-10-16T19:58:06.601149+0000","last_fullsized":"2023-10-16T19:58:06.601149+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:42:51.289673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.900155+0000","last_change":"2023-10-16T19:58:04.585183+0000","last_active":"2023-10-16T19:58:05.900155+0000","last_peered":"2023-10-16T19:58:05.900155+0000","last_clean":"2023-10-16T19:58:05.900155+0000","last_became_active":"2023-10-16T19:58:04.584173+0000","last_became_peered":"2023-10-16T19:58:04.584173+0000","last_unstale":"2023-10-16T19:58:05.900155+0000","last_undegraded":"2023-10-16T19:58:05.900155+0000","last_fullsized":"2023-10-16T19:58:05.900155+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_clean_scrub_stamp":"2023-10-16T19:58:03.569082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:09:03.659551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:06.907620+0000","last_change":"2023-10-16T19:58:05.601649+0000","last_active":"2023-10-16T19:58:06.907620+0000","last_peered":"2023-10-16T19:58:06.907620+0000","last_clean":"2023-10-16T19:58:06.907620+0000","last_became_active":"2023-10-16T19:58:05.601416+0000","last_became_peered":"2023-10-16T19:58:05.601416+0000","last_unstale":"2023-10-16T19:58:06.907620+0000","last_undegraded":"2023-10-16T19:58:06.907620+0000","last_fullsized":"2023-10-16T19:58:06.907620+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:41:58.386070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.903214+0000","last_change":"2023-10-16T19:58:04.590433+0000","last_active":"2023-10-16T19:58:05.903214+0000","last_peered":"2023-10-16T19:58:05.903214+0000","last_clean":"2023-10-16T19:58:05.903214+0000","last_became_active":"2023-10-16T19:58:04.589891+0000","last_became_peered":"2023-10-16T19:58:04.589891+0000","last_unstale":"2023-10-16T19:58:05.903214+0000","last_undegraded":"2023-10-16T19:58:05.903214+0000","last_fullsized":"2023-10-16T19:58:05.903214+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_clean_scrub_stamp":"2023-10-16T19:58:03.569082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:31:31.566550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:06.908068+0000","last_change":"2023-10-16T19:58:05.603341+0000","last_active":"2023-10-16T19:58:06.908068+0000","last_peered":"2023-10-16T19:58:06.908068+0000","last_clean":"2023-10-16T19:58:06.908068+0000","last_became_active":"2023-10-16T19:58:05.603042+0000","last_became_peered":"2023-10-16T19:58:05.603042+0000","last_unstale":"2023-10-16T19:58:06.908068+0000","last_undegraded":"2023-10-16T19:58:06.908068+0000","last_fullsized":"2023-10-16T19:58:06.908068+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:03:27.064265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.900339+0000","last_change":"2023-10-16T19:58:04.589480+0000","last_active":"2023-10-16T19:58:05.900339+0000","last_peered":"2023-10-16T19:58:05.900339+0000","last_clean":"2023-10-16T19:58:05.900339+0000","last_became_active":"2023-10-16T19:58:04.589253+0000","last_became_peered":"2023-10-16T19:58:04.589253+0000","last_unstale":"2023-10-16T19:58:05.900339+0000","last_undegraded":"2023-10-16T19:58:05.900339+0000","last_fullsized":"2023-10-16T19:58:05.900339+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_clean_scrub_stamp":"2023-10-16T19:58:03.569082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:45:34.917364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:07.028095+0000","last_change":"2023-10-16T19:58:05.602710+0000","last_active":"2023-10-16T19:58:07.028095+0000","last_peered":"2023-10-16T19:58:07.028095+0000","last_clean":"2023-10-16T19:58:07.028095+0000","last_became_active":"2023-10-16T19:58:05.602336+0000","last_became_peered":"2023-10-16T19:58:05.602336+0000","last_unstale":"2023-10-16T19:58:07.028095+0000","last_undegraded":"2023-10-16T19:58:07.028095+0000","last_fullsized":"2023-10-16T19:58:07.028095+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:23:18.475974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.902719+0000","last_change":"2023-10-16T19:58:04.586281+0000","last_active":"2023-10-16T19:58:05.902719+0000","last_peered":"2023-10-16T19:58:05.902719+0000","last_clean":"2023-10-16T19:58:05.902719+0000","last_became_active":"2023-10-16T19:58:04.586047+0000","last_became_peered":"2023-10-16T19:58:04.586047+0000","last_unstale":"2023-10-16T19:58:05.902719+0000","last_undegraded":"2023-10-16T19:58:05.902719+0000","last_fullsized":"2023-10-16T19:58:05.902719+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_clean_scrub_stamp":"2023-10-16T19:58:03.569082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:31:31.566550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:07.027615+0000","last_change":"2023-10-16T19:58:05.606519+0000","last_active":"2023-10-16T19:58:07.027615+0000","last_peered":"2023-10-16T19:58:07.027615+0000","last_clean":"2023-10-16T19:58:07.027615+0000","last_became_active":"2023-10-16T19:58:05.606148+0000","last_became_peered":"2023-10-16T19:58:05.606148+0000","last_unstale":"2023-10-16T19:58:07.027615+0000","last_undegraded":"2023-10-16T19:58:07.027615+0000","last_fullsized":"2023-10-16T19:58:07.027615+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:30:57.464645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"32'3","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.903980+0000","last_change":"2023-10-16T19:58:04.589426+0000","last_active":"2023-10-16T19:58:05.903980+0000","last_peered":"2023-10-16T19:58:05.903980+0000","last_clean":"2023-10-16T19:58:05.903980+0000","last_became_active":"2023-10-16T19:58:04.589139+0000","last_became_peered":"2023-10-16T19:58:04.589139+0000","last_unstale":"2023-10-16T19:58:05.903980+0000","last_undegraded":"2023-10-16T19:58:05.903980+0000","last_fullsized":"2023-10-16T19:58:05.903980+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_clean_scrub_stamp":"2023-10-16T19:58:03.569082+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:55:48.953087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:06.907817+0000","last_change":"2023-10-16T19:58:05.601316+0000","last_active":"2023-10-16T19:58:06.907817+0000","last_peered":"2023-10-16T19:58:06.907817+0000","last_clean":"2023-10-16T19:58:06.907817+0000","last_became_active":"2023-10-16T19:58:05.600598+0000","last_became_peered":"2023-10-16T19:58:05.600598+0000","last_unstale":"2023-10-16T19:58:06.907817+0000","last_undegraded":"2023-10-16T19:58:06.907817+0000","last_fullsized":"2023-10-16T19:58:06.907817+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:22:44.892357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"32'6","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.900175+0000","last_change":"2023-10-16T19:58:04.585306+0000","last_active":"2023-10-16T19:58:05.900175+0000","last_peered":"2023-10-16T19:58:05.900175+0000","last_clean":"2023-10-16T19:58:05.900175+0000","last_became_active":"2023-10-16T19:58:04.584588+0000","last_became_peered":"2023-10-16T19:58:04.584588+0000","last_unstale":"2023-10-16T19:58:05.900175+0000","last_undegraded":"2023-10-16T19:58:05.900175+0000","last_fullsized":"2023-10-16T19:58:05.900175+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_clean_scrub_stamp":"2023-10-16T19:58:03.569082+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:26:32.485443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:06.907587+0000","last_change":"2023-10-16T19:58:05.602640+0000","last_active":"2023-10-16T19:58:06.907587+0000","last_peered":"2023-10-16T19:58:06.907587+0000","last_clean":"2023-10-16T19:58:06.907587+0000","last_became_active":"2023-10-16T19:58:05.602386+0000","last_became_peered":"2023-10-16T19:58:05.602386+0000","last_unstale":"2023-10-16T19:58:06.907587+0000","last_undegraded":"2023-10-16T19:58:06.907587+0000","last_fullsized":"2023-10-16T19:58:06.907587+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:24:38.118997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"32'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.903229+0000","last_change":"2023-10-16T19:58:04.586869+0000","last_active":"2023-10-16T19:58:05.903229+0000","last_peered":"2023-10-16T19:58:05.903229+0000","last_clean":"2023-10-16T19:58:05.903229+0000","last_became_active":"2023-10-16T19:58:04.586290+0000","last_became_peered":"2023-10-16T19:58:04.586290+0000","last_unstale":"2023-10-16T19:58:05.903229+0000","last_undegraded":"2023-10-16T19:58:05.903229+0000","last_fullsized":"2023-10-16T19:58:05.903229+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_clean_scrub_stamp":"2023-10-16T19:58:03.569082+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:36:39.376783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:07.027826+0000","last_change":"2023-10-16T19:58:05.606176+0000","last_active":"2023-10-16T19:58:07.027826+0000","last_peered":"2023-10-16T19:58:07.027826+0000","last_clean":"2023-10-16T19:58:07.027826+0000","last_became_active":"2023-10-16T19:58:05.605962+0000","last_became_peered":"2023-10-16T19:58:05.605962+0000","last_unstale":"2023-10-16T19:58:07.027826+0000","last_undegraded":"2023-10-16T19:58:07.027826+0000","last_fullsized":"2023-10-16T19:58:07.027826+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:17:36.021934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.900285+0000","last_change":"2023-10-16T19:58:04.587764+0000","last_active":"2023-10-16T19:58:05.900285+0000","last_peered":"2023-10-16T19:58:05.900285+0000","last_clean":"2023-10-16T19:58:05.900285+0000","last_became_active":"2023-10-16T19:58:04.587531+0000","last_became_peered":"2023-10-16T19:58:04.587531+0000","last_unstale":"2023-10-16T19:58:05.900285+0000","last_undegraded":"2023-10-16T19:58:05.900285+0000","last_fullsized":"2023-10-16T19:58:05.900285+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_clean_scrub_stamp":"2023-10-16T19:58:03.569082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:43:31.501292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:08.048860+0000","last_change":"2023-10-16T19:58:05.608149+0000","last_active":"2023-10-16T19:58:08.048860+0000","last_peered":"2023-10-16T19:58:08.048860+0000","last_clean":"2023-10-16T19:58:08.048860+0000","last_became_active":"2023-10-16T19:58:05.607449+0000","last_became_peered":"2023-10-16T19:58:05.607449+0000","last_unstale":"2023-10-16T19:58:08.048860+0000","last_undegraded":"2023-10-16T19:58:08.048860+0000","last_fullsized":"2023-10-16T19:58:08.048860+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:16:05.497063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.900269+0000","last_change":"2023-10-16T19:58:04.588496+0000","last_active":"2023-10-16T19:58:05.900269+0000","last_peered":"2023-10-16T19:58:05.900269+0000","last_clean":"2023-10-16T19:58:05.900269+0000","last_became_active":"2023-10-16T19:58:04.588305+0000","last_became_peered":"2023-10-16T19:58:04.588305+0000","last_unstale":"2023-10-16T19:58:05.900269+0000","last_undegraded":"2023-10-16T19:58:05.900269+0000","last_fullsized":"2023-10-16T19:58:05.900269+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_clean_scrub_stamp":"2023-10-16T19:58:03.569082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:29:54.752503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:07.027380+0000","last_change":"2023-10-16T19:58:05.599594+0000","last_active":"2023-10-16T19:58:07.027380+0000","last_peered":"2023-10-16T19:58:07.027380+0000","last_clean":"2023-10-16T19:58:07.027380+0000","last_became_active":"2023-10-16T19:58:05.599356+0000","last_became_peered":"2023-10-16T19:58:05.599356+0000","last_unstale":"2023-10-16T19:58:07.027380+0000","last_undegraded":"2023-10-16T19:58:07.027380+0000","last_fullsized":"2023-10-16T19:58:07.027380+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:55:49.957648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"32'8","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.900249+0000","last_change":"2023-10-16T19:58:04.580974+0000","last_active":"2023-10-16T19:58:05.900249+0000","last_peered":"2023-10-16T19:58:05.900249+0000","last_clean":"2023-10-16T19:58:05.900249+0000","last_became_active":"2023-10-16T19:58:04.580648+0000","last_became_peered":"2023-10-16T19:58:04.580648+0000","last_unstale":"2023-10-16T19:58:05.900249+0000","last_undegraded":"2023-10-16T19:58:05.900249+0000","last_fullsized":"2023-10-16T19:58:05.900249+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_clean_scrub_stamp":"2023-10-16T19:58:03.569082+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:26:45.146069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:06.601286+0000","last_change":"2023-10-16T19:58:05.600582+0000","last_active":"2023-10-16T19:58:06.601286+0000","last_peered":"2023-10-16T19:58:06.601286+0000","last_clean":"2023-10-16T19:58:06.601286+0000","last_became_active":"2023-10-16T19:58:05.600333+0000","last_became_peered":"2023-10-16T19:58:05.600333+0000","last_unstale":"2023-10-16T19:58:06.601286+0000","last_undegraded":"2023-10-16T19:58:06.601286+0000","last_fullsized":"2023-10-16T19:58:06.601286+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:57:59.985913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"32'1","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.900190+0000","last_change":"2023-10-16T19:58:04.587935+0000","last_active":"2023-10-16T19:58:05.900190+0000","last_peered":"2023-10-16T19:58:05.900190+0000","last_clean":"2023-10-16T19:58:05.900190+0000","last_became_active":"2023-10-16T19:58:04.587576+0000","last_became_peered":"2023-10-16T19:58:04.587576+0000","last_unstale":"2023-10-16T19:58:05.900190+0000","last_undegraded":"2023-10-16T19:58:05.900190+0000","last_fullsized":"2023-10-16T19:58:05.900190+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_clean_scrub_stamp":"2023-10-16T19:58:03.569082+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:05:22.385602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:06.907877+0000","last_change":"2023-10-16T19:58:05.599461+0000","last_active":"2023-10-16T19:58:06.907877+0000","last_peered":"2023-10-16T19:58:06.907877+0000","last_clean":"2023-10-16T19:58:06.907877+0000","last_became_active":"2023-10-16T19:58:05.598861+0000","last_became_peered":"2023-10-16T19:58:05.598861+0000","last_unstale":"2023-10-16T19:58:06.907877+0000","last_undegraded":"2023-10-16T19:58:06.907877+0000","last_fullsized":"2023-10-16T19:58:06.907877+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:15:51.793903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"32'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.903256+0000","last_change":"2023-10-16T19:58:04.586713+0000","last_active":"2023-10-16T19:58:05.903256+0000","last_peered":"2023-10-16T19:58:05.903256+0000","last_clean":"2023-10-16T19:58:05.903256+0000","last_became_active":"2023-10-16T19:58:04.585973+0000","last_became_peered":"2023-10-16T19:58:04.585973+0000","last_unstale":"2023-10-16T19:58:05.903256+0000","last_undegraded":"2023-10-16T19:58:05.903256+0000","last_fullsized":"2023-10-16T19:58:05.903256+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_clean_scrub_stamp":"2023-10-16T19:58:03.569082+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:55:48.953087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:06.907571+0000","last_change":"2023-10-16T19:58:05.606948+0000","last_active":"2023-10-16T19:58:06.907571+0000","last_peered":"2023-10-16T19:58:06.907571+0000","last_clean":"2023-10-16T19:58:06.907571+0000","last_became_active":"2023-10-16T19:58:05.606722+0000","last_became_peered":"2023-10-16T19:58:05.606722+0000","last_unstale":"2023-10-16T19:58:06.907571+0000","last_undegraded":"2023-10-16T19:58:06.907571+0000","last_fullsized":"2023-10-16T19:58:06.907571+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:42:51.289673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"32'1","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.903176+0000","last_change":"2023-10-16T19:58:04.587531+0000","last_active":"2023-10-16T19:58:05.903176+0000","last_peered":"2023-10-16T19:58:05.903176+0000","last_clean":"2023-10-16T19:58:05.903176+0000","last_became_active":"2023-10-16T19:58:04.586934+0000","last_became_peered":"2023-10-16T19:58:04.586934+0000","last_unstale":"2023-10-16T19:58:05.903176+0000","last_undegraded":"2023-10-16T19:58:05.903176+0000","last_fullsized":"2023-10-16T19:58:05.903176+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_clean_scrub_stamp":"2023-10-16T19:58:03.569082+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:50:59.901042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:06.599160+0000","last_change":"2023-10-16T19:58:05.607501+0000","last_active":"2023-10-16T19:58:06.599160+0000","last_peered":"2023-10-16T19:58:06.599160+0000","last_clean":"2023-10-16T19:58:06.599160+0000","last_became_active":"2023-10-16T19:58:05.607269+0000","last_became_peered":"2023-10-16T19:58:05.607269+0000","last_unstale":"2023-10-16T19:58:06.599160+0000","last_undegraded":"2023-10-16T19:58:06.599160+0000","last_fullsized":"2023-10-16T19:58:06.599160+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:43:51.911077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.903109+0000","last_change":"2023-10-16T19:58:04.592403+0000","last_active":"2023-10-16T19:58:05.903109+0000","last_peered":"2023-10-16T19:58:05.903109+0000","last_clean":"2023-10-16T19:58:05.903109+0000","last_became_active":"2023-10-16T19:58:04.591967+0000","last_became_peered":"2023-10-16T19:58:04.591967+0000","last_unstale":"2023-10-16T19:58:05.903109+0000","last_undegraded":"2023-10-16T19:58:05.903109+0000","last_fullsized":"2023-10-16T19:58:05.903109+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_clean_scrub_stamp":"2023-10-16T19:58:03.569082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:46:15.563804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:06.599199+0000","last_change":"2023-10-16T19:58:05.600386+0000","last_active":"2023-10-16T19:58:06.599199+0000","last_peered":"2023-10-16T19:58:06.599199+0000","last_clean":"2023-10-16T19:58:06.599199+0000","last_became_active":"2023-10-16T19:58:05.600081+0000","last_became_peered":"2023-10-16T19:58:05.600081+0000","last_unstale":"2023-10-16T19:58:06.599199+0000","last_undegraded":"2023-10-16T19:58:06.599199+0000","last_fullsized":"2023-10-16T19:58:06.599199+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:11:36.806952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"32'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.902674+0000","last_change":"2023-10-16T19:58:04.588001+0000","last_active":"2023-10-16T19:58:05.902674+0000","last_peered":"2023-10-16T19:58:05.902674+0000","last_clean":"2023-10-16T19:58:05.902674+0000","last_became_active":"2023-10-16T19:58:04.587629+0000","last_became_peered":"2023-10-16T19:58:04.587629+0000","last_unstale":"2023-10-16T19:58:05.902674+0000","last_undegraded":"2023-10-16T19:58:05.902674+0000","last_fullsized":"2023-10-16T19:58:05.902674+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_clean_scrub_stamp":"2023-10-16T19:58:03.569082+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:57:52.788971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:06.599279+0000","last_change":"2023-10-16T19:58:05.607547+0000","last_active":"2023-10-16T19:58:06.599279+0000","last_peered":"2023-10-16T19:58:06.599279+0000","last_clean":"2023-10-16T19:58:06.599279+0000","last_became_active":"2023-10-16T19:58:05.607311+0000","last_became_peered":"2023-10-16T19:58:05.607311+0000","last_unstale":"2023-10-16T19:58:06.599279+0000","last_undegraded":"2023-10-16T19:58:06.599279+0000","last_fullsized":"2023-10-16T19:58:06.599279+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:04:38.247560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.904154+0000","last_change":"2023-10-16T19:58:04.583596+0000","last_active":"2023-10-16T19:58:05.904154+0000","last_peered":"2023-10-16T19:58:05.904154+0000","last_clean":"2023-10-16T19:58:05.904154+0000","last_became_active":"2023-10-16T19:58:04.583346+0000","last_became_peered":"2023-10-16T19:58:04.583346+0000","last_unstale":"2023-10-16T19:58:05.904154+0000","last_undegraded":"2023-10-16T19:58:05.904154+0000","last_fullsized":"2023-10-16T19:58:05.904154+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_clean_scrub_stamp":"2023-10-16T19:58:03.569082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:08:50.287071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:06.599374+0000","last_change":"2023-10-16T19:58:05.605758+0000","last_active":"2023-10-16T19:58:06.599374+0000","last_peered":"2023-10-16T19:58:06.599374+0000","last_clean":"2023-10-16T19:58:06.599374+0000","last_became_active":"2023-10-16T19:58:05.605529+0000","last_became_peered":"2023-10-16T19:58:05.605529+0000","last_unstale":"2023-10-16T19:58:06.599374+0000","last_undegraded":"2023-10-16T19:58:06.599374+0000","last_fullsized":"2023-10-16T19:58:06.599374+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:56:22.040826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.903243+0000","last_change":"2023-10-16T19:58:04.590215+0000","last_active":"2023-10-16T19:58:05.903243+0000","last_peered":"2023-10-16T19:58:05.903243+0000","last_clean":"2023-10-16T19:58:05.903243+0000","last_became_active":"2023-10-16T19:58:04.589542+0000","last_became_peered":"2023-10-16T19:58:04.589542+0000","last_unstale":"2023-10-16T19:58:05.903243+0000","last_undegraded":"2023-10-16T19:58:05.903243+0000","last_fullsized":"2023-10-16T19:58:05.903243+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_clean_scrub_stamp":"2023-10-16T19:58:03.569082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:57:52.788971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:08.049050+0000","last_change":"2023-10-16T19:58:05.608889+0000","last_active":"2023-10-16T19:58:08.049050+0000","last_peered":"2023-10-16T19:58:08.049050+0000","last_clean":"2023-10-16T19:58:08.049050+0000","last_became_active":"2023-10-16T19:58:05.608517+0000","last_became_peered":"2023-10-16T19:58:05.608517+0000","last_unstale":"2023-10-16T19:58:08.049050+0000","last_undegraded":"2023-10-16T19:58:08.049050+0000","last_fullsized":"2023-10-16T19:58:08.049050+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:25:36.321203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.904109+0000","last_change":"2023-10-16T19:58:04.587619+0000","last_active":"2023-10-16T19:58:05.904109+0000","last_peered":"2023-10-16T19:58:05.904109+0000","last_clean":"2023-10-16T19:58:05.904109+0000","last_became_active":"2023-10-16T19:58:04.587332+0000","last_became_peered":"2023-10-16T19:58:04.587332+0000","last_unstale":"2023-10-16T19:58:05.904109+0000","last_undegraded":"2023-10-16T19:58:05.904109+0000","last_fullsized":"2023-10-16T19:58:05.904109+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_clean_scrub_stamp":"2023-10-16T19:58:03.569082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:09:03.659551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:06.599401+0000","last_change":"2023-10-16T19:58:05.600830+0000","last_active":"2023-10-16T19:58:06.599401+0000","last_peered":"2023-10-16T19:58:06.599401+0000","last_clean":"2023-10-16T19:58:06.599401+0000","last_became_active":"2023-10-16T19:58:05.600305+0000","last_became_peered":"2023-10-16T19:58:05.600305+0000","last_unstale":"2023-10-16T19:58:06.599401+0000","last_undegraded":"2023-10-16T19:58:06.599401+0000","last_fullsized":"2023-10-16T19:58:06.599401+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:43:32.505853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"32'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.900264+0000","last_change":"2023-10-16T19:58:04.582724+0000","last_active":"2023-10-16T19:58:05.900264+0000","last_peered":"2023-10-16T19:58:05.900264+0000","last_clean":"2023-10-16T19:58:05.900264+0000","last_became_active":"2023-10-16T19:58:04.582012+0000","last_became_peered":"2023-10-16T19:58:04.582012+0000","last_unstale":"2023-10-16T19:58:05.900264+0000","last_undegraded":"2023-10-16T19:58:05.900264+0000","last_fullsized":"2023-10-16T19:58:05.900264+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_clean_scrub_stamp":"2023-10-16T19:58:03.569082+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:55:48.953087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:06.908225+0000","last_change":"2023-10-16T19:58:05.602250+0000","last_active":"2023-10-16T19:58:06.908225+0000","last_peered":"2023-10-16T19:58:06.908225+0000","last_clean":"2023-10-16T19:58:06.908225+0000","last_became_active":"2023-10-16T19:58:05.600830+0000","last_became_peered":"2023-10-16T19:58:05.600830+0000","last_unstale":"2023-10-16T19:58:06.908225+0000","last_undegraded":"2023-10-16T19:58:06.908225+0000","last_fullsized":"2023-10-16T19:58:06.908225+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:17:36.021934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"33'1","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:06.600649+0000","last_change":"2023-10-16T19:58:04.587844+0000","last_active":"2023-10-16T19:58:06.600649+0000","last_peered":"2023-10-16T19:58:06.600649+0000","last_clean":"2023-10-16T19:58:06.600649+0000","last_became_active":"2023-10-16T19:58:04.587329+0000","last_became_peered":"2023-10-16T19:58:04.587329+0000","last_unstale":"2023-10-16T19:58:06.600649+0000","last_undegraded":"2023-10-16T19:58:06.600649+0000","last_fullsized":"2023-10-16T19:58:06.600649+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_clean_scrub_stamp":"2023-10-16T19:58:03.569082+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:55:48.953087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:06.600449+0000","last_change":"2023-10-16T19:58:05.606214+0000","last_active":"2023-10-16T19:58:06.600449+0000","last_peered":"2023-10-16T19:58:06.600449+0000","last_clean":"2023-10-16T19:58:06.600449+0000","last_became_active":"2023-10-16T19:58:05.605958+0000","last_became_peered":"2023-10-16T19:58:05.605958+0000","last_unstale":"2023-10-16T19:58:06.600449+0000","last_undegraded":"2023-10-16T19:58:06.600449+0000","last_fullsized":"2023-10-16T19:58:06.600449+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:26:46.150630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.900321+0000","last_change":"2023-10-16T19:58:04.587092+0000","last_active":"2023-10-16T19:58:05.900321+0000","last_peered":"2023-10-16T19:58:05.900321+0000","last_clean":"2023-10-16T19:58:05.900321+0000","last_became_active":"2023-10-16T19:58:04.586851+0000","last_became_peered":"2023-10-16T19:58:04.586851+0000","last_unstale":"2023-10-16T19:58:05.900321+0000","last_undegraded":"2023-10-16T19:58:05.900321+0000","last_fullsized":"2023-10-16T19:58:05.900321+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_clean_scrub_stamp":"2023-10-16T19:58:03.569082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:36:39.376783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:07.027640+0000","last_change":"2023-10-16T19:58:05.606520+0000","last_active":"2023-10-16T19:58:07.027640+0000","last_peered":"2023-10-16T19:58:07.027640+0000","last_clean":"2023-10-16T19:58:07.027640+0000","last_became_active":"2023-10-16T19:58:05.606081+0000","last_became_peered":"2023-10-16T19:58:05.606081+0000","last_unstale":"2023-10-16T19:58:07.027640+0000","last_undegraded":"2023-10-16T19:58:07.027640+0000","last_fullsized":"2023-10-16T19:58:07.027640+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:26:46.150630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.902760+0000","last_change":"2023-10-16T19:58:04.588408+0000","last_active":"2023-10-16T19:58:05.902760+0000","last_peered":"2023-10-16T19:58:05.902760+0000","last_clean":"2023-10-16T19:58:05.902760+0000","last_became_active":"2023-10-16T19:58:04.588050+0000","last_became_peered":"2023-10-16T19:58:04.588050+0000","last_unstale":"2023-10-16T19:58:05.902760+0000","last_undegraded":"2023-10-16T19:58:05.902760+0000","last_fullsized":"2023-10-16T19:58:05.902760+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_clean_scrub_stamp":"2023-10-16T19:58:03.569082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:36:39.376783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:06.600631+0000","last_change":"2023-10-16T19:58:05.607522+0000","last_active":"2023-10-16T19:58:06.600631+0000","last_peered":"2023-10-16T19:58:06.600631+0000","last_clean":"2023-10-16T19:58:06.600631+0000","last_became_active":"2023-10-16T19:58:05.607381+0000","last_became_peered":"2023-10-16T19:58:05.607381+0000","last_unstale":"2023-10-16T19:58:06.600631+0000","last_undegraded":"2023-10-16T19:58:06.600631+0000","last_fullsized":"2023-10-16T19:58:06.600631+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:07:11.937484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.900254+0000","last_change":"2023-10-16T19:58:04.582574+0000","last_active":"2023-10-16T19:58:05.900254+0000","last_peered":"2023-10-16T19:58:05.900254+0000","last_clean":"2023-10-16T19:58:05.900254+0000","last_became_active":"2023-10-16T19:58:04.581711+0000","last_became_peered":"2023-10-16T19:58:04.581711+0000","last_unstale":"2023-10-16T19:58:05.900254+0000","last_undegraded":"2023-10-16T19:58:05.900254+0000","last_fullsized":"2023-10-16T19:58:05.900254+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_clean_scrub_stamp":"2023-10-16T19:58:03.569082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:57:52.788971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:07.027751+0000","last_change":"2023-10-16T19:58:05.602722+0000","last_active":"2023-10-16T19:58:07.027751+0000","last_peered":"2023-10-16T19:58:07.027751+0000","last_clean":"2023-10-16T19:58:07.027751+0000","last_became_active":"2023-10-16T19:58:05.602184+0000","last_became_peered":"2023-10-16T19:58:05.602184+0000","last_unstale":"2023-10-16T19:58:07.027751+0000","last_undegraded":"2023-10-16T19:58:07.027751+0000","last_fullsized":"2023-10-16T19:58:07.027751+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:16:44.802078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.903097+0000","last_change":"2023-10-16T19:58:04.589600+0000","last_active":"2023-10-16T19:58:05.903097+0000","last_peered":"2023-10-16T19:58:05.903097+0000","last_clean":"2023-10-16T19:58:05.903097+0000","last_became_active":"2023-10-16T19:58:04.587683+0000","last_became_peered":"2023-10-16T19:58:04.587683+0000","last_unstale":"2023-10-16T19:58:05.903097+0000","last_undegraded":"2023-10-16T19:58:05.903097+0000","last_fullsized":"2023-10-16T19:58:05.903097+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_clean_scrub_stamp":"2023-10-16T19:58:03.569082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:56:21.036265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:06.600727+0000","last_change":"2023-10-16T19:58:05.601329+0000","last_active":"2023-10-16T19:58:06.600727+0000","last_peered":"2023-10-16T19:58:06.600727+0000","last_clean":"2023-10-16T19:58:06.600727+0000","last_became_active":"2023-10-16T19:58:05.601074+0000","last_became_peered":"2023-10-16T19:58:05.601074+0000","last_unstale":"2023-10-16T19:58:06.600727+0000","last_undegraded":"2023-10-16T19:58:06.600727+0000","last_fullsized":"2023-10-16T19:58:06.600727+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:26:46.150630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.900213+0000","last_change":"2023-10-16T19:58:04.588810+0000","last_active":"2023-10-16T19:58:05.900213+0000","last_peered":"2023-10-16T19:58:05.900213+0000","last_clean":"2023-10-16T19:58:05.900213+0000","last_became_active":"2023-10-16T19:58:04.588392+0000","last_became_peered":"2023-10-16T19:58:04.588392+0000","last_unstale":"2023-10-16T19:58:05.900213+0000","last_undegraded":"2023-10-16T19:58:05.900213+0000","last_fullsized":"2023-10-16T19:58:05.900213+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_clean_scrub_stamp":"2023-10-16T19:58:03.569082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:41:57.381509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:08.049197+0000","last_change":"2023-10-16T19:58:05.609385+0000","last_active":"2023-10-16T19:58:08.049197+0000","last_peered":"2023-10-16T19:58:08.049197+0000","last_clean":"2023-10-16T19:58:08.049197+0000","last_became_active":"2023-10-16T19:58:05.609118+0000","last_became_peered":"2023-10-16T19:58:05.609118+0000","last_unstale":"2023-10-16T19:58:08.049197+0000","last_undegraded":"2023-10-16T19:58:08.049197+0000","last_fullsized":"2023-10-16T19:58:08.049197+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:23:18.475974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.904186+0000","last_change":"2023-10-16T19:58:04.586182+0000","last_active":"2023-10-16T19:58:05.904186+0000","last_peered":"2023-10-16T19:58:05.904186+0000","last_clean":"2023-10-16T19:58:05.904186+0000","last_became_active":"2023-10-16T19:58:04.585930+0000","last_became_peered":"2023-10-16T19:58:04.585930+0000","last_unstale":"2023-10-16T19:58:05.904186+0000","last_undegraded":"2023-10-16T19:58:05.904186+0000","last_fullsized":"2023-10-16T19:58:05.904186+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_clean_scrub_stamp":"2023-10-16T19:58:03.569082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:50:59.901042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":175,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.602583+0000","last_change":"2023-10-16T19:56:58.775782+0000","last_active":"2023-10-16T19:58:05.602583+0000","last_peered":"2023-10-16T19:58:05.602583+0000","last_clean":"2023-10-16T19:58:05.602583+0000","last_became_active":"2023-10-16T19:56:58.775567+0000","last_became_peered":"2023-10-16T19:56:58.775567+0000","last_unstale":"2023-10-16T19:58:05.602583+0000","last_undegraded":"2023-10-16T19:58:05.602583+0000","last_fullsized":"2023-10-16T19:58:05.602583+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:56:57.693332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:56:57.693332+0000","last_clean_scrub_stamp":"2023-10-16T19:56:57.693332+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:10:23.849736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574865,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":718,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194594,"statfs":{"total":200000000,"available":199264318,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 19:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.40799999999999997}]},{"osd":1,"last update":"Mon Oct 16 19:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.54200000000000004}]},{"osd":2,"last update":"Mon Oct 16 19:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.60499999999999998}]},{"osd":3,"last update":"Mon Oct 16 19:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.498},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.57099999999999995}]},{"osd":4,"last update":"Mon Oct 16 19:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.59299999999999997}]},{"osd":5,"last update":"Mon Oct 16 19:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"last":0.61699999999999999}]},{"osd":6,"last update":"Mon Oct 16 19:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.63400000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574865,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":142,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195170,"statfs":{"total":200000000,"available":199854160,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 19:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.58299999999999996}]},{"osd":1,"last update":"Mon Oct 16 19:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.64700000000000002}]},{"osd":2,"last update":"Mon Oct 16 19:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.70099999999999996}]},{"osd":3,"last update":"Mon Oct 16 19:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.746},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.52500000000000002}]},{"osd":4,"last update":"Mon Oct 16 19:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.50700000000000001}]},{"osd":5,"last update":"Mon Oct 16 19:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.72799999999999998}]},{"osd":7,"last update":"Mon Oct 16 19:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.624},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.56999999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574865,"num_pgs":32,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":143,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195169,"statfs":{"total":200000000,"available":199853142,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 19:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"min":{"1min":0.19700000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.309,"5min":0.309,"15min":0.309},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"last":0.30599999999999999}]},{"osd":2,"last update":"Mon Oct 16 19:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.443,"5min":0.443,"15min":0.443},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"last":0.41499999999999998}]},{"osd":3,"last update":"Mon Oct 16 19:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"last":0.32600000000000001}]},{"osd":4,"last update":"Mon Oct 16 19:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.44800000000000001}]},{"osd":5,"last update":"Mon Oct 16 19:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.59699999999999998}]},{"osd":6,"last update":"Mon Oct 16 19:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.54500000000000004}]},{"osd":7,"last update":"Mon Oct 16 19:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.502}]}]},{"osd":0,"up_from":13,"seq":55834574865,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":718,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194594,"statfs":{"total":200000000,"available":199264408,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 16 19:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":11.031000000000001,"5min":11.031000000000001,"15min":11.031000000000001},"last":0.26200000000000001},{"interface":"front","average":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":12.218,"5min":12.218,"15min":12.218},"last":0.36199999999999999}]},{"osd":2,"last update":"Mon Oct 16 19:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":11.058,"5min":11.058,"15min":11.058},"last":0.32100000000000001},{"interface":"front","average":{"1min":1.123,"5min":1.123,"15min":1.123},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":14.763999999999999,"5min":14.763999999999999,"15min":14.763999999999999},"last":0.29799999999999999}]},{"osd":3,"last update":"Mon Oct 16 19:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":10.935,"5min":10.935,"15min":10.935},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":11.083,"5min":11.083,"15min":11.083},"last":0.39000000000000001}]},{"osd":4,"last update":"Mon Oct 16 19:57:58 2023","interfaces":[{"interface":"back","average":{"1min":1.196,"5min":1.196,"15min":1.196},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":12.279,"5min":12.279,"15min":12.279},"last":0.51700000000000002},{"interface":"front","average":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":10.879,"5min":10.879,"15min":10.879},"last":0.40300000000000002}]},{"osd":5,"last update":"Mon Oct 16 19:57:58 2023","interfaces":[{"interface":"back","average":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":10.907,"5min":10.907,"15min":10.907},"last":0.38100000000000001},{"interface":"front","average":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":11,"5min":11,"15min":11},"last":0.48099999999999998}]},{"osd":6,"last update":"Mon Oct 16 19:57:58 2023","interfaces":[{"interface":"back","average":{"1min":1.157,"5min":1.157,"15min":1.157},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":10.972,"5min":10.972,"15min":10.972},"last":0.41999999999999998},{"interface":"front","average":{"1min":1.24,"5min":1.24,"15min":1.24},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":12.34,"5min":12.34,"15min":12.34},"last":0.45200000000000001}]},{"osd":7,"last update":"Mon Oct 16 19:57:58 2023","interfaces":[{"interface":"back","average":{"1min":1.252,"5min":1.252,"15min":1.252},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":12.311,"5min":12.311,"15min":12.311},"last":0.48799999999999999},{"interface":"front","average":{"1min":1.167,"5min":1.167,"15min":1.167},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":10.845000000000001,"5min":10.845000000000001,"15min":10.845000000000001},"last":0.432}]}]},{"osd":2,"up_from":13,"seq":55834574865,"num_pgs":17,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":141,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195170,"statfs":{"total":200000000,"available":199854706,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 19:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"min":{"1min":0.17899999999999999,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"last":0.26400000000000001},{"interface":"front","average":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"min":{"1min":0.20100000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.36799999999999999}]},{"osd":1,"last update":"Mon Oct 16 19:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.375,"15min":0.375},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"last":0.30199999999999999},{"interface":"front","average":{"1min":0.37,"5min":0.37,"15min":0.37},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"last":0.28799999999999998}]},{"osd":3,"last update":"Mon Oct 16 19:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.34499999999999997}]},{"osd":4,"last update":"Mon Oct 16 19:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.48599999999999999}]},{"osd":5,"last update":"Mon Oct 16 19:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.38400000000000001}]},{"osd":6,"last update":"Mon Oct 16 19:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.433}]},{"osd":7,"last update":"Mon Oct 16 19:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.45900000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574865,"num_pgs":31,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":143,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195169,"statfs":{"total":200000000,"available":199853142,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 19:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"last":0.246},{"interface":"front","average":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.498,"5min":0.498,"15min":0.498},"last":0.38}]},{"osd":1,"last update":"Mon Oct 16 19:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"last":0.313},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"min":{"1min":0.20499999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.32600000000000001}]},{"osd":2,"last update":"Mon Oct 16 19:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.36299999999999999}]},{"osd":4,"last update":"Mon Oct 16 19:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.63},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.51200000000000001}]},{"osd":5,"last update":"Mon Oct 16 19:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.58699999999999997}]},{"osd":6,"last update":"Mon Oct 16 19:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.501}]},{"osd":7,"last update":"Mon Oct 16 19:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.2030000000000001,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.139,"5min":1.139,"15min":1.139},"last":0.47999999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574865,"num_pgs":29,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":141,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195170,"statfs":{"total":200000000,"available":199854672,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 19:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.46600000000000003}]},{"osd":1,"last update":"Mon Oct 16 19:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.034,"5min":1.034,"15min":1.034},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.40400000000000003}]},{"osd":2,"last update":"Mon Oct 16 19:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.103,"5min":1.103,"15min":1.103},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.50900000000000001}]},{"osd":3,"last update":"Mon Oct 16 19:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.071,"5min":1.071,"15min":1.071},"last":0.56999999999999995}]},{"osd":5,"last update":"Mon Oct 16 19:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.49099999999999999}]},{"osd":6,"last update":"Mon Oct 16 19:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.44900000000000001}]},{"osd":7,"last update":"Mon Oct 16 19:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.441},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.59399999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574865,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":142,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195170,"statfs":{"total":200000000,"available":199854104,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 19:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.45100000000000001}]},{"osd":1,"last update":"Mon Oct 16 19:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":7.9989999999999997,"5min":7.9989999999999997,"15min":7.9989999999999997},"last":0.435},{"interface":"front","average":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":8.0150000000000006,"5min":8.0150000000000006,"15min":8.0150000000000006},"last":0.53400000000000003}]},{"osd":2,"last update":"Mon Oct 16 19:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":1.032,"5min":1.032,"15min":1.032},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.379}]},{"osd":3,"last update":"Mon Oct 16 19:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":8.077,"5min":8.077,"15min":8.077},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.58299999999999996}]},{"osd":4,"last update":"Mon Oct 16 19:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.65100000000000002}]},{"osd":6,"last update":"Mon Oct 16 19:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.63600000000000001}]},{"osd":7,"last update":"Mon Oct 16 19:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.625},{"interface":"front","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.61399999999999999}]}]}],"pool_statfs":[]}} 2023-10-16T19:58:14.290 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-10-16T19:58:14.291 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-16T19:58:14.445 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.443+0000 7f1c01aa0700 1 Processor -- start 2023-10-16T19:58:14.446 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.443+0000 7f1c01aa0700 1 -- start start 2023-10-16T19:58:14.449 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.443+0000 7f1c01aa0700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f1bfc071f60 0x7f1bfc06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:14.449 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.444+0000 7f1c01aa0700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1bfc06eb20 0x7f1bfc06efb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:14.449 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.444+0000 7f1c01aa0700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1bfc0cefc0 con 0x7f1bfc15b130 2023-10-16T19:58:14.449 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.444+0000 7f1c01aa0700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1bfc0b0050 con 0x7f1bfc071f60 2023-10-16T19:58:14.450 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.444+0000 7f1c01aa0700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bfc0723e0 con 0x7f1bfc06eb20 2023-10-16T19:58:14.450 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.444+0000 7f1bfaffd700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f1bfc071f60 0x7f1bfc06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:14.450 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.444+0000 7f1bfb7fe700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f1bfc15b130 0x7f1bfc0cb970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:57464/0 (socket says 172.21.15.157:57464) 2023-10-16T19:58:14.451 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.444+0000 7f1bfb7fe700 1 -- 172.21.15.157:0/1264575775 learned_addr learned my addr 172.21.15.157:0/1264575775 (peer_addr_for_me v1:172.21.15.157:0/0) 2023-10-16T19:58:14.451 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.444+0000 7f1bfbfff700 1 --2- 172.21.15.157:0/1264575775 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1bfc06eb20 0x7f1bfc06efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:14.451 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.444+0000 7f1bfaffd700 1 -- 172.21.15.157:0/1264575775 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1bfc06eb20 msgr2=0x7f1bfc06efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:58:14.452 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.444+0000 7f1bfaffd700 1 --2- 172.21.15.157:0/1264575775 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1bfc06eb20 0x7f1bfc06efb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:14.452 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.444+0000 7f1bfaffd700 1 -- 172.21.15.157:0/1264575775 >> v1:172.21.15.157:6789/0 conn(0x7f1bfc15b130 legacy=0x7f1bfc0cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:14.452 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.444+0000 7f1bfaffd700 1 -- 172.21.15.157:0/1264575775 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bfc06e090 con 0x7f1bfc071f60 2023-10-16T19:58:14.453 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.444+0000 7f1bfa7fc700 1 -- 172.21.15.157:0/1264575775 <== mon.0 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2194578996 0 0) 0x7f1bfc0cefc0 con 0x7f1bfc15b130 2023-10-16T19:58:14.453 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.444+0000 7f1bfbfff700 1 --2- 172.21.15.157:0/1264575775 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1bfc06eb20 0x7f1bfc06efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T19:58:14.453 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.444+0000 7f1bfaffd700 1 --2- 172.21.15.157:0/1264575775 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1bfc071f60 0x7f1bfc06d0f0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f1bf0009840 tx=0x7f1bf0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8d0498fe1ddb492 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:58:14.453 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.444+0000 7f1bfa7fc700 1 -- 172.21.15.157:0/1264575775 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bf0011830 con 0x7f1bfc071f60 2023-10-16T19:58:14.454 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.444+0000 7f1bfa7fc700 1 -- 172.21.15.157:0/1264575775 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bf0011990 con 0x7f1bfc071f60 2023-10-16T19:58:14.454 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.444+0000 7f1bfa7fc700 1 -- 172.21.15.157:0/1264575775 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bf0011d20 con 0x7f1bfc071f60 2023-10-16T19:58:14.457 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.445+0000 7f1c01aa0700 1 -- 172.21.15.157:0/1264575775 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1bfc071f60 msgr2=0x7f1bfc06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:14.458 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.445+0000 7f1c01aa0700 1 --2- 172.21.15.157:0/1264575775 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1bfc071f60 0x7f1bfc06d0f0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f1bf0009840 tx=0x7f1bf0009b50 comp rx=0 tx=0).stop 2023-10-16T19:58:14.458 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.445+0000 7f1c01aa0700 1 -- 172.21.15.157:0/1264575775 shutdown_connections 2023-10-16T19:58:14.458 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.445+0000 7f1c01aa0700 1 --2- 172.21.15.157:0/1264575775 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1bfc06eb20 0x7f1bfc06efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:14.458 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.445+0000 7f1c01aa0700 1 --2- 172.21.15.157:0/1264575775 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1bfc071f60 0x7f1bfc06d0f0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:14.459 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.445+0000 7f1c01aa0700 1 -- 172.21.15.157:0/1264575775 >> 172.21.15.157:0/1264575775 conn(0x7f1bfc0cd4e0 msgr2=0x7f1bfc0cd8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:58:14.459 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.445+0000 7f1c01aa0700 1 -- 172.21.15.157:0/1264575775 shutdown_connections 2023-10-16T19:58:14.459 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.445+0000 7f1c01aa0700 1 -- 172.21.15.157:0/1264575775 wait complete. 2023-10-16T19:58:14.460 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.446+0000 7f1c01aa0700 1 Processor -- start 2023-10-16T19:58:14.460 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.446+0000 7f1c01aa0700 1 -- start start 2023-10-16T19:58:14.463 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.447+0000 7f1c01aa0700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1bfc06eb20 0x7f1bfc14f600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:14.463 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.447+0000 7f1c01aa0700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1bfc071f60 0x7f1bfc166450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:14.463 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.447+0000 7f1c01aa0700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1bfc15b130 0x7f1bfc0b12e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:14.464 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.447+0000 7f1c01aa0700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bfc166f10 con 0x7f1bfc06eb20 2023-10-16T19:58:14.464 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.447+0000 7f1c01aa0700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bfc1671f0 con 0x7f1bfc15b130 2023-10-16T19:58:14.464 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.447+0000 7f1c01aa0700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bfc1674d0 con 0x7f1bfc071f60 2023-10-16T19:58:14.464 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.447+0000 7f1bfb7fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1bfc06eb20 0x7f1bfc14f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:14.465 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.447+0000 7f1bfb7fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1bfc06eb20 0x7f1bfc14f600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:47798/0 (socket says 172.21.15.157:47798) 2023-10-16T19:58:14.465 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.447+0000 7f1bfb7fe700 1 -- 172.21.15.157:0/3526367617 learned_addr learned my addr 172.21.15.157:0/3526367617 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:58:14.465 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.447+0000 7f1bfbfff700 1 --2- 172.21.15.157:0/3526367617 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1bfc15b130 0x7f1bfc0b12e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:14.466 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.447+0000 7f1bfaffd700 1 --2- 172.21.15.157:0/3526367617 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1bfc071f60 0x7f1bfc166450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:14.466 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.447+0000 7f1bfb7fe700 1 -- 172.21.15.157:0/3526367617 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1bfc071f60 msgr2=0x7f1bfc166450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:14.466 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.447+0000 7f1bfb7fe700 1 --2- 172.21.15.157:0/3526367617 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1bfc071f60 0x7f1bfc166450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:14.467 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.447+0000 7f1bfb7fe700 1 -- 172.21.15.157:0/3526367617 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1bfc15b130 msgr2=0x7f1bfc0b12e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:14.467 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.447+0000 7f1bfb7fe700 1 --2- 172.21.15.157:0/3526367617 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1bfc15b130 0x7f1bfc0b12e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:14.467 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.447+0000 7f1bfb7fe700 1 -- 172.21.15.157:0/3526367617 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bf00094a0 con 0x7f1bfc06eb20 2023-10-16T19:58:14.467 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.448+0000 7f1bfb7fe700 1 --2- 172.21.15.157:0/3526367617 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1bfc06eb20 0x7f1bfc14f600 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f1bec00c550 tx=0x7f1bec00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:58:14.468 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.448+0000 7f1be3fff700 1 -- 172.21.15.157:0/3526367617 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bec004c80 con 0x7f1bfc06eb20 2023-10-16T19:58:14.468 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.448+0000 7f1be3fff700 1 -- 172.21.15.157:0/3526367617 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bec004e00 con 0x7f1bfc06eb20 2023-10-16T19:58:14.468 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.448+0000 7f1c01aa0700 1 -- 172.21.15.157:0/3526367617 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bfc1677b0 con 0x7f1bfc06eb20 2023-10-16T19:58:14.469 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.448+0000 7f1be3fff700 1 -- 172.21.15.157:0/3526367617 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bec007310 con 0x7f1bfc06eb20 2023-10-16T19:58:14.469 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.448+0000 7f1c01aa0700 1 -- 172.21.15.157:0/3526367617 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bfc167fb0 con 0x7f1bfc06eb20 2023-10-16T19:58:14.469 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.449+0000 7f1c01aa0700 1 -- 172.21.15.157:0/3526367617 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1bfc167cd0 con 0x7f1bfc06eb20 2023-10-16T19:58:14.469 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.449+0000 7f1be3fff700 1 -- 172.21.15.157:0/3526367617 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f1bec007470 con 0x7f1bfc06eb20 2023-10-16T19:58:14.470 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.449+0000 7f1be3fff700 1 --2- 172.21.15.157:0/3526367617 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f1be806af00 0x7f1be806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:14.470 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.450+0000 7f1be3fff700 1 -- 172.21.15.157:0/3526367617 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5729+0+0 (secure 0 0 0) 0x7f1bec0892d0 con 0x7f1bfc06eb20 2023-10-16T19:58:14.470 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.450+0000 7f1bfaffd700 1 --2- 172.21.15.157:0/3526367617 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f1be806af00 0x7f1be806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:14.471 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.450+0000 7f1bfaffd700 1 --2- 172.21.15.157:0/3526367617 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f1be806af00 0x7f1be806d3c0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f1bf00090b0 tx=0x7f1bf0008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:58:14.471 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.454+0000 7f1be3fff700 1 -- 172.21.15.157:0/3526367617 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1bec0543f0 con 0x7f1bfc06eb20 2023-10-16T19:58:14.640 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.637+0000 7f1c01aa0700 1 -- 172.21.15.157:0/3526367617 --> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1bfc06dad0 con 0x7f1be806af00 2023-10-16T19:58:14.648 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.646+0000 7f1be3fff700 1 -- 172.21.15.157:0/3526367617 <== mgr.4100 v2:172.21.15.187:6832/2426285296 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+284555 (secure 0 0 0) 0x7f1bf0011b80 con 0x7f1be806af00 2023-10-16T19:58:14.651 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-10-16T19:58:14.654 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.649+0000 7f1c01aa0700 1 -- 172.21.15.157:0/3526367617 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f1be806af00 msgr2=0x7f1be806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:14.654 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.649+0000 7f1c01aa0700 1 --2- 172.21.15.157:0/3526367617 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f1be806af00 0x7f1be806d3c0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f1bf00090b0 tx=0x7f1bf0008030 comp rx=0 tx=0).stop 2023-10-16T19:58:14.654 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.649+0000 7f1c01aa0700 1 -- 172.21.15.157:0/3526367617 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1bfc06eb20 msgr2=0x7f1bfc14f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:14.655 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.649+0000 7f1c01aa0700 1 --2- 172.21.15.157:0/3526367617 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1bfc06eb20 0x7f1bfc14f600 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f1bec00c550 tx=0x7f1bec00c910 comp rx=0 tx=0).stop 2023-10-16T19:58:14.655 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.649+0000 7f1c01aa0700 1 -- 172.21.15.157:0/3526367617 shutdown_connections 2023-10-16T19:58:14.655 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.649+0000 7f1c01aa0700 1 --2- 172.21.15.157:0/3526367617 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f1be806af00 0x7f1be806d3c0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:14.656 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.649+0000 7f1c01aa0700 1 --2- 172.21.15.157:0/3526367617 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1bfc15b130 0x7f1bfc0b12e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:14.656 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.649+0000 7f1c01aa0700 1 --2- 172.21.15.157:0/3526367617 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1bfc06eb20 0x7f1bfc14f600 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:14.656 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.649+0000 7f1c01aa0700 1 --2- 172.21.15.157:0/3526367617 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1bfc071f60 0x7f1bfc166450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:14.657 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.649+0000 7f1c01aa0700 1 -- 172.21.15.157:0/3526367617 >> 172.21.15.157:0/3526367617 conn(0x7f1bfc0cd4e0 msgr2=0x7f1bfc0cf450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:58:14.658 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.649+0000 7f1c01aa0700 1 -- 172.21.15.157:0/3526367617 shutdown_connections 2023-10-16T19:58:14.658 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.649+0000 7f1c01aa0700 1 -- 172.21.15.157:0/3526367617 wait complete. 2023-10-16T19:58:14.658 INFO:teuthology.orchestra.run.smithi157.stderr:dumped all 2023-10-16T19:58:14.666 INFO:teuthology.orchestra.run.smithi157.stdout:{"pg_ready":true,"pg_map":{"version":62,"stamp":"2023-10-16T19:58:12.906917+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":2292,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560207,"statfs":{"total":1600000000,"available":1597652652,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002016"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:07.027378+0000","last_change":"2023-10-16T19:58:05.597289+0000","last_active":"2023-10-16T19:58:07.027378+0000","last_peered":"2023-10-16T19:58:07.027378+0000","last_clean":"2023-10-16T19:58:07.027378+0000","last_became_active":"2023-10-16T19:58:05.597025+0000","last_became_peered":"2023-10-16T19:58:05.597025+0000","last_unstale":"2023-10-16T19:58:07.027378+0000","last_undegraded":"2023-10-16T19:58:07.027378+0000","last_fullsized":"2023-10-16T19:58:07.027378+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:57:53.793532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:07.027896+0000","last_change":"2023-10-16T19:58:05.606250+0000","last_active":"2023-10-16T19:58:07.027896+0000","last_peered":"2023-10-16T19:58:07.027896+0000","last_clean":"2023-10-16T19:58:07.027896+0000","last_became_active":"2023-10-16T19:58:05.605969+0000","last_became_peered":"2023-10-16T19:58:05.605969+0000","last_unstale":"2023-10-16T19:58:07.027896+0000","last_undegraded":"2023-10-16T19:58:07.027896+0000","last_fullsized":"2023-10-16T19:58:07.027896+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:25:36.321203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:06.908178+0000","last_change":"2023-10-16T19:58:05.601472+0000","last_active":"2023-10-16T19:58:06.908178+0000","last_peered":"2023-10-16T19:58:06.908178+0000","last_clean":"2023-10-16T19:58:06.908178+0000","last_became_active":"2023-10-16T19:58:05.601072+0000","last_became_peered":"2023-10-16T19:58:05.601072+0000","last_unstale":"2023-10-16T19:58:06.908178+0000","last_undegraded":"2023-10-16T19:58:06.908178+0000","last_fullsized":"2023-10-16T19:58:06.908178+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:16:44.802078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:06.907743+0000","last_change":"2023-10-16T19:58:05.603410+0000","last_active":"2023-10-16T19:58:06.907743+0000","last_peered":"2023-10-16T19:58:06.907743+0000","last_clean":"2023-10-16T19:58:06.907743+0000","last_became_active":"2023-10-16T19:58:05.603003+0000","last_became_peered":"2023-10-16T19:58:05.603003+0000","last_unstale":"2023-10-16T19:58:06.907743+0000","last_undegraded":"2023-10-16T19:58:06.907743+0000","last_fullsized":"2023-10-16T19:58:06.907743+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:45:35.921925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:06.599174+0000","last_change":"2023-10-16T19:58:05.603205+0000","last_active":"2023-10-16T19:58:06.599174+0000","last_peered":"2023-10-16T19:58:06.599174+0000","last_clean":"2023-10-16T19:58:06.599174+0000","last_became_active":"2023-10-16T19:58:05.602976+0000","last_became_peered":"2023-10-16T19:58:05.602976+0000","last_unstale":"2023-10-16T19:58:06.599174+0000","last_undegraded":"2023-10-16T19:58:06.599174+0000","last_fullsized":"2023-10-16T19:58:06.599174+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:45:26.140866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:07.027617+0000","last_change":"2023-10-16T19:58:05.602575+0000","last_active":"2023-10-16T19:58:07.027617+0000","last_peered":"2023-10-16T19:58:07.027617+0000","last_clean":"2023-10-16T19:58:07.027617+0000","last_became_active":"2023-10-16T19:58:05.601803+0000","last_became_peered":"2023-10-16T19:58:05.601803+0000","last_unstale":"2023-10-16T19:58:07.027617+0000","last_undegraded":"2023-10-16T19:58:07.027617+0000","last_fullsized":"2023-10-16T19:58:07.027617+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:16:05.497063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:08.048629+0000","last_change":"2023-10-16T19:58:05.605393+0000","last_active":"2023-10-16T19:58:08.048629+0000","last_peered":"2023-10-16T19:58:08.048629+0000","last_clean":"2023-10-16T19:58:08.048629+0000","last_became_active":"2023-10-16T19:58:05.605148+0000","last_became_peered":"2023-10-16T19:58:05.605148+0000","last_unstale":"2023-10-16T19:58:08.048629+0000","last_undegraded":"2023-10-16T19:58:08.048629+0000","last_fullsized":"2023-10-16T19:58:08.048629+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:22:44.892357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:08.048675+0000","last_change":"2023-10-16T19:58:05.605461+0000","last_active":"2023-10-16T19:58:08.048675+0000","last_peered":"2023-10-16T19:58:08.048675+0000","last_clean":"2023-10-16T19:58:08.048675+0000","last_became_active":"2023-10-16T19:58:05.605200+0000","last_became_peered":"2023-10-16T19:58:05.605200+0000","last_unstale":"2023-10-16T19:58:08.048675+0000","last_undegraded":"2023-10-16T19:58:08.048675+0000","last_fullsized":"2023-10-16T19:58:08.048675+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:47:35.655272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:06.600844+0000","last_change":"2023-10-16T19:58:05.602243+0000","last_active":"2023-10-16T19:58:06.600844+0000","last_peered":"2023-10-16T19:58:06.600844+0000","last_clean":"2023-10-16T19:58:06.600844+0000","last_became_active":"2023-10-16T19:58:05.601910+0000","last_became_peered":"2023-10-16T19:58:05.601910+0000","last_unstale":"2023-10-16T19:58:06.600844+0000","last_undegraded":"2023-10-16T19:58:06.600844+0000","last_fullsized":"2023-10-16T19:58:06.600844+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:07:11.937484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:06.907450+0000","last_change":"2023-10-16T19:58:05.600582+0000","last_active":"2023-10-16T19:58:06.907450+0000","last_peered":"2023-10-16T19:58:06.907450+0000","last_clean":"2023-10-16T19:58:06.907450+0000","last_became_active":"2023-10-16T19:58:05.600356+0000","last_became_peered":"2023-10-16T19:58:05.600356+0000","last_unstale":"2023-10-16T19:58:06.907450+0000","last_undegraded":"2023-10-16T19:58:06.907450+0000","last_fullsized":"2023-10-16T19:58:06.907450+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:26:33.490004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:08.048860+0000","last_change":"2023-10-16T19:58:05.610325+0000","last_active":"2023-10-16T19:58:08.048860+0000","last_peered":"2023-10-16T19:58:08.048860+0000","last_clean":"2023-10-16T19:58:08.048860+0000","last_became_active":"2023-10-16T19:58:05.609979+0000","last_became_peered":"2023-10-16T19:58:05.609979+0000","last_unstale":"2023-10-16T19:58:08.048860+0000","last_undegraded":"2023-10-16T19:58:08.048860+0000","last_fullsized":"2023-10-16T19:58:08.048860+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:30:57.464645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:06.907718+0000","last_change":"2023-10-16T19:58:05.602076+0000","last_active":"2023-10-16T19:58:06.907718+0000","last_peered":"2023-10-16T19:58:06.907718+0000","last_clean":"2023-10-16T19:58:06.907718+0000","last_became_active":"2023-10-16T19:58:05.600490+0000","last_became_peered":"2023-10-16T19:58:05.600490+0000","last_unstale":"2023-10-16T19:58:06.907718+0000","last_undegraded":"2023-10-16T19:58:06.907718+0000","last_fullsized":"2023-10-16T19:58:06.907718+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:45:35.921925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:06.599132+0000","last_change":"2023-10-16T19:58:05.600961+0000","last_active":"2023-10-16T19:58:06.599132+0000","last_peered":"2023-10-16T19:58:06.599132+0000","last_clean":"2023-10-16T19:58:06.599132+0000","last_became_active":"2023-10-16T19:58:05.600614+0000","last_became_peered":"2023-10-16T19:58:05.600614+0000","last_unstale":"2023-10-16T19:58:06.599132+0000","last_undegraded":"2023-10-16T19:58:06.599132+0000","last_fullsized":"2023-10-16T19:58:06.599132+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:46:16.568366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:07.028165+0000","last_change":"2023-10-16T19:58:05.602410+0000","last_active":"2023-10-16T19:58:07.028165+0000","last_peered":"2023-10-16T19:58:07.028165+0000","last_clean":"2023-10-16T19:58:07.028165+0000","last_became_active":"2023-10-16T19:58:05.601569+0000","last_became_peered":"2023-10-16T19:58:05.601569+0000","last_unstale":"2023-10-16T19:58:07.028165+0000","last_undegraded":"2023-10-16T19:58:07.028165+0000","last_fullsized":"2023-10-16T19:58:07.028165+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:15:53.489096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:06.908030+0000","last_change":"2023-10-16T19:58:05.599789+0000","last_active":"2023-10-16T19:58:06.908030+0000","last_peered":"2023-10-16T19:58:06.908030+0000","last_clean":"2023-10-16T19:58:06.908030+0000","last_became_active":"2023-10-16T19:58:05.599026+0000","last_became_peered":"2023-10-16T19:58:05.599026+0000","last_unstale":"2023-10-16T19:58:06.908030+0000","last_undegraded":"2023-10-16T19:58:06.908030+0000","last_fullsized":"2023-10-16T19:58:06.908030+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:04:03.788625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:08.048995+0000","last_change":"2023-10-16T19:58:05.610219+0000","last_active":"2023-10-16T19:58:08.048995+0000","last_peered":"2023-10-16T19:58:08.048995+0000","last_clean":"2023-10-16T19:58:08.048995+0000","last_became_active":"2023-10-16T19:58:05.609613+0000","last_became_peered":"2023-10-16T19:58:05.609613+0000","last_unstale":"2023-10-16T19:58:08.048995+0000","last_undegraded":"2023-10-16T19:58:08.048995+0000","last_fullsized":"2023-10-16T19:58:08.048995+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:03:27.064265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:08.048854+0000","last_change":"2023-10-16T19:58:05.608855+0000","last_active":"2023-10-16T19:58:08.048854+0000","last_peered":"2023-10-16T19:58:08.048854+0000","last_clean":"2023-10-16T19:58:08.048854+0000","last_became_active":"2023-10-16T19:58:05.608184+0000","last_became_peered":"2023-10-16T19:58:05.608184+0000","last_unstale":"2023-10-16T19:58:08.048854+0000","last_undegraded":"2023-10-16T19:58:08.048854+0000","last_fullsized":"2023-10-16T19:58:08.048854+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:15:51.793903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:07.027692+0000","last_change":"2023-10-16T19:58:05.601271+0000","last_active":"2023-10-16T19:58:07.027692+0000","last_peered":"2023-10-16T19:58:07.027692+0000","last_clean":"2023-10-16T19:58:07.027692+0000","last_became_active":"2023-10-16T19:58:05.600977+0000","last_became_peered":"2023-10-16T19:58:05.600977+0000","last_unstale":"2023-10-16T19:58:07.027692+0000","last_undegraded":"2023-10-16T19:58:07.027692+0000","last_fullsized":"2023-10-16T19:58:07.027692+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:04:03.788625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:07.027493+0000","last_change":"2023-10-16T19:58:05.602564+0000","last_active":"2023-10-16T19:58:07.027493+0000","last_peered":"2023-10-16T19:58:07.027493+0000","last_clean":"2023-10-16T19:58:07.027493+0000","last_became_active":"2023-10-16T19:58:05.601866+0000","last_became_peered":"2023-10-16T19:58:05.601866+0000","last_unstale":"2023-10-16T19:58:07.027493+0000","last_undegraded":"2023-10-16T19:58:07.027493+0000","last_fullsized":"2023-10-16T19:58:07.027493+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:15:51.793903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:06.599266+0000","last_change":"2023-10-16T19:58:05.603764+0000","last_active":"2023-10-16T19:58:06.599266+0000","last_peered":"2023-10-16T19:58:06.599266+0000","last_clean":"2023-10-16T19:58:06.599266+0000","last_became_active":"2023-10-16T19:58:05.603536+0000","last_became_peered":"2023-10-16T19:58:05.603536+0000","last_unstale":"2023-10-16T19:58:06.599266+0000","last_undegraded":"2023-10-16T19:58:06.599266+0000","last_fullsized":"2023-10-16T19:58:06.599266+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:20:13.830601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:06.600643+0000","last_change":"2023-10-16T19:58:05.607035+0000","last_active":"2023-10-16T19:58:06.600643+0000","last_peered":"2023-10-16T19:58:06.600643+0000","last_clean":"2023-10-16T19:58:06.600643+0000","last_became_active":"2023-10-16T19:58:05.606725+0000","last_became_peered":"2023-10-16T19:58:05.606725+0000","last_unstale":"2023-10-16T19:58:06.600643+0000","last_undegraded":"2023-10-16T19:58:06.600643+0000","last_fullsized":"2023-10-16T19:58:06.600643+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:05:23.390163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:06.600926+0000","last_change":"2023-10-16T19:58:05.606076+0000","last_active":"2023-10-16T19:58:06.600926+0000","last_peered":"2023-10-16T19:58:06.600926+0000","last_clean":"2023-10-16T19:58:06.600926+0000","last_became_active":"2023-10-16T19:58:05.605335+0000","last_became_peered":"2023-10-16T19:58:05.605335+0000","last_unstale":"2023-10-16T19:58:06.600926+0000","last_undegraded":"2023-10-16T19:58:06.600926+0000","last_fullsized":"2023-10-16T19:58:06.600926+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:09:04.664112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:06.600504+0000","last_change":"2023-10-16T19:58:05.609361+0000","last_active":"2023-10-16T19:58:06.600504+0000","last_peered":"2023-10-16T19:58:06.600504+0000","last_clean":"2023-10-16T19:58:06.600504+0000","last_became_active":"2023-10-16T19:58:05.609123+0000","last_became_peered":"2023-10-16T19:58:05.609123+0000","last_unstale":"2023-10-16T19:58:06.600504+0000","last_undegraded":"2023-10-16T19:58:06.600504+0000","last_fullsized":"2023-10-16T19:58:06.600504+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:29:55.757064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:06.907737+0000","last_change":"2023-10-16T19:58:05.599645+0000","last_active":"2023-10-16T19:58:06.907737+0000","last_peered":"2023-10-16T19:58:06.907737+0000","last_clean":"2023-10-16T19:58:06.907737+0000","last_became_active":"2023-10-16T19:58:05.599210+0000","last_became_peered":"2023-10-16T19:58:05.599210+0000","last_unstale":"2023-10-16T19:58:06.907737+0000","last_undegraded":"2023-10-16T19:58:06.907737+0000","last_fullsized":"2023-10-16T19:58:06.907737+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:47:35.655272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:06.907710+0000","last_change":"2023-10-16T19:58:05.608218+0000","last_active":"2023-10-16T19:58:06.907710+0000","last_peered":"2023-10-16T19:58:06.907710+0000","last_clean":"2023-10-16T19:58:06.907710+0000","last_became_active":"2023-10-16T19:58:05.608010+0000","last_became_peered":"2023-10-16T19:58:05.608010+0000","last_unstale":"2023-10-16T19:58:06.907710+0000","last_undegraded":"2023-10-16T19:58:06.907710+0000","last_fullsized":"2023-10-16T19:58:06.907710+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:10:06.943190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:07.027753+0000","last_change":"2023-10-16T19:58:05.607417+0000","last_active":"2023-10-16T19:58:07.027753+0000","last_peered":"2023-10-16T19:58:07.027753+0000","last_clean":"2023-10-16T19:58:07.027753+0000","last_became_active":"2023-10-16T19:58:05.607185+0000","last_became_peered":"2023-10-16T19:58:05.607185+0000","last_unstale":"2023-10-16T19:58:07.027753+0000","last_undegraded":"2023-10-16T19:58:07.027753+0000","last_fullsized":"2023-10-16T19:58:07.027753+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:03:27.064265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:06.907334+0000","last_change":"2023-10-16T19:58:05.606277+0000","last_active":"2023-10-16T19:58:06.907334+0000","last_peered":"2023-10-16T19:58:06.907334+0000","last_clean":"2023-10-16T19:58:06.907334+0000","last_became_active":"2023-10-16T19:58:05.606043+0000","last_became_peered":"2023-10-16T19:58:05.606043+0000","last_unstale":"2023-10-16T19:58:06.907334+0000","last_undegraded":"2023-10-16T19:58:06.907334+0000","last_fullsized":"2023-10-16T19:58:06.907334+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:09:04.664112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:06.907996+0000","last_change":"2023-10-16T19:58:05.607969+0000","last_active":"2023-10-16T19:58:06.907996+0000","last_peered":"2023-10-16T19:58:06.907996+0000","last_clean":"2023-10-16T19:58:06.907996+0000","last_became_active":"2023-10-16T19:58:05.607763+0000","last_became_peered":"2023-10-16T19:58:05.607763+0000","last_unstale":"2023-10-16T19:58:06.907996+0000","last_undegraded":"2023-10-16T19:58:06.907996+0000","last_fullsized":"2023-10-16T19:58:06.907996+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:30:57.464645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:06.601107+0000","last_change":"2023-10-16T19:58:05.604754+0000","last_active":"2023-10-16T19:58:06.601107+0000","last_peered":"2023-10-16T19:58:06.601107+0000","last_clean":"2023-10-16T19:58:06.601107+0000","last_became_active":"2023-10-16T19:58:05.604309+0000","last_became_peered":"2023-10-16T19:58:05.604309+0000","last_unstale":"2023-10-16T19:58:06.601107+0000","last_undegraded":"2023-10-16T19:58:06.601107+0000","last_fullsized":"2023-10-16T19:58:06.601107+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:26:33.490004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:08.048842+0000","last_change":"2023-10-16T19:58:05.606380+0000","last_active":"2023-10-16T19:58:08.048842+0000","last_peered":"2023-10-16T19:58:08.048842+0000","last_clean":"2023-10-16T19:58:08.048842+0000","last_became_active":"2023-10-16T19:58:05.606102+0000","last_became_peered":"2023-10-16T19:58:05.606102+0000","last_unstale":"2023-10-16T19:58:08.048842+0000","last_undegraded":"2023-10-16T19:58:08.048842+0000","last_fullsized":"2023-10-16T19:58:08.048842+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:04:03.788625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:07.027526+0000","last_change":"2023-10-16T19:58:05.600187+0000","last_active":"2023-10-16T19:58:07.027526+0000","last_peered":"2023-10-16T19:58:07.027526+0000","last_clean":"2023-10-16T19:58:07.027526+0000","last_became_active":"2023-10-16T19:58:05.599955+0000","last_became_peered":"2023-10-16T19:58:05.599955+0000","last_unstale":"2023-10-16T19:58:07.027526+0000","last_undegraded":"2023-10-16T19:58:07.027526+0000","last_fullsized":"2023-10-16T19:58:07.027526+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:05:23.390163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:08.049001+0000","last_change":"2023-10-16T19:58:05.609019+0000","last_active":"2023-10-16T19:58:08.049001+0000","last_peered":"2023-10-16T19:58:08.049001+0000","last_clean":"2023-10-16T19:58:08.049001+0000","last_became_active":"2023-10-16T19:58:05.608571+0000","last_became_peered":"2023-10-16T19:58:05.608571+0000","last_unstale":"2023-10-16T19:58:08.049001+0000","last_undegraded":"2023-10-16T19:58:08.049001+0000","last_fullsized":"2023-10-16T19:58:08.049001+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:17:36.021934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:06.600335+0000","last_change":"2023-10-16T19:58:05.609465+0000","last_active":"2023-10-16T19:58:06.600335+0000","last_peered":"2023-10-16T19:58:06.600335+0000","last_clean":"2023-10-16T19:58:06.600335+0000","last_became_active":"2023-10-16T19:58:05.609211+0000","last_became_peered":"2023-10-16T19:58:05.609211+0000","last_unstale":"2023-10-16T19:58:06.600335+0000","last_undegraded":"2023-10-16T19:58:06.600335+0000","last_fullsized":"2023-10-16T19:58:06.600335+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:05:23.390163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"32'4","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.904227+0000","last_change":"2023-10-16T19:58:04.587769+0000","last_active":"2023-10-16T19:58:05.904227+0000","last_peered":"2023-10-16T19:58:05.904227+0000","last_clean":"2023-10-16T19:58:05.904227+0000","last_became_active":"2023-10-16T19:58:04.587523+0000","last_became_peered":"2023-10-16T19:58:04.587523+0000","last_unstale":"2023-10-16T19:58:05.904227+0000","last_undegraded":"2023-10-16T19:58:05.904227+0000","last_fullsized":"2023-10-16T19:58:05.904227+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_clean_scrub_stamp":"2023-10-16T19:58:03.569082+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:20:12.826040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:07.027183+0000","last_change":"2023-10-16T19:58:05.598729+0000","last_active":"2023-10-16T19:58:07.027183+0000","last_peered":"2023-10-16T19:58:07.027183+0000","last_clean":"2023-10-16T19:58:07.027183+0000","last_became_active":"2023-10-16T19:58:05.598478+0000","last_became_peered":"2023-10-16T19:58:05.598478+0000","last_unstale":"2023-10-16T19:58:07.027183+0000","last_undegraded":"2023-10-16T19:58:07.027183+0000","last_fullsized":"2023-10-16T19:58:07.027183+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:36:40.381344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"32'1","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.902612+0000","last_change":"2023-10-16T19:58:04.589820+0000","last_active":"2023-10-16T19:58:05.902612+0000","last_peered":"2023-10-16T19:58:05.902612+0000","last_clean":"2023-10-16T19:58:05.902612+0000","last_became_active":"2023-10-16T19:58:04.589624+0000","last_became_peered":"2023-10-16T19:58:04.589624+0000","last_unstale":"2023-10-16T19:58:05.902612+0000","last_undegraded":"2023-10-16T19:58:05.902612+0000","last_fullsized":"2023-10-16T19:58:05.902612+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_clean_scrub_stamp":"2023-10-16T19:58:03.569082+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:50:59.901042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:06.600772+0000","last_change":"2023-10-16T19:58:05.603987+0000","last_active":"2023-10-16T19:58:06.600772+0000","last_peered":"2023-10-16T19:58:06.600772+0000","last_clean":"2023-10-16T19:58:06.600772+0000","last_became_active":"2023-10-16T19:58:05.603733+0000","last_became_peered":"2023-10-16T19:58:05.603733+0000","last_unstale":"2023-10-16T19:58:06.600772+0000","last_undegraded":"2023-10-16T19:58:06.600772+0000","last_fullsized":"2023-10-16T19:58:06.600772+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:29:55.757064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"32'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.900393+0000","last_change":"2023-10-16T19:58:04.587285+0000","last_active":"2023-10-16T19:58:05.900393+0000","last_peered":"2023-10-16T19:58:05.900393+0000","last_clean":"2023-10-16T19:58:05.900393+0000","last_became_active":"2023-10-16T19:58:04.587076+0000","last_became_peered":"2023-10-16T19:58:04.587076+0000","last_unstale":"2023-10-16T19:58:05.900393+0000","last_undegraded":"2023-10-16T19:58:05.900393+0000","last_fullsized":"2023-10-16T19:58:05.900393+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_clean_scrub_stamp":"2023-10-16T19:58:03.569082+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:05:22.385602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:06.907582+0000","last_change":"2023-10-16T19:58:05.603529+0000","last_active":"2023-10-16T19:58:06.907582+0000","last_peered":"2023-10-16T19:58:06.907582+0000","last_clean":"2023-10-16T19:58:06.907582+0000","last_became_active":"2023-10-16T19:58:05.603317+0000","last_became_peered":"2023-10-16T19:58:05.603317+0000","last_unstale":"2023-10-16T19:58:06.907582+0000","last_undegraded":"2023-10-16T19:58:06.907582+0000","last_fullsized":"2023-10-16T19:58:06.907582+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:57:59.985913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"32'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.900113+0000","last_change":"2023-10-16T19:58:04.581625+0000","last_active":"2023-10-16T19:58:05.900113+0000","last_peered":"2023-10-16T19:58:05.900113+0000","last_clean":"2023-10-16T19:58:05.900113+0000","last_became_active":"2023-10-16T19:58:04.580982+0000","last_became_peered":"2023-10-16T19:58:04.580982+0000","last_unstale":"2023-10-16T19:58:05.900113+0000","last_undegraded":"2023-10-16T19:58:05.900113+0000","last_fullsized":"2023-10-16T19:58:05.900113+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_clean_scrub_stamp":"2023-10-16T19:58:03.569082+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:10:41.518249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:08.048999+0000","last_change":"2023-10-16T19:58:05.609638+0000","last_active":"2023-10-16T19:58:08.048999+0000","last_peered":"2023-10-16T19:58:08.048999+0000","last_clean":"2023-10-16T19:58:08.048999+0000","last_became_active":"2023-10-16T19:58:05.609287+0000","last_became_peered":"2023-10-16T19:58:05.609287+0000","last_unstale":"2023-10-16T19:58:08.048999+0000","last_undegraded":"2023-10-16T19:58:08.048999+0000","last_fullsized":"2023-10-16T19:58:08.048999+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:16:44.802078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"32'1","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.903123+0000","last_change":"2023-10-16T19:58:04.592222+0000","last_active":"2023-10-16T19:58:05.903123+0000","last_peered":"2023-10-16T19:58:05.903123+0000","last_clean":"2023-10-16T19:58:05.903123+0000","last_became_active":"2023-10-16T19:58:04.591382+0000","last_became_peered":"2023-10-16T19:58:04.591382+0000","last_unstale":"2023-10-16T19:58:05.903123+0000","last_undegraded":"2023-10-16T19:58:05.903123+0000","last_fullsized":"2023-10-16T19:58:05.903123+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_clean_scrub_stamp":"2023-10-16T19:58:03.569082+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:43:50.906516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:06.907902+0000","last_change":"2023-10-16T19:58:05.606948+0000","last_active":"2023-10-16T19:58:06.907902+0000","last_peered":"2023-10-16T19:58:06.907902+0000","last_clean":"2023-10-16T19:58:06.907902+0000","last_became_active":"2023-10-16T19:58:05.606777+0000","last_became_peered":"2023-10-16T19:58:05.606777+0000","last_unstale":"2023-10-16T19:58:06.907902+0000","last_undegraded":"2023-10-16T19:58:06.907902+0000","last_fullsized":"2023-10-16T19:58:06.907902+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:16:05.497063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"32'1","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.903086+0000","last_change":"2023-10-16T19:58:04.584929+0000","last_active":"2023-10-16T19:58:05.903086+0000","last_peered":"2023-10-16T19:58:05.903086+0000","last_clean":"2023-10-16T19:58:05.903086+0000","last_became_active":"2023-10-16T19:58:04.584702+0000","last_became_peered":"2023-10-16T19:58:04.584702+0000","last_unstale":"2023-10-16T19:58:05.903086+0000","last_undegraded":"2023-10-16T19:58:05.903086+0000","last_fullsized":"2023-10-16T19:58:05.903086+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_clean_scrub_stamp":"2023-10-16T19:58:03.569082+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:04:37.242998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:06.601149+0000","last_change":"2023-10-16T19:58:05.601585+0000","last_active":"2023-10-16T19:58:06.601149+0000","last_peered":"2023-10-16T19:58:06.601149+0000","last_clean":"2023-10-16T19:58:06.601149+0000","last_became_active":"2023-10-16T19:58:05.600813+0000","last_became_peered":"2023-10-16T19:58:05.600813+0000","last_unstale":"2023-10-16T19:58:06.601149+0000","last_undegraded":"2023-10-16T19:58:06.601149+0000","last_fullsized":"2023-10-16T19:58:06.601149+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:42:51.289673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.900155+0000","last_change":"2023-10-16T19:58:04.585183+0000","last_active":"2023-10-16T19:58:05.900155+0000","last_peered":"2023-10-16T19:58:05.900155+0000","last_clean":"2023-10-16T19:58:05.900155+0000","last_became_active":"2023-10-16T19:58:04.584173+0000","last_became_peered":"2023-10-16T19:58:04.584173+0000","last_unstale":"2023-10-16T19:58:05.900155+0000","last_undegraded":"2023-10-16T19:58:05.900155+0000","last_fullsized":"2023-10-16T19:58:05.900155+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_clean_scrub_stamp":"2023-10-16T19:58:03.569082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:09:03.659551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:06.907620+0000","last_change":"2023-10-16T19:58:05.601649+0000","last_active":"2023-10-16T19:58:06.907620+0000","last_peered":"2023-10-16T19:58:06.907620+0000","last_clean":"2023-10-16T19:58:06.907620+0000","last_became_active":"2023-10-16T19:58:05.601416+0000","last_became_peered":"2023-10-16T19:58:05.601416+0000","last_unstale":"2023-10-16T19:58:06.907620+0000","last_undegraded":"2023-10-16T19:58:06.907620+0000","last_fullsized":"2023-10-16T19:58:06.907620+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:41:58.386070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.903214+0000","last_change":"2023-10-16T19:58:04.590433+0000","last_active":"2023-10-16T19:58:05.903214+0000","last_peered":"2023-10-16T19:58:05.903214+0000","last_clean":"2023-10-16T19:58:05.903214+0000","last_became_active":"2023-10-16T19:58:04.589891+0000","last_became_peered":"2023-10-16T19:58:04.589891+0000","last_unstale":"2023-10-16T19:58:05.903214+0000","last_undegraded":"2023-10-16T19:58:05.903214+0000","last_fullsized":"2023-10-16T19:58:05.903214+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_clean_scrub_stamp":"2023-10-16T19:58:03.569082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:31:31.566550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:06.908068+0000","last_change":"2023-10-16T19:58:05.603341+0000","last_active":"2023-10-16T19:58:06.908068+0000","last_peered":"2023-10-16T19:58:06.908068+0000","last_clean":"2023-10-16T19:58:06.908068+0000","last_became_active":"2023-10-16T19:58:05.603042+0000","last_became_peered":"2023-10-16T19:58:05.603042+0000","last_unstale":"2023-10-16T19:58:06.908068+0000","last_undegraded":"2023-10-16T19:58:06.908068+0000","last_fullsized":"2023-10-16T19:58:06.908068+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:03:27.064265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.900339+0000","last_change":"2023-10-16T19:58:04.589480+0000","last_active":"2023-10-16T19:58:05.900339+0000","last_peered":"2023-10-16T19:58:05.900339+0000","last_clean":"2023-10-16T19:58:05.900339+0000","last_became_active":"2023-10-16T19:58:04.589253+0000","last_became_peered":"2023-10-16T19:58:04.589253+0000","last_unstale":"2023-10-16T19:58:05.900339+0000","last_undegraded":"2023-10-16T19:58:05.900339+0000","last_fullsized":"2023-10-16T19:58:05.900339+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_clean_scrub_stamp":"2023-10-16T19:58:03.569082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:45:34.917364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:07.028095+0000","last_change":"2023-10-16T19:58:05.602710+0000","last_active":"2023-10-16T19:58:07.028095+0000","last_peered":"2023-10-16T19:58:07.028095+0000","last_clean":"2023-10-16T19:58:07.028095+0000","last_became_active":"2023-10-16T19:58:05.602336+0000","last_became_peered":"2023-10-16T19:58:05.602336+0000","last_unstale":"2023-10-16T19:58:07.028095+0000","last_undegraded":"2023-10-16T19:58:07.028095+0000","last_fullsized":"2023-10-16T19:58:07.028095+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:23:18.475974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.902719+0000","last_change":"2023-10-16T19:58:04.586281+0000","last_active":"2023-10-16T19:58:05.902719+0000","last_peered":"2023-10-16T19:58:05.902719+0000","last_clean":"2023-10-16T19:58:05.902719+0000","last_became_active":"2023-10-16T19:58:04.586047+0000","last_became_peered":"2023-10-16T19:58:04.586047+0000","last_unstale":"2023-10-16T19:58:05.902719+0000","last_undegraded":"2023-10-16T19:58:05.902719+0000","last_fullsized":"2023-10-16T19:58:05.902719+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_clean_scrub_stamp":"2023-10-16T19:58:03.569082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:31:31.566550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:07.027615+0000","last_change":"2023-10-16T19:58:05.606519+0000","last_active":"2023-10-16T19:58:07.027615+0000","last_peered":"2023-10-16T19:58:07.027615+0000","last_clean":"2023-10-16T19:58:07.027615+0000","last_became_active":"2023-10-16T19:58:05.606148+0000","last_became_peered":"2023-10-16T19:58:05.606148+0000","last_unstale":"2023-10-16T19:58:07.027615+0000","last_undegraded":"2023-10-16T19:58:07.027615+0000","last_fullsized":"2023-10-16T19:58:07.027615+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:30:57.464645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"32'3","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.903980+0000","last_change":"2023-10-16T19:58:04.589426+0000","last_active":"2023-10-16T19:58:05.903980+0000","last_peered":"2023-10-16T19:58:05.903980+0000","last_clean":"2023-10-16T19:58:05.903980+0000","last_became_active":"2023-10-16T19:58:04.589139+0000","last_became_peered":"2023-10-16T19:58:04.589139+0000","last_unstale":"2023-10-16T19:58:05.903980+0000","last_undegraded":"2023-10-16T19:58:05.903980+0000","last_fullsized":"2023-10-16T19:58:05.903980+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_clean_scrub_stamp":"2023-10-16T19:58:03.569082+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:55:48.953087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:06.907817+0000","last_change":"2023-10-16T19:58:05.601316+0000","last_active":"2023-10-16T19:58:06.907817+0000","last_peered":"2023-10-16T19:58:06.907817+0000","last_clean":"2023-10-16T19:58:06.907817+0000","last_became_active":"2023-10-16T19:58:05.600598+0000","last_became_peered":"2023-10-16T19:58:05.600598+0000","last_unstale":"2023-10-16T19:58:06.907817+0000","last_undegraded":"2023-10-16T19:58:06.907817+0000","last_fullsized":"2023-10-16T19:58:06.907817+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:22:44.892357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"32'6","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.900175+0000","last_change":"2023-10-16T19:58:04.585306+0000","last_active":"2023-10-16T19:58:05.900175+0000","last_peered":"2023-10-16T19:58:05.900175+0000","last_clean":"2023-10-16T19:58:05.900175+0000","last_became_active":"2023-10-16T19:58:04.584588+0000","last_became_peered":"2023-10-16T19:58:04.584588+0000","last_unstale":"2023-10-16T19:58:05.900175+0000","last_undegraded":"2023-10-16T19:58:05.900175+0000","last_fullsized":"2023-10-16T19:58:05.900175+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_clean_scrub_stamp":"2023-10-16T19:58:03.569082+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:26:32.485443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:06.907587+0000","last_change":"2023-10-16T19:58:05.602640+0000","last_active":"2023-10-16T19:58:06.907587+0000","last_peered":"2023-10-16T19:58:06.907587+0000","last_clean":"2023-10-16T19:58:06.907587+0000","last_became_active":"2023-10-16T19:58:05.602386+0000","last_became_peered":"2023-10-16T19:58:05.602386+0000","last_unstale":"2023-10-16T19:58:06.907587+0000","last_undegraded":"2023-10-16T19:58:06.907587+0000","last_fullsized":"2023-10-16T19:58:06.907587+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:24:38.118997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"32'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.903229+0000","last_change":"2023-10-16T19:58:04.586869+0000","last_active":"2023-10-16T19:58:05.903229+0000","last_peered":"2023-10-16T19:58:05.903229+0000","last_clean":"2023-10-16T19:58:05.903229+0000","last_became_active":"2023-10-16T19:58:04.586290+0000","last_became_peered":"2023-10-16T19:58:04.586290+0000","last_unstale":"2023-10-16T19:58:05.903229+0000","last_undegraded":"2023-10-16T19:58:05.903229+0000","last_fullsized":"2023-10-16T19:58:05.903229+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_clean_scrub_stamp":"2023-10-16T19:58:03.569082+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:36:39.376783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:07.027826+0000","last_change":"2023-10-16T19:58:05.606176+0000","last_active":"2023-10-16T19:58:07.027826+0000","last_peered":"2023-10-16T19:58:07.027826+0000","last_clean":"2023-10-16T19:58:07.027826+0000","last_became_active":"2023-10-16T19:58:05.605962+0000","last_became_peered":"2023-10-16T19:58:05.605962+0000","last_unstale":"2023-10-16T19:58:07.027826+0000","last_undegraded":"2023-10-16T19:58:07.027826+0000","last_fullsized":"2023-10-16T19:58:07.027826+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:17:36.021934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.900285+0000","last_change":"2023-10-16T19:58:04.587764+0000","last_active":"2023-10-16T19:58:05.900285+0000","last_peered":"2023-10-16T19:58:05.900285+0000","last_clean":"2023-10-16T19:58:05.900285+0000","last_became_active":"2023-10-16T19:58:04.587531+0000","last_became_peered":"2023-10-16T19:58:04.587531+0000","last_unstale":"2023-10-16T19:58:05.900285+0000","last_undegraded":"2023-10-16T19:58:05.900285+0000","last_fullsized":"2023-10-16T19:58:05.900285+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_clean_scrub_stamp":"2023-10-16T19:58:03.569082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:43:31.501292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:08.048860+0000","last_change":"2023-10-16T19:58:05.608149+0000","last_active":"2023-10-16T19:58:08.048860+0000","last_peered":"2023-10-16T19:58:08.048860+0000","last_clean":"2023-10-16T19:58:08.048860+0000","last_became_active":"2023-10-16T19:58:05.607449+0000","last_became_peered":"2023-10-16T19:58:05.607449+0000","last_unstale":"2023-10-16T19:58:08.048860+0000","last_undegraded":"2023-10-16T19:58:08.048860+0000","last_fullsized":"2023-10-16T19:58:08.048860+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:16:05.497063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.900269+0000","last_change":"2023-10-16T19:58:04.588496+0000","last_active":"2023-10-16T19:58:05.900269+0000","last_peered":"2023-10-16T19:58:05.900269+0000","last_clean":"2023-10-16T19:58:05.900269+0000","last_became_active":"2023-10-16T19:58:04.588305+0000","last_became_peered":"2023-10-16T19:58:04.588305+0000","last_unstale":"2023-10-16T19:58:05.900269+0000","last_undegraded":"2023-10-16T19:58:05.900269+0000","last_fullsized":"2023-10-16T19:58:05.900269+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_clean_scrub_stamp":"2023-10-16T19:58:03.569082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:29:54.752503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:07.027380+0000","last_change":"2023-10-16T19:58:05.599594+0000","last_active":"2023-10-16T19:58:07.027380+0000","last_peered":"2023-10-16T19:58:07.027380+0000","last_clean":"2023-10-16T19:58:07.027380+0000","last_became_active":"2023-10-16T19:58:05.599356+0000","last_became_peered":"2023-10-16T19:58:05.599356+0000","last_unstale":"2023-10-16T19:58:07.027380+0000","last_undegraded":"2023-10-16T19:58:07.027380+0000","last_fullsized":"2023-10-16T19:58:07.027380+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:55:49.957648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"32'8","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.900249+0000","last_change":"2023-10-16T19:58:04.580974+0000","last_active":"2023-10-16T19:58:05.900249+0000","last_peered":"2023-10-16T19:58:05.900249+0000","last_clean":"2023-10-16T19:58:05.900249+0000","last_became_active":"2023-10-16T19:58:04.580648+0000","last_became_peered":"2023-10-16T19:58:04.580648+0000","last_unstale":"2023-10-16T19:58:05.900249+0000","last_undegraded":"2023-10-16T19:58:05.900249+0000","last_fullsized":"2023-10-16T19:58:05.900249+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_clean_scrub_stamp":"2023-10-16T19:58:03.569082+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:26:45.146069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:06.601286+0000","last_change":"2023-10-16T19:58:05.600582+0000","last_active":"2023-10-16T19:58:06.601286+0000","last_peered":"2023-10-16T19:58:06.601286+0000","last_clean":"2023-10-16T19:58:06.601286+0000","last_became_active":"2023-10-16T19:58:05.600333+0000","last_became_peered":"2023-10-16T19:58:05.600333+0000","last_unstale":"2023-10-16T19:58:06.601286+0000","last_undegraded":"2023-10-16T19:58:06.601286+0000","last_fullsized":"2023-10-16T19:58:06.601286+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:57:59.985913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"32'1","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.900190+0000","last_change":"2023-10-16T19:58:04.587935+0000","last_active":"2023-10-16T19:58:05.900190+0000","last_peered":"2023-10-16T19:58:05.900190+0000","last_clean":"2023-10-16T19:58:05.900190+0000","last_became_active":"2023-10-16T19:58:04.587576+0000","last_became_peered":"2023-10-16T19:58:04.587576+0000","last_unstale":"2023-10-16T19:58:05.900190+0000","last_undegraded":"2023-10-16T19:58:05.900190+0000","last_fullsized":"2023-10-16T19:58:05.900190+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_clean_scrub_stamp":"2023-10-16T19:58:03.569082+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:05:22.385602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:06.907877+0000","last_change":"2023-10-16T19:58:05.599461+0000","last_active":"2023-10-16T19:58:06.907877+0000","last_peered":"2023-10-16T19:58:06.907877+0000","last_clean":"2023-10-16T19:58:06.907877+0000","last_became_active":"2023-10-16T19:58:05.598861+0000","last_became_peered":"2023-10-16T19:58:05.598861+0000","last_unstale":"2023-10-16T19:58:06.907877+0000","last_undegraded":"2023-10-16T19:58:06.907877+0000","last_fullsized":"2023-10-16T19:58:06.907877+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:15:51.793903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"32'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.903256+0000","last_change":"2023-10-16T19:58:04.586713+0000","last_active":"2023-10-16T19:58:05.903256+0000","last_peered":"2023-10-16T19:58:05.903256+0000","last_clean":"2023-10-16T19:58:05.903256+0000","last_became_active":"2023-10-16T19:58:04.585973+0000","last_became_peered":"2023-10-16T19:58:04.585973+0000","last_unstale":"2023-10-16T19:58:05.903256+0000","last_undegraded":"2023-10-16T19:58:05.903256+0000","last_fullsized":"2023-10-16T19:58:05.903256+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_clean_scrub_stamp":"2023-10-16T19:58:03.569082+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:55:48.953087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:06.907571+0000","last_change":"2023-10-16T19:58:05.606948+0000","last_active":"2023-10-16T19:58:06.907571+0000","last_peered":"2023-10-16T19:58:06.907571+0000","last_clean":"2023-10-16T19:58:06.907571+0000","last_became_active":"2023-10-16T19:58:05.606722+0000","last_became_peered":"2023-10-16T19:58:05.606722+0000","last_unstale":"2023-10-16T19:58:06.907571+0000","last_undegraded":"2023-10-16T19:58:06.907571+0000","last_fullsized":"2023-10-16T19:58:06.907571+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:42:51.289673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"32'1","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.903176+0000","last_change":"2023-10-16T19:58:04.587531+0000","last_active":"2023-10-16T19:58:05.903176+0000","last_peered":"2023-10-16T19:58:05.903176+0000","last_clean":"2023-10-16T19:58:05.903176+0000","last_became_active":"2023-10-16T19:58:04.586934+0000","last_became_peered":"2023-10-16T19:58:04.586934+0000","last_unstale":"2023-10-16T19:58:05.903176+0000","last_undegraded":"2023-10-16T19:58:05.903176+0000","last_fullsized":"2023-10-16T19:58:05.903176+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_clean_scrub_stamp":"2023-10-16T19:58:03.569082+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:50:59.901042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:06.599160+0000","last_change":"2023-10-16T19:58:05.607501+0000","last_active":"2023-10-16T19:58:06.599160+0000","last_peered":"2023-10-16T19:58:06.599160+0000","last_clean":"2023-10-16T19:58:06.599160+0000","last_became_active":"2023-10-16T19:58:05.607269+0000","last_became_peered":"2023-10-16T19:58:05.607269+0000","last_unstale":"2023-10-16T19:58:06.599160+0000","last_undegraded":"2023-10-16T19:58:06.599160+0000","last_fullsized":"2023-10-16T19:58:06.599160+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:43:51.911077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.903109+0000","last_change":"2023-10-16T19:58:04.592403+0000","last_active":"2023-10-16T19:58:05.903109+0000","last_peered":"2023-10-16T19:58:05.903109+0000","last_clean":"2023-10-16T19:58:05.903109+0000","last_became_active":"2023-10-16T19:58:04.591967+0000","last_became_peered":"2023-10-16T19:58:04.591967+0000","last_unstale":"2023-10-16T19:58:05.903109+0000","last_undegraded":"2023-10-16T19:58:05.903109+0000","last_fullsized":"2023-10-16T19:58:05.903109+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_clean_scrub_stamp":"2023-10-16T19:58:03.569082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:46:15.563804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:06.599199+0000","last_change":"2023-10-16T19:58:05.600386+0000","last_active":"2023-10-16T19:58:06.599199+0000","last_peered":"2023-10-16T19:58:06.599199+0000","last_clean":"2023-10-16T19:58:06.599199+0000","last_became_active":"2023-10-16T19:58:05.600081+0000","last_became_peered":"2023-10-16T19:58:05.600081+0000","last_unstale":"2023-10-16T19:58:06.599199+0000","last_undegraded":"2023-10-16T19:58:06.599199+0000","last_fullsized":"2023-10-16T19:58:06.599199+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:11:36.806952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"32'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.902674+0000","last_change":"2023-10-16T19:58:04.588001+0000","last_active":"2023-10-16T19:58:05.902674+0000","last_peered":"2023-10-16T19:58:05.902674+0000","last_clean":"2023-10-16T19:58:05.902674+0000","last_became_active":"2023-10-16T19:58:04.587629+0000","last_became_peered":"2023-10-16T19:58:04.587629+0000","last_unstale":"2023-10-16T19:58:05.902674+0000","last_undegraded":"2023-10-16T19:58:05.902674+0000","last_fullsized":"2023-10-16T19:58:05.902674+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_clean_scrub_stamp":"2023-10-16T19:58:03.569082+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:57:52.788971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:06.599279+0000","last_change":"2023-10-16T19:58:05.607547+0000","last_active":"2023-10-16T19:58:06.599279+0000","last_peered":"2023-10-16T19:58:06.599279+0000","last_clean":"2023-10-16T19:58:06.599279+0000","last_became_active":"2023-10-16T19:58:05.607311+0000","last_became_peered":"2023-10-16T19:58:05.607311+0000","last_unstale":"2023-10-16T19:58:06.599279+0000","last_undegraded":"2023-10-16T19:58:06.599279+0000","last_fullsized":"2023-10-16T19:58:06.599279+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:04:38.247560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.904154+0000","last_change":"2023-10-16T19:58:04.583596+0000","last_active":"2023-10-16T19:58:05.904154+0000","last_peered":"2023-10-16T19:58:05.904154+0000","last_clean":"2023-10-16T19:58:05.904154+0000","last_became_active":"2023-10-16T19:58:04.583346+0000","last_became_peered":"2023-10-16T19:58:04.583346+0000","last_unstale":"2023-10-16T19:58:05.904154+0000","last_undegraded":"2023-10-16T19:58:05.904154+0000","last_fullsized":"2023-10-16T19:58:05.904154+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_clean_scrub_stamp":"2023-10-16T19:58:03.569082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:08:50.287071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:06.599374+0000","last_change":"2023-10-16T19:58:05.605758+0000","last_active":"2023-10-16T19:58:06.599374+0000","last_peered":"2023-10-16T19:58:06.599374+0000","last_clean":"2023-10-16T19:58:06.599374+0000","last_became_active":"2023-10-16T19:58:05.605529+0000","last_became_peered":"2023-10-16T19:58:05.605529+0000","last_unstale":"2023-10-16T19:58:06.599374+0000","last_undegraded":"2023-10-16T19:58:06.599374+0000","last_fullsized":"2023-10-16T19:58:06.599374+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:56:22.040826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.903243+0000","last_change":"2023-10-16T19:58:04.590215+0000","last_active":"2023-10-16T19:58:05.903243+0000","last_peered":"2023-10-16T19:58:05.903243+0000","last_clean":"2023-10-16T19:58:05.903243+0000","last_became_active":"2023-10-16T19:58:04.589542+0000","last_became_peered":"2023-10-16T19:58:04.589542+0000","last_unstale":"2023-10-16T19:58:05.903243+0000","last_undegraded":"2023-10-16T19:58:05.903243+0000","last_fullsized":"2023-10-16T19:58:05.903243+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_clean_scrub_stamp":"2023-10-16T19:58:03.569082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:57:52.788971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:08.049050+0000","last_change":"2023-10-16T19:58:05.608889+0000","last_active":"2023-10-16T19:58:08.049050+0000","last_peered":"2023-10-16T19:58:08.049050+0000","last_clean":"2023-10-16T19:58:08.049050+0000","last_became_active":"2023-10-16T19:58:05.608517+0000","last_became_peered":"2023-10-16T19:58:05.608517+0000","last_unstale":"2023-10-16T19:58:08.049050+0000","last_undegraded":"2023-10-16T19:58:08.049050+0000","last_fullsized":"2023-10-16T19:58:08.049050+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:25:36.321203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.904109+0000","last_change":"2023-10-16T19:58:04.587619+0000","last_active":"2023-10-16T19:58:05.904109+0000","last_peered":"2023-10-16T19:58:05.904109+0000","last_clean":"2023-10-16T19:58:05.904109+0000","last_became_active":"2023-10-16T19:58:04.587332+0000","last_became_peered":"2023-10-16T19:58:04.587332+0000","last_unstale":"2023-10-16T19:58:05.904109+0000","last_undegraded":"2023-10-16T19:58:05.904109+0000","last_fullsized":"2023-10-16T19:58:05.904109+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_clean_scrub_stamp":"2023-10-16T19:58:03.569082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:09:03.659551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:06.599401+0000","last_change":"2023-10-16T19:58:05.600830+0000","last_active":"2023-10-16T19:58:06.599401+0000","last_peered":"2023-10-16T19:58:06.599401+0000","last_clean":"2023-10-16T19:58:06.599401+0000","last_became_active":"2023-10-16T19:58:05.600305+0000","last_became_peered":"2023-10-16T19:58:05.600305+0000","last_unstale":"2023-10-16T19:58:06.599401+0000","last_undegraded":"2023-10-16T19:58:06.599401+0000","last_fullsized":"2023-10-16T19:58:06.599401+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:43:32.505853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"32'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.900264+0000","last_change":"2023-10-16T19:58:04.582724+0000","last_active":"2023-10-16T19:58:05.900264+0000","last_peered":"2023-10-16T19:58:05.900264+0000","last_clean":"2023-10-16T19:58:05.900264+0000","last_became_active":"2023-10-16T19:58:04.582012+0000","last_became_peered":"2023-10-16T19:58:04.582012+0000","last_unstale":"2023-10-16T19:58:05.900264+0000","last_undegraded":"2023-10-16T19:58:05.900264+0000","last_fullsized":"2023-10-16T19:58:05.900264+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_clean_scrub_stamp":"2023-10-16T19:58:03.569082+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:55:48.953087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:06.908225+0000","last_change":"2023-10-16T19:58:05.602250+0000","last_active":"2023-10-16T19:58:06.908225+0000","last_peered":"2023-10-16T19:58:06.908225+0000","last_clean":"2023-10-16T19:58:06.908225+0000","last_became_active":"2023-10-16T19:58:05.600830+0000","last_became_peered":"2023-10-16T19:58:05.600830+0000","last_unstale":"2023-10-16T19:58:06.908225+0000","last_undegraded":"2023-10-16T19:58:06.908225+0000","last_fullsized":"2023-10-16T19:58:06.908225+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:17:36.021934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"33'1","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:06.600649+0000","last_change":"2023-10-16T19:58:04.587844+0000","last_active":"2023-10-16T19:58:06.600649+0000","last_peered":"2023-10-16T19:58:06.600649+0000","last_clean":"2023-10-16T19:58:06.600649+0000","last_became_active":"2023-10-16T19:58:04.587329+0000","last_became_peered":"2023-10-16T19:58:04.587329+0000","last_unstale":"2023-10-16T19:58:06.600649+0000","last_undegraded":"2023-10-16T19:58:06.600649+0000","last_fullsized":"2023-10-16T19:58:06.600649+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_clean_scrub_stamp":"2023-10-16T19:58:03.569082+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:55:48.953087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:06.600449+0000","last_change":"2023-10-16T19:58:05.606214+0000","last_active":"2023-10-16T19:58:06.600449+0000","last_peered":"2023-10-16T19:58:06.600449+0000","last_clean":"2023-10-16T19:58:06.600449+0000","last_became_active":"2023-10-16T19:58:05.605958+0000","last_became_peered":"2023-10-16T19:58:05.605958+0000","last_unstale":"2023-10-16T19:58:06.600449+0000","last_undegraded":"2023-10-16T19:58:06.600449+0000","last_fullsized":"2023-10-16T19:58:06.600449+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:26:46.150630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.900321+0000","last_change":"2023-10-16T19:58:04.587092+0000","last_active":"2023-10-16T19:58:05.900321+0000","last_peered":"2023-10-16T19:58:05.900321+0000","last_clean":"2023-10-16T19:58:05.900321+0000","last_became_active":"2023-10-16T19:58:04.586851+0000","last_became_peered":"2023-10-16T19:58:04.586851+0000","last_unstale":"2023-10-16T19:58:05.900321+0000","last_undegraded":"2023-10-16T19:58:05.900321+0000","last_fullsized":"2023-10-16T19:58:05.900321+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_clean_scrub_stamp":"2023-10-16T19:58:03.569082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:36:39.376783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:07.027640+0000","last_change":"2023-10-16T19:58:05.606520+0000","last_active":"2023-10-16T19:58:07.027640+0000","last_peered":"2023-10-16T19:58:07.027640+0000","last_clean":"2023-10-16T19:58:07.027640+0000","last_became_active":"2023-10-16T19:58:05.606081+0000","last_became_peered":"2023-10-16T19:58:05.606081+0000","last_unstale":"2023-10-16T19:58:07.027640+0000","last_undegraded":"2023-10-16T19:58:07.027640+0000","last_fullsized":"2023-10-16T19:58:07.027640+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:26:46.150630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.902760+0000","last_change":"2023-10-16T19:58:04.588408+0000","last_active":"2023-10-16T19:58:05.902760+0000","last_peered":"2023-10-16T19:58:05.902760+0000","last_clean":"2023-10-16T19:58:05.902760+0000","last_became_active":"2023-10-16T19:58:04.588050+0000","last_became_peered":"2023-10-16T19:58:04.588050+0000","last_unstale":"2023-10-16T19:58:05.902760+0000","last_undegraded":"2023-10-16T19:58:05.902760+0000","last_fullsized":"2023-10-16T19:58:05.902760+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_clean_scrub_stamp":"2023-10-16T19:58:03.569082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:36:39.376783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:06.600631+0000","last_change":"2023-10-16T19:58:05.607522+0000","last_active":"2023-10-16T19:58:06.600631+0000","last_peered":"2023-10-16T19:58:06.600631+0000","last_clean":"2023-10-16T19:58:06.600631+0000","last_became_active":"2023-10-16T19:58:05.607381+0000","last_became_peered":"2023-10-16T19:58:05.607381+0000","last_unstale":"2023-10-16T19:58:06.600631+0000","last_undegraded":"2023-10-16T19:58:06.600631+0000","last_fullsized":"2023-10-16T19:58:06.600631+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:07:11.937484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.900254+0000","last_change":"2023-10-16T19:58:04.582574+0000","last_active":"2023-10-16T19:58:05.900254+0000","last_peered":"2023-10-16T19:58:05.900254+0000","last_clean":"2023-10-16T19:58:05.900254+0000","last_became_active":"2023-10-16T19:58:04.581711+0000","last_became_peered":"2023-10-16T19:58:04.581711+0000","last_unstale":"2023-10-16T19:58:05.900254+0000","last_undegraded":"2023-10-16T19:58:05.900254+0000","last_fullsized":"2023-10-16T19:58:05.900254+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_clean_scrub_stamp":"2023-10-16T19:58:03.569082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:57:52.788971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:07.027751+0000","last_change":"2023-10-16T19:58:05.602722+0000","last_active":"2023-10-16T19:58:07.027751+0000","last_peered":"2023-10-16T19:58:07.027751+0000","last_clean":"2023-10-16T19:58:07.027751+0000","last_became_active":"2023-10-16T19:58:05.602184+0000","last_became_peered":"2023-10-16T19:58:05.602184+0000","last_unstale":"2023-10-16T19:58:07.027751+0000","last_undegraded":"2023-10-16T19:58:07.027751+0000","last_fullsized":"2023-10-16T19:58:07.027751+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:16:44.802078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.903097+0000","last_change":"2023-10-16T19:58:04.589600+0000","last_active":"2023-10-16T19:58:05.903097+0000","last_peered":"2023-10-16T19:58:05.903097+0000","last_clean":"2023-10-16T19:58:05.903097+0000","last_became_active":"2023-10-16T19:58:04.587683+0000","last_became_peered":"2023-10-16T19:58:04.587683+0000","last_unstale":"2023-10-16T19:58:05.903097+0000","last_undegraded":"2023-10-16T19:58:05.903097+0000","last_fullsized":"2023-10-16T19:58:05.903097+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_clean_scrub_stamp":"2023-10-16T19:58:03.569082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:56:21.036265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:06.600727+0000","last_change":"2023-10-16T19:58:05.601329+0000","last_active":"2023-10-16T19:58:06.600727+0000","last_peered":"2023-10-16T19:58:06.600727+0000","last_clean":"2023-10-16T19:58:06.600727+0000","last_became_active":"2023-10-16T19:58:05.601074+0000","last_became_peered":"2023-10-16T19:58:05.601074+0000","last_unstale":"2023-10-16T19:58:06.600727+0000","last_undegraded":"2023-10-16T19:58:06.600727+0000","last_fullsized":"2023-10-16T19:58:06.600727+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:26:46.150630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.900213+0000","last_change":"2023-10-16T19:58:04.588810+0000","last_active":"2023-10-16T19:58:05.900213+0000","last_peered":"2023-10-16T19:58:05.900213+0000","last_clean":"2023-10-16T19:58:05.900213+0000","last_became_active":"2023-10-16T19:58:04.588392+0000","last_became_peered":"2023-10-16T19:58:04.588392+0000","last_unstale":"2023-10-16T19:58:05.900213+0000","last_undegraded":"2023-10-16T19:58:05.900213+0000","last_fullsized":"2023-10-16T19:58:05.900213+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_clean_scrub_stamp":"2023-10-16T19:58:03.569082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:41:57.381509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:08.049197+0000","last_change":"2023-10-16T19:58:05.609385+0000","last_active":"2023-10-16T19:58:08.049197+0000","last_peered":"2023-10-16T19:58:08.049197+0000","last_clean":"2023-10-16T19:58:08.049197+0000","last_became_active":"2023-10-16T19:58:05.609118+0000","last_became_peered":"2023-10-16T19:58:05.609118+0000","last_unstale":"2023-10-16T19:58:08.049197+0000","last_undegraded":"2023-10-16T19:58:08.049197+0000","last_fullsized":"2023-10-16T19:58:08.049197+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:23:18.475974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.904186+0000","last_change":"2023-10-16T19:58:04.586182+0000","last_active":"2023-10-16T19:58:05.904186+0000","last_peered":"2023-10-16T19:58:05.904186+0000","last_clean":"2023-10-16T19:58:05.904186+0000","last_became_active":"2023-10-16T19:58:04.585930+0000","last_became_peered":"2023-10-16T19:58:04.585930+0000","last_unstale":"2023-10-16T19:58:05.904186+0000","last_undegraded":"2023-10-16T19:58:05.904186+0000","last_fullsized":"2023-10-16T19:58:05.904186+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_clean_scrub_stamp":"2023-10-16T19:58:03.569082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:50:59.901042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":175,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.602583+0000","last_change":"2023-10-16T19:56:58.775782+0000","last_active":"2023-10-16T19:58:05.602583+0000","last_peered":"2023-10-16T19:58:05.602583+0000","last_clean":"2023-10-16T19:58:05.602583+0000","last_became_active":"2023-10-16T19:56:58.775567+0000","last_became_peered":"2023-10-16T19:56:58.775567+0000","last_unstale":"2023-10-16T19:58:05.602583+0000","last_undegraded":"2023-10-16T19:58:05.602583+0000","last_fullsized":"2023-10-16T19:58:05.602583+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:56:57.693332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:56:57.693332+0000","last_clean_scrub_stamp":"2023-10-16T19:56:57.693332+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:10:23.849736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574865,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":718,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194594,"statfs":{"total":200000000,"available":199264318,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 19:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.40799999999999997}]},{"osd":1,"last update":"Mon Oct 16 19:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.54200000000000004}]},{"osd":2,"last update":"Mon Oct 16 19:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.60499999999999998}]},{"osd":3,"last update":"Mon Oct 16 19:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.498},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.57099999999999995}]},{"osd":4,"last update":"Mon Oct 16 19:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.59299999999999997}]},{"osd":5,"last update":"Mon Oct 16 19:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"last":0.61699999999999999}]},{"osd":6,"last update":"Mon Oct 16 19:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.63400000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574865,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":142,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195170,"statfs":{"total":200000000,"available":199854160,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 19:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.58299999999999996}]},{"osd":1,"last update":"Mon Oct 16 19:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.64700000000000002}]},{"osd":2,"last update":"Mon Oct 16 19:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.70099999999999996}]},{"osd":3,"last update":"Mon Oct 16 19:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.746},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.52500000000000002}]},{"osd":4,"last update":"Mon Oct 16 19:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.50700000000000001}]},{"osd":5,"last update":"Mon Oct 16 19:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.72799999999999998}]},{"osd":7,"last update":"Mon Oct 16 19:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.624},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.56999999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574865,"num_pgs":32,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":143,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195169,"statfs":{"total":200000000,"available":199853142,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 19:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"min":{"1min":0.19700000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.309,"5min":0.309,"15min":0.309},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"last":0.30599999999999999}]},{"osd":2,"last update":"Mon Oct 16 19:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.443,"5min":0.443,"15min":0.443},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"last":0.41499999999999998}]},{"osd":3,"last update":"Mon Oct 16 19:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"last":0.32600000000000001}]},{"osd":4,"last update":"Mon Oct 16 19:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.44800000000000001}]},{"osd":5,"last update":"Mon Oct 16 19:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.59699999999999998}]},{"osd":6,"last update":"Mon Oct 16 19:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.54500000000000004}]},{"osd":7,"last update":"Mon Oct 16 19:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.502}]}]},{"osd":0,"up_from":13,"seq":55834574865,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":718,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194594,"statfs":{"total":200000000,"available":199264408,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 16 19:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":11.031000000000001,"5min":11.031000000000001,"15min":11.031000000000001},"last":0.26200000000000001},{"interface":"front","average":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":12.218,"5min":12.218,"15min":12.218},"last":0.36199999999999999}]},{"osd":2,"last update":"Mon Oct 16 19:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":11.058,"5min":11.058,"15min":11.058},"last":0.32100000000000001},{"interface":"front","average":{"1min":1.123,"5min":1.123,"15min":1.123},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":14.763999999999999,"5min":14.763999999999999,"15min":14.763999999999999},"last":0.29799999999999999}]},{"osd":3,"last update":"Mon Oct 16 19:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":10.935,"5min":10.935,"15min":10.935},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":11.083,"5min":11.083,"15min":11.083},"last":0.39000000000000001}]},{"osd":4,"last update":"Mon Oct 16 19:57:58 2023","interfaces":[{"interface":"back","average":{"1min":1.196,"5min":1.196,"15min":1.196},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":12.279,"5min":12.279,"15min":12.279},"last":0.51700000000000002},{"interface":"front","average":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":10.879,"5min":10.879,"15min":10.879},"last":0.40300000000000002}]},{"osd":5,"last update":"Mon Oct 16 19:57:58 2023","interfaces":[{"interface":"back","average":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":10.907,"5min":10.907,"15min":10.907},"last":0.38100000000000001},{"interface":"front","average":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":11,"5min":11,"15min":11},"last":0.48099999999999998}]},{"osd":6,"last update":"Mon Oct 16 19:57:58 2023","interfaces":[{"interface":"back","average":{"1min":1.157,"5min":1.157,"15min":1.157},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":10.972,"5min":10.972,"15min":10.972},"last":0.41999999999999998},{"interface":"front","average":{"1min":1.24,"5min":1.24,"15min":1.24},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":12.34,"5min":12.34,"15min":12.34},"last":0.45200000000000001}]},{"osd":7,"last update":"Mon Oct 16 19:57:58 2023","interfaces":[{"interface":"back","average":{"1min":1.252,"5min":1.252,"15min":1.252},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":12.311,"5min":12.311,"15min":12.311},"last":0.48799999999999999},{"interface":"front","average":{"1min":1.167,"5min":1.167,"15min":1.167},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":10.845000000000001,"5min":10.845000000000001,"15min":10.845000000000001},"last":0.432}]}]},{"osd":2,"up_from":13,"seq":55834574865,"num_pgs":17,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":141,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195170,"statfs":{"total":200000000,"available":199854706,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 19:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"min":{"1min":0.17899999999999999,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"last":0.26400000000000001},{"interface":"front","average":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"min":{"1min":0.20100000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.36799999999999999}]},{"osd":1,"last update":"Mon Oct 16 19:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.375,"15min":0.375},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"last":0.30199999999999999},{"interface":"front","average":{"1min":0.37,"5min":0.37,"15min":0.37},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"last":0.28799999999999998}]},{"osd":3,"last update":"Mon Oct 16 19:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.34499999999999997}]},{"osd":4,"last update":"Mon Oct 16 19:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.48599999999999999}]},{"osd":5,"last update":"Mon Oct 16 19:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.38400000000000001}]},{"osd":6,"last update":"Mon Oct 16 19:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.433}]},{"osd":7,"last update":"Mon Oct 16 19:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.45900000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574865,"num_pgs":31,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":143,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195169,"statfs":{"total":200000000,"available":199853142,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 19:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"last":0.246},{"interface":"front","average":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.498,"5min":0.498,"15min":0.498},"last":0.38}]},{"osd":1,"last update":"Mon Oct 16 19:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"last":0.313},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"min":{"1min":0.20499999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.32600000000000001}]},{"osd":2,"last update":"Mon Oct 16 19:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.36299999999999999}]},{"osd":4,"last update":"Mon Oct 16 19:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.63},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.51200000000000001}]},{"osd":5,"last update":"Mon Oct 16 19:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.58699999999999997}]},{"osd":6,"last update":"Mon Oct 16 19:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.501}]},{"osd":7,"last update":"Mon Oct 16 19:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.2030000000000001,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.139,"5min":1.139,"15min":1.139},"last":0.47999999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574865,"num_pgs":29,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":141,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195170,"statfs":{"total":200000000,"available":199854672,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 19:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.46600000000000003}]},{"osd":1,"last update":"Mon Oct 16 19:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.034,"5min":1.034,"15min":1.034},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.40400000000000003}]},{"osd":2,"last update":"Mon Oct 16 19:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.103,"5min":1.103,"15min":1.103},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.50900000000000001}]},{"osd":3,"last update":"Mon Oct 16 19:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.071,"5min":1.071,"15min":1.071},"last":0.56999999999999995}]},{"osd":5,"last update":"Mon Oct 16 19:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.49099999999999999}]},{"osd":6,"last update":"Mon Oct 16 19:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.44900000000000001}]},{"osd":7,"last update":"Mon Oct 16 19:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.441},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.59399999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574865,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":142,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195170,"statfs":{"total":200000000,"available":199854104,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 19:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.45100000000000001}]},{"osd":1,"last update":"Mon Oct 16 19:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":7.9989999999999997,"5min":7.9989999999999997,"15min":7.9989999999999997},"last":0.435},{"interface":"front","average":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":8.0150000000000006,"5min":8.0150000000000006,"15min":8.0150000000000006},"last":0.53400000000000003}]},{"osd":2,"last update":"Mon Oct 16 19:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":1.032,"5min":1.032,"15min":1.032},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.379}]},{"osd":3,"last update":"Mon Oct 16 19:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":8.077,"5min":8.077,"15min":8.077},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.58299999999999996}]},{"osd":4,"last update":"Mon Oct 16 19:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.65100000000000002}]},{"osd":6,"last update":"Mon Oct 16 19:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.63600000000000001}]},{"osd":7,"last update":"Mon Oct 16 19:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.625},{"interface":"front","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.61399999999999999}]}]}],"pool_statfs":[]}} 2023-10-16T19:58:14.673 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T19:58:14.826 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.823+0000 7f85a06bf700 1 Processor -- start 2023-10-16T19:58:14.826 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.824+0000 7f85a06bf700 1 -- start start 2023-10-16T19:58:14.828 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.824+0000 7f85a06bf700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f85980cd0a0 0x7f8598071fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:14.829 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.824+0000 7f85a06bf700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f859806f530 con 0x7f859806af60 2023-10-16T19:58:14.829 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.824+0000 7f85a06bf700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f859806f7d0 con 0x7f859815c1d0 2023-10-16T19:58:14.829 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.824+0000 7f85a06bf700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f859806fab0 con 0x7f85980cd0a0 2023-10-16T19:58:14.830 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.825+0000 7f859ec5c700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f85980cd0a0 0x7f8598071fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:14.830 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.825+0000 7f859dc5a700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f859806af60 0x7f859815fe50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:57480/0 (socket says 172.21.15.157:57480) 2023-10-16T19:58:14.830 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.825+0000 7f859dc5a700 1 -- 172.21.15.157:0/3821894584 learned_addr learned my addr 172.21.15.157:0/3821894584 (peer_addr_for_me v1:172.21.15.157:0/0) 2023-10-16T19:58:14.830 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.825+0000 7f859ec5c700 1 -- 172.21.15.157:0/3821894584 >> v1:172.21.15.187:6789/0 conn(0x7f859815c1d0 legacy=0x7f859806a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:58:14.831 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.825+0000 7f859d459700 1 -- 172.21.15.157:0/3821894584 <== mon.0 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 445216423 0 0) 0x7f859806f530 con 0x7f859806af60 2023-10-16T19:58:14.831 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.825+0000 7f859ec5c700 1 -- 172.21.15.157:0/3821894584 >> v1:172.21.15.157:6789/0 conn(0x7f859806af60 legacy=0x7f859815fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:14.831 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.825+0000 7f859ec5c700 1 -- 172.21.15.157:0/3821894584 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85980cb1a0 con 0x7f85980cd0a0 2023-10-16T19:58:14.832 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.825+0000 7f859ec5c700 1 --2- 172.21.15.157:0/3821894584 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f85980cd0a0 0x7f8598071fb0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f8590009d90 tx=0x7f859000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e7cf9f2c40a075b server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:58:14.832 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.825+0000 7f859d459700 1 -- 172.21.15.157:0/3821894584 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f859000e070 con 0x7f85980cd0a0 2023-10-16T19:58:14.832 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.825+0000 7f859d459700 1 -- 172.21.15.157:0/3821894584 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f859000bb90 con 0x7f85980cd0a0 2023-10-16T19:58:14.832 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.825+0000 7f859d459700 1 -- 172.21.15.157:0/3821894584 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8590003a70 con 0x7f85980cd0a0 2023-10-16T19:58:14.833 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.826+0000 7f85a06bf700 1 -- 172.21.15.157:0/3821894584 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f85980cd0a0 msgr2=0x7f8598071fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:14.833 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.826+0000 7f85a06bf700 1 --2- 172.21.15.157:0/3821894584 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f85980cd0a0 0x7f8598071fb0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f8590009d90 tx=0x7f859000b330 comp rx=0 tx=0).stop 2023-10-16T19:58:14.833 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.826+0000 7f85a06bf700 1 -- 172.21.15.157:0/3821894584 shutdown_connections 2023-10-16T19:58:14.833 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.826+0000 7f85a06bf700 1 --2- 172.21.15.157:0/3821894584 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f85980cd0a0 0x7f8598071fb0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:14.834 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.826+0000 7f85a06bf700 1 -- 172.21.15.157:0/3821894584 >> 172.21.15.157:0/3821894584 conn(0x7f85980cd4e0 msgr2=0x7f85980cd8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:58:14.834 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.826+0000 7f85a06bf700 1 -- 172.21.15.157:0/3821894584 shutdown_connections 2023-10-16T19:58:14.834 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.826+0000 7f85a06bf700 1 -- 172.21.15.157:0/3821894584 wait complete. 2023-10-16T19:58:14.837 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.827+0000 7f85a06bf700 1 Processor -- start 2023-10-16T19:58:14.837 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.827+0000 7f85a06bf700 1 -- start start 2023-10-16T19:58:14.838 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.828+0000 7f85a06bf700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f859806af60 0x7f85981491e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:14.838 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.828+0000 7f85a06bf700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f85980cd0a0 0x7f85980b2fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:14.838 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.828+0000 7f85a06bf700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f859815c1d0 0x7f8598148a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:14.838 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.828+0000 7f85a06bf700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85980b3500 con 0x7f85980cd0a0 2023-10-16T19:58:14.839 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.828+0000 7f85a06bf700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8598148f70 con 0x7f859806af60 2023-10-16T19:58:14.839 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.828+0000 7f85a06bf700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f859814a4b0 con 0x7f859815c1d0 2023-10-16T19:58:14.839 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.828+0000 7f859dc5a700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f85980cd0a0 0x7f85980b2fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:14.840 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.828+0000 7f859dc5a700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f85980cd0a0 0x7f85980b2fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:47814/0 (socket says 172.21.15.157:47814) 2023-10-16T19:58:14.840 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.828+0000 7f859dc5a700 1 -- 172.21.15.157:0/3435780580 learned_addr learned my addr 172.21.15.157:0/3435780580 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:58:14.840 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.828+0000 7f859ec5c700 1 --2- 172.21.15.157:0/3435780580 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f859815c1d0 0x7f8598148a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:14.840 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.828+0000 7f859e45b700 1 --2- 172.21.15.157:0/3435780580 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f859806af60 0x7f85981491e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:14.841 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.828+0000 7f859dc5a700 1 -- 172.21.15.157:0/3435780580 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f859815c1d0 msgr2=0x7f8598148a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:14.841 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.828+0000 7f859dc5a700 1 --2- 172.21.15.157:0/3435780580 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f859815c1d0 0x7f8598148a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:14.841 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.828+0000 7f859dc5a700 1 -- 172.21.15.157:0/3435780580 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f859806af60 msgr2=0x7f85981491e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:14.841 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.828+0000 7f859dc5a700 1 --2- 172.21.15.157:0/3435780580 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f859806af60 0x7f85981491e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:14.842 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.828+0000 7f859dc5a700 1 -- 172.21.15.157:0/3435780580 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8590009a70 con 0x7f85980cd0a0 2023-10-16T19:58:14.842 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.828+0000 7f859e45b700 1 --2- 172.21.15.157:0/3435780580 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f859806af60 0x7f85981491e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T19:58:14.842 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.828+0000 7f859dc5a700 1 --2- 172.21.15.157:0/3435780580 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f85980cd0a0 0x7f85980b2fc0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f85940011e0 tx=0x7f859400cae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:58:14.843 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.828+0000 7f858effd700 1 -- 172.21.15.157:0/3435780580 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8594004c80 con 0x7f85980cd0a0 2023-10-16T19:58:14.843 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.828+0000 7f858effd700 1 -- 172.21.15.157:0/3435780580 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8594004e00 con 0x7f85980cd0a0 2023-10-16T19:58:14.843 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.829+0000 7f85a06bf700 1 -- 172.21.15.157:0/3435780580 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85981498a0 con 0x7f85980cd0a0 2023-10-16T19:58:14.843 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.829+0000 7f858effd700 1 -- 172.21.15.157:0/3435780580 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8594007310 con 0x7f85980cd0a0 2023-10-16T19:58:14.844 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.829+0000 7f85a06bf700 1 -- 172.21.15.157:0/3435780580 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8598149e60 con 0x7f85980cd0a0 2023-10-16T19:58:14.844 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.829+0000 7f85a06bf700 1 -- 172.21.15.157:0/3435780580 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f859814a660 con 0x7f85980cd0a0 2023-10-16T19:58:14.844 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.830+0000 7f858effd700 1 -- 172.21.15.157:0/3435780580 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f8594007470 con 0x7f85980cd0a0 2023-10-16T19:58:14.844 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.830+0000 7f858effd700 1 --2- 172.21.15.157:0/3435780580 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f857c06af00 0x7f857c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:14.845 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.830+0000 7f858effd700 1 -- 172.21.15.157:0/3435780580 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5729+0+0 (secure 0 0 0) 0x7f85940893a0 con 0x7f85980cd0a0 2023-10-16T19:58:14.845 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.830+0000 7f859e45b700 1 --2- 172.21.15.157:0/3435780580 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f857c06af00 0x7f857c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:14.845 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.831+0000 7f859e45b700 1 --2- 172.21.15.157:0/3435780580 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f857c06af00 0x7f857c06d3c0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f8588006fd0 tx=0x7f8588008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:58:14.846 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:14.835+0000 7f858effd700 1 -- 172.21.15.157:0/3435780580 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f859814a660 con 0x7f85980cd0a0 2023-10-16T19:58:15.030 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:15.027+0000 7f85a06bf700 1 -- 172.21.15.157:0/3435780580 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f859814a620 con 0x7f85980cd0a0 2023-10-16T19:58:15.030 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:15.028+0000 7f858effd700 1 -- 172.21.15.157:0/3435780580 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+16601 (secure 0 0 0) 0x7f8594054430 con 0x7f85980cd0a0 2023-10-16T19:58:15.031 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-10-16T19:58:15.032 INFO:teuthology.orchestra.run.smithi157.stdout:{"epoch":33,"fsid":"28199dc9-64d5-479e-83c6-21f097c33d39","created":"2023-10-16T19:56:49.201889+0000","modified":"2023-10-16T19:58:06.592936+0000","last_up_change":"2023-10-16T19:56:54.675673+0000","last_in_change":"2023-10-16T19:56:51.666728+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T19:56:56.932895+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"testcephfs1_metadata","create_time":"2023-10-16T19:58:02.774777+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"testcephfs1"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"testcephfs1_data","create_time":"2023-10-16T19:58:03.939912+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"testcephfs1"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":335785898},{"type":"v1","addr":"172.21.15.157:6809","nonce":335785898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":335785898},{"type":"v1","addr":"172.21.15.157:6811","nonce":335785898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6815","nonce":335785898},{"type":"v1","addr":"172.21.15.157:6817","nonce":335785898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":335785898},{"type":"v1","addr":"172.21.15.157:6813","nonce":335785898}]},"public_addr":"172.21.15.157:6809/335785898","cluster_addr":"172.21.15.157:6811/335785898","heartbeat_back_addr":"172.21.15.157:6817/335785898","heartbeat_front_addr":"172.21.15.157:6813/335785898","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":3482825047},{"type":"v1","addr":"172.21.15.157:6801","nonce":3482825047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":3482825047},{"type":"v1","addr":"172.21.15.157:6803","nonce":3482825047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":3482825047},{"type":"v1","addr":"172.21.15.157:6807","nonce":3482825047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":3482825047},{"type":"v1","addr":"172.21.15.157:6805","nonce":3482825047}]},"public_addr":"172.21.15.157:6801/3482825047","cluster_addr":"172.21.15.157:6803/3482825047","heartbeat_back_addr":"172.21.15.157:6807/3482825047","heartbeat_front_addr":"172.21.15.157:6805/3482825047","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":1118292389},{"type":"v1","addr":"172.21.15.157:6825","nonce":1118292389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":1118292389},{"type":"v1","addr":"172.21.15.157:6827","nonce":1118292389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":1118292389},{"type":"v1","addr":"172.21.15.157:6831","nonce":1118292389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":1118292389},{"type":"v1","addr":"172.21.15.157:6829","nonce":1118292389}]},"public_addr":"172.21.15.157:6825/1118292389","cluster_addr":"172.21.15.157:6827/1118292389","heartbeat_back_addr":"172.21.15.157:6831/1118292389","heartbeat_front_addr":"172.21.15.157:6829/1118292389","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":989329821},{"type":"v1","addr":"172.21.15.157:6816","nonce":989329821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":989329821},{"type":"v1","addr":"172.21.15.157:6819","nonce":989329821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":989329821},{"type":"v1","addr":"172.21.15.157:6823","nonce":989329821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":989329821},{"type":"v1","addr":"172.21.15.157:6821","nonce":989329821}]},"public_addr":"172.21.15.157:6816/989329821","cluster_addr":"172.21.15.157:6819/989329821","heartbeat_back_addr":"172.21.15.157:6823/989329821","heartbeat_front_addr":"172.21.15.157:6821/989329821","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":3841016811},{"type":"v1","addr":"172.21.15.187:6801","nonce":3841016811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6803","nonce":3841016811},{"type":"v1","addr":"172.21.15.187:6804","nonce":3841016811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6809","nonce":3841016811},{"type":"v1","addr":"172.21.15.187:6811","nonce":3841016811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":3841016811},{"type":"v1","addr":"172.21.15.187:6808","nonce":3841016811}]},"public_addr":"172.21.15.187:6801/3841016811","cluster_addr":"172.21.15.187:6804/3841016811","heartbeat_back_addr":"172.21.15.187:6811/3841016811","heartbeat_front_addr":"172.21.15.187:6808/3841016811","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":915130263},{"type":"v1","addr":"172.21.15.187:6805","nonce":915130263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6807","nonce":915130263},{"type":"v1","addr":"172.21.15.187:6810","nonce":915130263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":915130263},{"type":"v1","addr":"172.21.15.187:6815","nonce":915130263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":915130263},{"type":"v1","addr":"172.21.15.187:6813","nonce":915130263}]},"public_addr":"172.21.15.187:6805/915130263","cluster_addr":"172.21.15.187:6810/915130263","heartbeat_back_addr":"172.21.15.187:6815/915130263","heartbeat_front_addr":"172.21.15.187:6813/915130263","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":654976824},{"type":"v1","addr":"172.21.15.187:6817","nonce":654976824}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":654976824},{"type":"v1","addr":"172.21.15.187:6819","nonce":654976824}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":654976824},{"type":"v1","addr":"172.21.15.187:6823","nonce":654976824}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":654976824},{"type":"v1","addr":"172.21.15.187:6821","nonce":654976824}]},"public_addr":"172.21.15.187:6817/654976824","cluster_addr":"172.21.15.187:6819/654976824","heartbeat_back_addr":"172.21.15.187:6823/654976824","heartbeat_front_addr":"172.21.15.187:6821/654976824","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":4284059445},{"type":"v1","addr":"172.21.15.187:6825","nonce":4284059445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":4284059445},{"type":"v1","addr":"172.21.15.187:6827","nonce":4284059445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":4284059445},{"type":"v1","addr":"172.21.15.187:6831","nonce":4284059445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":4284059445},{"type":"v1","addr":"172.21.15.187:6829","nonce":4284059445}]},"public_addr":"172.21.15.187:6825/4284059445","cluster_addr":"172.21.15.187:6827/4284059445","heartbeat_back_addr":"172.21.15.187:6831/4284059445","heartbeat_front_addr":"172.21.15.187:6829/4284059445","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.819780+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.824193+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.849575+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.824806+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.809540+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.805093+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.866109+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T19:56:52.807372+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T19:58:15.033 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:15.031+0000 7f85a06bf700 1 -- 172.21.15.157:0/3435780580 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f857c06af00 msgr2=0x7f857c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:15.034 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:15.031+0000 7f85a06bf700 1 --2- 172.21.15.157:0/3435780580 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f857c06af00 0x7f857c06d3c0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f8588006fd0 tx=0x7f8588008040 comp rx=0 tx=0).stop 2023-10-16T19:58:15.034 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:15.031+0000 7f85a06bf700 1 -- 172.21.15.157:0/3435780580 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f85980cd0a0 msgr2=0x7f85980b2fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:15.034 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:15.031+0000 7f85a06bf700 1 --2- 172.21.15.157:0/3435780580 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f85980cd0a0 0x7f85980b2fc0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f85940011e0 tx=0x7f859400cae0 comp rx=0 tx=0).stop 2023-10-16T19:58:15.035 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:15.031+0000 7f85a06bf700 1 -- 172.21.15.157:0/3435780580 shutdown_connections 2023-10-16T19:58:15.035 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:15.031+0000 7f85a06bf700 1 --2- 172.21.15.157:0/3435780580 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f857c06af00 0x7f857c06d3c0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:15.035 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:15.031+0000 7f85a06bf700 1 --2- 172.21.15.157:0/3435780580 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f859806af60 0x7f85981491e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:15.036 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:15.031+0000 7f85a06bf700 1 --2- 172.21.15.157:0/3435780580 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f859815c1d0 0x7f8598148a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:15.036 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:15.031+0000 7f85a06bf700 1 --2- 172.21.15.157:0/3435780580 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f85980cd0a0 0x7f85980b2fc0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:15.036 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:15.031+0000 7f85a06bf700 1 -- 172.21.15.157:0/3435780580 >> 172.21.15.157:0/3435780580 conn(0x7f85980cd4e0 msgr2=0x7f859815da20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:58:15.036 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:15.031+0000 7f85a06bf700 1 -- 172.21.15.157:0/3435780580 shutdown_connections 2023-10-16T19:58:15.037 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:15.031+0000 7f85a06bf700 1 -- 172.21.15.157:0/3435780580 wait complete. 2023-10-16T19:58:16.046 INFO:tasks.ceph:Scrubbing osd.0 2023-10-16T19:58:16.047 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-10-16T19:58:16.185 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.183+0000 7f835bbe3700 1 Processor -- start 2023-10-16T19:58:16.186 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.183+0000 7f835bbe3700 1 -- start start 2023-10-16T19:58:16.189 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.184+0000 7f835bbe3700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f83540b5750 0x7f83540708d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:16.190 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.184+0000 7f835bbe3700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8354160880 con 0x7f83541603d0 2023-10-16T19:58:16.190 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.184+0000 7f835bbe3700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f835406c130 con 0x7f83540ca900 2023-10-16T19:58:16.191 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.184+0000 7f835bbe3700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f835406d720 con 0x7f83540b5750 2023-10-16T19:58:16.192 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.184+0000 7f835917e700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f83541603d0 0x7f835406ba20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:57492/0 (socket says 172.21.15.157:57492) 2023-10-16T19:58:16.192 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.184+0000 7f835917e700 1 -- 172.21.15.157:0/4005134116 learned_addr learned my addr 172.21.15.157:0/4005134116 (peer_addr_for_me v1:172.21.15.157:0/0) 2023-10-16T19:58:16.192 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.184+0000 7f835897d700 1 -- 172.21.15.157:0/4005134116 <== mon.0 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1270455260 0 0) 0x7f8354160880 con 0x7f83541603d0 2023-10-16T19:58:16.193 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.184+0000 7f835897d700 1 -- 172.21.15.157:0/4005134116 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f83400035b0 con 0x7f83541603d0 2023-10-16T19:58:16.193 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.184+0000 7f835997f700 1 --2- 172.21.15.157:0/4005134116 >> v2:172.21.15.187:3300/0 conn(0x7f83540b5750 0x7f83540708d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:16.193 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.184+0000 7f835897d700 1 -- 172.21.15.157:0/4005134116 <== mon.0 v1:172.21.15.157:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1367621725 0 0) 0x7f83400035b0 con 0x7f83541603d0 2023-10-16T19:58:16.194 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.184+0000 7f835897d700 1 -- 172.21.15.157:0/4005134116 >> v2:172.21.15.187:3300/0 conn(0x7f83540b5750 msgr2=0x7f83540708d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:58:16.194 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.184+0000 7f835897d700 1 --2- 172.21.15.157:0/4005134116 >> v2:172.21.15.187:3300/0 conn(0x7f83540b5750 0x7f83540708d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:16.194 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.184+0000 7f835897d700 1 -- 172.21.15.157:0/4005134116 >> v1:172.21.15.187:6789/0 conn(0x7f83540ca900 legacy=0x7f83540cad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:16.194 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.184+0000 7f835897d700 1 -- 172.21.15.157:0/4005134116 --> v1:172.21.15.157:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f835406a980 con 0x7f83541603d0 2023-10-16T19:58:16.195 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.184+0000 7f835897d700 1 -- 172.21.15.157:0/4005134116 <== mon.0 v1:172.21.15.157:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4021145519 0 0) 0x7f8344001670 con 0x7f83541603d0 2023-10-16T19:58:16.195 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.185+0000 7f835897d700 1 -- 172.21.15.157:0/4005134116 >> v1:172.21.15.157:6789/0 conn(0x7f83541603d0 legacy=0x7f835406ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:16.195 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.185+0000 7f835897d700 1 --2- 172.21.15.157:0/4005134116 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8340003a00 0x7f8340003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:16.196 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.185+0000 7f835897d700 1 --2- 172.21.15.157:0/4005134116 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8340004850 0x7f8340004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:16.196 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.185+0000 7f835897d700 1 --2- 172.21.15.157:0/4005134116 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8340005330 0x7f834000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:16.196 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.185+0000 7f835897d700 1 -- 172.21.15.157:0/4005134116 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f835406d720 con 0x7f8340003a00 2023-10-16T19:58:16.197 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.185+0000 7f835897d700 1 -- 172.21.15.157:0/4005134116 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f834000c200 con 0x7f8340005330 2023-10-16T19:58:16.197 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.185+0000 7f835897d700 1 -- 172.21.15.157:0/4005134116 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f834000c3c0 con 0x7f8340004850 2023-10-16T19:58:16.197 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.185+0000 7f835997f700 1 --2- 172.21.15.157:0/4005134116 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8340003a00 0x7f8340003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:16.197 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.185+0000 7f835a180700 1 --2- 172.21.15.157:0/4005134116 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8340005330 0x7f834000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:16.198 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.185+0000 7f835917e700 1 --2- 172.21.15.157:0/4005134116 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8340004850 0x7f8340004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:16.198 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.185+0000 7f835997f700 1 -- 172.21.15.157:0/4005134116 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8340004850 msgr2=0x7f8340004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:58:16.199 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.185+0000 7f835997f700 1 --2- 172.21.15.157:0/4005134116 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8340004850 0x7f8340004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:16.199 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.185+0000 7f835997f700 1 -- 172.21.15.157:0/4005134116 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8340005330 msgr2=0x7f834000ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:58:16.199 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.185+0000 7f835997f700 1 --2- 172.21.15.157:0/4005134116 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8340005330 0x7f834000ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:16.200 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.185+0000 7f835a180700 1 -- 172.21.15.157:0/4005134116 reap_dead start 2023-10-16T19:58:16.200 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.185+0000 7f835997f700 1 -- 172.21.15.157:0/4005134116 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83400035b0 con 0x7f8340003a00 2023-10-16T19:58:16.200 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.185+0000 7f835917e700 1 --2- 172.21.15.157:0/4005134116 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8340004850 0x7f8340004cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T19:58:16.201 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.185+0000 7f835997f700 1 --2- 172.21.15.157:0/4005134116 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8340003a00 0x7f8340003e20 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f8350009b30 tx=0x7f8340005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40ac0f2abd806ab8 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:58:16.201 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.185+0000 7f835897d700 1 -- 172.21.15.157:0/4005134116 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f835000e6c0 con 0x7f8340003a00 2023-10-16T19:58:16.201 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.185+0000 7f835897d700 1 -- 172.21.15.157:0/4005134116 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f835000e820 con 0x7f8340003a00 2023-10-16T19:58:16.201 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.185+0000 7f835897d700 1 -- 172.21.15.157:0/4005134116 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f835000eb90 con 0x7f8340003a00 2023-10-16T19:58:16.202 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.186+0000 7f835bbe3700 1 -- 172.21.15.157:0/4005134116 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8340003a00 msgr2=0x7f8340003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:16.202 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.186+0000 7f835bbe3700 1 --2- 172.21.15.157:0/4005134116 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8340003a00 0x7f8340003e20 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f8350009b30 tx=0x7f8340005880 comp rx=0 tx=0).stop 2023-10-16T19:58:16.202 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.186+0000 7f835bbe3700 1 -- 172.21.15.157:0/4005134116 shutdown_connections 2023-10-16T19:58:16.203 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.186+0000 7f835bbe3700 1 --2- 172.21.15.157:0/4005134116 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8340003a00 0x7f8340003e20 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:16.203 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.186+0000 7f835bbe3700 1 -- 172.21.15.157:0/4005134116 >> 172.21.15.157:0/4005134116 conn(0x7f835406c7e0 msgr2=0x7f835406cbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:58:16.203 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.186+0000 7f835bbe3700 1 -- 172.21.15.157:0/4005134116 shutdown_connections 2023-10-16T19:58:16.203 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.186+0000 7f835bbe3700 1 -- 172.21.15.157:0/4005134116 wait complete. 2023-10-16T19:58:16.204 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.187+0000 7f835bbe3700 1 Processor -- start 2023-10-16T19:58:16.204 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.187+0000 7f835bbe3700 1 -- start start 2023-10-16T19:58:16.208 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.188+0000 7f835bbe3700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8340003a00 0x7f83541f0d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:16.208 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.188+0000 7f835bbe3700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f83540c9a70 0x7f8354154710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:16.208 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.188+0000 7f835bbe3700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8354154c50 0x7f8354155100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:16.209 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.188+0000 7f835bbe3700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83541f12a0 con 0x7f83540c9a70 2023-10-16T19:58:16.209 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.188+0000 7f835bbe3700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83541569e0 con 0x7f8340003a00 2023-10-16T19:58:16.209 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.188+0000 7f835bbe3700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8354156cc0 con 0x7f8354154c50 2023-10-16T19:58:16.209 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.188+0000 7f835917e700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f83540c9a70 0x7f8354154710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:16.210 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.188+0000 7f835917e700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f83540c9a70 0x7f8354154710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:47834/0 (socket says 172.21.15.157:47834) 2023-10-16T19:58:16.210 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.188+0000 7f835917e700 1 -- 172.21.15.157:0/2334820930 learned_addr learned my addr 172.21.15.157:0/2334820930 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:58:16.210 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.188+0000 7f835997f700 1 --2- 172.21.15.157:0/2334820930 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8340003a00 0x7f83541f0d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:16.211 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.188+0000 7f835a180700 1 --2- 172.21.15.157:0/2334820930 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8354154c50 0x7f8354155100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:16.211 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.188+0000 7f835917e700 1 -- 172.21.15.157:0/2334820930 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8354154c50 msgr2=0x7f8354155100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:16.211 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.188+0000 7f835917e700 1 --2- 172.21.15.157:0/2334820930 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8354154c50 0x7f8354155100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:16.211 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.188+0000 7f835917e700 1 -- 172.21.15.157:0/2334820930 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8340003a00 msgr2=0x7f83541f0d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:16.212 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.188+0000 7f835917e700 1 --2- 172.21.15.157:0/2334820930 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8340003a00 0x7f83541f0d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:16.212 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.188+0000 7f835917e700 1 -- 172.21.15.157:0/2334820930 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83540c7380 con 0x7f83540c9a70 2023-10-16T19:58:16.212 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.188+0000 7f835997f700 1 --2- 172.21.15.157:0/2334820930 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8340003a00 0x7f83541f0d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T19:58:16.213 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.188+0000 7f835a180700 1 --2- 172.21.15.157:0/2334820930 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8354154c50 0x7f8354155100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T19:58:16.213 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.188+0000 7f835917e700 1 --2- 172.21.15.157:0/2334820930 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f83540c9a70 0x7f8354154710 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f83440017a0 tx=0x7f834400eb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:58:16.213 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.189+0000 7f834a7fc700 1 -- 172.21.15.157:0/2334820930 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8344012590 con 0x7f83540c9a70 2023-10-16T19:58:16.213 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.189+0000 7f834a7fc700 1 -- 172.21.15.157:0/2334820930 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83440126f0 con 0x7f83540c9a70 2023-10-16T19:58:16.214 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.189+0000 7f835bbe3700 1 -- 172.21.15.157:0/2334820930 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83540c7660 con 0x7f83540c9a70 2023-10-16T19:58:16.214 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.189+0000 7f834a7fc700 1 -- 172.21.15.157:0/2334820930 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8344012a60 con 0x7f83540c9a70 2023-10-16T19:58:16.214 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.189+0000 7f835bbe3700 1 -- 172.21.15.157:0/2334820930 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83541566d0 con 0x7f83540c9a70 2023-10-16T19:58:16.215 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.189+0000 7f835bbe3700 1 -- 172.21.15.157:0/2334820930 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f835406af40 con 0x7f83540c9a70 2023-10-16T19:58:16.215 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.190+0000 7f834a7fc700 1 -- 172.21.15.157:0/2334820930 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f8344012bc0 con 0x7f83540c9a70 2023-10-16T19:58:16.215 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.190+0000 7f834a7fc700 1 --2- 172.21.15.157:0/2334820930 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f833806af00 0x7f833806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:16.215 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.191+0000 7f834a7fc700 1 -- 172.21.15.157:0/2334820930 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5729+0+0 (secure 0 0 0) 0x7f8344089c90 con 0x7f83540c9a70 2023-10-16T19:58:16.216 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.191+0000 7f834a7fc700 1 --2- 172.21.15.157:0/2334820930 >> [v2:172.21.15.157:6808/335785898,v1:172.21.15.157:6809/335785898] conn(0x7f8338073100 0x7f8338075540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:16.216 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.191+0000 7f834a7fc700 1 -- 172.21.15.157:0/2334820930 --> [v2:172.21.15.157:6808/335785898,v1:172.21.15.157:6809/335785898] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8338075c10 con 0x7f8338073100 2023-10-16T19:58:16.216 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.191+0000 7f834a7fc700 1 -- 172.21.15.157:0/2334820930 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f834408a0e0 con 0x7f83540c9a70 2023-10-16T19:58:16.217 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.191+0000 7f835a180700 1 --2- 172.21.15.157:0/2334820930 >> [v2:172.21.15.157:6808/335785898,v1:172.21.15.157:6809/335785898] conn(0x7f8338073100 0x7f8338075540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:16.217 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.191+0000 7f835997f700 1 --2- 172.21.15.157:0/2334820930 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f833806af00 0x7f833806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:16.217 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.191+0000 7f835a180700 1 --2- 172.21.15.157:0/2334820930 >> [v2:172.21.15.157:6808/335785898,v1:172.21.15.157:6809/335785898] conn(0x7f8338073100 0x7f8338075540 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:58:16.218 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.191+0000 7f835997f700 1 --2- 172.21.15.157:0/2334820930 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f833806af00 0x7f833806d3c0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f83500090b0 tx=0x7f8350008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:58:16.218 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.192+0000 7f834a7fc700 1 -- 172.21.15.157:0/2334820930 <== osd.0 v2:172.21.15.157:6808/335785898 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23595 (crc 0 0 0) 0x7f8338075c10 con 0x7f8338073100 2023-10-16T19:58:16.218 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.205+0000 7f835bbe3700 1 -- 172.21.15.157:0/2334820930 --> [v2:172.21.15.157:6808/335785898,v1:172.21.15.157:6809/335785898] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f835406ac60 con 0x7f8338073100 2023-10-16T19:58:16.219 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.205+0000 7f834a7fc700 1 -- 172.21.15.157:0/2334820930 <== osd.0 v2:172.21.15.157:6808/335785898 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+757 (crc 0 0 0) 0x7f834c003b80 con 0x7f8338073100 2023-10-16T19:58:16.219 INFO:teuthology.orchestra.run.smithi157.stdout:{ 2023-10-16T19:58:16.220 INFO:teuthology.orchestra.run.smithi157.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) osd_delete_sleep = '0.000000' osd_delete_sleep_hdd = '0.000000' osd_delete_sleep_hybrid = '0.000000' osd_delete_sleep_ssd = '0.000000' osd_max_backfills = '1' osd_pg_delete_cost = '15728640' (not observed, change may require restart) osd_recovery_max_active = '0' osd_recovery_max_active_hdd = '3' osd_recovery_max_active_ssd = '10' osd_recovery_sleep = '0.000000' osd_recovery_sleep_hdd = '0.000000' osd_recovery_sleep_hybrid = '0.000000' osd_recovery_sleep_ssd = '0.000000' osd_scrub_sleep = '0.000000' osd_snap_trim_sleep = '0.000000' osd_snap_trim_sleep_hdd = '0.000000' osd_snap_trim_sleep_hybrid = '0.000000' osd_snap_trim_sleep_ssd = '0.000000' " 2023-10-16T19:58:16.220 INFO:teuthology.orchestra.run.smithi157.stdout:} 2023-10-16T19:58:16.222 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.205+0000 7f835bbe3700 1 -- 172.21.15.157:0/2334820930 >> [v2:172.21.15.157:6808/335785898,v1:172.21.15.157:6809/335785898] conn(0x7f8338073100 msgr2=0x7f8338075540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:16.222 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.205+0000 7f835bbe3700 1 --2- 172.21.15.157:0/2334820930 >> [v2:172.21.15.157:6808/335785898,v1:172.21.15.157:6809/335785898] conn(0x7f8338073100 0x7f8338075540 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:16.223 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.205+0000 7f835bbe3700 1 -- 172.21.15.157:0/2334820930 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f833806af00 msgr2=0x7f833806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:16.223 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.205+0000 7f835bbe3700 1 --2- 172.21.15.157:0/2334820930 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f833806af00 0x7f833806d3c0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f83500090b0 tx=0x7f8350008030 comp rx=0 tx=0).stop 2023-10-16T19:58:16.223 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.205+0000 7f835bbe3700 1 -- 172.21.15.157:0/2334820930 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f83540c9a70 msgr2=0x7f8354154710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:16.223 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.205+0000 7f835bbe3700 1 --2- 172.21.15.157:0/2334820930 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f83540c9a70 0x7f8354154710 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f83440017a0 tx=0x7f834400eb10 comp rx=0 tx=0).stop 2023-10-16T19:58:16.224 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.205+0000 7f835a180700 1 -- 172.21.15.157:0/2334820930 reap_dead start 2023-10-16T19:58:16.224 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.205+0000 7f835bbe3700 1 -- 172.21.15.157:0/2334820930 shutdown_connections 2023-10-16T19:58:16.224 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.205+0000 7f835bbe3700 1 -- 172.21.15.157:0/2334820930 >> 172.21.15.157:0/2334820930 conn(0x7f835406c7e0 msgr2=0x7f83540af770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:58:16.225 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.205+0000 7f835bbe3700 1 -- 172.21.15.157:0/2334820930 shutdown_connections 2023-10-16T19:58:16.225 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.205+0000 7f835bbe3700 1 -- 172.21.15.157:0/2334820930 wait complete. 2023-10-16T19:58:16.225 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2023-10-16T19:58:16.347 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.345+0000 7fbdfcbf6700 1 Processor -- start 2023-10-16T19:58:16.348 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.345+0000 7fbdfcbf6700 1 -- start start 2023-10-16T19:58:16.353 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.346+0000 7fbdfcbf6700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbdf815e2f0 0x7fbdf806d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:16.354 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.346+0000 7fbdfcbf6700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fbdf806af60 0x7fbdf80ce910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:16.354 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.346+0000 7fbdfcbf6700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdf80d08b0 con 0x7fbdf806de00 2023-10-16T19:58:16.355 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.346+0000 7fbdfcbf6700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbdf81628f0 con 0x7fbdf806af60 2023-10-16T19:58:16.355 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.346+0000 7fbdfcbf6700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdf8162bd0 con 0x7fbdf815e2f0 2023-10-16T19:58:16.356 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.346+0000 7fbdf5d9b700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7fbdf806de00 0x7fbdf806a850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:57514/0 (socket says 172.21.15.157:57514) 2023-10-16T19:58:16.356 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.346+0000 7fbdf5d9b700 1 -- 172.21.15.157:0/1048890741 learned_addr learned my addr 172.21.15.157:0/1048890741 (peer_addr_for_me v1:172.21.15.157:0/0) 2023-10-16T19:58:16.356 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.346+0000 7fbdf559a700 1 -- 172.21.15.157:0/1048890741 <== mon.0 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3199408342 0 0) 0x7fbdf80d08b0 con 0x7fbdf806de00 2023-10-16T19:58:16.357 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.346+0000 7fbdf6d9d700 1 --2- 172.21.15.157:0/1048890741 >> v2:172.21.15.187:3300/0 conn(0x7fbdf806af60 0x7fbdf80ce910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:16.357 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.346+0000 7fbdf559a700 1 -- 172.21.15.157:0/1048890741 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbde00035b0 con 0x7fbdf806de00 2023-10-16T19:58:16.357 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.346+0000 7fbdf659c700 1 --2- 172.21.15.157:0/1048890741 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbdf815e2f0 0x7fbdf806d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:16.358 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.346+0000 7fbdf559a700 1 -- 172.21.15.157:0/1048890741 <== mon.0 v1:172.21.15.157:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 466689089 0 0) 0x7fbde00035b0 con 0x7fbdf806de00 2023-10-16T19:58:16.358 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.346+0000 7fbdf559a700 1 -- 172.21.15.157:0/1048890741 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbdf815e2f0 msgr2=0x7fbdf806d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:58:16.358 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.346+0000 7fbdf559a700 1 --2- 172.21.15.157:0/1048890741 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbdf815e2f0 0x7fbdf806d0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:16.358 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.346+0000 7fbdf559a700 1 -- 172.21.15.157:0/1048890741 >> v2:172.21.15.187:3300/0 conn(0x7fbdf806af60 msgr2=0x7fbdf80ce910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:58:16.359 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.346+0000 7fbdf559a700 1 --2- 172.21.15.157:0/1048890741 >> v2:172.21.15.187:3300/0 conn(0x7fbdf806af60 0x7fbdf80ce910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:16.359 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.346+0000 7fbdf559a700 1 -- 172.21.15.157:0/1048890741 --> v1:172.21.15.157:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdf80d05d0 con 0x7fbdf806de00 2023-10-16T19:58:16.359 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.346+0000 7fbdf559a700 1 -- 172.21.15.157:0/1048890741 <== mon.0 v1:172.21.15.157:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4021145519 0 0) 0x7fbdec001670 con 0x7fbdf806de00 2023-10-16T19:58:16.360 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.346+0000 7fbdf559a700 1 -- 172.21.15.157:0/1048890741 >> v1:172.21.15.157:6789/0 conn(0x7fbdf806de00 legacy=0x7fbdf806a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:16.360 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.346+0000 7fbdf559a700 1 --2- 172.21.15.157:0/1048890741 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbde0003a00 0x7fbde0003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:16.360 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.346+0000 7fbdf559a700 1 --2- 172.21.15.157:0/1048890741 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbde0004850 0x7fbde0004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:16.360 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.346+0000 7fbdf559a700 1 --2- 172.21.15.157:0/1048890741 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbde0005210 0x7fbde000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:16.361 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.346+0000 7fbdf559a700 1 -- 172.21.15.157:0/1048890741 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdf81628f0 con 0x7fbde0005210 2023-10-16T19:58:16.361 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.346+0000 7fbdf559a700 1 -- 172.21.15.157:0/1048890741 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdf8162bd0 con 0x7fbde0003a00 2023-10-16T19:58:16.361 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.346+0000 7fbdf559a700 1 -- 172.21.15.157:0/1048890741 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbde000c0e0 con 0x7fbde0004850 2023-10-16T19:58:16.361 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.347+0000 7fbdf6d9d700 1 --2- 172.21.15.157:0/1048890741 >> v2:172.21.15.187:3300/0 conn(0x7fbdf806af60 0x7fbdf80ce910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T19:58:16.362 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.347+0000 7fbdf659c700 1 --2- 172.21.15.157:0/1048890741 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbdf815e2f0 0x7fbdf806d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T19:58:16.362 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.347+0000 7fbdf6d9d700 1 --2- 172.21.15.157:0/1048890741 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbde0005210 0x7fbde000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:16.362 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.347+0000 7fbdf5d9b700 1 --2- 172.21.15.157:0/1048890741 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbde0004850 0x7fbde0004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:16.363 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.347+0000 7fbdf659c700 1 --2- 172.21.15.157:0/1048890741 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbde0003a00 0x7fbde0003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:16.363 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.347+0000 7fbdf6d9d700 1 -- 172.21.15.157:0/1048890741 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbde0004850 msgr2=0x7fbde0004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:58:16.363 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.347+0000 7fbdf6d9d700 1 --2- 172.21.15.157:0/1048890741 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbde0004850 0x7fbde0004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:16.363 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.347+0000 7fbdf6d9d700 1 -- 172.21.15.157:0/1048890741 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbde0003a00 msgr2=0x7fbde0003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:58:16.364 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.347+0000 7fbdf6d9d700 1 --2- 172.21.15.157:0/1048890741 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbde0003a00 0x7fbde0003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:16.364 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.347+0000 7fbdf6d9d700 1 -- 172.21.15.157:0/1048890741 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbde00035b0 con 0x7fbde0005210 2023-10-16T19:58:16.364 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.347+0000 7fbdf659c700 1 --2- 172.21.15.157:0/1048890741 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbde0003a00 0x7fbde0003e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T19:58:16.365 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.347+0000 7fbdf6d9d700 1 --2- 172.21.15.157:0/1048890741 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbde0005210 0x7fbde000ba10 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fbdf00073e0 tx=0x7fbde0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6cab5cfb1a518e1 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:58:16.365 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.347+0000 7fbdf559a700 1 -- 172.21.15.157:0/1048890741 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdf0014400 con 0x7fbde0005210 2023-10-16T19:58:16.365 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.347+0000 7fbdf559a700 1 -- 172.21.15.157:0/1048890741 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdf0014560 con 0x7fbde0005210 2023-10-16T19:58:16.366 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.347+0000 7fbdf559a700 1 -- 172.21.15.157:0/1048890741 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdf00148d0 con 0x7fbde0005210 2023-10-16T19:58:16.366 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.348+0000 7fbdfcbf6700 1 -- 172.21.15.157:0/1048890741 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbde0005210 msgr2=0x7fbde000ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:16.366 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.348+0000 7fbdfcbf6700 1 --2- 172.21.15.157:0/1048890741 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbde0005210 0x7fbde000ba10 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fbdf00073e0 tx=0x7fbde0005880 comp rx=0 tx=0).stop 2023-10-16T19:58:16.366 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.348+0000 7fbdf6d9d700 1 -- 172.21.15.157:0/1048890741 reap_dead start 2023-10-16T19:58:16.367 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.348+0000 7fbdfcbf6700 1 -- 172.21.15.157:0/1048890741 shutdown_connections 2023-10-16T19:58:16.367 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.348+0000 7fbdfcbf6700 1 -- 172.21.15.157:0/1048890741 >> 172.21.15.157:0/1048890741 conn(0x7fbdf80cd4e0 msgr2=0x7fbdf80cd8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:58:16.367 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.348+0000 7fbdfcbf6700 1 -- 172.21.15.157:0/1048890741 shutdown_connections 2023-10-16T19:58:16.368 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.348+0000 7fbdfcbf6700 1 -- 172.21.15.157:0/1048890741 wait complete. 2023-10-16T19:58:16.368 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.349+0000 7fbdfcbf6700 1 Processor -- start 2023-10-16T19:58:16.368 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.349+0000 7fbdfcbf6700 1 -- start start 2023-10-16T19:58:16.368 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.350+0000 7fbdfcbf6700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbde0005210 0x7fbdf81f3220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:16.369 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.350+0000 7fbdfcbf6700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbdf80b4e10 0x7fbdf80b5270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:16.369 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.350+0000 7fbdfcbf6700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbdf8160b80 0x7fbdf8161010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:16.369 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.350+0000 7fbdfcbf6700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdf8161550 con 0x7fbdf80b4e10 2023-10-16T19:58:16.370 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.350+0000 7fbdfcbf6700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdf80b5860 con 0x7fbde0005210 2023-10-16T19:58:16.370 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.350+0000 7fbdfcbf6700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdf80b5b40 con 0x7fbdf8160b80 2023-10-16T19:58:16.370 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.350+0000 7fbdf5d9b700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbdf80b4e10 0x7fbdf80b5270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:16.370 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.350+0000 7fbdf5d9b700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbdf80b4e10 0x7fbdf80b5270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:47856/0 (socket says 172.21.15.157:47856) 2023-10-16T19:58:16.371 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.350+0000 7fbdf5d9b700 1 -- 172.21.15.157:0/3698434216 learned_addr learned my addr 172.21.15.157:0/3698434216 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:58:16.371 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.350+0000 7fbdf659c700 1 --2- 172.21.15.157:0/3698434216 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbde0005210 0x7fbdf81f3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:16.371 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.350+0000 7fbdf6d9d700 1 --2- 172.21.15.157:0/3698434216 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbdf8160b80 0x7fbdf8161010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:16.372 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.350+0000 7fbdf5d9b700 1 -- 172.21.15.157:0/3698434216 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbdf8160b80 msgr2=0x7fbdf8161010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:16.372 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.350+0000 7fbdf5d9b700 1 --2- 172.21.15.157:0/3698434216 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbdf8160b80 0x7fbdf8161010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:16.372 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.350+0000 7fbdf5d9b700 1 -- 172.21.15.157:0/3698434216 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbde0005210 msgr2=0x7fbdf81f3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:16.372 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.350+0000 7fbdf5d9b700 1 --2- 172.21.15.157:0/3698434216 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbde0005210 0x7fbdf81f3220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:16.373 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.350+0000 7fbdf5d9b700 1 -- 172.21.15.157:0/3698434216 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdf80b5e20 con 0x7fbdf80b4e10 2023-10-16T19:58:16.373 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.350+0000 7fbdf5d9b700 1 --2- 172.21.15.157:0/3698434216 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbdf80b4e10 0x7fbdf80b5270 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fbdec007310 tx=0x7fbdec007620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:58:16.373 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.351+0000 7fbde6ffd700 1 -- 172.21.15.157:0/3698434216 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdec007800 con 0x7fbdf80b4e10 2023-10-16T19:58:16.374 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.351+0000 7fbde6ffd700 1 -- 172.21.15.157:0/3698434216 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdec00f8d0 con 0x7fbdf80b4e10 2023-10-16T19:58:16.374 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.351+0000 7fbdfcbf6700 1 -- 172.21.15.157:0/3698434216 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdf80b6100 con 0x7fbdf80b4e10 2023-10-16T19:58:16.374 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.351+0000 7fbde6ffd700 1 -- 172.21.15.157:0/3698434216 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdec00fc80 con 0x7fbdf80b4e10 2023-10-16T19:58:16.374 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.351+0000 7fbdfcbf6700 1 -- 172.21.15.157:0/3698434216 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdf81f3760 con 0x7fbdf80b4e10 2023-10-16T19:58:16.376 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.352+0000 7fbdfcbf6700 1 -- 172.21.15.157:0/3698434216 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbdf80b6620 con 0x7fbdf80b4e10 2023-10-16T19:58:16.376 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.352+0000 7fbde6ffd700 1 -- 172.21.15.157:0/3698434216 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fbdec01d460 con 0x7fbdf80b4e10 2023-10-16T19:58:16.376 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.352+0000 7fbde6ffd700 1 --2- 172.21.15.157:0/3698434216 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fbdd806af00 0x7fbdd806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:16.377 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.352+0000 7fbde6ffd700 1 -- 172.21.15.157:0/3698434216 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5729+0+0 (secure 0 0 0) 0x7fbdec089680 con 0x7fbdf80b4e10 2023-10-16T19:58:16.377 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.353+0000 7fbdf659c700 1 --2- 172.21.15.157:0/3698434216 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fbdd806af00 0x7fbdd806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:16.377 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.353+0000 7fbdf659c700 1 --2- 172.21.15.157:0/3698434216 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fbdd806af00 0x7fbdd806d3c0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fbdf80af240 tx=0x7fbde8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:58:16.377 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.357+0000 7fbde6ffd700 1 -- 172.21.15.157:0/3698434216 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fbdf80b6620 con 0x7fbdf80b4e10 2023-10-16T19:58:16.547 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.545+0000 7fbdfcbf6700 1 -- 172.21.15.157:0/3698434216 --> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7fbdf80b5cb0 con 0x7fbdd806af00 2023-10-16T19:58:16.548 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.545+0000 7fbde6ffd700 1 -- 172.21.15.157:0/3698434216 <== mgr.4100 v2:172.21.15.187:6832/2426285296 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fbdf80b5cb0 con 0x7fbdd806af00 2023-10-16T19:58:16.550 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.547+0000 7fbdfcbf6700 1 -- 172.21.15.157:0/3698434216 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fbdd806af00 msgr2=0x7fbdd806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:16.550 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.547+0000 7fbdfcbf6700 1 --2- 172.21.15.157:0/3698434216 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fbdd806af00 0x7fbdd806d3c0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fbdf80af240 tx=0x7fbde8008040 comp rx=0 tx=0).stop 2023-10-16T19:58:16.551 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.547+0000 7fbdfcbf6700 1 -- 172.21.15.157:0/3698434216 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbdf80b4e10 msgr2=0x7fbdf80b5270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:16.551 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.547+0000 7fbdfcbf6700 1 --2- 172.21.15.157:0/3698434216 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbdf80b4e10 0x7fbdf80b5270 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fbdec007310 tx=0x7fbdec007620 comp rx=0 tx=0).stop 2023-10-16T19:58:16.551 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.547+0000 7fbdfcbf6700 1 -- 172.21.15.157:0/3698434216 shutdown_connections 2023-10-16T19:58:16.551 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.547+0000 7fbdfcbf6700 1 --2- 172.21.15.157:0/3698434216 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fbdd806af00 0x7fbdd806d3c0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:16.552 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.547+0000 7fbdfcbf6700 1 --2- 172.21.15.157:0/3698434216 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbde0005210 0x7fbdf81f3220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:16.552 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.547+0000 7fbdfcbf6700 1 --2- 172.21.15.157:0/3698434216 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbdf8160b80 0x7fbdf8161010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:16.552 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.547+0000 7fbdfcbf6700 1 --2- 172.21.15.157:0/3698434216 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbdf80b4e10 0x7fbdf80b5270 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:16.552 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.547+0000 7fbdfcbf6700 1 -- 172.21.15.157:0/3698434216 >> 172.21.15.157:0/3698434216 conn(0x7fbdf80cd4e0 msgr2=0x7fbdf80b0540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:58:16.553 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.548+0000 7fbdfcbf6700 1 -- 172.21.15.157:0/3698434216 shutdown_connections 2023-10-16T19:58:16.553 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.548+0000 7fbdfcbf6700 1 -- 172.21.15.157:0/3698434216 wait complete. 2023-10-16T19:58:16.554 INFO:teuthology.orchestra.run.smithi157.stderr:instructed osd(s) 0 to deep-scrub 2023-10-16T19:58:16.562 INFO:tasks.ceph:Scrubbing osd.1 2023-10-16T19:58:16.562 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-10-16T19:58:16.687 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.685+0000 7f0d7c537700 1 Processor -- start 2023-10-16T19:58:16.688 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.685+0000 7f0d7c537700 1 -- start start 2023-10-16T19:58:16.693 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.686+0000 7f0d7c537700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0d740cc280 0x7f0d740b36b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:16.694 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.686+0000 7f0d7c537700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f0d740b3bf0 0x7f0d7415f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:16.694 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.686+0000 7f0d7c537700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d7415ce40 con 0x7f0d7415bdb0 2023-10-16T19:58:16.694 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.686+0000 7f0d7c537700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d740b4070 con 0x7f0d740b3bf0 2023-10-16T19:58:16.695 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.686+0000 7f0d7c537700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d740d19e0 con 0x7f0d740cc280 2023-10-16T19:58:16.695 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.686+0000 7f0d7a2d3700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f0d7415bdb0 0x7f0d740d1170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:57534/0 (socket says 172.21.15.157:57534) 2023-10-16T19:58:16.695 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.686+0000 7f0d7a2d3700 1 -- 172.21.15.157:0/2382168414 learned_addr learned my addr 172.21.15.157:0/2382168414 (peer_addr_for_me v1:172.21.15.157:0/0) 2023-10-16T19:58:16.695 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.686+0000 7f0d792d1700 1 -- 172.21.15.157:0/2382168414 <== mon.0 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3877005645 0 0) 0x7f0d7415ce40 con 0x7f0d7415bdb0 2023-10-16T19:58:16.696 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.686+0000 7f0d7aad4700 1 --2- 172.21.15.157:0/2382168414 >> v2:172.21.15.187:3300/0 conn(0x7f0d740b3bf0 0x7f0d7415f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:16.696 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.686+0000 7f0d79ad2700 1 --2- 172.21.15.157:0/2382168414 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0d740cc280 0x7f0d740b36b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:16.696 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.686+0000 7f0d792d1700 1 -- 172.21.15.157:0/2382168414 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0d600035b0 con 0x7f0d7415bdb0 2023-10-16T19:58:16.697 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.686+0000 7f0d792d1700 1 -- 172.21.15.157:0/2382168414 <== mon.0 v1:172.21.15.157:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1447560303 0 0) 0x7f0d600035b0 con 0x7f0d7415bdb0 2023-10-16T19:58:16.697 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.686+0000 7f0d792d1700 1 -- 172.21.15.157:0/2382168414 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0d740cc280 msgr2=0x7f0d740b36b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:58:16.697 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.686+0000 7f0d792d1700 1 --2- 172.21.15.157:0/2382168414 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0d740cc280 0x7f0d740b36b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:16.697 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.686+0000 7f0d792d1700 1 -- 172.21.15.157:0/2382168414 >> v2:172.21.15.187:3300/0 conn(0x7f0d740b3bf0 msgr2=0x7f0d7415f9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:58:16.698 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.686+0000 7f0d792d1700 1 --2- 172.21.15.157:0/2382168414 >> v2:172.21.15.187:3300/0 conn(0x7f0d740b3bf0 0x7f0d7415f9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:16.698 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.686+0000 7f0d792d1700 1 -- 172.21.15.157:0/2382168414 --> v1:172.21.15.157:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d7415c510 con 0x7f0d7415bdb0 2023-10-16T19:58:16.698 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.686+0000 7f0d792d1700 1 -- 172.21.15.157:0/2382168414 <== mon.0 v1:172.21.15.157:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4021145519 0 0) 0x7f0d64001670 con 0x7f0d7415bdb0 2023-10-16T19:58:16.699 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.686+0000 7f0d792d1700 1 -- 172.21.15.157:0/2382168414 >> v1:172.21.15.157:6789/0 conn(0x7f0d7415bdb0 legacy=0x7f0d740d1170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:16.699 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.686+0000 7f0d792d1700 1 --2- 172.21.15.157:0/2382168414 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0d740cc280 0x7f0d60003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:16.699 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.686+0000 7f0d792d1700 1 --2- 172.21.15.157:0/2382168414 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0d60003f80 0x7f0d60004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:16.699 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.686+0000 7f0d792d1700 1 --2- 172.21.15.157:0/2382168414 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0d60004d90 0x7f0d60005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:16.700 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.686+0000 7f0d792d1700 1 -- 172.21.15.157:0/2382168414 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d740b4070 con 0x7f0d60004d90 2023-10-16T19:58:16.700 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.686+0000 7f0d792d1700 1 -- 172.21.15.157:0/2382168414 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d740d19e0 con 0x7f0d60003f80 2023-10-16T19:58:16.700 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.686+0000 7f0d792d1700 1 -- 172.21.15.157:0/2382168414 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d6000ba10 con 0x7f0d740cc280 2023-10-16T19:58:16.701 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.686+0000 7f0d7aad4700 1 --2- 172.21.15.157:0/2382168414 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0d60004d90 0x7f0d60005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:16.701 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.686+0000 7f0d7a2d3700 1 --2- 172.21.15.157:0/2382168414 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0d740cc280 0x7f0d60003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:16.701 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.687+0000 7f0d79ad2700 1 --2- 172.21.15.157:0/2382168414 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0d60003f80 0x7f0d60004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:16.701 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.687+0000 7f0d7aad4700 1 -- 172.21.15.157:0/2382168414 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0d740cc280 msgr2=0x7f0d60003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:58:16.702 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.687+0000 7f0d7aad4700 1 --2- 172.21.15.157:0/2382168414 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0d740cc280 0x7f0d60003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:16.702 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.687+0000 7f0d7aad4700 1 -- 172.21.15.157:0/2382168414 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0d60003f80 msgr2=0x7f0d60004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:58:16.702 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.687+0000 7f0d7aad4700 1 --2- 172.21.15.157:0/2382168414 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0d60003f80 0x7f0d60004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:16.703 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.687+0000 7f0d7aad4700 1 -- 172.21.15.157:0/2382168414 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d600035b0 con 0x7f0d60004d90 2023-10-16T19:58:16.703 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.687+0000 7f0d7aad4700 1 --2- 172.21.15.157:0/2382168414 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0d60004d90 0x7f0d60005210 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f0d6c009fc0 tx=0x7f0d60005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad395764ea4eb112 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:58:16.703 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.687+0000 7f0d792d1700 1 -- 172.21.15.157:0/2382168414 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d6c00ebd0 con 0x7f0d60004d90 2023-10-16T19:58:16.703 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.687+0000 7f0d792d1700 1 -- 172.21.15.157:0/2382168414 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d6c00f040 con 0x7f0d60004d90 2023-10-16T19:58:16.704 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.687+0000 7f0d792d1700 1 -- 172.21.15.157:0/2382168414 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d6c014480 con 0x7f0d60004d90 2023-10-16T19:58:16.704 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.687+0000 7f0d7c537700 1 -- 172.21.15.157:0/2382168414 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0d60004d90 msgr2=0x7f0d60005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:16.704 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.687+0000 7f0d7c537700 1 --2- 172.21.15.157:0/2382168414 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0d60004d90 0x7f0d60005210 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f0d6c009fc0 tx=0x7f0d60005880 comp rx=0 tx=0).stop 2023-10-16T19:58:16.704 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.687+0000 7f0d7aad4700 1 -- 172.21.15.157:0/2382168414 reap_dead start 2023-10-16T19:58:16.705 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.688+0000 7f0d7c537700 1 -- 172.21.15.157:0/2382168414 shutdown_connections 2023-10-16T19:58:16.705 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.688+0000 7f0d7c537700 1 -- 172.21.15.157:0/2382168414 >> 172.21.15.157:0/2382168414 conn(0x7f0d740ce6b0 msgr2=0x7f0d740ceac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:58:16.705 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.688+0000 7f0d7c537700 1 -- 172.21.15.157:0/2382168414 shutdown_connections 2023-10-16T19:58:16.706 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.688+0000 7f0d7c537700 1 -- 172.21.15.157:0/2382168414 wait complete. 2023-10-16T19:58:16.706 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.689+0000 7f0d7c537700 1 Processor -- start 2023-10-16T19:58:16.706 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.689+0000 7f0d7c537700 1 -- start start 2023-10-16T19:58:16.706 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.689+0000 7f0d7c537700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0d60004d90 0x7f0d740cb3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:16.707 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.689+0000 7f0d7c537700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0d741f7720 0x7f0d740b2ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:16.707 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.690+0000 7f0d7c537700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0d740b3000 0x7f0d740b4ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:16.707 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.690+0000 7f0d7c537700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d7406b960 con 0x7f0d60004d90 2023-10-16T19:58:16.707 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.690+0000 7f0d7c537700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d7406bc40 con 0x7f0d740b3000 2023-10-16T19:58:16.708 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.690+0000 7f0d7c537700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d7406bf20 con 0x7f0d741f7720 2023-10-16T19:58:16.708 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.690+0000 7f0d7a2d3700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0d60004d90 0x7f0d740cb3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:16.708 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.690+0000 7f0d7a2d3700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0d60004d90 0x7f0d740cb3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:47874/0 (socket says 172.21.15.157:47874) 2023-10-16T19:58:16.709 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.690+0000 7f0d7a2d3700 1 -- 172.21.15.157:0/3686124201 learned_addr learned my addr 172.21.15.157:0/3686124201 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:58:16.709 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.690+0000 7f0d79ad2700 1 --2- 172.21.15.157:0/3686124201 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0d741f7720 0x7f0d740b2ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:16.709 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.690+0000 7f0d7aad4700 1 --2- 172.21.15.157:0/3686124201 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0d740b3000 0x7f0d740b4ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:16.710 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.690+0000 7f0d7a2d3700 1 -- 172.21.15.157:0/3686124201 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0d741f7720 msgr2=0x7f0d740b2ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:16.710 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.690+0000 7f0d7a2d3700 1 --2- 172.21.15.157:0/3686124201 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0d741f7720 0x7f0d740b2ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:16.710 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.690+0000 7f0d7a2d3700 1 -- 172.21.15.157:0/3686124201 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0d740b3000 msgr2=0x7f0d740b4ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:16.710 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.690+0000 7f0d7a2d3700 1 --2- 172.21.15.157:0/3686124201 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0d740b3000 0x7f0d740b4ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:16.711 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.690+0000 7f0d7a2d3700 1 -- 172.21.15.157:0/3686124201 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d7406c200 con 0x7f0d60004d90 2023-10-16T19:58:16.711 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.690+0000 7f0d7a2d3700 1 --2- 172.21.15.157:0/3686124201 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0d60004d90 0x7f0d740cb3b0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f0d64001aa0 tx=0x7f0d64001760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:58:16.711 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.690+0000 7f0d6affd700 1 -- 172.21.15.157:0/3686124201 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d6400f650 con 0x7f0d60004d90 2023-10-16T19:58:16.711 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.690+0000 7f0d6affd700 1 -- 172.21.15.157:0/3686124201 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d6400f7b0 con 0x7f0d60004d90 2023-10-16T19:58:16.712 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.690+0000 7f0d7c537700 1 -- 172.21.15.157:0/3686124201 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d7406c4e0 con 0x7f0d60004d90 2023-10-16T19:58:16.712 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.690+0000 7f0d6affd700 1 -- 172.21.15.157:0/3686124201 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d6400fb60 con 0x7f0d60004d90 2023-10-16T19:58:16.712 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.690+0000 7f0d7c537700 1 -- 172.21.15.157:0/3686124201 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d740cbad0 con 0x7f0d60004d90 2023-10-16T19:58:16.713 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.691+0000 7f0d7c537700 1 -- 172.21.15.157:0/3686124201 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0d7415cad0 con 0x7f0d60004d90 2023-10-16T19:58:16.714 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.692+0000 7f0d6affd700 1 -- 172.21.15.157:0/3686124201 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f0d6400fcc0 con 0x7f0d60004d90 2023-10-16T19:58:16.715 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.692+0000 7f0d6affd700 1 --2- 172.21.15.157:0/3686124201 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f0d5806af00 0x7f0d5806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:16.715 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.692+0000 7f0d6affd700 1 -- 172.21.15.157:0/3686124201 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5729+0+0 (secure 0 0 0) 0x7f0d64089490 con 0x7f0d60004d90 2023-10-16T19:58:16.717 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.692+0000 7f0d6affd700 1 --2- 172.21.15.157:0/3686124201 >> [v2:172.21.15.157:6800/3482825047,v1:172.21.15.157:6801/3482825047] conn(0x7f0d58073100 0x7f0d58075540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:16.718 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.692+0000 7f0d6affd700 1 -- 172.21.15.157:0/3686124201 --> [v2:172.21.15.157:6800/3482825047,v1:172.21.15.157:6801/3482825047] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0d58075c10 con 0x7f0d58073100 2023-10-16T19:58:16.718 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.692+0000 7f0d6affd700 1 -- 172.21.15.157:0/3686124201 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0d6408bb50 con 0x7f0d60004d90 2023-10-16T19:58:16.718 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.692+0000 7f0d79ad2700 1 --2- 172.21.15.157:0/3686124201 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f0d5806af00 0x7f0d5806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:16.719 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.692+0000 7f0d7aad4700 1 --2- 172.21.15.157:0/3686124201 >> [v2:172.21.15.157:6800/3482825047,v1:172.21.15.157:6801/3482825047] conn(0x7f0d58073100 0x7f0d58075540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:16.719 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.693+0000 7f0d7aad4700 1 --2- 172.21.15.157:0/3686124201 >> [v2:172.21.15.157:6800/3482825047,v1:172.21.15.157:6801/3482825047] conn(0x7f0d58073100 0x7f0d58075540 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:58:16.719 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.693+0000 7f0d79ad2700 1 --2- 172.21.15.157:0/3686124201 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f0d5806af00 0x7f0d5806d3c0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f0d740ccff0 tx=0x7f0d70009210 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:58:16.719 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.693+0000 7f0d6affd700 1 -- 172.21.15.157:0/3686124201 <== osd.1 v2:172.21.15.157:6800/3482825047 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23595 (crc 0 0 0) 0x7f0d58075c10 con 0x7f0d58073100 2023-10-16T19:58:16.720 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.706+0000 7f0d7c537700 1 -- 172.21.15.157:0/3686124201 --> [v2:172.21.15.157:6800/3482825047,v1:172.21.15.157:6801/3482825047] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f0d7415c7f0 con 0x7f0d58073100 2023-10-16T19:58:16.720 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.706+0000 7f0d6affd700 1 -- 172.21.15.157:0/3686124201 <== osd.1 v2:172.21.15.157:6800/3482825047 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+757 (crc 0 0 0) 0x7f0d6c00ea70 con 0x7f0d58073100 2023-10-16T19:58:16.720 INFO:teuthology.orchestra.run.smithi157.stdout:{ 2023-10-16T19:58:16.721 INFO:teuthology.orchestra.run.smithi157.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) osd_delete_sleep = '0.000000' osd_delete_sleep_hdd = '0.000000' osd_delete_sleep_hybrid = '0.000000' osd_delete_sleep_ssd = '0.000000' osd_max_backfills = '1' osd_pg_delete_cost = '15728640' (not observed, change may require restart) osd_recovery_max_active = '0' osd_recovery_max_active_hdd = '3' osd_recovery_max_active_ssd = '10' osd_recovery_sleep = '0.000000' osd_recovery_sleep_hdd = '0.000000' osd_recovery_sleep_hybrid = '0.000000' osd_recovery_sleep_ssd = '0.000000' osd_scrub_sleep = '0.000000' osd_snap_trim_sleep = '0.000000' osd_snap_trim_sleep_hdd = '0.000000' osd_snap_trim_sleep_hybrid = '0.000000' osd_snap_trim_sleep_ssd = '0.000000' " 2023-10-16T19:58:16.721 INFO:teuthology.orchestra.run.smithi157.stdout:} 2023-10-16T19:58:16.723 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.706+0000 7f0d7c537700 1 -- 172.21.15.157:0/3686124201 >> [v2:172.21.15.157:6800/3482825047,v1:172.21.15.157:6801/3482825047] conn(0x7f0d58073100 msgr2=0x7f0d58075540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:16.723 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.706+0000 7f0d7c537700 1 --2- 172.21.15.157:0/3686124201 >> [v2:172.21.15.157:6800/3482825047,v1:172.21.15.157:6801/3482825047] conn(0x7f0d58073100 0x7f0d58075540 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:16.723 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.706+0000 7f0d7c537700 1 -- 172.21.15.157:0/3686124201 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f0d5806af00 msgr2=0x7f0d5806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:16.724 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.706+0000 7f0d7c537700 1 --2- 172.21.15.157:0/3686124201 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f0d5806af00 0x7f0d5806d3c0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f0d740ccff0 tx=0x7f0d70009210 comp rx=0 tx=0).stop 2023-10-16T19:58:16.724 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.706+0000 7f0d7c537700 1 -- 172.21.15.157:0/3686124201 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0d60004d90 msgr2=0x7f0d740cb3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:16.724 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.706+0000 7f0d7c537700 1 --2- 172.21.15.157:0/3686124201 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0d60004d90 0x7f0d740cb3b0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f0d64001aa0 tx=0x7f0d64001760 comp rx=0 tx=0).stop 2023-10-16T19:58:16.724 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.706+0000 7f0d7aad4700 1 -- 172.21.15.157:0/3686124201 reap_dead start 2023-10-16T19:58:16.725 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.706+0000 7f0d7c537700 1 -- 172.21.15.157:0/3686124201 shutdown_connections 2023-10-16T19:58:16.725 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.706+0000 7f0d7c537700 1 -- 172.21.15.157:0/3686124201 >> 172.21.15.157:0/3686124201 conn(0x7f0d740ce6b0 msgr2=0x7f0d74159f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:58:16.725 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.707+0000 7f0d7c537700 1 -- 172.21.15.157:0/3686124201 shutdown_connections 2023-10-16T19:58:16.725 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.707+0000 7f0d7c537700 1 -- 172.21.15.157:0/3686124201 wait complete. 2023-10-16T19:58:16.726 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2023-10-16T19:58:16.847 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.845+0000 7f6ddddab700 1 Processor -- start 2023-10-16T19:58:16.847 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.845+0000 7f6ddddab700 1 -- start start 2023-10-16T19:58:16.850 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.845+0000 7f6ddddab700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f6dd815e2f0 0x7f6dd806d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:16.851 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.845+0000 7f6ddddab700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f6dd806af60 0x7f6dd80ce910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:16.851 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.845+0000 7f6ddddab700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6dd80d08b0 con 0x7f6dd806de00 2023-10-16T19:58:16.851 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.845+0000 7f6ddddab700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6dd81628f0 con 0x7f6dd806af60 2023-10-16T19:58:16.851 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.845+0000 7f6ddddab700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6dd8162bd0 con 0x7f6dd815e2f0 2023-10-16T19:58:16.852 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.846+0000 7f6dd7fff700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f6dd806af60 0x7f6dd80ce910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:16.852 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.846+0000 7f6dd6ffd700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f6dd806de00 0x7f6dd806a850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:57556/0 (socket says 172.21.15.157:57556) 2023-10-16T19:58:16.852 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.846+0000 7f6dd6ffd700 1 -- 172.21.15.157:0/1104553998 learned_addr learned my addr 172.21.15.157:0/1104553998 (peer_addr_for_me v1:172.21.15.157:0/0) 2023-10-16T19:58:16.853 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.846+0000 7f6dd77fe700 1 --2- 172.21.15.157:0/1104553998 >> v2:172.21.15.187:3300/0 conn(0x7f6dd815e2f0 0x7f6dd806d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:16.853 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.846+0000 7f6dd7fff700 1 -- 172.21.15.157:0/1104553998 >> v2:172.21.15.187:3300/0 conn(0x7f6dd815e2f0 msgr2=0x7f6dd806d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:58:16.853 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.846+0000 7f6dd7fff700 1 --2- 172.21.15.157:0/1104553998 >> v2:172.21.15.187:3300/0 conn(0x7f6dd815e2f0 0x7f6dd806d0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:16.853 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.846+0000 7f6dd7fff700 1 -- 172.21.15.157:0/1104553998 >> v1:172.21.15.157:6789/0 conn(0x7f6dd806de00 legacy=0x7f6dd806a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:16.854 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.846+0000 7f6dd7fff700 1 -- 172.21.15.157:0/1104553998 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dd80d05d0 con 0x7f6dd806af60 2023-10-16T19:58:16.854 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.846+0000 7f6dd67fc700 1 -- 172.21.15.157:0/1104553998 <== mon.0 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3329213667 0 0) 0x7f6dd80d08b0 con 0x7f6dd806de00 2023-10-16T19:58:16.854 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.846+0000 7f6dd77fe700 1 --2- 172.21.15.157:0/1104553998 >> v2:172.21.15.187:3300/0 conn(0x7f6dd815e2f0 0x7f6dd806d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T19:58:16.855 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.846+0000 7f6dd7fff700 1 --2- 172.21.15.157:0/1104553998 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6dd806af60 0x7f6dd80ce910 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f6dd80d1ad0 tx=0x7f6dd000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4860094410aeeca server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:58:16.855 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.846+0000 7f6dd67fc700 1 -- 172.21.15.157:0/1104553998 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dd000e070 con 0x7f6dd806af60 2023-10-16T19:58:16.856 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.846+0000 7f6dd67fc700 1 -- 172.21.15.157:0/1104553998 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dd000bbd0 con 0x7f6dd806af60 2023-10-16T19:58:16.856 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.846+0000 7f6dd67fc700 1 -- 172.21.15.157:0/1104553998 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dd0012430 con 0x7f6dd806af60 2023-10-16T19:58:16.856 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.847+0000 7f6ddddab700 1 -- 172.21.15.157:0/1104553998 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6dd806af60 msgr2=0x7f6dd80ce910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:16.856 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.847+0000 7f6ddddab700 1 --2- 172.21.15.157:0/1104553998 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6dd806af60 0x7f6dd80ce910 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f6dd80d1ad0 tx=0x7f6dd000b330 comp rx=0 tx=0).stop 2023-10-16T19:58:16.857 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.847+0000 7f6ddddab700 1 -- 172.21.15.157:0/1104553998 shutdown_connections 2023-10-16T19:58:16.857 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.847+0000 7f6ddddab700 1 --2- 172.21.15.157:0/1104553998 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6dd806af60 0x7f6dd80ce910 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:16.857 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.847+0000 7f6ddddab700 1 --2- 172.21.15.157:0/1104553998 >> v2:172.21.15.187:3300/0 conn(0x7f6dd815e2f0 0x7f6dd806d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:16.858 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.847+0000 7f6ddddab700 1 -- 172.21.15.157:0/1104553998 >> 172.21.15.157:0/1104553998 conn(0x7f6dd80cd4e0 msgr2=0x7f6dd80cd8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:58:16.858 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.847+0000 7f6ddddab700 1 -- 172.21.15.157:0/1104553998 shutdown_connections 2023-10-16T19:58:16.858 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.847+0000 7f6ddddab700 1 -- 172.21.15.157:0/1104553998 wait complete. 2023-10-16T19:58:16.859 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.848+0000 7f6ddddab700 1 Processor -- start 2023-10-16T19:58:16.859 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.848+0000 7f6ddddab700 1 -- start start 2023-10-16T19:58:16.862 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.849+0000 7f6ddddab700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6dd806af60 0x7f6dd8158e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:16.862 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.849+0000 7f6ddddab700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6dd806de00 0x7f6dd815eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:16.863 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.849+0000 7f6ddddab700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6dd815e2f0 0x7f6dd80c6660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:16.863 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.849+0000 7f6ddddab700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dd80c5ec0 con 0x7f6dd806de00 2023-10-16T19:58:16.863 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.849+0000 7f6ddddab700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dd8159820 con 0x7f6dd815e2f0 2023-10-16T19:58:16.863 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.849+0000 7f6ddddab700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6dd8161b90 con 0x7f6dd806af60 2023-10-16T19:58:16.864 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.849+0000 7f6dd6ffd700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6dd806de00 0x7f6dd815eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:16.864 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.849+0000 7f6dd6ffd700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6dd806de00 0x7f6dd815eac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:47892/0 (socket says 172.21.15.157:47892) 2023-10-16T19:58:16.865 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.849+0000 7f6dd6ffd700 1 -- 172.21.15.157:0/1190263118 learned_addr learned my addr 172.21.15.157:0/1190263118 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:58:16.865 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.849+0000 7f6dd7fff700 1 --2- 172.21.15.157:0/1190263118 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6dd815e2f0 0x7f6dd80c6660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:16.865 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.849+0000 7f6dd77fe700 1 --2- 172.21.15.157:0/1190263118 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6dd806af60 0x7f6dd8158e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:16.866 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.849+0000 7f6dd6ffd700 1 -- 172.21.15.157:0/1190263118 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6dd806af60 msgr2=0x7f6dd8158e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:16.866 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.849+0000 7f6dd6ffd700 1 --2- 172.21.15.157:0/1190263118 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6dd806af60 0x7f6dd8158e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:16.866 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.849+0000 7f6dd6ffd700 1 -- 172.21.15.157:0/1190263118 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6dd815e2f0 msgr2=0x7f6dd80c6660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:16.867 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.849+0000 7f6dd6ffd700 1 --2- 172.21.15.157:0/1190263118 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6dd815e2f0 0x7f6dd80c6660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:16.867 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.849+0000 7f6dd6ffd700 1 -- 172.21.15.157:0/1190263118 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dd0009a70 con 0x7f6dd806de00 2023-10-16T19:58:16.867 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.849+0000 7f6dd6ffd700 1 --2- 172.21.15.157:0/1190263118 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6dd806de00 0x7f6dd815eac0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f6dc000c550 tx=0x7f6dc000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:58:16.868 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.849+0000 7f6dcffff700 1 -- 172.21.15.157:0/1190263118 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dc0004c80 con 0x7f6dd806de00 2023-10-16T19:58:16.868 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.849+0000 7f6dcffff700 1 -- 172.21.15.157:0/1190263118 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dc0004e00 con 0x7f6dd806de00 2023-10-16T19:58:16.868 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.849+0000 7f6ddddab700 1 -- 172.21.15.157:0/1190263118 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6dd80c60a0 con 0x7f6dd806de00 2023-10-16T19:58:16.869 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.849+0000 7f6dcffff700 1 -- 172.21.15.157:0/1190263118 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dc0007310 con 0x7f6dd806de00 2023-10-16T19:58:16.869 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.850+0000 7f6ddddab700 1 -- 172.21.15.157:0/1190263118 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6dd815f000 con 0x7f6dd806de00 2023-10-16T19:58:16.869 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.851+0000 7f6ddddab700 1 -- 172.21.15.157:0/1190263118 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6dd80c4d70 con 0x7f6dd806de00 2023-10-16T19:58:16.869 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.851+0000 7f6dcffff700 1 -- 172.21.15.157:0/1190263118 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f6dc0007470 con 0x7f6dd806de00 2023-10-16T19:58:16.870 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.851+0000 7f6dcffff700 1 --2- 172.21.15.157:0/1190263118 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f6db806af00 0x7f6db806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:16.870 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.851+0000 7f6dcffff700 1 -- 172.21.15.157:0/1190263118 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5729+0+0 (secure 0 0 0) 0x7f6dc0089280 con 0x7f6dd806de00 2023-10-16T19:58:16.870 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.852+0000 7f6dd77fe700 1 --2- 172.21.15.157:0/1190263118 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f6db806af00 0x7f6db806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:16.871 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.852+0000 7f6dd77fe700 1 --2- 172.21.15.157:0/1190263118 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f6db806af00 0x7f6db806d3c0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f6dc8006fd0 tx=0x7f6dc8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:58:16.871 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:16.856+0000 7f6dcffff700 1 -- 172.21.15.157:0/1190263118 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6dd80c4d70 con 0x7f6dd806de00 2023-10-16T19:58:17.051 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.049+0000 7f6ddddab700 1 -- 172.21.15.157:0/1190263118 --> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f6dd80b02a0 con 0x7f6db806af00 2023-10-16T19:58:17.052 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.050+0000 7f6dcffff700 1 -- 172.21.15.157:0/1190263118 <== mgr.4100 v2:172.21.15.187:6832/2426285296 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f6dc800ae30 con 0x7f6db806af00 2023-10-16T19:58:17.054 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.052+0000 7f6ddddab700 1 -- 172.21.15.157:0/1190263118 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f6db806af00 msgr2=0x7f6db806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:17.055 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.052+0000 7f6ddddab700 1 --2- 172.21.15.157:0/1190263118 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f6db806af00 0x7f6db806d3c0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f6dc8006fd0 tx=0x7f6dc8008040 comp rx=0 tx=0).stop 2023-10-16T19:58:17.055 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.052+0000 7f6ddddab700 1 -- 172.21.15.157:0/1190263118 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6dd806de00 msgr2=0x7f6dd815eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:17.056 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.052+0000 7f6ddddab700 1 --2- 172.21.15.157:0/1190263118 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6dd806de00 0x7f6dd815eac0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f6dc000c550 tx=0x7f6dc000c910 comp rx=0 tx=0).stop 2023-10-16T19:58:17.056 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.052+0000 7f6ddddab700 1 -- 172.21.15.157:0/1190263118 shutdown_connections 2023-10-16T19:58:17.056 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.052+0000 7f6ddddab700 1 --2- 172.21.15.157:0/1190263118 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f6db806af00 0x7f6db806d3c0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:17.056 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.052+0000 7f6ddddab700 1 --2- 172.21.15.157:0/1190263118 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6dd815e2f0 0x7f6dd80c6660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:17.057 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.052+0000 7f6ddddab700 1 --2- 172.21.15.157:0/1190263118 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6dd806af60 0x7f6dd8158e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:17.057 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.052+0000 7f6ddddab700 1 --2- 172.21.15.157:0/1190263118 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6dd806de00 0x7f6dd815eac0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:17.057 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.052+0000 7f6ddddab700 1 -- 172.21.15.157:0/1190263118 >> 172.21.15.157:0/1190263118 conn(0x7f6dd80cd4e0 msgr2=0x7f6dd815b1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:58:17.057 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.052+0000 7f6ddddab700 1 -- 172.21.15.157:0/1190263118 shutdown_connections 2023-10-16T19:58:17.058 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.052+0000 7f6ddddab700 1 -- 172.21.15.157:0/1190263118 wait complete. 2023-10-16T19:58:17.058 INFO:teuthology.orchestra.run.smithi157.stderr:instructed osd(s) 1 to deep-scrub 2023-10-16T19:58:17.066 INFO:tasks.ceph:Scrubbing osd.2 2023-10-16T19:58:17.067 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-10-16T19:58:17.191 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.188+0000 7f217769b700 1 Processor -- start 2023-10-16T19:58:17.191 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.189+0000 7f217769b700 1 -- start start 2023-10-16T19:58:17.194 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.189+0000 7f217769b700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f217015e090 0x7f217006b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:17.195 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.189+0000 7f217769b700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f217006ea10 0x7f21700afa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:17.195 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.189+0000 7f217769b700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f21700affc0 0x7f217015e470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:17.195 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.189+0000 7f217769b700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21700b0450 con 0x7f217015e090 2023-10-16T19:58:17.196 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.189+0000 7f217769b700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2170071b50 con 0x7f217006ea10 2023-10-16T19:58:17.196 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.189+0000 7f217769b700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f217006b6a0 con 0x7f21700affc0 2023-10-16T19:58:17.196 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.189+0000 7f2175437700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f217015e090 0x7f217006b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:17.197 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.189+0000 7f2175437700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f217015e090 0x7f217006b160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:47898/0 (socket says 172.21.15.157:47898) 2023-10-16T19:58:17.197 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.189+0000 7f2175437700 1 -- 172.21.15.157:0/3405063572 learned_addr learned my addr 172.21.15.157:0/3405063572 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:58:17.197 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.190+0000 7f2174c36700 1 --2- 172.21.15.157:0/3405063572 >> v2:172.21.15.187:3300/0 conn(0x7f217006ea10 0x7f21700afa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:17.198 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.190+0000 7f2175c38700 1 --2- 172.21.15.157:0/3405063572 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f21700affc0 0x7f217015e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:17.198 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.190+0000 7f2175437700 1 -- 172.21.15.157:0/3405063572 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f21700affc0 msgr2=0x7f217015e470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:58:17.198 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.190+0000 7f2175437700 1 --2- 172.21.15.157:0/3405063572 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f21700affc0 0x7f217015e470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:17.198 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.190+0000 7f2175437700 1 -- 172.21.15.157:0/3405063572 >> v2:172.21.15.187:3300/0 conn(0x7f217006ea10 msgr2=0x7f21700afa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:58:17.199 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.190+0000 7f2175437700 1 --2- 172.21.15.157:0/3405063572 >> v2:172.21.15.187:3300/0 conn(0x7f217006ea10 0x7f21700afa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:17.199 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.190+0000 7f2175437700 1 -- 172.21.15.157:0/3405063572 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2170072320 con 0x7f217015e090 2023-10-16T19:58:17.199 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.190+0000 7f2174c36700 1 --2- 172.21.15.157:0/3405063572 >> v2:172.21.15.187:3300/0 conn(0x7f217006ea10 0x7f21700afa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T19:58:17.200 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.190+0000 7f2175c38700 1 --2- 172.21.15.157:0/3405063572 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f21700affc0 0x7f217015e470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T19:58:17.200 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.190+0000 7f2175437700 1 --2- 172.21.15.157:0/3405063572 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f217015e090 0x7f217006b160 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f21700c7aa0 tx=0x7f2160009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbd98def4087b5ac server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:58:17.201 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.190+0000 7f2167fff700 1 -- 172.21.15.157:0/3405063572 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f216000b870 con 0x7f217015e090 2023-10-16T19:58:17.201 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.190+0000 7f2167fff700 1 -- 172.21.15.157:0/3405063572 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f216000b9d0 con 0x7f217015e090 2023-10-16T19:58:17.201 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.190+0000 7f2167fff700 1 -- 172.21.15.157:0/3405063572 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f216000bd60 con 0x7f217015e090 2023-10-16T19:58:17.201 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.191+0000 7f217769b700 1 -- 172.21.15.157:0/3405063572 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f217015e090 msgr2=0x7f217006b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:17.202 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.191+0000 7f217769b700 1 --2- 172.21.15.157:0/3405063572 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f217015e090 0x7f217006b160 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f21700c7aa0 tx=0x7f2160009bd0 comp rx=0 tx=0).stop 2023-10-16T19:58:17.202 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.191+0000 7f217769b700 1 -- 172.21.15.157:0/3405063572 shutdown_connections 2023-10-16T19:58:17.203 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.191+0000 7f217769b700 1 --2- 172.21.15.157:0/3405063572 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f21700affc0 0x7f217015e470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:17.203 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.191+0000 7f217769b700 1 --2- 172.21.15.157:0/3405063572 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f217015e090 0x7f217006b160 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:17.203 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.191+0000 7f217769b700 1 --2- 172.21.15.157:0/3405063572 >> v2:172.21.15.187:3300/0 conn(0x7f217006ea10 0x7f21700afa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:17.203 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.191+0000 7f217769b700 1 -- 172.21.15.157:0/3405063572 >> 172.21.15.157:0/3405063572 conn(0x7f21700d0b30 msgr2=0x7f21700d0f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:58:17.204 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.191+0000 7f217769b700 1 -- 172.21.15.157:0/3405063572 shutdown_connections 2023-10-16T19:58:17.204 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.191+0000 7f217769b700 1 -- 172.21.15.157:0/3405063572 wait complete. 2023-10-16T19:58:17.205 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.192+0000 7f217769b700 1 Processor -- start 2023-10-16T19:58:17.205 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.192+0000 7f217769b700 1 -- start start 2023-10-16T19:58:17.208 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.193+0000 7f217769b700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f217006ea10 0x7f21700b59c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:17.209 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.193+0000 7f217769b700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f21700affc0 0x7f21700b06f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:17.209 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.193+0000 7f217769b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f217015e090 0x7f217006d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:17.209 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.193+0000 7f217769b700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f217015b830 con 0x7f217006ea10 2023-10-16T19:58:17.210 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.193+0000 7f217769b700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21700b1620 con 0x7f217015e090 2023-10-16T19:58:17.210 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.193+0000 7f217769b700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21700b1060 con 0x7f21700affc0 2023-10-16T19:58:17.210 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.193+0000 7f2175437700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f217006ea10 0x7f21700b59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:17.211 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.193+0000 7f2175437700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f217006ea10 0x7f21700b59c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:47904/0 (socket says 172.21.15.157:47904) 2023-10-16T19:58:17.211 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.193+0000 7f2175437700 1 -- 172.21.15.157:0/1894077976 learned_addr learned my addr 172.21.15.157:0/1894077976 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:58:17.211 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.193+0000 7f2174c36700 1 --2- 172.21.15.157:0/1894077976 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f21700affc0 0x7f21700b06f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:17.212 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.193+0000 7f2175c38700 1 --2- 172.21.15.157:0/1894077976 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f217015e090 0x7f217006d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:17.212 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.193+0000 7f2175437700 1 -- 172.21.15.157:0/1894077976 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f21700affc0 msgr2=0x7f21700b06f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:17.212 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.193+0000 7f2175437700 1 --2- 172.21.15.157:0/1894077976 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f21700affc0 0x7f21700b06f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:17.213 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.193+0000 7f2175437700 1 -- 172.21.15.157:0/1894077976 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f217015e090 msgr2=0x7f217006d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:17.213 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.193+0000 7f2175437700 1 --2- 172.21.15.157:0/1894077976 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f217015e090 0x7f217006d110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:17.213 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.193+0000 7f2175437700 1 -- 172.21.15.157:0/1894077976 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2160009550 con 0x7f217006ea10 2023-10-16T19:58:17.213 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.193+0000 7f2175c38700 1 --2- 172.21.15.157:0/1894077976 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f217015e090 0x7f217006d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T19:58:17.214 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.193+0000 7f2175437700 1 --2- 172.21.15.157:0/1894077976 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f217006ea10 0x7f21700b59c0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f2160014040 tx=0x7f2160004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:58:17.214 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.193+0000 7f2165ffb700 1 -- 172.21.15.157:0/1894077976 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2160004520 con 0x7f217006ea10 2023-10-16T19:58:17.214 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.193+0000 7f2165ffb700 1 -- 172.21.15.157:0/1894077976 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f216001e070 con 0x7f217006ea10 2023-10-16T19:58:17.215 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.193+0000 7f217769b700 1 -- 172.21.15.157:0/1894077976 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21700b1340 con 0x7f217006ea10 2023-10-16T19:58:17.215 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.193+0000 7f2165ffb700 1 -- 172.21.15.157:0/1894077976 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21600038e0 con 0x7f217006ea10 2023-10-16T19:58:17.215 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.194+0000 7f217769b700 1 -- 172.21.15.157:0/1894077976 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21700b5f00 con 0x7f217006ea10 2023-10-16T19:58:17.215 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.194+0000 7f217769b700 1 -- 172.21.15.157:0/1894077976 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2170072040 con 0x7f217006ea10 2023-10-16T19:58:17.216 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.195+0000 7f2165ffb700 1 -- 172.21.15.157:0/1894077976 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f2160003a40 con 0x7f217006ea10 2023-10-16T19:58:17.216 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.195+0000 7f2165ffb700 1 --2- 172.21.15.157:0/1894077976 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f215406af00 0x7f215406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:17.216 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.195+0000 7f2165ffb700 1 -- 172.21.15.157:0/1894077976 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5729+0+0 (secure 0 0 0) 0x7f2160020070 con 0x7f217006ea10 2023-10-16T19:58:17.217 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.196+0000 7f2165ffb700 1 --2- 172.21.15.157:0/1894077976 >> [v2:172.21.15.157:6824/1118292389,v1:172.21.15.157:6825/1118292389] conn(0x7f2154073100 0x7f2154075540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:17.217 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.196+0000 7f2165ffb700 1 -- 172.21.15.157:0/1894077976 --> [v2:172.21.15.157:6824/1118292389,v1:172.21.15.157:6825/1118292389] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2154075c10 con 0x7f2154073100 2023-10-16T19:58:17.217 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.196+0000 7f2165ffb700 1 -- 172.21.15.157:0/1894077976 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f216008b090 con 0x7f217006ea10 2023-10-16T19:58:17.217 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.196+0000 7f2174c36700 1 --2- 172.21.15.157:0/1894077976 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f215406af00 0x7f215406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:17.218 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.196+0000 7f2175c38700 1 --2- 172.21.15.157:0/1894077976 >> [v2:172.21.15.157:6824/1118292389,v1:172.21.15.157:6825/1118292389] conn(0x7f2154073100 0x7f2154075540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:17.218 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.196+0000 7f2175c38700 1 --2- 172.21.15.157:0/1894077976 >> [v2:172.21.15.157:6824/1118292389,v1:172.21.15.157:6825/1118292389] conn(0x7f2154073100 0x7f2154075540 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:58:17.218 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.196+0000 7f2174c36700 1 --2- 172.21.15.157:0/1894077976 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f215406af00 0x7f215406d3c0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f21700b2280 tx=0x7f216c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:58:17.219 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.197+0000 7f2165ffb700 1 -- 172.21.15.157:0/1894077976 <== osd.2 v2:172.21.15.157:6824/1118292389 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23595 (crc 0 0 0) 0x7f2154075c10 con 0x7f2154073100 2023-10-16T19:58:17.219 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.210+0000 7f217769b700 1 -- 172.21.15.157:0/1894077976 --> [v2:172.21.15.157:6824/1118292389,v1:172.21.15.157:6825/1118292389] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f2170071d60 con 0x7f2154073100 2023-10-16T19:58:17.220 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.210+0000 7f2165ffb700 1 -- 172.21.15.157:0/1894077976 <== osd.2 v2:172.21.15.157:6824/1118292389 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+757 (crc 0 0 0) 0x7f216800d430 con 0x7f2154073100 2023-10-16T19:58:17.220 INFO:teuthology.orchestra.run.smithi157.stdout:{ 2023-10-16T19:58:17.221 INFO:teuthology.orchestra.run.smithi157.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) osd_delete_sleep = '0.000000' osd_delete_sleep_hdd = '0.000000' osd_delete_sleep_hybrid = '0.000000' osd_delete_sleep_ssd = '0.000000' osd_max_backfills = '1' osd_pg_delete_cost = '15728640' (not observed, change may require restart) osd_recovery_max_active = '0' osd_recovery_max_active_hdd = '3' osd_recovery_max_active_ssd = '10' osd_recovery_sleep = '0.000000' osd_recovery_sleep_hdd = '0.000000' osd_recovery_sleep_hybrid = '0.000000' osd_recovery_sleep_ssd = '0.000000' osd_scrub_sleep = '0.000000' osd_snap_trim_sleep = '0.000000' osd_snap_trim_sleep_hdd = '0.000000' osd_snap_trim_sleep_hybrid = '0.000000' osd_snap_trim_sleep_ssd = '0.000000' " 2023-10-16T19:58:17.221 INFO:teuthology.orchestra.run.smithi157.stdout:} 2023-10-16T19:58:17.222 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.210+0000 7f217769b700 1 -- 172.21.15.157:0/1894077976 >> [v2:172.21.15.157:6824/1118292389,v1:172.21.15.157:6825/1118292389] conn(0x7f2154073100 msgr2=0x7f2154075540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:17.222 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.210+0000 7f217769b700 1 --2- 172.21.15.157:0/1894077976 >> [v2:172.21.15.157:6824/1118292389,v1:172.21.15.157:6825/1118292389] conn(0x7f2154073100 0x7f2154075540 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:17.223 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.210+0000 7f217769b700 1 -- 172.21.15.157:0/1894077976 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f215406af00 msgr2=0x7f215406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:17.223 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.210+0000 7f217769b700 1 --2- 172.21.15.157:0/1894077976 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f215406af00 0x7f215406d3c0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f21700b2280 tx=0x7f216c008040 comp rx=0 tx=0).stop 2023-10-16T19:58:17.224 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.210+0000 7f217769b700 1 -- 172.21.15.157:0/1894077976 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f217006ea10 msgr2=0x7f21700b59c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:17.224 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.210+0000 7f217769b700 1 --2- 172.21.15.157:0/1894077976 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f217006ea10 0x7f21700b59c0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f2160014040 tx=0x7f2160004750 comp rx=0 tx=0).stop 2023-10-16T19:58:17.225 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.210+0000 7f2175c38700 1 -- 172.21.15.157:0/1894077976 reap_dead start 2023-10-16T19:58:17.225 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.210+0000 7f217769b700 1 -- 172.21.15.157:0/1894077976 shutdown_connections 2023-10-16T19:58:17.225 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.210+0000 7f217769b700 1 -- 172.21.15.157:0/1894077976 >> 172.21.15.157:0/1894077976 conn(0x7f21700d0b30 msgr2=0x7f2170160d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:58:17.225 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.210+0000 7f217769b700 1 -- 172.21.15.157:0/1894077976 shutdown_connections 2023-10-16T19:58:17.226 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.210+0000 7f217769b700 1 -- 172.21.15.157:0/1894077976 wait complete. 2023-10-16T19:58:17.227 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-10-16T19:58:17.349 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.346+0000 7f9e14109700 1 Processor -- start 2023-10-16T19:58:17.349 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.346+0000 7f9e14109700 1 -- start start 2023-10-16T19:58:17.353 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.347+0000 7f9e14109700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9e0c15c1d0 0x7f9e0c071fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:17.353 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.347+0000 7f9e14109700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e0c06f530 con 0x7f9e0c06af60 2023-10-16T19:58:17.353 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.347+0000 7f9e14109700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e0c06f7d0 con 0x7f9e0c0cd0a0 2023-10-16T19:58:17.354 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.347+0000 7f9e14109700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e0c06fab0 con 0x7f9e0c15c1d0 2023-10-16T19:58:17.354 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.347+0000 7f9e126a6700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f9e0c06af60 0x7f9e0c15fe50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:57588/0 (socket says 172.21.15.157:57588) 2023-10-16T19:58:17.355 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.347+0000 7f9e126a6700 1 -- 172.21.15.157:0/1356220552 learned_addr learned my addr 172.21.15.157:0/1356220552 (peer_addr_for_me v1:172.21.15.157:0/0) 2023-10-16T19:58:17.355 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.348+0000 7f9e11ea5700 1 --2- 172.21.15.157:0/1356220552 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9e0c15c1d0 0x7f9e0c071fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:17.355 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.348+0000 7f9e10ea3700 1 -- 172.21.15.157:0/1356220552 <== mon.0 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2060076213 0 0) 0x7f9e0c06f530 con 0x7f9e0c06af60 2023-10-16T19:58:17.355 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.348+0000 7f9e10ea3700 1 -- 172.21.15.157:0/1356220552 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9df80035b0 con 0x7f9e0c06af60 2023-10-16T19:58:17.356 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.348+0000 7f9e10ea3700 1 -- 172.21.15.157:0/1356220552 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 749900418 0 0) 0x7f9e0c06f7d0 con 0x7f9e0c0cd0a0 2023-10-16T19:58:17.356 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.348+0000 7f9e10ea3700 1 -- 172.21.15.157:0/1356220552 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9e0c06f530 con 0x7f9e0c0cd0a0 2023-10-16T19:58:17.356 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.348+0000 7f9e10ea3700 1 -- 172.21.15.157:0/1356220552 <== mon.0 v1:172.21.15.157:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1518966166 0 0) 0x7f9df80035b0 con 0x7f9e0c06af60 2023-10-16T19:58:17.357 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.348+0000 7f9e10ea3700 1 -- 172.21.15.157:0/1356220552 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9e0c15c1d0 msgr2=0x7f9e0c071fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:58:17.357 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.348+0000 7f9e10ea3700 1 --2- 172.21.15.157:0/1356220552 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9e0c15c1d0 0x7f9e0c071fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:17.357 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.348+0000 7f9e10ea3700 1 -- 172.21.15.157:0/1356220552 >> v1:172.21.15.187:6789/0 conn(0x7f9e0c0cd0a0 legacy=0x7f9e0c06a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:17.357 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.348+0000 7f9e10ea3700 1 -- 172.21.15.157:0/1356220552 --> v1:172.21.15.157:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e0c0cb1a0 con 0x7f9e0c06af60 2023-10-16T19:58:17.358 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.348+0000 7f9e10ea3700 1 -- 172.21.15.157:0/1356220552 <== mon.0 v1:172.21.15.157:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4021145519 0 0) 0x7f9e040019c0 con 0x7f9e0c06af60 2023-10-16T19:58:17.358 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.348+0000 7f9e10ea3700 1 -- 172.21.15.157:0/1356220552 >> v1:172.21.15.157:6789/0 conn(0x7f9e0c06af60 legacy=0x7f9e0c15fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:17.358 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.348+0000 7f9e10ea3700 1 --2- 172.21.15.157:0/1356220552 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9df8003bc0 0x7f9df8003fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:17.359 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.348+0000 7f9e10ea3700 1 --2- 172.21.15.157:0/1356220552 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9df8004850 0x7f9df8004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:17.359 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.348+0000 7f9e10ea3700 1 --2- 172.21.15.157:0/1356220552 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9e0c15c1d0 0x7f9df8005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:17.359 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.348+0000 7f9e10ea3700 1 -- 172.21.15.157:0/1356220552 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e0c06fab0 con 0x7f9df8003bc0 2023-10-16T19:58:17.359 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.348+0000 7f9e10ea3700 1 -- 172.21.15.157:0/1356220552 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9df800bac0 con 0x7f9df8004850 2023-10-16T19:58:17.360 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.348+0000 7f9e10ea3700 1 -- 172.21.15.157:0/1356220552 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9df800bc80 con 0x7f9e0c15c1d0 2023-10-16T19:58:17.360 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.348+0000 7f9e11ea5700 1 --2- 172.21.15.157:0/1356220552 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9df8003bc0 0x7f9df8003fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:17.360 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.348+0000 7f9e116a4700 1 --2- 172.21.15.157:0/1356220552 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9df8004850 0x7f9df8004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:17.360 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.348+0000 7f9e126a6700 1 --2- 172.21.15.157:0/1356220552 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9e0c15c1d0 0x7f9df8005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:17.361 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.348+0000 7f9e11ea5700 1 -- 172.21.15.157:0/1356220552 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9e0c15c1d0 msgr2=0x7f9df8005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:58:17.361 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.348+0000 7f9e11ea5700 1 --2- 172.21.15.157:0/1356220552 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9e0c15c1d0 0x7f9df8005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:17.362 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.348+0000 7f9e11ea5700 1 -- 172.21.15.157:0/1356220552 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9df8004850 msgr2=0x7f9df8004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:58:17.362 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.348+0000 7f9e11ea5700 1 --2- 172.21.15.157:0/1356220552 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9df8004850 0x7f9df8004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:17.362 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.348+0000 7f9e11ea5700 1 -- 172.21.15.157:0/1356220552 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9df80035b0 con 0x7f9df8003bc0 2023-10-16T19:58:17.363 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.348+0000 7f9e126a6700 1 --2- 172.21.15.157:0/1356220552 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9e0c15c1d0 0x7f9df8005210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T19:58:17.363 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.349+0000 7f9e11ea5700 1 --2- 172.21.15.157:0/1356220552 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9df8003bc0 0x7f9df8003fc0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f9dfc009b60 tx=0x7f9df8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bba663e7633b2517 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:58:17.363 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.349+0000 7f9e10ea3700 1 -- 172.21.15.157:0/1356220552 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dfc00e6c0 con 0x7f9df8003bc0 2023-10-16T19:58:17.364 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.349+0000 7f9e10ea3700 1 -- 172.21.15.157:0/1356220552 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dfc00e820 con 0x7f9df8003bc0 2023-10-16T19:58:17.364 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.349+0000 7f9e10ea3700 1 -- 172.21.15.157:0/1356220552 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dfc00eb90 con 0x7f9df8003bc0 2023-10-16T19:58:17.364 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.349+0000 7f9e14109700 1 -- 172.21.15.157:0/1356220552 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9df8003bc0 msgr2=0x7f9df8003fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:17.365 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.349+0000 7f9e14109700 1 --2- 172.21.15.157:0/1356220552 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9df8003bc0 0x7f9df8003fc0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f9dfc009b60 tx=0x7f9df8005880 comp rx=0 tx=0).stop 2023-10-16T19:58:17.365 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.349+0000 7f9e126a6700 1 -- 172.21.15.157:0/1356220552 reap_dead start 2023-10-16T19:58:17.365 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.349+0000 7f9e14109700 1 -- 172.21.15.157:0/1356220552 shutdown_connections 2023-10-16T19:58:17.366 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.349+0000 7f9e14109700 1 -- 172.21.15.157:0/1356220552 >> 172.21.15.157:0/1356220552 conn(0x7f9e0c0cd4e0 msgr2=0x7f9e0c0cd8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:58:17.366 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.349+0000 7f9e14109700 1 -- 172.21.15.157:0/1356220552 shutdown_connections 2023-10-16T19:58:17.366 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.349+0000 7f9e14109700 1 -- 172.21.15.157:0/1356220552 wait complete. 2023-10-16T19:58:17.367 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.351+0000 7f9e14109700 1 Processor -- start 2023-10-16T19:58:17.367 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.351+0000 7f9e14109700 1 -- start start 2023-10-16T19:58:17.370 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.351+0000 7f9e14109700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9df8003bc0 0x7f9e0c15dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:17.370 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.351+0000 7f9e14109700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9e0c1f17c0 0x7f9e0c14f870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:17.371 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.351+0000 7f9e14109700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9e0c0c7aa0 0x7f9e0c0a9450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:17.371 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.351+0000 7f9e14109700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e0c14fdb0 con 0x7f9e0c1f17c0 2023-10-16T19:58:17.371 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.351+0000 7f9e14109700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e0c0c82f0 con 0x7f9df8003bc0 2023-10-16T19:58:17.372 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.352+0000 7f9e14109700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e0c0c85d0 con 0x7f9e0c0c7aa0 2023-10-16T19:58:17.372 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.352+0000 7f9e116a4700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9e0c1f17c0 0x7f9e0c14f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:17.372 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.352+0000 7f9e116a4700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9e0c1f17c0 0x7f9e0c14f870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:47928/0 (socket says 172.21.15.157:47928) 2023-10-16T19:58:17.373 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.352+0000 7f9e116a4700 1 -- 172.21.15.157:0/2181289463 learned_addr learned my addr 172.21.15.157:0/2181289463 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:58:17.373 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.352+0000 7f9e126a6700 1 --2- 172.21.15.157:0/2181289463 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9e0c0c7aa0 0x7f9e0c0a9450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:17.373 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.352+0000 7f9e11ea5700 1 --2- 172.21.15.157:0/2181289463 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9df8003bc0 0x7f9e0c15dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:17.374 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.352+0000 7f9e116a4700 1 -- 172.21.15.157:0/2181289463 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9e0c0c7aa0 msgr2=0x7f9e0c0a9450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:17.374 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.352+0000 7f9e116a4700 1 --2- 172.21.15.157:0/2181289463 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9e0c0c7aa0 0x7f9e0c0a9450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:17.374 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.352+0000 7f9e116a4700 1 -- 172.21.15.157:0/2181289463 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9df8003bc0 msgr2=0x7f9e0c15dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:17.375 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.352+0000 7f9e116a4700 1 --2- 172.21.15.157:0/2181289463 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9df8003bc0 0x7f9e0c15dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:17.375 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.352+0000 7f9e116a4700 1 -- 172.21.15.157:0/2181289463 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e0c0c88b0 con 0x7f9e0c1f17c0 2023-10-16T19:58:17.375 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.352+0000 7f9e116a4700 1 --2- 172.21.15.157:0/2181289463 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9e0c1f17c0 0x7f9e0c14f870 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f9e0800e7b0 tx=0x7f9e0800eb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:58:17.376 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.352+0000 7f9e027fc700 1 -- 172.21.15.157:0/2181289463 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e080052e0 con 0x7f9e0c1f17c0 2023-10-16T19:58:17.376 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.352+0000 7f9e027fc700 1 -- 172.21.15.157:0/2181289463 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e08005440 con 0x7f9e0c1f17c0 2023-10-16T19:58:17.376 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.352+0000 7f9e14109700 1 -- 172.21.15.157:0/2181289463 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e0c0c8b90 con 0x7f9e0c1f17c0 2023-10-16T19:58:17.376 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.352+0000 7f9e027fc700 1 -- 172.21.15.157:0/2181289463 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e080038c0 con 0x7f9e0c1f17c0 2023-10-16T19:58:17.377 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.352+0000 7f9e14109700 1 -- 172.21.15.157:0/2181289463 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e0c1f1c40 con 0x7f9e0c1f17c0 2023-10-16T19:58:17.377 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.353+0000 7f9e14109700 1 -- 172.21.15.157:0/2181289463 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e0c04f400 con 0x7f9e0c1f17c0 2023-10-16T19:58:17.377 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.354+0000 7f9e027fc700 1 -- 172.21.15.157:0/2181289463 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f9e08003a20 con 0x7f9e0c1f17c0 2023-10-16T19:58:17.377 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.354+0000 7f9e027fc700 1 --2- 172.21.15.157:0/2181289463 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f9df006af00 0x7f9df006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:17.378 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.354+0000 7f9e027fc700 1 -- 172.21.15.157:0/2181289463 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5729+0+0 (secure 0 0 0) 0x7f9e08088f90 con 0x7f9e0c1f17c0 2023-10-16T19:58:17.378 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.354+0000 7f9e11ea5700 1 --2- 172.21.15.157:0/2181289463 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f9df006af00 0x7f9df006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:17.378 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.355+0000 7f9e11ea5700 1 --2- 172.21.15.157:0/2181289463 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f9df006af00 0x7f9df006d3c0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f9dfc000c00 tx=0x7f9dfc008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:58:17.379 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.359+0000 7f9e027fc700 1 -- 172.21.15.157:0/2181289463 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9e080bbca0 con 0x7f9e0c1f17c0 2023-10-16T19:58:17.550 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.547+0000 7f9e14109700 1 -- 172.21.15.157:0/2181289463 --> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f9e0c0ccb10 con 0x7f9df006af00 2023-10-16T19:58:17.550 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.548+0000 7f9e027fc700 1 -- 172.21.15.157:0/2181289463 <== mgr.4100 v2:172.21.15.187:6832/2426285296 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f9dfc00ea10 con 0x7f9df006af00 2023-10-16T19:58:17.552 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.550+0000 7f9e14109700 1 -- 172.21.15.157:0/2181289463 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f9df006af00 msgr2=0x7f9df006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:17.553 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.550+0000 7f9e14109700 1 --2- 172.21.15.157:0/2181289463 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f9df006af00 0x7f9df006d3c0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f9dfc000c00 tx=0x7f9dfc008030 comp rx=0 tx=0).stop 2023-10-16T19:58:17.553 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.550+0000 7f9e14109700 1 -- 172.21.15.157:0/2181289463 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9e0c1f17c0 msgr2=0x7f9e0c14f870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:17.553 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.550+0000 7f9e14109700 1 --2- 172.21.15.157:0/2181289463 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9e0c1f17c0 0x7f9e0c14f870 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f9e0800e7b0 tx=0x7f9e0800eb70 comp rx=0 tx=0).stop 2023-10-16T19:58:17.554 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.550+0000 7f9e14109700 1 -- 172.21.15.157:0/2181289463 shutdown_connections 2023-10-16T19:58:17.554 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.550+0000 7f9e14109700 1 --2- 172.21.15.157:0/2181289463 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f9df006af00 0x7f9df006d3c0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:17.554 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.550+0000 7f9e14109700 1 --2- 172.21.15.157:0/2181289463 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9df8003bc0 0x7f9e0c15dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:17.555 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.550+0000 7f9e14109700 1 --2- 172.21.15.157:0/2181289463 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9e0c0c7aa0 0x7f9e0c0a9450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:17.555 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.550+0000 7f9e14109700 1 --2- 172.21.15.157:0/2181289463 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9e0c1f17c0 0x7f9e0c14f870 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:17.555 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.550+0000 7f9e14109700 1 -- 172.21.15.157:0/2181289463 >> 172.21.15.157:0/2181289463 conn(0x7f9e0c0cd4e0 msgr2=0x7f9e0c15ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:58:17.555 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.550+0000 7f9e14109700 1 -- 172.21.15.157:0/2181289463 shutdown_connections 2023-10-16T19:58:17.556 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.550+0000 7f9e14109700 1 -- 172.21.15.157:0/2181289463 wait complete. 2023-10-16T19:58:17.556 INFO:teuthology.orchestra.run.smithi157.stderr:instructed osd(s) 2 to deep-scrub 2023-10-16T19:58:17.564 INFO:tasks.ceph:Scrubbing osd.3 2023-10-16T19:58:17.565 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2023-10-16T19:58:17.689 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.687+0000 7f0477e6d700 1 Processor -- start 2023-10-16T19:58:17.689 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.687+0000 7f0477e6d700 1 -- start start 2023-10-16T19:58:17.691 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.688+0000 7f0477e6d700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f047015e090 0x7f047006b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:17.692 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.688+0000 7f0477e6d700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f047006b6a0 con 0x7f047006ea10 2023-10-16T19:58:17.692 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.688+0000 7f0477e6d700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0470072320 con 0x7f04700b0190 2023-10-16T19:58:17.692 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.688+0000 7f0477e6d700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0470071b50 con 0x7f047015e090 2023-10-16T19:58:17.692 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.688+0000 7f0475c09700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f047015e090 0x7f047006b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:17.693 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.688+0000 7f0475408700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f047006ea10 0x7f04700afa80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:57604/0 (socket says 172.21.15.157:57604) 2023-10-16T19:58:17.693 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.688+0000 7f0475408700 1 -- 172.21.15.157:0/2827718647 learned_addr learned my addr 172.21.15.157:0/2827718647 (peer_addr_for_me v1:172.21.15.157:0/0) 2023-10-16T19:58:17.693 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.688+0000 7f0475c09700 1 -- 172.21.15.157:0/2827718647 >> v1:172.21.15.187:6789/0 conn(0x7f04700b0190 legacy=0x7f047015e470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:17.694 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.688+0000 7f0475c09700 1 -- 172.21.15.157:0/2827718647 >> v1:172.21.15.157:6789/0 conn(0x7f047006ea10 legacy=0x7f04700afa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:17.694 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.688+0000 7f0475c09700 1 -- 172.21.15.157:0/2827718647 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0470071d60 con 0x7f047015e090 2023-10-16T19:58:17.694 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.688+0000 7f0475c09700 1 --2- 172.21.15.157:0/2827718647 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f047015e090 0x7f047006b160 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f046c009840 tx=0x7f046c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bfd6d3ee62a883a server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:58:17.694 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.688+0000 7f0474c07700 1 -- 172.21.15.157:0/2827718647 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f046c011830 con 0x7f047015e090 2023-10-16T19:58:17.695 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.688+0000 7f0474c07700 1 -- 172.21.15.157:0/2827718647 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f046c011990 con 0x7f047015e090 2023-10-16T19:58:17.695 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.688+0000 7f0474c07700 1 -- 172.21.15.157:0/2827718647 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f046c011d20 con 0x7f047015e090 2023-10-16T19:58:17.695 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.689+0000 7f0477e6d700 1 -- 172.21.15.157:0/2827718647 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f047015e090 msgr2=0x7f047006b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:17.696 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.689+0000 7f0477e6d700 1 --2- 172.21.15.157:0/2827718647 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f047015e090 0x7f047006b160 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f046c009840 tx=0x7f046c009b50 comp rx=0 tx=0).stop 2023-10-16T19:58:17.696 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.689+0000 7f0477e6d700 1 -- 172.21.15.157:0/2827718647 shutdown_connections 2023-10-16T19:58:17.696 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.689+0000 7f0477e6d700 1 --2- 172.21.15.157:0/2827718647 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f047015e090 0x7f047006b160 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:17.697 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.689+0000 7f0477e6d700 1 -- 172.21.15.157:0/2827718647 >> 172.21.15.157:0/2827718647 conn(0x7f04700d0b30 msgr2=0x7f04700d0f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:58:17.697 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.689+0000 7f0477e6d700 1 -- 172.21.15.157:0/2827718647 shutdown_connections 2023-10-16T19:58:17.697 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.689+0000 7f0477e6d700 1 -- 172.21.15.157:0/2827718647 wait complete. 2023-10-16T19:58:17.700 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.690+0000 7f0477e6d700 1 Processor -- start 2023-10-16T19:58:17.701 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.690+0000 7f0477e6d700 1 -- start start 2023-10-16T19:58:17.701 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.691+0000 7f0477e6d700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f047006ea10 0x7f0470155930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:17.701 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.691+0000 7f0477e6d700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f04700b0190 0x7f04700cfd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:17.702 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.691+0000 7f0477e6d700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f047015e090 0x7f0470157360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:17.702 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.691+0000 7f0477e6d700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04700cf6d0 con 0x7f047015e090 2023-10-16T19:58:17.702 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.691+0000 7f0477e6d700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04700b4fe0 con 0x7f04700b0190 2023-10-16T19:58:17.703 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.691+0000 7f0477e6d700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0470155e70 con 0x7f047006ea10 2023-10-16T19:58:17.703 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.691+0000 7f047640a700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f047015e090 0x7f0470157360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:17.703 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.691+0000 7f047640a700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f047015e090 0x7f0470157360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:47942/0 (socket says 172.21.15.157:47942) 2023-10-16T19:58:17.703 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.691+0000 7f047640a700 1 -- 172.21.15.157:0/2215515692 learned_addr learned my addr 172.21.15.157:0/2215515692 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:58:17.704 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.691+0000 7f047640a700 1 -- 172.21.15.157:0/2215515692 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f047006ea10 msgr2=0x7f0470155930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:17.704 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.691+0000 7f047640a700 1 --2- 172.21.15.157:0/2215515692 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f047006ea10 0x7f0470155930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:17.704 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.691+0000 7f047640a700 1 -- 172.21.15.157:0/2215515692 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f04700b0190 msgr2=0x7f04700cfd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:17.704 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.691+0000 7f0475408700 1 --2- 172.21.15.157:0/2215515692 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f04700b0190 0x7f04700cfd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:17.705 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.692+0000 7f047640a700 1 --2- 172.21.15.157:0/2215515692 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f04700b0190 0x7f04700cfd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:17.705 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.692+0000 7f047640a700 1 -- 172.21.15.157:0/2215515692 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f046c0094a0 con 0x7f047015e090 2023-10-16T19:58:17.705 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.692+0000 7f047640a700 1 --2- 172.21.15.157:0/2215515692 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f047015e090 0x7f0470157360 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f046800cbf0 tx=0x7f046800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:58:17.706 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.692+0000 7f04667fc700 1 -- 172.21.15.157:0/2215515692 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0468003c00 con 0x7f047015e090 2023-10-16T19:58:17.706 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.692+0000 7f04667fc700 1 -- 172.21.15.157:0/2215515692 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0468003d60 con 0x7f047015e090 2023-10-16T19:58:17.706 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.692+0000 7f0477e6d700 1 -- 172.21.15.157:0/2215515692 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04700ceac0 con 0x7f047015e090 2023-10-16T19:58:17.706 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.692+0000 7f04667fc700 1 -- 172.21.15.157:0/2215515692 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f046800ac20 con 0x7f047015e090 2023-10-16T19:58:17.707 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.692+0000 7f0477e6d700 1 -- 172.21.15.157:0/2215515692 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04700cf080 con 0x7f047015e090 2023-10-16T19:58:17.707 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.693+0000 7f0477e6d700 1 -- 172.21.15.157:0/2215515692 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f047006a960 con 0x7f047015e090 2023-10-16T19:58:17.707 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.693+0000 7f04667fc700 1 -- 172.21.15.157:0/2215515692 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f04680050d0 con 0x7f047015e090 2023-10-16T19:58:17.708 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.694+0000 7f04667fc700 1 --2- 172.21.15.157:0/2215515692 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f045406af00 0x7f045406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:17.708 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.694+0000 7f04667fc700 1 -- 172.21.15.157:0/2215515692 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5729+0+0 (secure 0 0 0) 0x7f046808a090 con 0x7f047015e090 2023-10-16T19:58:17.708 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.694+0000 7f04667fc700 1 --2- 172.21.15.157:0/2215515692 >> [v2:172.21.15.157:6814/989329821,v1:172.21.15.157:6816/989329821] conn(0x7f0454073100 0x7f0454075540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:17.708 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.694+0000 7f04667fc700 1 -- 172.21.15.157:0/2215515692 --> [v2:172.21.15.157:6814/989329821,v1:172.21.15.157:6816/989329821] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0454075c10 con 0x7f0454073100 2023-10-16T19:58:17.709 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.694+0000 7f0475c09700 1 --2- 172.21.15.157:0/2215515692 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f045406af00 0x7f045406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:17.709 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.694+0000 7f04667fc700 1 -- 172.21.15.157:0/2215515692 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f046808a4e0 con 0x7f047015e090 2023-10-16T19:58:17.710 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.694+0000 7f0475408700 1 --2- 172.21.15.157:0/2215515692 >> [v2:172.21.15.157:6814/989329821,v1:172.21.15.157:6816/989329821] conn(0x7f0454073100 0x7f0454075540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:17.710 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.694+0000 7f0475408700 1 --2- 172.21.15.157:0/2215515692 >> [v2:172.21.15.157:6814/989329821,v1:172.21.15.157:6816/989329821] conn(0x7f0454073100 0x7f0454075540 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:58:17.710 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.694+0000 7f0475c09700 1 --2- 172.21.15.157:0/2215515692 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f045406af00 0x7f045406d3c0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f046c0090b0 tx=0x7f046c010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:58:17.710 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.695+0000 7f04667fc700 1 -- 172.21.15.157:0/2215515692 <== osd.3 v2:172.21.15.157:6814/989329821 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23595 (crc 0 0 0) 0x7f0454075c10 con 0x7f0454073100 2023-10-16T19:58:17.711 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.708+0000 7f0477e6d700 1 -- 172.21.15.157:0/2215515692 --> [v2:172.21.15.157:6814/989329821,v1:172.21.15.157:6816/989329821] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f0470072040 con 0x7f0454073100 2023-10-16T19:58:17.711 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.708+0000 7f04667fc700 1 -- 172.21.15.157:0/2215515692 <== osd.3 v2:172.21.15.157:6814/989329821 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+757 (crc 0 0 0) 0x7f0460007370 con 0x7f0454073100 2023-10-16T19:58:17.712 INFO:teuthology.orchestra.run.smithi157.stdout:{ 2023-10-16T19:58:17.712 INFO:teuthology.orchestra.run.smithi157.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) osd_delete_sleep = '0.000000' osd_delete_sleep_hdd = '0.000000' osd_delete_sleep_hybrid = '0.000000' osd_delete_sleep_ssd = '0.000000' osd_max_backfills = '1' osd_pg_delete_cost = '15728640' (not observed, change may require restart) osd_recovery_max_active = '0' osd_recovery_max_active_hdd = '3' osd_recovery_max_active_ssd = '10' osd_recovery_sleep = '0.000000' osd_recovery_sleep_hdd = '0.000000' osd_recovery_sleep_hybrid = '0.000000' osd_recovery_sleep_ssd = '0.000000' osd_scrub_sleep = '0.000000' osd_snap_trim_sleep = '0.000000' osd_snap_trim_sleep_hdd = '0.000000' osd_snap_trim_sleep_hybrid = '0.000000' osd_snap_trim_sleep_ssd = '0.000000' " 2023-10-16T19:58:17.713 INFO:teuthology.orchestra.run.smithi157.stdout:} 2023-10-16T19:58:17.714 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.708+0000 7f0477e6d700 1 -- 172.21.15.157:0/2215515692 >> [v2:172.21.15.157:6814/989329821,v1:172.21.15.157:6816/989329821] conn(0x7f0454073100 msgr2=0x7f0454075540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:17.714 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.708+0000 7f0477e6d700 1 --2- 172.21.15.157:0/2215515692 >> [v2:172.21.15.157:6814/989329821,v1:172.21.15.157:6816/989329821] conn(0x7f0454073100 0x7f0454075540 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:17.714 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.708+0000 7f0477e6d700 1 -- 172.21.15.157:0/2215515692 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f045406af00 msgr2=0x7f045406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:17.715 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.708+0000 7f0477e6d700 1 --2- 172.21.15.157:0/2215515692 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f045406af00 0x7f045406d3c0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f046c0090b0 tx=0x7f046c010000 comp rx=0 tx=0).stop 2023-10-16T19:58:17.715 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.708+0000 7f0477e6d700 1 -- 172.21.15.157:0/2215515692 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f047015e090 msgr2=0x7f0470157360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:17.715 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.708+0000 7f0477e6d700 1 --2- 172.21.15.157:0/2215515692 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f047015e090 0x7f0470157360 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f046800cbf0 tx=0x7f046800a060 comp rx=0 tx=0).stop 2023-10-16T19:58:17.716 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.708+0000 7f047640a700 1 -- 172.21.15.157:0/2215515692 reap_dead start 2023-10-16T19:58:17.716 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.708+0000 7f0477e6d700 1 -- 172.21.15.157:0/2215515692 shutdown_connections 2023-10-16T19:58:17.716 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.708+0000 7f0477e6d700 1 -- 172.21.15.157:0/2215515692 >> 172.21.15.157:0/2215515692 conn(0x7f04700d0b30 msgr2=0x7f04700cd540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:58:17.716 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.708+0000 7f0477e6d700 1 -- 172.21.15.157:0/2215515692 shutdown_connections 2023-10-16T19:58:17.717 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.708+0000 7f0477e6d700 1 -- 172.21.15.157:0/2215515692 wait complete. 2023-10-16T19:58:17.722 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2023-10-16T19:58:17.844 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.841+0000 7f4bd2833700 1 Processor -- start 2023-10-16T19:58:17.844 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.841+0000 7f4bd2833700 1 -- start start 2023-10-16T19:58:17.848 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.842+0000 7f4bd2833700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f4bcc15dce0 0x7f4bcc06d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:17.848 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.842+0000 7f4bd2833700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4bcc0d1a90 0x7f4bcc0b3690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:17.848 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.842+0000 7f4bd2833700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bcc0ce610 con 0x7f4bcc15e0c0 2023-10-16T19:58:17.849 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.842+0000 7f4bd2833700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4bcc0b13c0 con 0x7f4bcc15dce0 2023-10-16T19:58:17.849 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.842+0000 7f4bd2833700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bcc0d1f50 con 0x7f4bcc0d1a90 2023-10-16T19:58:17.849 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.842+0000 7f4bd0dd0700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f4bcc15e0c0 0x7f4bcc06b960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:57624/0 (socket says 172.21.15.157:57624) 2023-10-16T19:58:17.849 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.842+0000 7f4bd0dd0700 1 -- 172.21.15.157:0/1460212291 learned_addr learned my addr 172.21.15.157:0/1460212291 (peer_addr_for_me v1:172.21.15.157:0/0) 2023-10-16T19:58:17.850 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.843+0000 7f4bcb7fe700 1 --2- 172.21.15.157:0/1460212291 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4bcc0d1a90 0x7f4bcc0b3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:17.850 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.843+0000 7f4bcaffd700 1 -- 172.21.15.157:0/1460212291 <== mon.0 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2829755648 0 0) 0x7f4bcc0ce610 con 0x7f4bcc15e0c0 2023-10-16T19:58:17.850 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.843+0000 7f4bcaffd700 1 -- 172.21.15.157:0/1460212291 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4bb80035b0 con 0x7f4bcc15e0c0 2023-10-16T19:58:17.851 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.843+0000 7f4bcbfff700 1 --2- 172.21.15.157:0/1460212291 >> v2:172.21.15.187:3300/0 conn(0x7f4bcc15dce0 0x7f4bcc06d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:17.851 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.843+0000 7f4bcaffd700 1 -- 172.21.15.157:0/1460212291 <== mon.0 v1:172.21.15.157:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3090215320 0 0) 0x7f4bb80035b0 con 0x7f4bcc15e0c0 2023-10-16T19:58:17.851 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.843+0000 7f4bcaffd700 1 -- 172.21.15.157:0/1460212291 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4bcc0d1a90 msgr2=0x7f4bcc0b3690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:58:17.851 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.843+0000 7f4bcaffd700 1 --2- 172.21.15.157:0/1460212291 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4bcc0d1a90 0x7f4bcc0b3690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:17.852 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.843+0000 7f4bcaffd700 1 -- 172.21.15.157:0/1460212291 >> v2:172.21.15.187:3300/0 conn(0x7f4bcc15dce0 msgr2=0x7f4bcc06d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:58:17.852 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.843+0000 7f4bcaffd700 1 --2- 172.21.15.157:0/1460212291 >> v2:172.21.15.187:3300/0 conn(0x7f4bcc15dce0 0x7f4bcc06d2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:17.852 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.843+0000 7f4bcaffd700 1 -- 172.21.15.157:0/1460212291 --> v1:172.21.15.157:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bcc0d2230 con 0x7f4bcc15e0c0 2023-10-16T19:58:17.853 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.843+0000 7f4bcaffd700 1 -- 172.21.15.157:0/1460212291 <== mon.0 v1:172.21.15.157:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4021145519 0 0) 0x7f4bc40019f0 con 0x7f4bcc15e0c0 2023-10-16T19:58:17.853 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.843+0000 7f4bcaffd700 1 -- 172.21.15.157:0/1460212291 >> v1:172.21.15.157:6789/0 conn(0x7f4bcc15e0c0 legacy=0x7f4bcc06b960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:17.853 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.843+0000 7f4bcaffd700 1 --2- 172.21.15.157:0/1460212291 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4bb8003a00 0x7f4bb8003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:17.854 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.843+0000 7f4bcaffd700 1 --2- 172.21.15.157:0/1460212291 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4bcc0d1a90 0x7f4bb8004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:17.854 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.843+0000 7f4bcaffd700 1 --2- 172.21.15.157:0/1460212291 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4bb8004d90 0x7f4bb8005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:17.854 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.843+0000 7f4bcaffd700 1 -- 172.21.15.157:0/1460212291 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bcc0b13c0 con 0x7f4bb8003a00 2023-10-16T19:58:17.854 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.843+0000 7f4bcaffd700 1 -- 172.21.15.157:0/1460212291 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bcc0d1f50 con 0x7f4bb8004d90 2023-10-16T19:58:17.855 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.843+0000 7f4bcaffd700 1 -- 172.21.15.157:0/1460212291 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bb800ba40 con 0x7f4bcc0d1a90 2023-10-16T19:58:17.855 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.843+0000 7f4bcbfff700 1 --2- 172.21.15.157:0/1460212291 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4bb8003a00 0x7f4bb8003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:17.855 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.843+0000 7f4bcb7fe700 1 --2- 172.21.15.157:0/1460212291 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4bcc0d1a90 0x7f4bb8004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:17.856 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.843+0000 7f4bd0dd0700 1 --2- 172.21.15.157:0/1460212291 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4bb8004d90 0x7f4bb8005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:17.856 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.843+0000 7f4bcbfff700 1 -- 172.21.15.157:0/1460212291 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4bcc0d1a90 msgr2=0x7f4bb8004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:58:17.856 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.843+0000 7f4bcbfff700 1 --2- 172.21.15.157:0/1460212291 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4bcc0d1a90 0x7f4bb8004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:17.856 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.843+0000 7f4bcbfff700 1 -- 172.21.15.157:0/1460212291 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4bb8004d90 msgr2=0x7f4bb8005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:58:17.857 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.843+0000 7f4bcbfff700 1 --2- 172.21.15.157:0/1460212291 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4bb8004d90 0x7f4bb8005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:17.857 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.843+0000 7f4bcbfff700 1 -- 172.21.15.157:0/1460212291 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bb80035b0 con 0x7f4bb8003a00 2023-10-16T19:58:17.857 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.843+0000 7f4bcbfff700 1 --2- 172.21.15.157:0/1460212291 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4bb8003a00 0x7f4bb8003e20 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f4bb4009b60 tx=0x7f4bb8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=265c6b83e1bc0928 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:58:17.857 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.844+0000 7f4bcaffd700 1 -- 172.21.15.157:0/1460212291 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bb400e6c0 con 0x7f4bb8003a00 2023-10-16T19:58:17.858 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.844+0000 7f4bcaffd700 1 -- 172.21.15.157:0/1460212291 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bb400e820 con 0x7f4bb8003a00 2023-10-16T19:58:17.858 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.844+0000 7f4bcaffd700 1 -- 172.21.15.157:0/1460212291 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bb400eb90 con 0x7f4bb8003a00 2023-10-16T19:58:17.858 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.844+0000 7f4bd2833700 1 -- 172.21.15.157:0/1460212291 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4bb8003a00 msgr2=0x7f4bb8003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:17.859 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.844+0000 7f4bd2833700 1 --2- 172.21.15.157:0/1460212291 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4bb8003a00 0x7f4bb8003e20 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f4bb4009b60 tx=0x7f4bb8005880 comp rx=0 tx=0).stop 2023-10-16T19:58:17.859 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.844+0000 7f4bd0dd0700 1 -- 172.21.15.157:0/1460212291 reap_dead start 2023-10-16T19:58:17.859 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.844+0000 7f4bd2833700 1 -- 172.21.15.157:0/1460212291 shutdown_connections 2023-10-16T19:58:17.859 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.844+0000 7f4bd2833700 1 -- 172.21.15.157:0/1460212291 >> 172.21.15.157:0/1460212291 conn(0x7f4bcc06e300 msgr2=0x7f4bcc06e6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:58:17.860 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.844+0000 7f4bd2833700 1 -- 172.21.15.157:0/1460212291 shutdown_connections 2023-10-16T19:58:17.860 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.844+0000 7f4bd2833700 1 -- 172.21.15.157:0/1460212291 wait complete. 2023-10-16T19:58:17.860 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.845+0000 7f4bd2833700 1 Processor -- start 2023-10-16T19:58:17.860 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.846+0000 7f4bd2833700 1 -- start start 2023-10-16T19:58:17.863 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.846+0000 7f4bd2833700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4bb8003a00 0x7f4bcc1e8040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:17.864 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.846+0000 7f4bd2833700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4bcc0c7ae0 0x7f4bcc1e6770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:17.864 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.846+0000 7f4bd2833700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4bcc0cbcc0 0x7f4bcc0c8ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:17.864 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.847+0000 7f4bd2833700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bcc1e7bb0 con 0x7f4bb8003a00 2023-10-16T19:58:17.865 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.847+0000 7f4bd2833700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bcc1e6fa0 con 0x7f4bcc0c7ae0 2023-10-16T19:58:17.865 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.847+0000 7f4bd2833700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bcc1e7280 con 0x7f4bcc0cbcc0 2023-10-16T19:58:17.865 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.847+0000 7f4bcbfff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4bb8003a00 0x7f4bcc1e8040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:17.866 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.847+0000 7f4bcbfff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4bb8003a00 0x7f4bcc1e8040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:47960/0 (socket says 172.21.15.157:47960) 2023-10-16T19:58:17.866 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.847+0000 7f4bcbfff700 1 -- 172.21.15.157:0/2272358534 learned_addr learned my addr 172.21.15.157:0/2272358534 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:58:17.866 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.847+0000 7f4bcb7fe700 1 --2- 172.21.15.157:0/2272358534 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4bcc0c7ae0 0x7f4bcc1e6770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:17.866 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.847+0000 7f4bd0dd0700 1 --2- 172.21.15.157:0/2272358534 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4bcc0cbcc0 0x7f4bcc0c8ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:17.867 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.847+0000 7f4bcbfff700 1 -- 172.21.15.157:0/2272358534 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4bcc0cbcc0 msgr2=0x7f4bcc0c8ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:17.867 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.847+0000 7f4bcbfff700 1 --2- 172.21.15.157:0/2272358534 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4bcc0cbcc0 0x7f4bcc0c8ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:17.867 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.847+0000 7f4bcbfff700 1 -- 172.21.15.157:0/2272358534 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4bcc0c7ae0 msgr2=0x7f4bcc1e6770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:17.868 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.847+0000 7f4bcbfff700 1 --2- 172.21.15.157:0/2272358534 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4bcc0c7ae0 0x7f4bcc1e6770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:17.868 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.847+0000 7f4bcbfff700 1 -- 172.21.15.157:0/2272358534 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bcc1e7560 con 0x7f4bb8003a00 2023-10-16T19:58:17.868 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.847+0000 7f4bd0dd0700 1 --2- 172.21.15.157:0/2272358534 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4bcc0cbcc0 0x7f4bcc0c8ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T19:58:17.868 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.847+0000 7f4bcbfff700 1 --2- 172.21.15.157:0/2272358534 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4bb8003a00 0x7f4bcc1e8040 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f4bb40090b0 tx=0x7f4bb40047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:58:17.869 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.847+0000 7f4bc8ff9700 1 -- 172.21.15.157:0/2272358534 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bb4021070 con 0x7f4bb8003a00 2023-10-16T19:58:17.869 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.847+0000 7f4bc8ff9700 1 -- 172.21.15.157:0/2272358534 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bb40036a0 con 0x7f4bb8003a00 2023-10-16T19:58:17.869 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.847+0000 7f4bd2833700 1 -- 172.21.15.157:0/2272358534 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bcc1e7840 con 0x7f4bb8003a00 2023-10-16T19:58:17.870 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.847+0000 7f4bc8ff9700 1 -- 172.21.15.157:0/2272358534 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bb400e6c0 con 0x7f4bb8003a00 2023-10-16T19:58:17.870 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.847+0000 7f4bd2833700 1 -- 172.21.15.157:0/2272358534 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bcc0c91e0 con 0x7f4bb8003a00 2023-10-16T19:58:17.870 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.848+0000 7f4bd2833700 1 -- 172.21.15.157:0/2272358534 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bcc04f400 con 0x7f4bb8003a00 2023-10-16T19:58:17.870 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.848+0000 7f4bc8ff9700 1 -- 172.21.15.157:0/2272358534 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f4bb4025070 con 0x7f4bb8003a00 2023-10-16T19:58:17.871 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.849+0000 7f4bc8ff9700 1 --2- 172.21.15.157:0/2272358534 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f4bac06af30 0x7f4bac06d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:17.871 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.849+0000 7f4bc8ff9700 1 -- 172.21.15.157:0/2272358534 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5729+0+0 (secure 0 0 0) 0x7f4bb408a8c0 con 0x7f4bb8003a00 2023-10-16T19:58:17.872 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.849+0000 7f4bcb7fe700 1 --2- 172.21.15.157:0/2272358534 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f4bac06af30 0x7f4bac06d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:17.872 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.849+0000 7f4bcb7fe700 1 --2- 172.21.15.157:0/2272358534 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f4bac06af30 0x7f4bac06d3f0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f4bcc156a60 tx=0x7f4bbc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:58:17.872 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:17.853+0000 7f4bc8ff9700 1 -- 172.21.15.157:0/2272358534 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4bb4055b00 con 0x7f4bb8003a00 2023-10-16T19:58:18.043 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.041+0000 7f4bd2833700 1 -- 172.21.15.157:0/2272358534 --> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f4bcc0d27f0 con 0x7f4bac06af30 2023-10-16T19:58:18.044 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.042+0000 7f4bc8ff9700 1 -- 172.21.15.157:0/2272358534 <== mgr.4100 v2:172.21.15.187:6832/2426285296 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f4bbc0097f0 con 0x7f4bac06af30 2023-10-16T19:58:18.046 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.044+0000 7f4bd2833700 1 -- 172.21.15.157:0/2272358534 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f4bac06af30 msgr2=0x7f4bac06d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:18.047 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.044+0000 7f4bd2833700 1 --2- 172.21.15.157:0/2272358534 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f4bac06af30 0x7f4bac06d3f0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f4bcc156a60 tx=0x7f4bbc008040 comp rx=0 tx=0).stop 2023-10-16T19:58:18.047 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.044+0000 7f4bd2833700 1 -- 172.21.15.157:0/2272358534 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4bb8003a00 msgr2=0x7f4bcc1e8040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:18.047 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.044+0000 7f4bd2833700 1 --2- 172.21.15.157:0/2272358534 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4bb8003a00 0x7f4bcc1e8040 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f4bb40090b0 tx=0x7f4bb40047c0 comp rx=0 tx=0).stop 2023-10-16T19:58:18.047 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.044+0000 7f4bd2833700 1 -- 172.21.15.157:0/2272358534 shutdown_connections 2023-10-16T19:58:18.048 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.044+0000 7f4bd2833700 1 --2- 172.21.15.157:0/2272358534 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4bcc0cbcc0 0x7f4bcc0c8ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:18.048 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.044+0000 7f4bd2833700 1 --2- 172.21.15.157:0/2272358534 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4bb8003a00 0x7f4bcc1e8040 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:18.048 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.044+0000 7f4bd2833700 1 --2- 172.21.15.157:0/2272358534 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f4bac06af30 0x7f4bac06d3f0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:18.048 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.044+0000 7f4bd2833700 1 --2- 172.21.15.157:0/2272358534 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4bcc0c7ae0 0x7f4bcc1e6770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:18.049 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.044+0000 7f4bd2833700 1 -- 172.21.15.157:0/2272358534 >> 172.21.15.157:0/2272358534 conn(0x7f4bcc06e300 msgr2=0x7f4bcc0cef50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:58:18.049 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.044+0000 7f4bd2833700 1 -- 172.21.15.157:0/2272358534 shutdown_connections 2023-10-16T19:58:18.049 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.044+0000 7f4bd2833700 1 -- 172.21.15.157:0/2272358534 wait complete. 2023-10-16T19:58:18.050 INFO:teuthology.orchestra.run.smithi157.stderr:instructed osd(s) 3 to deep-scrub 2023-10-16T19:58:18.058 INFO:tasks.ceph:Scrubbing osd.4 2023-10-16T19:58:18.059 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2023-10-16T19:58:18.183 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.180+0000 7fcaa792d700 1 Processor -- start 2023-10-16T19:58:18.183 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.180+0000 7fcaa792d700 1 -- start start 2023-10-16T19:58:18.185 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.181+0000 7fcaa792d700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcaa00b5750 0x7fcaa00708d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:18.186 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.181+0000 7fcaa792d700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fcaa01603d0 0x7fcaa006ba20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:18.186 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.181+0000 7fcaa792d700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fcaa006bf60 0x7fcaa00ca900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:18.186 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.181+0000 7fcaa792d700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcaa006d720 con 0x7fcaa006bf60 2023-10-16T19:58:18.187 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.181+0000 7fcaa792d700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcaa0160850 con 0x7fcaa01603d0 2023-10-16T19:58:18.187 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.181+0000 7fcaa792d700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcaa006a980 con 0x7fcaa00b5750 2023-10-16T19:58:18.187 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.181+0000 7fcaa5eca700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fcaa006bf60 0x7fcaa00ca900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:18.188 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.182+0000 7fcaa5eca700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fcaa006bf60 0x7fcaa00ca900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:47972/0 (socket says 172.21.15.157:47972) 2023-10-16T19:58:18.188 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.182+0000 7fcaa5eca700 1 -- 172.21.15.157:0/3385337497 learned_addr learned my addr 172.21.15.157:0/3385337497 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:58:18.188 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.182+0000 7fcaa56c9700 1 --2- 172.21.15.157:0/3385337497 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcaa00b5750 0x7fcaa00708d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:18.189 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.182+0000 7fcaa4ec8700 1 --2- 172.21.15.157:0/3385337497 >> v2:172.21.15.187:3300/0 conn(0x7fcaa01603d0 0x7fcaa006ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:18.189 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.182+0000 7fcaa5eca700 1 -- 172.21.15.157:0/3385337497 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcaa00b5750 msgr2=0x7fcaa00708d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:58:18.189 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.182+0000 7fcaa5eca700 1 --2- 172.21.15.157:0/3385337497 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcaa00b5750 0x7fcaa00708d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:18.190 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.182+0000 7fcaa5eca700 1 -- 172.21.15.157:0/3385337497 >> v2:172.21.15.187:3300/0 conn(0x7fcaa01603d0 msgr2=0x7fcaa006ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:58:18.190 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.182+0000 7fcaa5eca700 1 --2- 172.21.15.157:0/3385337497 >> v2:172.21.15.187:3300/0 conn(0x7fcaa01603d0 0x7fcaa006ba20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:18.190 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.182+0000 7fcaa5eca700 1 -- 172.21.15.157:0/3385337497 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcaa006ac60 con 0x7fcaa006bf60 2023-10-16T19:58:18.191 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.182+0000 7fcaa5eca700 1 --2- 172.21.15.157:0/3385337497 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcaa006bf60 0x7fcaa00ca900 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fcaa006c3e0 tx=0x7fca9800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdf2675312f4babb server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:58:18.191 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.182+0000 7fca97fff700 1 -- 172.21.15.157:0/3385337497 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca9800e070 con 0x7fcaa006bf60 2023-10-16T19:58:18.191 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.182+0000 7fca97fff700 1 -- 172.21.15.157:0/3385337497 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca9800b9c0 con 0x7fcaa006bf60 2023-10-16T19:58:18.192 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.182+0000 7fca97fff700 1 -- 172.21.15.157:0/3385337497 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca9800bd70 con 0x7fcaa006bf60 2023-10-16T19:58:18.192 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.183+0000 7fcaa792d700 1 -- 172.21.15.157:0/3385337497 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcaa006bf60 msgr2=0x7fcaa00ca900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:18.192 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.183+0000 7fcaa792d700 1 --2- 172.21.15.157:0/3385337497 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcaa006bf60 0x7fcaa00ca900 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fcaa006c3e0 tx=0x7fca9800b330 comp rx=0 tx=0).stop 2023-10-16T19:58:18.192 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.183+0000 7fcaa792d700 1 -- 172.21.15.157:0/3385337497 shutdown_connections 2023-10-16T19:58:18.193 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.183+0000 7fcaa792d700 1 --2- 172.21.15.157:0/3385337497 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcaa006bf60 0x7fcaa00ca900 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:18.193 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.183+0000 7fcaa792d700 1 --2- 172.21.15.157:0/3385337497 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcaa00b5750 0x7fcaa00708d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:18.193 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.183+0000 7fcaa792d700 1 --2- 172.21.15.157:0/3385337497 >> v2:172.21.15.187:3300/0 conn(0x7fcaa01603d0 0x7fcaa006ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:18.194 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.183+0000 7fcaa792d700 1 -- 172.21.15.157:0/3385337497 >> 172.21.15.157:0/3385337497 conn(0x7fcaa006c7e0 msgr2=0x7fcaa006cbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:58:18.194 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.183+0000 7fcaa792d700 1 -- 172.21.15.157:0/3385337497 shutdown_connections 2023-10-16T19:58:18.194 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.183+0000 7fcaa792d700 1 -- 172.21.15.157:0/3385337497 wait complete. 2023-10-16T19:58:18.198 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.184+0000 7fcaa792d700 1 Processor -- start 2023-10-16T19:58:18.198 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.184+0000 7fcaa792d700 1 -- start start 2023-10-16T19:58:18.199 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.185+0000 7fcaa792d700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcaa00b5750 0x7fcaa0153b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:18.199 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.185+0000 7fcaa792d700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcaa01603d0 0x7fcaa00c9c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:18.199 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.185+0000 7fcaa792d700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcaa00c79c0 0x7fcaa00ca160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:18.199 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.185+0000 7fcaa792d700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaa015e0d0 con 0x7fcaa00b5750 2023-10-16T19:58:18.200 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.185+0000 7fcaa792d700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaa0157be0 con 0x7fcaa01603d0 2023-10-16T19:58:18.200 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.185+0000 7fcaa792d700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcaa00c7eb0 con 0x7fcaa00c79c0 2023-10-16T19:58:18.200 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.185+0000 7fcaa56c9700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcaa00b5750 0x7fcaa0153b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:18.201 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.185+0000 7fcaa56c9700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcaa00b5750 0x7fcaa0153b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:47974/0 (socket says 172.21.15.157:47974) 2023-10-16T19:58:18.201 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.185+0000 7fcaa56c9700 1 -- 172.21.15.157:0/2695407764 learned_addr learned my addr 172.21.15.157:0/2695407764 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:58:18.201 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.185+0000 7fcaa4ec8700 1 --2- 172.21.15.157:0/2695407764 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcaa01603d0 0x7fcaa00c9c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:18.201 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.185+0000 7fcaa5eca700 1 --2- 172.21.15.157:0/2695407764 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcaa00c79c0 0x7fcaa00ca160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:18.202 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.185+0000 7fcaa56c9700 1 -- 172.21.15.157:0/2695407764 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcaa00c79c0 msgr2=0x7fcaa00ca160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:18.202 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.185+0000 7fcaa56c9700 1 --2- 172.21.15.157:0/2695407764 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcaa00c79c0 0x7fcaa00ca160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:18.202 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.185+0000 7fcaa56c9700 1 -- 172.21.15.157:0/2695407764 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcaa01603d0 msgr2=0x7fcaa00c9c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:18.203 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.185+0000 7fcaa56c9700 1 --2- 172.21.15.157:0/2695407764 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcaa01603d0 0x7fcaa00c9c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:18.203 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.185+0000 7fcaa56c9700 1 -- 172.21.15.157:0/2695407764 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca98009b30 con 0x7fcaa00b5750 2023-10-16T19:58:18.203 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.185+0000 7fcaa4ec8700 1 --2- 172.21.15.157:0/2695407764 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcaa01603d0 0x7fcaa00c9c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T19:58:18.204 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.185+0000 7fcaa56c9700 1 --2- 172.21.15.157:0/2695407764 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcaa00b5750 0x7fcaa0153b10 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fca9000c7f0 tx=0x7fca9000cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:58:18.204 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.185+0000 7fca95ffb700 1 -- 172.21.15.157:0/2695407764 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca90011800 con 0x7fcaa00b5750 2023-10-16T19:58:18.204 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.185+0000 7fca95ffb700 1 -- 172.21.15.157:0/2695407764 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca90011960 con 0x7fcaa00b5750 2023-10-16T19:58:18.205 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.185+0000 7fcaa792d700 1 -- 172.21.15.157:0/2695407764 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcaa015e2e0 con 0x7fcaa00b5750 2023-10-16T19:58:18.205 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.185+0000 7fca95ffb700 1 -- 172.21.15.157:0/2695407764 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca90011d10 con 0x7fcaa00b5750 2023-10-16T19:58:18.205 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.185+0000 7fcaa792d700 1 -- 172.21.15.157:0/2695407764 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcaa015e8a0 con 0x7fcaa00b5750 2023-10-16T19:58:18.205 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.186+0000 7fcaa792d700 1 -- 172.21.15.157:0/2695407764 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fcaa006b220 con 0x7fcaa00b5750 2023-10-16T19:58:18.206 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.187+0000 7fca95ffb700 1 -- 172.21.15.157:0/2695407764 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fca90018360 con 0x7fcaa00b5750 2023-10-16T19:58:18.206 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.187+0000 7fca95ffb700 1 --2- 172.21.15.157:0/2695407764 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fca8406af00 0x7fca8406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:18.206 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.187+0000 7fca95ffb700 1 -- 172.21.15.157:0/2695407764 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5729+0+0 (secure 0 0 0) 0x7fca90089640 con 0x7fcaa00b5750 2023-10-16T19:58:18.207 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.187+0000 7fca95ffb700 1 --2- 172.21.15.157:0/2695407764 >> [v2:172.21.15.187:6800/3841016811,v1:172.21.15.187:6801/3841016811] conn(0x7fca84073100 0x7fca84075540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:18.207 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.187+0000 7fca95ffb700 1 -- 172.21.15.157:0/2695407764 --> [v2:172.21.15.187:6800/3841016811,v1:172.21.15.187:6801/3841016811] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fca84075c10 con 0x7fca84073100 2023-10-16T19:58:18.207 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.187+0000 7fca95ffb700 1 -- 172.21.15.157:0/2695407764 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7fca9008bd00 con 0x7fcaa00b5750 2023-10-16T19:58:18.208 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.187+0000 7fcaa4ec8700 1 --2- 172.21.15.157:0/2695407764 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fca8406af00 0x7fca8406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:18.208 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.187+0000 7fcaa5eca700 1 --2- 172.21.15.157:0/2695407764 >> [v2:172.21.15.187:6800/3841016811,v1:172.21.15.187:6801/3841016811] conn(0x7fca84073100 0x7fca84075540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:18.208 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.188+0000 7fcaa4ec8700 1 --2- 172.21.15.157:0/2695407764 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fca8406af00 0x7fca8406d3c0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fca9c006fd0 tx=0x7fca9c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:58:18.209 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.188+0000 7fcaa5eca700 1 --2- 172.21.15.157:0/2695407764 >> [v2:172.21.15.187:6800/3841016811,v1:172.21.15.187:6801/3841016811] conn(0x7fca84073100 0x7fca84075540 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:58:18.209 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.188+0000 7fca95ffb700 1 -- 172.21.15.157:0/2695407764 <== osd.4 v2:172.21.15.187:6800/3841016811 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23595 (crc 0 0 0) 0x7fca84075c10 con 0x7fca84073100 2023-10-16T19:58:18.210 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.201+0000 7fcaa792d700 1 -- 172.21.15.157:0/2695407764 --> [v2:172.21.15.187:6800/3841016811,v1:172.21.15.187:6801/3841016811] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fcaa006af40 con 0x7fca84073100 2023-10-16T19:58:18.210 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.202+0000 7fca95ffb700 1 -- 172.21.15.157:0/2695407764 <== osd.4 v2:172.21.15.187:6800/3841016811 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+757 (crc 0 0 0) 0x7fca98009300 con 0x7fca84073100 2023-10-16T19:58:18.211 INFO:teuthology.orchestra.run.smithi157.stdout:{ 2023-10-16T19:58:18.211 INFO:teuthology.orchestra.run.smithi157.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) osd_delete_sleep = '0.000000' osd_delete_sleep_hdd = '0.000000' osd_delete_sleep_hybrid = '0.000000' osd_delete_sleep_ssd = '0.000000' osd_max_backfills = '1' osd_pg_delete_cost = '15728640' (not observed, change may require restart) osd_recovery_max_active = '0' osd_recovery_max_active_hdd = '3' osd_recovery_max_active_ssd = '10' osd_recovery_sleep = '0.000000' osd_recovery_sleep_hdd = '0.000000' osd_recovery_sleep_hybrid = '0.000000' osd_recovery_sleep_ssd = '0.000000' osd_scrub_sleep = '0.000000' osd_snap_trim_sleep = '0.000000' osd_snap_trim_sleep_hdd = '0.000000' osd_snap_trim_sleep_hybrid = '0.000000' osd_snap_trim_sleep_ssd = '0.000000' " 2023-10-16T19:58:18.211 INFO:teuthology.orchestra.run.smithi157.stdout:} 2023-10-16T19:58:18.213 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.202+0000 7fcaa792d700 1 -- 172.21.15.157:0/2695407764 >> [v2:172.21.15.187:6800/3841016811,v1:172.21.15.187:6801/3841016811] conn(0x7fca84073100 msgr2=0x7fca84075540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:18.213 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.202+0000 7fcaa792d700 1 --2- 172.21.15.157:0/2695407764 >> [v2:172.21.15.187:6800/3841016811,v1:172.21.15.187:6801/3841016811] conn(0x7fca84073100 0x7fca84075540 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:18.213 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.202+0000 7fcaa792d700 1 -- 172.21.15.157:0/2695407764 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fca8406af00 msgr2=0x7fca8406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:18.214 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.202+0000 7fcaa792d700 1 --2- 172.21.15.157:0/2695407764 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fca8406af00 0x7fca8406d3c0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fca9c006fd0 tx=0x7fca9c008040 comp rx=0 tx=0).stop 2023-10-16T19:58:18.214 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.202+0000 7fcaa792d700 1 -- 172.21.15.157:0/2695407764 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcaa00b5750 msgr2=0x7fcaa0153b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:18.214 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.202+0000 7fcaa792d700 1 --2- 172.21.15.157:0/2695407764 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcaa00b5750 0x7fcaa0153b10 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fca9000c7f0 tx=0x7fca9000cbb0 comp rx=0 tx=0).stop 2023-10-16T19:58:18.215 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.202+0000 7fcaa5eca700 1 -- 172.21.15.157:0/2695407764 reap_dead start 2023-10-16T19:58:18.215 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.202+0000 7fcaa792d700 1 -- 172.21.15.157:0/2695407764 shutdown_connections 2023-10-16T19:58:18.215 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.203+0000 7fcaa792d700 1 -- 172.21.15.157:0/2695407764 >> 172.21.15.157:0/2695407764 conn(0x7fcaa006c7e0 msgr2=0x7fcaa00720e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:58:18.215 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.203+0000 7fcaa792d700 1 -- 172.21.15.157:0/2695407764 shutdown_connections 2023-10-16T19:58:18.216 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.203+0000 7fcaa792d700 1 -- 172.21.15.157:0/2695407764 wait complete. 2023-10-16T19:58:18.217 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2023-10-16T19:58:18.338 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.336+0000 7f6b2a3c2700 1 Processor -- start 2023-10-16T19:58:18.339 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.336+0000 7f6b2a3c2700 1 -- start start 2023-10-16T19:58:18.341 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.337+0000 7f6b2a3c2700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f6b2406de00 0x7f6b2406d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:18.341 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.337+0000 7f6b2a3c2700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b240d08b0 con 0x7f6b2415e2f0 2023-10-16T19:58:18.342 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.337+0000 7f6b2a3c2700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b241628f0 con 0x7f6b2406af60 2023-10-16T19:58:18.342 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.337+0000 7f6b2a3c2700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b24162bd0 con 0x7f6b2406de00 2023-10-16T19:58:18.342 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.337+0000 7f6b23fff700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f6b2415e2f0 0x7f6b2406a850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:57656/0 (socket says 172.21.15.157:57656) 2023-10-16T19:58:18.342 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.337+0000 7f6b2895f700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f6b2406de00 0x7f6b2406d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:18.343 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.337+0000 7f6b23fff700 1 -- 172.21.15.157:0/2821491983 learned_addr learned my addr 172.21.15.157:0/2821491983 (peer_addr_for_me v1:172.21.15.157:0/0) 2023-10-16T19:58:18.343 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.337+0000 7f6b2895f700 1 -- 172.21.15.157:0/2821491983 >> v1:172.21.15.187:6789/0 conn(0x7f6b2406af60 legacy=0x7f6b24070f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:18.343 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.337+0000 7f6b2895f700 1 -- 172.21.15.157:0/2821491983 >> v1:172.21.15.157:6789/0 conn(0x7f6b2415e2f0 legacy=0x7f6b2406a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:18.344 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.337+0000 7f6b2895f700 1 -- 172.21.15.157:0/2821491983 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b240d05d0 con 0x7f6b2406de00 2023-10-16T19:58:18.344 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.337+0000 7f6b22ffd700 1 -- 172.21.15.157:0/2821491983 <== mon.0 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1026843275 0 0) 0x7f6b240d08b0 con 0x7f6b2415e2f0 2023-10-16T19:58:18.344 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.337+0000 7f6b2895f700 1 --2- 172.21.15.157:0/2821491983 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6b2406de00 0x7f6b2406d0f0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f6b1c009d90 tx=0x7f6b1c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f7c8d901673a849 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:58:18.345 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.338+0000 7f6b22ffd700 1 -- 172.21.15.157:0/2821491983 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b1c00e070 con 0x7f6b2406de00 2023-10-16T19:58:18.345 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.338+0000 7f6b22ffd700 1 -- 172.21.15.157:0/2821491983 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b1c00bbd0 con 0x7f6b2406de00 2023-10-16T19:58:18.345 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.338+0000 7f6b22ffd700 1 -- 172.21.15.157:0/2821491983 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b1c012430 con 0x7f6b2406de00 2023-10-16T19:58:18.345 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.338+0000 7f6b2a3c2700 1 -- 172.21.15.157:0/2821491983 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6b2406de00 msgr2=0x7f6b2406d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:18.346 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.338+0000 7f6b2a3c2700 1 --2- 172.21.15.157:0/2821491983 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6b2406de00 0x7f6b2406d0f0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f6b1c009d90 tx=0x7f6b1c00b330 comp rx=0 tx=0).stop 2023-10-16T19:58:18.346 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.338+0000 7f6b2a3c2700 1 -- 172.21.15.157:0/2821491983 shutdown_connections 2023-10-16T19:58:18.346 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.338+0000 7f6b2a3c2700 1 --2- 172.21.15.157:0/2821491983 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6b2406de00 0x7f6b2406d0f0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:18.347 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.338+0000 7f6b2a3c2700 1 -- 172.21.15.157:0/2821491983 >> 172.21.15.157:0/2821491983 conn(0x7f6b240cd4e0 msgr2=0x7f6b240cd8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:58:18.347 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.338+0000 7f6b2a3c2700 1 -- 172.21.15.157:0/2821491983 shutdown_connections 2023-10-16T19:58:18.347 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.338+0000 7f6b2a3c2700 1 -- 172.21.15.157:0/2821491983 wait complete. 2023-10-16T19:58:18.350 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.339+0000 7f6b2a3c2700 1 Processor -- start 2023-10-16T19:58:18.351 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.340+0000 7f6b2a3c2700 1 -- start start 2023-10-16T19:58:18.351 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.340+0000 7f6b2a3c2700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6b2406af60 0x7f6b241f7b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:18.351 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.340+0000 7f6b2a3c2700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6b2406de00 0x7f6b240b4130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:18.351 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.340+0000 7f6b2a3c2700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6b2415e2f0 0x7f6b240b4670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:18.352 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.340+0000 7f6b2a3c2700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b240b6860 con 0x7f6b2415e2f0 2023-10-16T19:58:18.352 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.340+0000 7f6b2a3c2700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b240b6040 con 0x7f6b2406af60 2023-10-16T19:58:18.352 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.340+0000 7f6b2a3c2700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b240b3bb0 con 0x7f6b2406de00 2023-10-16T19:58:18.353 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.340+0000 7f6b2895f700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6b2415e2f0 0x7f6b240b4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:18.353 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.340+0000 7f6b2895f700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6b2415e2f0 0x7f6b240b4670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:47994/0 (socket says 172.21.15.157:47994) 2023-10-16T19:58:18.353 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.340+0000 7f6b2895f700 1 -- 172.21.15.157:0/2951088297 learned_addr learned my addr 172.21.15.157:0/2951088297 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:58:18.354 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.341+0000 7f6b23fff700 1 --2- 172.21.15.157:0/2951088297 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6b2406af60 0x7f6b241f7b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:18.354 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.341+0000 7f6b2895f700 1 -- 172.21.15.157:0/2951088297 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6b2406de00 msgr2=0x7f6b240b4130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:18.354 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.341+0000 7f6b237fe700 1 --2- 172.21.15.157:0/2951088297 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6b2406de00 0x7f6b240b4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:18.354 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.341+0000 7f6b2895f700 1 --2- 172.21.15.157:0/2951088297 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6b2406de00 0x7f6b240b4130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:18.355 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.341+0000 7f6b2895f700 1 -- 172.21.15.157:0/2951088297 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6b2406af60 msgr2=0x7f6b241f7b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:18.355 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.341+0000 7f6b2895f700 1 --2- 172.21.15.157:0/2951088297 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6b2406af60 0x7f6b241f7b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:18.355 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.341+0000 7f6b2895f700 1 -- 172.21.15.157:0/2951088297 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b1c009a70 con 0x7f6b2415e2f0 2023-10-16T19:58:18.356 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.341+0000 7f6b23fff700 1 --2- 172.21.15.157:0/2951088297 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6b2406af60 0x7f6b241f7b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T19:58:18.356 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.341+0000 7f6b2895f700 1 --2- 172.21.15.157:0/2951088297 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6b2415e2f0 0x7f6b240b4670 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f6b1c014040 tx=0x7f6b1c004b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:58:18.356 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.341+0000 7f6b20ff9700 1 -- 172.21.15.157:0/2951088297 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b1c012430 con 0x7f6b2415e2f0 2023-10-16T19:58:18.356 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.341+0000 7f6b20ff9700 1 -- 172.21.15.157:0/2951088297 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b1c020070 con 0x7f6b2415e2f0 2023-10-16T19:58:18.357 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.341+0000 7f6b2a3c2700 1 -- 172.21.15.157:0/2951088297 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b240b62a0 con 0x7f6b2415e2f0 2023-10-16T19:58:18.357 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.341+0000 7f6b20ff9700 1 -- 172.21.15.157:0/2951088297 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b1c004280 con 0x7f6b2415e2f0 2023-10-16T19:58:18.357 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.341+0000 7f6b2a3c2700 1 -- 172.21.15.157:0/2951088297 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b240cd140 con 0x7f6b2415e2f0 2023-10-16T19:58:18.358 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.342+0000 7f6b2a3c2700 1 -- 172.21.15.157:0/2951088297 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b2404f400 con 0x7f6b2415e2f0 2023-10-16T19:58:18.358 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.342+0000 7f6b20ff9700 1 -- 172.21.15.157:0/2951088297 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f6b1c0043e0 con 0x7f6b2415e2f0 2023-10-16T19:58:18.358 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.343+0000 7f6b20ff9700 1 --2- 172.21.15.157:0/2951088297 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f6b1006af00 0x7f6b1006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:18.359 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.343+0000 7f6b20ff9700 1 -- 172.21.15.157:0/2951088297 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5729+0+0 (secure 0 0 0) 0x7f6b1c022070 con 0x7f6b2415e2f0 2023-10-16T19:58:18.359 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.343+0000 7f6b23fff700 1 --2- 172.21.15.157:0/2951088297 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f6b1006af00 0x7f6b1006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:18.359 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.344+0000 7f6b23fff700 1 --2- 172.21.15.157:0/2951088297 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f6b1006af00 0x7f6b1006d3c0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f6b18000f60 tx=0x7f6b18009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:58:18.360 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.347+0000 7f6b20ff9700 1 -- 172.21.15.157:0/2951088297 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6b1c0565b0 con 0x7f6b2415e2f0 2023-10-16T19:58:18.536 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.534+0000 7f6b2a3c2700 1 -- 172.21.15.157:0/2951088297 --> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f6b240b02a0 con 0x7f6b1006af00 2023-10-16T19:58:18.551 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.535+0000 7f6b20ff9700 1 -- 172.21.15.157:0/2951088297 <== mgr.4100 v2:172.21.15.187:6832/2426285296 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f6b18001c90 con 0x7f6b1006af00 2023-10-16T19:58:18.552 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.537+0000 7f6b2a3c2700 1 -- 172.21.15.157:0/2951088297 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f6b1006af00 msgr2=0x7f6b1006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:18.552 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.537+0000 7f6b2a3c2700 1 --2- 172.21.15.157:0/2951088297 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f6b1006af00 0x7f6b1006d3c0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f6b18000f60 tx=0x7f6b18009040 comp rx=0 tx=0).stop 2023-10-16T19:58:18.552 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.537+0000 7f6b2a3c2700 1 -- 172.21.15.157:0/2951088297 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6b2415e2f0 msgr2=0x7f6b240b4670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:18.553 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.537+0000 7f6b2a3c2700 1 --2- 172.21.15.157:0/2951088297 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6b2415e2f0 0x7f6b240b4670 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f6b1c014040 tx=0x7f6b1c004b20 comp rx=0 tx=0).stop 2023-10-16T19:58:18.553 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.537+0000 7f6b2a3c2700 1 -- 172.21.15.157:0/2951088297 shutdown_connections 2023-10-16T19:58:18.553 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.537+0000 7f6b2a3c2700 1 --2- 172.21.15.157:0/2951088297 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f6b1006af00 0x7f6b1006d3c0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:18.553 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.537+0000 7f6b2a3c2700 1 --2- 172.21.15.157:0/2951088297 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6b2406af60 0x7f6b241f7b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:18.554 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.537+0000 7f6b2a3c2700 1 --2- 172.21.15.157:0/2951088297 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6b2415e2f0 0x7f6b240b4670 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:18.554 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.537+0000 7f6b2a3c2700 1 --2- 172.21.15.157:0/2951088297 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6b2406de00 0x7f6b240b4130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:18.554 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.537+0000 7f6b2a3c2700 1 -- 172.21.15.157:0/2951088297 >> 172.21.15.157:0/2951088297 conn(0x7f6b240cd4e0 msgr2=0x7f6b240b1b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:58:18.555 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.537+0000 7f6b2a3c2700 1 -- 172.21.15.157:0/2951088297 shutdown_connections 2023-10-16T19:58:18.555 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.537+0000 7f6b2a3c2700 1 -- 172.21.15.157:0/2951088297 wait complete. 2023-10-16T19:58:18.555 INFO:teuthology.orchestra.run.smithi157.stderr:instructed osd(s) 4 to deep-scrub 2023-10-16T19:58:18.556 INFO:tasks.ceph:Scrubbing osd.5 2023-10-16T19:58:18.556 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2023-10-16T19:58:18.681 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.679+0000 7f7998069700 1 Processor -- start 2023-10-16T19:58:18.682 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.679+0000 7f7998069700 1 -- start start 2023-10-16T19:58:18.684 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.680+0000 7f7998069700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f799015e090 0x7f799006b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:18.684 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.680+0000 7f7998069700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f799006ea10 0x7f79900afa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:18.685 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.680+0000 7f7998069700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f799006b6a0 con 0x7f79900affc0 2023-10-16T19:58:18.685 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.680+0000 7f7998069700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79900b0450 con 0x7f799015e090 2023-10-16T19:58:18.685 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.680+0000 7f7998069700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7990071b50 con 0x7f799006ea10 2023-10-16T19:58:18.686 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.680+0000 7f7996606700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f79900affc0 0x7f799015e470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:57674/0 (socket says 172.21.15.157:57674) 2023-10-16T19:58:18.686 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.680+0000 7f7996606700 1 -- 172.21.15.157:0/1778544499 learned_addr learned my addr 172.21.15.157:0/1778544499 (peer_addr_for_me v1:172.21.15.157:0/0) 2023-10-16T19:58:18.686 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.680+0000 7f7995e05700 1 --2- 172.21.15.157:0/1778544499 >> v2:172.21.15.187:3300/0 conn(0x7f799015e090 0x7f799006b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:18.687 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.680+0000 7f7995604700 1 --2- 172.21.15.157:0/1778544499 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f799006ea10 0x7f79900afa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:18.687 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.680+0000 7f7994e03700 1 -- 172.21.15.157:0/1778544499 <== mon.0 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2713544986 0 0) 0x7f799006b6a0 con 0x7f79900affc0 2023-10-16T19:58:18.687 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.680+0000 7f7994e03700 1 -- 172.21.15.157:0/1778544499 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f797c0035b0 con 0x7f79900affc0 2023-10-16T19:58:18.687 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.680+0000 7f7995e05700 1 -- 172.21.15.157:0/1778544499 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f799006ea10 msgr2=0x7f79900afa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:58:18.688 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.680+0000 7f7995e05700 1 --2- 172.21.15.157:0/1778544499 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f799006ea10 0x7f79900afa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:18.688 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.680+0000 7f7995e05700 1 -- 172.21.15.157:0/1778544499 >> v1:172.21.15.157:6789/0 conn(0x7f79900affc0 legacy=0x7f799015e470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:18.688 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.680+0000 7f7995e05700 1 -- 172.21.15.157:0/1778544499 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7990072320 con 0x7f799015e090 2023-10-16T19:58:18.688 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.681+0000 7f7995e05700 1 --2- 172.21.15.157:0/1778544499 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f799015e090 0x7f799006b160 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f798c009840 tx=0x7f798c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=85c8aa005b0178c5 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:58:18.689 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.681+0000 7f7994e03700 1 -- 172.21.15.157:0/1778544499 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f798c011830 con 0x7f799015e090 2023-10-16T19:58:18.689 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.681+0000 7f7994e03700 1 -- 172.21.15.157:0/1778544499 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f798c011990 con 0x7f799015e090 2023-10-16T19:58:18.689 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.681+0000 7f7994e03700 1 -- 172.21.15.157:0/1778544499 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f798c011d00 con 0x7f799015e090 2023-10-16T19:58:18.690 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.681+0000 7f7998069700 1 -- 172.21.15.157:0/1778544499 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f799015e090 msgr2=0x7f799006b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:18.690 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.681+0000 7f7998069700 1 --2- 172.21.15.157:0/1778544499 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f799015e090 0x7f799006b160 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f798c009840 tx=0x7f798c009b50 comp rx=0 tx=0).stop 2023-10-16T19:58:18.690 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.681+0000 7f7998069700 1 -- 172.21.15.157:0/1778544499 shutdown_connections 2023-10-16T19:58:18.690 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.681+0000 7f7998069700 1 --2- 172.21.15.157:0/1778544499 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f799015e090 0x7f799006b160 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:18.691 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.681+0000 7f7998069700 1 --2- 172.21.15.157:0/1778544499 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f799006ea10 0x7f79900afa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:18.691 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.681+0000 7f7998069700 1 -- 172.21.15.157:0/1778544499 >> 172.21.15.157:0/1778544499 conn(0x7f79900d0b30 msgr2=0x7f79900d0f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:58:18.691 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.681+0000 7f7998069700 1 -- 172.21.15.157:0/1778544499 shutdown_connections 2023-10-16T19:58:18.692 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.682+0000 7f7998069700 1 -- 172.21.15.157:0/1778544499 wait complete. 2023-10-16T19:58:18.695 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.683+0000 7f7998069700 1 Processor -- start 2023-10-16T19:58:18.695 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.683+0000 7f7998069700 1 -- start start 2023-10-16T19:58:18.695 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.683+0000 7f7998069700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f799006ea10 0x7f7990159c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:18.696 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.683+0000 7f7998069700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f79900affc0 0x7f79900b18a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:18.696 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.683+0000 7f7998069700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f799015e090 0x7f79901480a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:18.696 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.683+0000 7f7998069700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79900b1410 con 0x7f799015e090 2023-10-16T19:58:18.697 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.683+0000 7f7998069700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79900b0800 con 0x7f799006ea10 2023-10-16T19:58:18.697 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.683+0000 7f7998069700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79900b0ae0 con 0x7f79900affc0 2023-10-16T19:58:18.697 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.683+0000 7f7996606700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f799015e090 0x7f79901480a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:18.697 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.684+0000 7f7996606700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f799015e090 0x7f79901480a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:48008/0 (socket says 172.21.15.157:48008) 2023-10-16T19:58:18.698 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.684+0000 7f7996606700 1 -- 172.21.15.157:0/3493149400 learned_addr learned my addr 172.21.15.157:0/3493149400 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:58:18.698 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.684+0000 7f7995e05700 1 --2- 172.21.15.157:0/3493149400 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f799006ea10 0x7f7990159c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:18.698 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.684+0000 7f7995604700 1 --2- 172.21.15.157:0/3493149400 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f79900affc0 0x7f79900b18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:18.699 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.684+0000 7f7996606700 1 -- 172.21.15.157:0/3493149400 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f79900affc0 msgr2=0x7f79900b18a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:18.699 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.684+0000 7f7996606700 1 --2- 172.21.15.157:0/3493149400 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f79900affc0 0x7f79900b18a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:18.699 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.684+0000 7f7996606700 1 -- 172.21.15.157:0/3493149400 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f799006ea10 msgr2=0x7f7990159c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:18.699 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.684+0000 7f7996606700 1 --2- 172.21.15.157:0/3493149400 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f799006ea10 0x7f7990159c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:18.700 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.684+0000 7f7996606700 1 -- 172.21.15.157:0/3493149400 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f798c0094a0 con 0x7f799015e090 2023-10-16T19:58:18.700 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.684+0000 7f7995604700 1 --2- 172.21.15.157:0/3493149400 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f79900affc0 0x7f79900b18a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T19:58:18.701 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.684+0000 7f7996606700 1 --2- 172.21.15.157:0/3493149400 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f799015e090 0x7f79901480a0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f798800cb40 tx=0x7f798800ce50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:58:18.701 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.684+0000 7f79867fc700 1 -- 172.21.15.157:0/3493149400 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f798800aaa0 con 0x7f799015e090 2023-10-16T19:58:18.701 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.684+0000 7f79867fc700 1 -- 172.21.15.157:0/3493149400 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f798800ac00 con 0x7f799015e090 2023-10-16T19:58:18.702 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.684+0000 7f7998069700 1 -- 172.21.15.157:0/3493149400 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79900b0dc0 con 0x7f799015e090 2023-10-16T19:58:18.702 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.684+0000 7f79867fc700 1 -- 172.21.15.157:0/3493149400 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7988012400 con 0x7f799015e090 2023-10-16T19:58:18.702 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.684+0000 7f7998069700 1 -- 172.21.15.157:0/3493149400 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7990147ca0 con 0x7f799015e090 2023-10-16T19:58:18.702 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.685+0000 7f7998069700 1 -- 172.21.15.157:0/3493149400 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7990072040 con 0x7f799015e090 2023-10-16T19:58:18.703 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.686+0000 7f79867fc700 1 -- 172.21.15.157:0/3493149400 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f798801b3b0 con 0x7f799015e090 2023-10-16T19:58:18.703 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.686+0000 7f79867fc700 1 --2- 172.21.15.157:0/3493149400 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f797406af00 0x7f797406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:18.703 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.686+0000 7f79867fc700 1 -- 172.21.15.157:0/3493149400 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5729+0+0 (secure 0 0 0) 0x7f79880899c0 con 0x7f799015e090 2023-10-16T19:58:18.704 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.686+0000 7f7995e05700 1 --2- 172.21.15.157:0/3493149400 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f797406af00 0x7f797406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:18.704 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.686+0000 7f79867fc700 1 --2- 172.21.15.157:0/3493149400 >> [v2:172.21.15.187:6802/915130263,v1:172.21.15.187:6805/915130263] conn(0x7f7974073100 0x7f7974075540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:18.704 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.686+0000 7f79867fc700 1 -- 172.21.15.157:0/3493149400 --> [v2:172.21.15.187:6802/915130263,v1:172.21.15.187:6805/915130263] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7974075c10 con 0x7f7974073100 2023-10-16T19:58:18.704 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.686+0000 7f79867fc700 1 -- 172.21.15.157:0/3493149400 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7988089e10 con 0x7f799015e090 2023-10-16T19:58:18.705 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.686+0000 7f7995604700 1 --2- 172.21.15.157:0/3493149400 >> [v2:172.21.15.187:6802/915130263,v1:172.21.15.187:6805/915130263] conn(0x7f7974073100 0x7f7974075540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:18.705 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.687+0000 7f7995e05700 1 --2- 172.21.15.157:0/3493149400 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f797406af00 0x7f797406d3c0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f798c000c00 tx=0x7f798c01c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:58:18.705 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.687+0000 7f7995604700 1 --2- 172.21.15.157:0/3493149400 >> [v2:172.21.15.187:6802/915130263,v1:172.21.15.187:6805/915130263] conn(0x7f7974073100 0x7f7974075540 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:58:18.706 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.688+0000 7f79867fc700 1 -- 172.21.15.157:0/3493149400 <== osd.5 v2:172.21.15.187:6802/915130263 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23595 (crc 0 0 0) 0x7f7974075c10 con 0x7f7974073100 2023-10-16T19:58:18.706 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.700+0000 7f7998069700 1 -- 172.21.15.157:0/3493149400 --> [v2:172.21.15.187:6802/915130263,v1:172.21.15.187:6805/915130263] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f7990071d60 con 0x7f7974073100 2023-10-16T19:58:18.707 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.701+0000 7f79867fc700 1 -- 172.21.15.157:0/3493149400 <== osd.5 v2:172.21.15.187:6802/915130263 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+757 (crc 0 0 0) 0x7f7980009960 con 0x7f7974073100 2023-10-16T19:58:18.707 INFO:teuthology.orchestra.run.smithi157.stdout:{ 2023-10-16T19:58:18.708 INFO:teuthology.orchestra.run.smithi157.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) osd_delete_sleep = '0.000000' osd_delete_sleep_hdd = '0.000000' osd_delete_sleep_hybrid = '0.000000' osd_delete_sleep_ssd = '0.000000' osd_max_backfills = '1' osd_pg_delete_cost = '15728640' (not observed, change may require restart) osd_recovery_max_active = '0' osd_recovery_max_active_hdd = '3' osd_recovery_max_active_ssd = '10' osd_recovery_sleep = '0.000000' osd_recovery_sleep_hdd = '0.000000' osd_recovery_sleep_hybrid = '0.000000' osd_recovery_sleep_ssd = '0.000000' osd_scrub_sleep = '0.000000' osd_snap_trim_sleep = '0.000000' osd_snap_trim_sleep_hdd = '0.000000' osd_snap_trim_sleep_hybrid = '0.000000' osd_snap_trim_sleep_ssd = '0.000000' " 2023-10-16T19:58:18.708 INFO:teuthology.orchestra.run.smithi157.stdout:} 2023-10-16T19:58:18.709 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.701+0000 7f7998069700 1 -- 172.21.15.157:0/3493149400 >> [v2:172.21.15.187:6802/915130263,v1:172.21.15.187:6805/915130263] conn(0x7f7974073100 msgr2=0x7f7974075540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:18.710 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.701+0000 7f7998069700 1 --2- 172.21.15.157:0/3493149400 >> [v2:172.21.15.187:6802/915130263,v1:172.21.15.187:6805/915130263] conn(0x7f7974073100 0x7f7974075540 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:18.710 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.701+0000 7f7998069700 1 -- 172.21.15.157:0/3493149400 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f797406af00 msgr2=0x7f797406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:18.710 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.701+0000 7f7998069700 1 --2- 172.21.15.157:0/3493149400 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f797406af00 0x7f797406d3c0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f798c000c00 tx=0x7f798c01c040 comp rx=0 tx=0).stop 2023-10-16T19:58:18.710 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.701+0000 7f7998069700 1 -- 172.21.15.157:0/3493149400 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f799015e090 msgr2=0x7f79901480a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:18.711 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.701+0000 7f7998069700 1 --2- 172.21.15.157:0/3493149400 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f799015e090 0x7f79901480a0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f798800cb40 tx=0x7f798800ce50 comp rx=0 tx=0).stop 2023-10-16T19:58:18.711 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.701+0000 7f7996606700 1 -- 172.21.15.157:0/3493149400 reap_dead start 2023-10-16T19:58:18.711 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.701+0000 7f7998069700 1 -- 172.21.15.157:0/3493149400 shutdown_connections 2023-10-16T19:58:18.711 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.701+0000 7f7998069700 1 -- 172.21.15.157:0/3493149400 >> 172.21.15.157:0/3493149400 conn(0x7f79900d0b30 msgr2=0x7f7990160340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:58:18.712 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.701+0000 7f7998069700 1 -- 172.21.15.157:0/3493149400 shutdown_connections 2023-10-16T19:58:18.712 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.701+0000 7f7998069700 1 -- 172.21.15.157:0/3493149400 wait complete. 2023-10-16T19:58:18.715 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2023-10-16T19:58:18.836 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.834+0000 7fd85b23c700 1 Processor -- start 2023-10-16T19:58:18.837 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.834+0000 7fd85b23c700 1 -- start start 2023-10-16T19:58:18.845 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.835+0000 7fd85b23c700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd85415de00 0x7fd854161a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:18.846 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.835+0000 7fd85b23c700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8540ce870 con 0x7fd854161f50 2023-10-16T19:58:18.846 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.835+0000 7fd85b23c700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd854162990 con 0x7fd8540ced00 2023-10-16T19:58:18.847 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.835+0000 7fd85b23c700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8541623d0 con 0x7fd85415de00 2023-10-16T19:58:18.847 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.835+0000 7fd853fff700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7fd854161f50 0x7fd8540d2200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:57688/0 (socket says 172.21.15.157:57688) 2023-10-16T19:58:18.847 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.835+0000 7fd853fff700 1 -- 172.21.15.157:0/3635661949 learned_addr learned my addr 172.21.15.157:0/3635661949 (peer_addr_for_me v1:172.21.15.157:0/0) 2023-10-16T19:58:18.848 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.835+0000 7fd858fd8700 1 --2- 172.21.15.157:0/3635661949 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd85415de00 0x7fd854161a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:18.848 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.835+0000 7fd8537fe700 1 -- 172.21.15.157:0/3635661949 <== mon.0 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2906063365 0 0) 0x7fd8540ce870 con 0x7fd854161f50 2023-10-16T19:58:18.848 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.835+0000 7fd8537fe700 1 -- 172.21.15.157:0/3635661949 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd8440035b0 con 0x7fd854161f50 2023-10-16T19:58:18.848 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.835+0000 7fd8537fe700 1 -- 172.21.15.157:0/3635661949 <== mon.0 v1:172.21.15.157:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1893380814 0 0) 0x7fd8440035b0 con 0x7fd854161f50 2023-10-16T19:58:18.849 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.835+0000 7fd8537fe700 1 -- 172.21.15.157:0/3635661949 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd85415de00 msgr2=0x7fd854161a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:58:18.849 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.835+0000 7fd8537fe700 1 --2- 172.21.15.157:0/3635661949 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd85415de00 0x7fd854161a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:18.849 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.835+0000 7fd8537fe700 1 -- 172.21.15.157:0/3635661949 >> v1:172.21.15.187:6789/0 conn(0x7fd8540ced00 legacy=0x7fd8540d05b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:18.850 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.835+0000 7fd8537fe700 1 -- 172.21.15.157:0/3635661949 --> v1:172.21.15.157:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8541626b0 con 0x7fd854161f50 2023-10-16T19:58:18.850 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.835+0000 7fd8537fe700 1 -- 172.21.15.157:0/3635661949 <== mon.0 v1:172.21.15.157:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4021145519 0 0) 0x7fd840001670 con 0x7fd854161f50 2023-10-16T19:58:18.851 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.835+0000 7fd8537fe700 1 -- 172.21.15.157:0/3635661949 >> v1:172.21.15.157:6789/0 conn(0x7fd854161f50 legacy=0x7fd8540d2200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:18.851 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.835+0000 7fd8537fe700 1 --2- 172.21.15.157:0/3635661949 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd844003a30 0x7fd844003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:18.851 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.835+0000 7fd8537fe700 1 --2- 172.21.15.157:0/3635661949 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd8440043e0 0x7fd8440048b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:18.852 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.835+0000 7fd8537fe700 1 --2- 172.21.15.157:0/3635661949 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd85415de00 0x7fd844005110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:18.852 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.835+0000 7fd8537fe700 1 -- 172.21.15.157:0/3635661949 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8541623d0 con 0x7fd844003a30 2023-10-16T19:58:18.853 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.835+0000 7fd8537fe700 1 -- 172.21.15.157:0/3635661949 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd84400ba10 con 0x7fd8440043e0 2023-10-16T19:58:18.853 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.835+0000 7fd8537fe700 1 -- 172.21.15.157:0/3635661949 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd84400bbd0 con 0x7fd85415de00 2023-10-16T19:58:18.854 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.836+0000 7fd858fd8700 1 --2- 172.21.15.157:0/3635661949 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd844003a30 0x7fd844003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:18.854 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.836+0000 7fd853fff700 1 --2- 172.21.15.157:0/3635661949 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd8440043e0 0x7fd8440048b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:18.855 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.836+0000 7fd8597d9700 1 --2- 172.21.15.157:0/3635661949 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd85415de00 0x7fd844005110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:18.855 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.836+0000 7fd858fd8700 1 -- 172.21.15.157:0/3635661949 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd85415de00 msgr2=0x7fd844005110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:58:18.856 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.836+0000 7fd858fd8700 1 --2- 172.21.15.157:0/3635661949 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd85415de00 0x7fd844005110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:18.856 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.836+0000 7fd858fd8700 1 -- 172.21.15.157:0/3635661949 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd8440043e0 msgr2=0x7fd8440048b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:58:18.857 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.836+0000 7fd858fd8700 1 --2- 172.21.15.157:0/3635661949 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd8440043e0 0x7fd8440048b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:18.857 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.836+0000 7fd858fd8700 1 -- 172.21.15.157:0/3635661949 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8440035b0 con 0x7fd844003a30 2023-10-16T19:58:18.858 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.836+0000 7fd853fff700 1 --2- 172.21.15.157:0/3635661949 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd8440043e0 0x7fd8440048b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T19:58:18.858 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.836+0000 7fd858fd8700 1 --2- 172.21.15.157:0/3635661949 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd844003a30 0x7fd844003e10 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fd848009b60 tx=0x7fd844005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff03ec5c39197ff5 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:58:18.859 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.836+0000 7fd8537fe700 1 -- 172.21.15.157:0/3635661949 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd84800e6c0 con 0x7fd844003a30 2023-10-16T19:58:18.859 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.836+0000 7fd8537fe700 1 -- 172.21.15.157:0/3635661949 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd84800e820 con 0x7fd844003a30 2023-10-16T19:58:18.859 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.836+0000 7fd8537fe700 1 -- 172.21.15.157:0/3635661949 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd84800eb90 con 0x7fd844003a30 2023-10-16T19:58:18.860 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.837+0000 7fd85b23c700 1 -- 172.21.15.157:0/3635661949 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd844003a30 msgr2=0x7fd844003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:18.860 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.837+0000 7fd85b23c700 1 --2- 172.21.15.157:0/3635661949 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd844003a30 0x7fd844003e10 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fd848009b60 tx=0x7fd844005880 comp rx=0 tx=0).stop 2023-10-16T19:58:18.860 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.837+0000 7fd8597d9700 1 -- 172.21.15.157:0/3635661949 reap_dead start 2023-10-16T19:58:18.861 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.837+0000 7fd85b23c700 1 -- 172.21.15.157:0/3635661949 shutdown_connections 2023-10-16T19:58:18.861 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.837+0000 7fd85b23c700 1 -- 172.21.15.157:0/3635661949 >> 172.21.15.157:0/3635661949 conn(0x7fd8540665a0 msgr2=0x7fd854066980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:58:18.861 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.837+0000 7fd85b23c700 1 -- 172.21.15.157:0/3635661949 shutdown_connections 2023-10-16T19:58:18.862 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.837+0000 7fd85b23c700 1 -- 172.21.15.157:0/3635661949 wait complete. 2023-10-16T19:58:18.862 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.838+0000 7fd85b23c700 1 Processor -- start 2023-10-16T19:58:18.862 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.838+0000 7fd85b23c700 1 -- start start 2023-10-16T19:58:18.863 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.839+0000 7fd85b23c700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd844003a30 0x7fd85415f880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:18.863 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.839+0000 7fd85b23c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd854157880 0x7fd854157d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:18.863 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.839+0000 7fd85b23c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd854153f20 0x7fd8541543d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:18.863 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.839+0000 7fd85b23c700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd854154910 con 0x7fd854153f20 2023-10-16T19:58:18.864 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.839+0000 7fd85b23c700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd854152e80 con 0x7fd854157880 2023-10-16T19:58:18.864 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.839+0000 7fd85b23c700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd854153160 con 0x7fd844003a30 2023-10-16T19:58:18.865 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.839+0000 7fd8597d9700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd854153f20 0x7fd8541543d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:18.865 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.839+0000 7fd8597d9700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd854153f20 0x7fd8541543d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:48030/0 (socket says 172.21.15.157:48030) 2023-10-16T19:58:18.865 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.839+0000 7fd8597d9700 1 -- 172.21.15.157:0/690469436 learned_addr learned my addr 172.21.15.157:0/690469436 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:58:18.866 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.840+0000 7fd858fd8700 1 --2- 172.21.15.157:0/690469436 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd844003a30 0x7fd85415f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:18.866 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.840+0000 7fd853fff700 1 --2- 172.21.15.157:0/690469436 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd854157880 0x7fd854157d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:18.866 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.840+0000 7fd8597d9700 1 -- 172.21.15.157:0/690469436 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd844003a30 msgr2=0x7fd85415f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:18.867 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.840+0000 7fd8597d9700 1 --2- 172.21.15.157:0/690469436 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd844003a30 0x7fd85415f880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:18.867 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.840+0000 7fd8597d9700 1 -- 172.21.15.157:0/690469436 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd854157880 msgr2=0x7fd854157d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:18.867 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.840+0000 7fd8597d9700 1 --2- 172.21.15.157:0/690469436 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd854157880 0x7fd854157d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:18.867 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.840+0000 7fd8597d9700 1 -- 172.21.15.157:0/690469436 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd854153440 con 0x7fd854153f20 2023-10-16T19:58:18.868 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.840+0000 7fd853fff700 1 --2- 172.21.15.157:0/690469436 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd854157880 0x7fd854157d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T19:58:18.868 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.840+0000 7fd8597d9700 1 --2- 172.21.15.157:0/690469436 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd854153f20 0x7fd8541543d0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fd8540d1f40 tx=0x7fd84c00ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:58:18.868 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.840+0000 7fd8517fa700 1 -- 172.21.15.157:0/690469436 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd84c003c10 con 0x7fd854153f20 2023-10-16T19:58:18.868 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.840+0000 7fd8517fa700 1 -- 172.21.15.157:0/690469436 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd84c003d70 con 0x7fd854153f20 2023-10-16T19:58:18.869 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.840+0000 7fd85b23c700 1 -- 172.21.15.157:0/690469436 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd854153720 con 0x7fd854153f20 2023-10-16T19:58:18.869 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.840+0000 7fd8517fa700 1 -- 172.21.15.157:0/690469436 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd84c005310 con 0x7fd854153f20 2023-10-16T19:58:18.869 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.840+0000 7fd85b23c700 1 -- 172.21.15.157:0/690469436 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd85415fdc0 con 0x7fd854153f20 2023-10-16T19:58:18.870 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.841+0000 7fd85b23c700 1 -- 172.21.15.157:0/690469436 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd854153c40 con 0x7fd854153f20 2023-10-16T19:58:18.870 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.841+0000 7fd8517fa700 1 -- 172.21.15.157:0/690469436 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fd84c005470 con 0x7fd854153f20 2023-10-16T19:58:18.871 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.842+0000 7fd8517fa700 1 --2- 172.21.15.157:0/690469436 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fd83806af00 0x7fd83806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:18.871 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.842+0000 7fd8517fa700 1 -- 172.21.15.157:0/690469436 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5729+0+0 (secure 0 0 0) 0x7fd84c0896d0 con 0x7fd854153f20 2023-10-16T19:58:18.872 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.842+0000 7fd858fd8700 1 --2- 172.21.15.157:0/690469436 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fd83806af00 0x7fd83806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:18.872 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.842+0000 7fd858fd8700 1 --2- 172.21.15.157:0/690469436 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fd83806af00 0x7fd83806d3c0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fd848000c00 tx=0x7fd848008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:58:18.873 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:18.846+0000 7fd8517fa700 1 -- 172.21.15.157:0/690469436 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd854153c40 con 0x7fd854153f20 2023-10-16T19:58:19.040 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.038+0000 7fd85b23c700 1 -- 172.21.15.157:0/690469436 --> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7fd85415e1e0 con 0x7fd83806af00 2023-10-16T19:58:19.041 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.038+0000 7fd8517fa700 1 -- 172.21.15.157:0/690469436 <== mgr.4100 v2:172.21.15.187:6832/2426285296 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fd84800e990 con 0x7fd83806af00 2023-10-16T19:58:19.043 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.040+0000 7fd85b23c700 1 -- 172.21.15.157:0/690469436 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fd83806af00 msgr2=0x7fd83806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:19.043 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.040+0000 7fd85b23c700 1 --2- 172.21.15.157:0/690469436 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fd83806af00 0x7fd83806d3c0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fd848000c00 tx=0x7fd848008030 comp rx=0 tx=0).stop 2023-10-16T19:58:19.044 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.040+0000 7fd85b23c700 1 -- 172.21.15.157:0/690469436 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd854153f20 msgr2=0x7fd8541543d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:19.044 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.040+0000 7fd85b23c700 1 --2- 172.21.15.157:0/690469436 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd854153f20 0x7fd8541543d0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fd8540d1f40 tx=0x7fd84c00ef20 comp rx=0 tx=0).stop 2023-10-16T19:58:19.044 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.040+0000 7fd85b23c700 1 -- 172.21.15.157:0/690469436 shutdown_connections 2023-10-16T19:58:19.044 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.040+0000 7fd85b23c700 1 --2- 172.21.15.157:0/690469436 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd854153f20 0x7fd8541543d0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:19.045 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.040+0000 7fd85b23c700 1 --2- 172.21.15.157:0/690469436 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd844003a30 0x7fd85415f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:19.045 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.040+0000 7fd85b23c700 1 --2- 172.21.15.157:0/690469436 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fd83806af00 0x7fd83806d3c0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:19.045 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.040+0000 7fd85b23c700 1 --2- 172.21.15.157:0/690469436 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd854157880 0x7fd854157d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:19.046 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.040+0000 7fd85b23c700 1 -- 172.21.15.157:0/690469436 >> 172.21.15.157:0/690469436 conn(0x7fd8540665a0 msgr2=0x7fd8541610a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:58:19.046 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.041+0000 7fd85b23c700 1 -- 172.21.15.157:0/690469436 shutdown_connections 2023-10-16T19:58:19.046 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.041+0000 7fd85b23c700 1 -- 172.21.15.157:0/690469436 wait complete. 2023-10-16T19:58:19.047 INFO:teuthology.orchestra.run.smithi157.stderr:instructed osd(s) 5 to deep-scrub 2023-10-16T19:58:19.055 INFO:tasks.ceph:Scrubbing osd.6 2023-10-16T19:58:19.055 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2023-10-16T19:58:19.180 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.177+0000 7f47e550d700 1 Processor -- start 2023-10-16T19:58:19.180 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.177+0000 7f47e550d700 1 -- start start 2023-10-16T19:58:19.183 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.178+0000 7f47e550d700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f47e015ded0 0x7f47e00d2140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:19.183 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.178+0000 7f47e550d700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f47e00cf150 0x7f47e00b6ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:19.183 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.178+0000 7f47e550d700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47e00b9d40 con 0x7f47e00b9890 2023-10-16T19:58:19.183 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.178+0000 7f47e550d700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47e00d2840 con 0x7f47e015ded0 2023-10-16T19:58:19.184 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.178+0000 7f47e550d700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47e00d2b20 con 0x7f47e00cf150 2023-10-16T19:58:19.184 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.178+0000 7f47deffd700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f47e015ded0 0x7f47e00d2140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:19.184 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.178+0000 7f47df7fe700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f47e00cf150 0x7f47e00b6ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:19.185 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.179+0000 7f47deffd700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f47e015ded0 0x7f47e00d2140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.157:43142/0 (socket says 172.21.15.157:43142) 2023-10-16T19:58:19.185 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.179+0000 7f47deffd700 1 -- 172.21.15.157:0/2031587684 learned_addr learned my addr 172.21.15.157:0/2031587684 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:58:19.185 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.179+0000 7f47deffd700 1 -- 172.21.15.157:0/2031587684 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f47e00cf150 msgr2=0x7f47e00b6ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:58:19.185 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.179+0000 7f47deffd700 1 --2- 172.21.15.157:0/2031587684 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f47e00cf150 0x7f47e00b6ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:19.186 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.179+0000 7f47deffd700 1 -- 172.21.15.157:0/2031587684 >> v1:172.21.15.187:6789/0 conn(0x7f47e00b9890 legacy=0x7f47e00cea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:19.186 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.179+0000 7f47ddffb700 1 -- 172.21.15.157:0/2031587684 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1921326918 0 0) 0x7f47e00b9d40 con 0x7f47e00b9890 2023-10-16T19:58:19.186 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.179+0000 7f47deffd700 1 -- 172.21.15.157:0/2031587684 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47e00d2e00 con 0x7f47e015ded0 2023-10-16T19:58:19.187 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.179+0000 7f47deffd700 1 --2- 172.21.15.157:0/2031587684 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f47e015ded0 0x7f47e00d2140 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f47d40098f0 tx=0x7f47d4009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=516b2b386019c1f2 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:58:19.187 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.179+0000 7f47ddffb700 1 -- 172.21.15.157:0/2031587684 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47d4011830 con 0x7f47e015ded0 2023-10-16T19:58:19.187 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.179+0000 7f47ddffb700 1 -- 172.21.15.157:0/2031587684 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47d4011990 con 0x7f47e015ded0 2023-10-16T19:58:19.187 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.179+0000 7f47ddffb700 1 -- 172.21.15.157:0/2031587684 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47d4011d20 con 0x7f47e015ded0 2023-10-16T19:58:19.188 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.180+0000 7f47e550d700 1 -- 172.21.15.157:0/2031587684 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f47e015ded0 msgr2=0x7f47e00d2140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:19.188 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.180+0000 7f47e550d700 1 --2- 172.21.15.157:0/2031587684 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f47e015ded0 0x7f47e00d2140 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f47d40098f0 tx=0x7f47d4009c00 comp rx=0 tx=0).stop 2023-10-16T19:58:19.188 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.180+0000 7f47e550d700 1 -- 172.21.15.157:0/2031587684 shutdown_connections 2023-10-16T19:58:19.189 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.180+0000 7f47e550d700 1 --2- 172.21.15.157:0/2031587684 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f47e00cf150 0x7f47e00b6ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:19.189 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.180+0000 7f47e550d700 1 --2- 172.21.15.157:0/2031587684 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f47e015ded0 0x7f47e00d2140 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:19.189 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.180+0000 7f47e550d700 1 -- 172.21.15.157:0/2031587684 >> 172.21.15.157:0/2031587684 conn(0x7f47e006aeb0 msgr2=0x7f47e006b2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:58:19.189 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.180+0000 7f47e550d700 1 -- 172.21.15.157:0/2031587684 shutdown_connections 2023-10-16T19:58:19.190 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.180+0000 7f47e550d700 1 -- 172.21.15.157:0/2031587684 wait complete. 2023-10-16T19:58:19.193 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.181+0000 7f47e550d700 1 Processor -- start 2023-10-16T19:58:19.193 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.181+0000 7f47e550d700 1 -- start start 2023-10-16T19:58:19.193 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.182+0000 7f47e550d700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f47e00b9890 0x7f47e01f4350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:19.194 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.182+0000 7f47e550d700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f47e00cf150 0x7f47e00ccc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:19.194 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.182+0000 7f47e550d700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f47e015ded0 0x7f47e00cd5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:19.194 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.182+0000 7f47e550d700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47e01f4890 con 0x7f47e00b9890 2023-10-16T19:58:19.195 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.182+0000 7f47e550d700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47e01f7350 con 0x7f47e00cf150 2023-10-16T19:58:19.195 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.182+0000 7f47e550d700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47e01f7630 con 0x7f47e015ded0 2023-10-16T19:58:19.195 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.182+0000 7f47deffd700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f47e00b9890 0x7f47e01f4350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:19.196 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.182+0000 7f47deffd700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f47e00b9890 0x7f47e01f4350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:48040/0 (socket says 172.21.15.157:48040) 2023-10-16T19:58:19.196 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.182+0000 7f47deffd700 1 -- 172.21.15.157:0/1932160930 learned_addr learned my addr 172.21.15.157:0/1932160930 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:58:19.196 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.182+0000 7f47df7fe700 1 --2- 172.21.15.157:0/1932160930 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f47e015ded0 0x7f47e00cd5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:19.196 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.182+0000 7f47de7fc700 1 --2- 172.21.15.157:0/1932160930 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f47e00cf150 0x7f47e00ccc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:19.197 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.182+0000 7f47deffd700 1 -- 172.21.15.157:0/1932160930 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f47e015ded0 msgr2=0x7f47e00cd5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:19.197 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.182+0000 7f47deffd700 1 --2- 172.21.15.157:0/1932160930 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f47e015ded0 0x7f47e00cd5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:19.197 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.182+0000 7f47deffd700 1 -- 172.21.15.157:0/1932160930 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f47e00cf150 msgr2=0x7f47e00ccc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:19.197 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.182+0000 7f47deffd700 1 --2- 172.21.15.157:0/1932160930 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f47e00cf150 0x7f47e00ccc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:19.198 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.182+0000 7f47deffd700 1 -- 172.21.15.157:0/1932160930 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47d4009550 con 0x7f47e00b9890 2023-10-16T19:58:19.198 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.183+0000 7f47df7fe700 1 --2- 172.21.15.157:0/1932160930 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f47e015ded0 0x7f47e00cd5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T19:58:19.198 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.183+0000 7f47de7fc700 1 --2- 172.21.15.157:0/1932160930 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f47e00cf150 0x7f47e00ccc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T19:58:19.199 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.183+0000 7f47deffd700 1 --2- 172.21.15.157:0/1932160930 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f47e00b9890 0x7f47e01f4350 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f47d4009c40 tx=0x7f47d4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:58:19.199 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.183+0000 7f47c77fe700 1 -- 172.21.15.157:0/1932160930 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47d40036a0 con 0x7f47e00b9890 2023-10-16T19:58:19.199 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.183+0000 7f47c77fe700 1 -- 172.21.15.157:0/1932160930 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47d401f070 con 0x7f47e00b9890 2023-10-16T19:58:19.200 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.183+0000 7f47c77fe700 1 -- 172.21.15.157:0/1932160930 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47d4003a60 con 0x7f47e00b9890 2023-10-16T19:58:19.200 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.183+0000 7f47e550d700 1 -- 172.21.15.157:0/1932160930 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47e01f7910 con 0x7f47e00b9890 2023-10-16T19:58:19.200 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.183+0000 7f47e550d700 1 -- 172.21.15.157:0/1932160930 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47e00cd1a0 con 0x7f47e00b9890 2023-10-16T19:58:19.200 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.184+0000 7f47e550d700 1 -- 172.21.15.157:0/1932160930 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f47e00d33c0 con 0x7f47e00b9890 2023-10-16T19:58:19.201 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.184+0000 7f47c77fe700 1 -- 172.21.15.157:0/1932160930 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f47d4003bc0 con 0x7f47e00b9890 2023-10-16T19:58:19.201 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.185+0000 7f47c77fe700 1 --2- 172.21.15.157:0/1932160930 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f47cc06af00 0x7f47cc06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:19.201 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.185+0000 7f47c77fe700 1 -- 172.21.15.157:0/1932160930 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5729+0+0 (secure 0 0 0) 0x7f47d4021070 con 0x7f47e00b9890 2023-10-16T19:58:19.201 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.185+0000 7f47c77fe700 1 --2- 172.21.15.157:0/1932160930 >> [v2:172.21.15.187:6816/654976824,v1:172.21.15.187:6817/654976824] conn(0x7f47cc073100 0x7f47cc075540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:19.202 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.185+0000 7f47c77fe700 1 -- 172.21.15.157:0/1932160930 --> [v2:172.21.15.187:6816/654976824,v1:172.21.15.187:6817/654976824] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f47cc075c10 con 0x7f47cc073100 2023-10-16T19:58:19.202 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.185+0000 7f47c77fe700 1 -- 172.21.15.157:0/1932160930 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f47d408b5f0 con 0x7f47e00b9890 2023-10-16T19:58:19.202 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.185+0000 7f47de7fc700 1 --2- 172.21.15.157:0/1932160930 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f47cc06af00 0x7f47cc06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:19.203 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.185+0000 7f47df7fe700 1 --2- 172.21.15.157:0/1932160930 >> [v2:172.21.15.187:6816/654976824,v1:172.21.15.187:6817/654976824] conn(0x7f47cc073100 0x7f47cc075540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:19.203 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.185+0000 7f47de7fc700 1 --2- 172.21.15.157:0/1932160930 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f47cc06af00 0x7f47cc06d3c0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f47e01e4ff0 tx=0x7f47d0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:58:19.203 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.186+0000 7f47df7fe700 1 --2- 172.21.15.157:0/1932160930 >> [v2:172.21.15.187:6816/654976824,v1:172.21.15.187:6817/654976824] conn(0x7f47cc073100 0x7f47cc075540 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:58:19.204 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.186+0000 7f47c77fe700 1 -- 172.21.15.157:0/1932160930 <== osd.6 v2:172.21.15.187:6816/654976824 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23595 (crc 0 0 0) 0x7f47cc075c10 con 0x7f47cc073100 2023-10-16T19:58:19.204 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.199+0000 7f47e550d700 1 -- 172.21.15.157:0/1932160930 --> [v2:172.21.15.187:6816/654976824,v1:172.21.15.187:6817/654976824] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f47e00d30e0 con 0x7f47cc073100 2023-10-16T19:58:19.205 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.199+0000 7f47c77fe700 1 -- 172.21.15.157:0/1932160930 <== osd.6 v2:172.21.15.187:6816/654976824 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+757 (crc 0 0 0) 0x7f47d8007450 con 0x7f47cc073100 2023-10-16T19:58:19.205 INFO:teuthology.orchestra.run.smithi157.stdout:{ 2023-10-16T19:58:19.206 INFO:teuthology.orchestra.run.smithi157.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) osd_delete_sleep = '0.000000' osd_delete_sleep_hdd = '0.000000' osd_delete_sleep_hybrid = '0.000000' osd_delete_sleep_ssd = '0.000000' osd_max_backfills = '1' osd_pg_delete_cost = '15728640' (not observed, change may require restart) osd_recovery_max_active = '0' osd_recovery_max_active_hdd = '3' osd_recovery_max_active_ssd = '10' osd_recovery_sleep = '0.000000' osd_recovery_sleep_hdd = '0.000000' osd_recovery_sleep_hybrid = '0.000000' osd_recovery_sleep_ssd = '0.000000' osd_scrub_sleep = '0.000000' osd_snap_trim_sleep = '0.000000' osd_snap_trim_sleep_hdd = '0.000000' osd_snap_trim_sleep_hybrid = '0.000000' osd_snap_trim_sleep_ssd = '0.000000' " 2023-10-16T19:58:19.206 INFO:teuthology.orchestra.run.smithi157.stdout:} 2023-10-16T19:58:19.207 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.200+0000 7f47e550d700 1 -- 172.21.15.157:0/1932160930 >> [v2:172.21.15.187:6816/654976824,v1:172.21.15.187:6817/654976824] conn(0x7f47cc073100 msgr2=0x7f47cc075540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:19.207 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.200+0000 7f47e550d700 1 --2- 172.21.15.157:0/1932160930 >> [v2:172.21.15.187:6816/654976824,v1:172.21.15.187:6817/654976824] conn(0x7f47cc073100 0x7f47cc075540 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:19.208 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.200+0000 7f47e550d700 1 -- 172.21.15.157:0/1932160930 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f47cc06af00 msgr2=0x7f47cc06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:19.208 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.200+0000 7f47e550d700 1 --2- 172.21.15.157:0/1932160930 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f47cc06af00 0x7f47cc06d3c0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f47e01e4ff0 tx=0x7f47d0009040 comp rx=0 tx=0).stop 2023-10-16T19:58:19.208 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.200+0000 7f47e550d700 1 -- 172.21.15.157:0/1932160930 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f47e00b9890 msgr2=0x7f47e01f4350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:19.208 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.200+0000 7f47e550d700 1 --2- 172.21.15.157:0/1932160930 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f47e00b9890 0x7f47e01f4350 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f47d4009c40 tx=0x7f47d4004750 comp rx=0 tx=0).stop 2023-10-16T19:58:19.209 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.200+0000 7f47df7fe700 1 -- 172.21.15.157:0/1932160930 reap_dead start 2023-10-16T19:58:19.209 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.200+0000 7f47e550d700 1 -- 172.21.15.157:0/1932160930 shutdown_connections 2023-10-16T19:58:19.209 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.200+0000 7f47e550d700 1 -- 172.21.15.157:0/1932160930 >> 172.21.15.157:0/1932160930 conn(0x7f47e006aeb0 msgr2=0x7f47e0155110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:58:19.210 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.200+0000 7f47e550d700 1 -- 172.21.15.157:0/1932160930 shutdown_connections 2023-10-16T19:58:19.210 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.200+0000 7f47e550d700 1 -- 172.21.15.157:0/1932160930 wait complete. 2023-10-16T19:58:19.214 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2023-10-16T19:58:19.337 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.334+0000 7f224592d700 1 Processor -- start 2023-10-16T19:58:19.337 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.334+0000 7f224592d700 1 -- start start 2023-10-16T19:58:19.340 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.335+0000 7f224592d700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f224015de00 0x7f2240161a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:19.340 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.335+0000 7f224592d700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f22400ced00 0x7f22400cf170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:19.341 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.335+0000 7f224592d700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22400ce870 con 0x7f2240161f50 2023-10-16T19:58:19.341 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.335+0000 7f224592d700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22400cf6b0 con 0x7f22400ced00 2023-10-16T19:58:19.341 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.335+0000 7f224592d700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2240162990 con 0x7f224015de00 2023-10-16T19:58:19.341 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.335+0000 7f223effd700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f224015de00 0x7f2240161a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:19.342 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.335+0000 7f223f7fe700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f22400ced00 0x7f22400cf170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:19.342 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.335+0000 7f223e7fc700 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7f2240161f50 0x7f22400d2200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.157:41420/0 (socket says 172.21.15.157:41420) 2023-10-16T19:58:19.342 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.335+0000 7f223f7fe700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f22400ced00 0x7f22400cf170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.157:43162/0 (socket says 172.21.15.157:43162) 2023-10-16T19:58:19.343 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.335+0000 7f223e7fc700 1 -- 172.21.15.157:0/682693493 learned_addr learned my addr 172.21.15.157:0/682693493 (peer_addr_for_me v1:172.21.15.157:0/0) 2023-10-16T19:58:19.343 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.336+0000 7f223dffb700 1 -- 172.21.15.157:0/682693493 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2353071640 0 0) 0x7f22400ce870 con 0x7f2240161f50 2023-10-16T19:58:19.343 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.336+0000 7f223dffb700 1 -- 172.21.15.157:0/682693493 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f222c0035b0 con 0x7f2240161f50 2023-10-16T19:58:19.343 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.336+0000 7f223f7fe700 1 -- 172.21.15.157:0/682693493 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f224015de00 msgr2=0x7f2240161a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:58:19.344 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.336+0000 7f223f7fe700 1 --2- 172.21.15.157:0/682693493 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f224015de00 0x7f2240161a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:19.344 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.336+0000 7f223f7fe700 1 -- 172.21.15.157:0/682693493 >> v1:172.21.15.187:6789/0 conn(0x7f2240161f50 legacy=0x7f22400d2200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:19.344 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.336+0000 7f223f7fe700 1 -- 172.21.15.157:0/682693493 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22401623d0 con 0x7f22400ced00 2023-10-16T19:58:19.345 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.336+0000 7f223effd700 1 --2- 172.21.15.157:0/682693493 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f224015de00 0x7f2240161a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T19:58:19.345 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.336+0000 7f223f7fe700 1 --2- 172.21.15.157:0/682693493 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f22400ced00 0x7f22400cf170 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f2230009d90 tx=0x7f223000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=29f138f08fde3557 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:58:19.345 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.336+0000 7f223dffb700 1 -- 172.21.15.157:0/682693493 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f223000e070 con 0x7f22400ced00 2023-10-16T19:58:19.345 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.336+0000 7f223dffb700 1 -- 172.21.15.157:0/682693493 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f223000bb20 con 0x7f22400ced00 2023-10-16T19:58:19.346 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.336+0000 7f223dffb700 1 -- 172.21.15.157:0/682693493 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2230012430 con 0x7f22400ced00 2023-10-16T19:58:19.346 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.337+0000 7f224592d700 1 -- 172.21.15.157:0/682693493 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f22400ced00 msgr2=0x7f22400cf170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:19.346 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.337+0000 7f224592d700 1 --2- 172.21.15.157:0/682693493 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f22400ced00 0x7f22400cf170 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f2230009d90 tx=0x7f223000b330 comp rx=0 tx=0).stop 2023-10-16T19:58:19.347 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.337+0000 7f224592d700 1 -- 172.21.15.157:0/682693493 shutdown_connections 2023-10-16T19:58:19.347 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.337+0000 7f224592d700 1 --2- 172.21.15.157:0/682693493 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f22400ced00 0x7f22400cf170 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:19.347 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.337+0000 7f224592d700 1 --2- 172.21.15.157:0/682693493 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f224015de00 0x7f2240161a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:19.347 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.337+0000 7f224592d700 1 -- 172.21.15.157:0/682693493 >> 172.21.15.157:0/682693493 conn(0x7f22400665a0 msgr2=0x7f2240066980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:58:19.348 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.337+0000 7f224592d700 1 -- 172.21.15.157:0/682693493 shutdown_connections 2023-10-16T19:58:19.348 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.337+0000 7f224592d700 1 -- 172.21.15.157:0/682693493 wait complete. 2023-10-16T19:58:19.348 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.338+0000 7f224592d700 1 Processor -- start 2023-10-16T19:58:19.348 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.338+0000 7f224592d700 1 -- start start 2023-10-16T19:58:19.351 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.339+0000 7f224592d700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f22400ced00 0x7f22401584d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:19.351 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.339+0000 7f224592d700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f224015de00 0x7f2240157f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:19.352 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.339+0000 7f224592d700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2240161f50 0x7f224015c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:19.352 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.339+0000 7f224592d700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22400c9c60 con 0x7f2240161f50 2023-10-16T19:58:19.352 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.339+0000 7f224592d700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22400cb9b0 con 0x7f22400ced00 2023-10-16T19:58:19.352 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.339+0000 7f224592d700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22400cbc90 con 0x7f224015de00 2023-10-16T19:58:19.353 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.339+0000 7f223f7fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2240161f50 0x7f224015c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:19.353 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.339+0000 7f223f7fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2240161f50 0x7f224015c630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:48060/0 (socket says 172.21.15.157:48060) 2023-10-16T19:58:19.353 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.339+0000 7f223f7fe700 1 -- 172.21.15.157:0/2587901902 learned_addr learned my addr 172.21.15.157:0/2587901902 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:58:19.353 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.339+0000 7f223e7fc700 1 --2- 172.21.15.157:0/2587901902 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f224015de00 0x7f2240157f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:19.354 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.339+0000 7f223effd700 1 --2- 172.21.15.157:0/2587901902 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f22400ced00 0x7f22401584d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:19.354 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.339+0000 7f223f7fe700 1 -- 172.21.15.157:0/2587901902 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f224015de00 msgr2=0x7f2240157f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:19.354 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.339+0000 7f223f7fe700 1 --2- 172.21.15.157:0/2587901902 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f224015de00 0x7f2240157f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:19.355 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.339+0000 7f223f7fe700 1 -- 172.21.15.157:0/2587901902 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f22400ced00 msgr2=0x7f22401584d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:19.355 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.339+0000 7f223f7fe700 1 --2- 172.21.15.157:0/2587901902 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f22400ced00 0x7f22401584d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:19.355 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.339+0000 7f223f7fe700 1 -- 172.21.15.157:0/2587901902 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22380094a0 con 0x7f2240161f50 2023-10-16T19:58:19.355 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.339+0000 7f223f7fe700 1 --2- 172.21.15.157:0/2587901902 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2240161f50 0x7f224015c630 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f2230014040 tx=0x7f2230004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:58:19.356 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.340+0000 7f2237fff700 1 -- 172.21.15.157:0/2587901902 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22300129f0 con 0x7f2240161f50 2023-10-16T19:58:19.356 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.340+0000 7f2237fff700 1 -- 172.21.15.157:0/2587901902 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2230020070 con 0x7f2240161f50 2023-10-16T19:58:19.356 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.340+0000 7f224592d700 1 -- 172.21.15.157:0/2587901902 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2230009a70 con 0x7f2240161f50 2023-10-16T19:58:19.357 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.340+0000 7f2237fff700 1 -- 172.21.15.157:0/2587901902 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2230012dd0 con 0x7f2240161f50 2023-10-16T19:58:19.357 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.340+0000 7f224592d700 1 -- 172.21.15.157:0/2587901902 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22400cc250 con 0x7f2240161f50 2023-10-16T19:58:19.357 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.341+0000 7f224592d700 1 -- 172.21.15.157:0/2587901902 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f224004f400 con 0x7f2240161f50 2023-10-16T19:58:19.357 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.341+0000 7f2237fff700 1 -- 172.21.15.157:0/2587901902 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f2230004040 con 0x7f2240161f50 2023-10-16T19:58:19.358 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.341+0000 7f2237fff700 1 --2- 172.21.15.157:0/2587901902 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f222006af00 0x7f222006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:19.358 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.341+0000 7f2237fff700 1 -- 172.21.15.157:0/2587901902 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5729+0+0 (secure 0 0 0) 0x7f2230022070 con 0x7f2240161f50 2023-10-16T19:58:19.358 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.342+0000 7f223effd700 1 --2- 172.21.15.157:0/2587901902 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f222006af00 0x7f222006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:19.359 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.342+0000 7f223effd700 1 --2- 172.21.15.157:0/2587901902 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f222006af00 0x7f222006d3c0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f2238009d70 tx=0x7f2238009210 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:58:19.359 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.346+0000 7f2237fff700 1 -- 172.21.15.157:0/2587901902 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2230056290 con 0x7f2240161f50 2023-10-16T19:58:19.536 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.534+0000 7f224592d700 1 -- 172.21.15.157:0/2587901902 --> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7f22400ce500 con 0x7f222006af00 2023-10-16T19:58:19.537 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.534+0000 7f2237fff700 1 -- 172.21.15.157:0/2587901902 <== mgr.4100 v2:172.21.15.187:6832/2426285296 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f22380099c0 con 0x7f222006af00 2023-10-16T19:58:19.539 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.536+0000 7f224592d700 1 -- 172.21.15.157:0/2587901902 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f222006af00 msgr2=0x7f222006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:19.539 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.536+0000 7f224592d700 1 --2- 172.21.15.157:0/2587901902 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f222006af00 0x7f222006d3c0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f2238009d70 tx=0x7f2238009210 comp rx=0 tx=0).stop 2023-10-16T19:58:19.540 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.536+0000 7f224592d700 1 -- 172.21.15.157:0/2587901902 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2240161f50 msgr2=0x7f224015c630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:19.540 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.536+0000 7f224592d700 1 --2- 172.21.15.157:0/2587901902 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2240161f50 0x7f224015c630 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f2230014040 tx=0x7f2230004ad0 comp rx=0 tx=0).stop 2023-10-16T19:58:19.540 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.536+0000 7f224592d700 1 -- 172.21.15.157:0/2587901902 shutdown_connections 2023-10-16T19:58:19.540 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.536+0000 7f224592d700 1 --2- 172.21.15.157:0/2587901902 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f222006af00 0x7f222006d3c0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:19.541 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.536+0000 7f224592d700 1 --2- 172.21.15.157:0/2587901902 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f22400ced00 0x7f22401584d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:19.541 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.536+0000 7f224592d700 1 --2- 172.21.15.157:0/2587901902 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2240161f50 0x7f224015c630 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:19.541 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.536+0000 7f224592d700 1 --2- 172.21.15.157:0/2587901902 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f224015de00 0x7f2240157f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:19.542 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.536+0000 7f224592d700 1 -- 172.21.15.157:0/2587901902 >> 172.21.15.157:0/2587901902 conn(0x7f22400665a0 msgr2=0x7f224015e8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:58:19.542 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.537+0000 7f224592d700 1 -- 172.21.15.157:0/2587901902 shutdown_connections 2023-10-16T19:58:19.542 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.537+0000 7f224592d700 1 -- 172.21.15.157:0/2587901902 wait complete. 2023-10-16T19:58:19.543 INFO:teuthology.orchestra.run.smithi157.stderr:instructed osd(s) 6 to deep-scrub 2023-10-16T19:58:19.551 INFO:tasks.ceph:Scrubbing osd.7 2023-10-16T19:58:19.551 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2023-10-16T19:58:19.675 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.673+0000 7f93428eb700 1 Processor -- start 2023-10-16T19:58:19.676 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.673+0000 7f93428eb700 1 -- start start 2023-10-16T19:58:19.678 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.674+0000 7f93428eb700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f933c071080 0x7f933c071500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:19.678 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.674+0000 7f93428eb700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f933c144430 con 0x7f933c1439a0 2023-10-16T19:58:19.679 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.674+0000 7f93428eb700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f933c071bf0 con 0x7f933c0b2710 2023-10-16T19:58:19.679 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.674+0000 7f93428eb700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f933c0ce790 con 0x7f933c071080 2023-10-16T19:58:19.679 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.674+0000 7f933bfff700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f933c1439a0 0x7f933c0cef80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:57736/0 (socket says 172.21.15.157:57736) 2023-10-16T19:58:19.679 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.674+0000 7f933bfff700 1 -- 172.21.15.157:0/260051342 learned_addr learned my addr 172.21.15.157:0/260051342 (peer_addr_for_me v1:172.21.15.157:0/0) 2023-10-16T19:58:19.680 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.674+0000 7f933b7fe700 1 --2- 172.21.15.157:0/260051342 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f933c071080 0x7f933c071500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:19.680 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.674+0000 7f933affd700 1 -- 172.21.15.157:0/260051342 <== mon.0 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3023453893 0 0) 0x7f933c144430 con 0x7f933c1439a0 2023-10-16T19:58:19.680 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.674+0000 7f933affd700 1 -- 172.21.15.157:0/260051342 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f93240035b0 con 0x7f933c1439a0 2023-10-16T19:58:19.680 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.674+0000 7f933affd700 1 -- 172.21.15.157:0/260051342 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1979683533 0 0) 0x7f933c071bf0 con 0x7f933c0b2710 2023-10-16T19:58:19.681 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.674+0000 7f933affd700 1 -- 172.21.15.157:0/260051342 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f933c144430 con 0x7f933c0b2710 2023-10-16T19:58:19.681 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.674+0000 7f933affd700 1 -- 172.21.15.157:0/260051342 <== mon.0 v1:172.21.15.157:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3123614247 0 0) 0x7f93240035b0 con 0x7f933c1439a0 2023-10-16T19:58:19.681 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.674+0000 7f933b7fe700 1 -- 172.21.15.157:0/260051342 >> v1:172.21.15.187:6789/0 conn(0x7f933c0b2710 legacy=0x7f933c06e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:19.682 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.674+0000 7f933b7fe700 1 -- 172.21.15.157:0/260051342 >> v1:172.21.15.157:6789/0 conn(0x7f933c1439a0 legacy=0x7f933c0cef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:19.682 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.674+0000 7f933b7fe700 1 -- 172.21.15.157:0/260051342 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f933c071ed0 con 0x7f933c071080 2023-10-16T19:58:19.682 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.675+0000 7f933b7fe700 1 --2- 172.21.15.157:0/260051342 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f933c071080 0x7f933c071500 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f932c009870 tx=0x7f932c009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3e29aca7cb66a3a0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:58:19.682 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.675+0000 7f933affd700 1 -- 172.21.15.157:0/260051342 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9330001670 con 0x7f933c071080 2023-10-16T19:58:19.683 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.675+0000 7f933affd700 1 -- 172.21.15.157:0/260051342 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f932c004030 con 0x7f933c071080 2023-10-16T19:58:19.683 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.675+0000 7f933affd700 1 -- 172.21.15.157:0/260051342 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f932c0043c0 con 0x7f933c071080 2023-10-16T19:58:19.683 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.675+0000 7f93428eb700 1 -- 172.21.15.157:0/260051342 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f933c071080 msgr2=0x7f933c071500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:19.684 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.675+0000 7f93428eb700 1 --2- 172.21.15.157:0/260051342 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f933c071080 0x7f933c071500 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f932c009870 tx=0x7f932c009b80 comp rx=0 tx=0).stop 2023-10-16T19:58:19.684 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.676+0000 7f93428eb700 1 -- 172.21.15.157:0/260051342 shutdown_connections 2023-10-16T19:58:19.684 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.676+0000 7f93428eb700 1 --2- 172.21.15.157:0/260051342 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f933c071080 0x7f933c071500 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:19.684 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.676+0000 7f93428eb700 1 -- 172.21.15.157:0/260051342 >> 172.21.15.157:0/260051342 conn(0x7f933c0d0b30 msgr2=0x7f933c0d0f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:58:19.685 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.676+0000 7f93428eb700 1 -- 172.21.15.157:0/260051342 shutdown_connections 2023-10-16T19:58:19.685 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.676+0000 7f93428eb700 1 -- 172.21.15.157:0/260051342 wait complete. 2023-10-16T19:58:19.688 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.677+0000 7f93428eb700 1 Processor -- start 2023-10-16T19:58:19.688 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.677+0000 7f93428eb700 1 -- start start 2023-10-16T19:58:19.688 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.678+0000 7f93428eb700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f933c071080 0x7f933c1f0b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:19.688 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.678+0000 7f93428eb700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f933c0b2710 0x7f933c156270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:19.689 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.678+0000 7f93428eb700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f933c1439a0 0x7f933c1567b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:19.689 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.678+0000 7f93428eb700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f933c157fa0 con 0x7f933c0b2710 2023-10-16T19:58:19.689 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.678+0000 7f93428eb700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f933c158560 con 0x7f933c071080 2023-10-16T19:58:19.690 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.678+0000 7f93428eb700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f933c15a7f0 con 0x7f933c1439a0 2023-10-16T19:58:19.690 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.678+0000 7f933b7fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f933c0b2710 0x7f933c156270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:19.690 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.678+0000 7f933b7fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f933c0b2710 0x7f933c156270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:48072/0 (socket says 172.21.15.157:48072) 2023-10-16T19:58:19.690 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.678+0000 7f933b7fe700 1 -- 172.21.15.157:0/3444404620 learned_addr learned my addr 172.21.15.157:0/3444404620 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:58:19.691 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.678+0000 7f9340e88700 1 --2- 172.21.15.157:0/3444404620 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f933c1439a0 0x7f933c1567b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:19.691 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.678+0000 7f933bfff700 1 --2- 172.21.15.157:0/3444404620 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f933c071080 0x7f933c1f0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:19.691 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.678+0000 7f933b7fe700 1 -- 172.21.15.157:0/3444404620 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f933c1439a0 msgr2=0x7f933c1567b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:19.691 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.678+0000 7f933b7fe700 1 --2- 172.21.15.157:0/3444404620 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f933c1439a0 0x7f933c1567b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:19.692 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.678+0000 7f933b7fe700 1 -- 172.21.15.157:0/3444404620 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f933c071080 msgr2=0x7f933c1f0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:19.692 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.678+0000 7f933b7fe700 1 --2- 172.21.15.157:0/3444404620 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f933c071080 0x7f933c1f0b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:19.692 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.678+0000 7f933b7fe700 1 -- 172.21.15.157:0/3444404620 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f932c0094a0 con 0x7f933c0b2710 2023-10-16T19:58:19.692 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.678+0000 7f933b7fe700 1 --2- 172.21.15.157:0/3444404620 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f933c0b2710 0x7f933c156270 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f932c0090b0 tx=0x7f932c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:58:19.693 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.678+0000 7f9338ff9700 1 -- 172.21.15.157:0/3444404620 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f932c003e20 con 0x7f933c0b2710 2023-10-16T19:58:19.693 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.678+0000 7f9338ff9700 1 -- 172.21.15.157:0/3444404620 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f932c01f070 con 0x7f933c0b2710 2023-10-16T19:58:19.693 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.678+0000 7f93428eb700 1 -- 172.21.15.157:0/3444404620 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f933c156cf0 con 0x7f933c0b2710 2023-10-16T19:58:19.693 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.679+0000 7f9338ff9700 1 -- 172.21.15.157:0/3444404620 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f932c011870 con 0x7f933c0b2710 2023-10-16T19:58:19.694 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.679+0000 7f93428eb700 1 -- 172.21.15.157:0/3444404620 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f933c157280 con 0x7f933c0b2710 2023-10-16T19:58:19.694 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.679+0000 7f93428eb700 1 -- 172.21.15.157:0/3444404620 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f933c06dd70 con 0x7f933c0b2710 2023-10-16T19:58:19.694 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.680+0000 7f9338ff9700 1 -- 172.21.15.157:0/3444404620 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f932c0119d0 con 0x7f933c0b2710 2023-10-16T19:58:19.695 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.680+0000 7f9338ff9700 1 --2- 172.21.15.157:0/3444404620 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f932806af00 0x7f932806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:19.695 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.680+0000 7f9338ff9700 1 -- 172.21.15.157:0/3444404620 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5729+0+0 (secure 0 0 0) 0x7f932c021070 con 0x7f933c0b2710 2023-10-16T19:58:19.695 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.680+0000 7f9338ff9700 1 --2- 172.21.15.157:0/3444404620 >> [v2:172.21.15.187:6824/4284059445,v1:172.21.15.187:6825/4284059445] conn(0x7f9328073100 0x7f9328075540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:19.695 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.680+0000 7f933bfff700 1 --2- 172.21.15.157:0/3444404620 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f932806af00 0x7f932806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:19.696 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.680+0000 7f9338ff9700 1 -- 172.21.15.157:0/3444404620 --> [v2:172.21.15.187:6824/4284059445,v1:172.21.15.187:6825/4284059445] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9328075c10 con 0x7f9328073100 2023-10-16T19:58:19.696 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.680+0000 7f9338ff9700 1 -- 172.21.15.157:0/3444404620 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f932c08d2b0 con 0x7f933c0b2710 2023-10-16T19:58:19.696 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.681+0000 7f9340e88700 1 --2- 172.21.15.157:0/3444404620 >> [v2:172.21.15.187:6824/4284059445,v1:172.21.15.187:6825/4284059445] conn(0x7f9328073100 0x7f9328075540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:19.696 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.681+0000 7f933bfff700 1 --2- 172.21.15.157:0/3444404620 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f932806af00 0x7f932806d3c0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f9330000f60 tx=0x7f9330001690 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:58:19.697 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.681+0000 7f9340e88700 1 --2- 172.21.15.157:0/3444404620 >> [v2:172.21.15.187:6824/4284059445,v1:172.21.15.187:6825/4284059445] conn(0x7f9328073100 0x7f9328075540 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:58:19.697 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.682+0000 7f9338ff9700 1 -- 172.21.15.157:0/3444404620 <== osd.7 v2:172.21.15.187:6824/4284059445 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23595 (crc 0 0 0) 0x7f9328075c10 con 0x7f9328073100 2023-10-16T19:58:19.698 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.695+0000 7f93428eb700 1 -- 172.21.15.157:0/3444404620 --> [v2:172.21.15.187:6824/4284059445,v1:172.21.15.187:6825/4284059445] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f933c06da90 con 0x7f9328073100 2023-10-16T19:58:19.698 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.696+0000 7f9338ff9700 1 -- 172.21.15.157:0/3444404620 <== osd.7 v2:172.21.15.187:6824/4284059445 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+757 (crc 0 0 0) 0x7f9334001fe0 con 0x7f9328073100 2023-10-16T19:58:19.699 INFO:teuthology.orchestra.run.smithi157.stdout:{ 2023-10-16T19:58:19.699 INFO:teuthology.orchestra.run.smithi157.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) osd_delete_sleep = '0.000000' osd_delete_sleep_hdd = '0.000000' osd_delete_sleep_hybrid = '0.000000' osd_delete_sleep_ssd = '0.000000' osd_max_backfills = '1' osd_pg_delete_cost = '15728640' (not observed, change may require restart) osd_recovery_max_active = '0' osd_recovery_max_active_hdd = '3' osd_recovery_max_active_ssd = '10' osd_recovery_sleep = '0.000000' osd_recovery_sleep_hdd = '0.000000' osd_recovery_sleep_hybrid = '0.000000' osd_recovery_sleep_ssd = '0.000000' osd_scrub_sleep = '0.000000' osd_snap_trim_sleep = '0.000000' osd_snap_trim_sleep_hdd = '0.000000' osd_snap_trim_sleep_hybrid = '0.000000' osd_snap_trim_sleep_ssd = '0.000000' " 2023-10-16T19:58:19.699 INFO:teuthology.orchestra.run.smithi157.stdout:} 2023-10-16T19:58:19.700 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.696+0000 7f93428eb700 1 -- 172.21.15.157:0/3444404620 >> [v2:172.21.15.187:6824/4284059445,v1:172.21.15.187:6825/4284059445] conn(0x7f9328073100 msgr2=0x7f9328075540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:19.700 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.696+0000 7f93428eb700 1 --2- 172.21.15.157:0/3444404620 >> [v2:172.21.15.187:6824/4284059445,v1:172.21.15.187:6825/4284059445] conn(0x7f9328073100 0x7f9328075540 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:19.701 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.696+0000 7f93428eb700 1 -- 172.21.15.157:0/3444404620 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f932806af00 msgr2=0x7f932806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:19.701 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.696+0000 7f93428eb700 1 --2- 172.21.15.157:0/3444404620 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f932806af00 0x7f932806d3c0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f9330000f60 tx=0x7f9330001690 comp rx=0 tx=0).stop 2023-10-16T19:58:19.701 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.696+0000 7f93428eb700 1 -- 172.21.15.157:0/3444404620 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f933c0b2710 msgr2=0x7f933c156270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:19.701 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.696+0000 7f93428eb700 1 --2- 172.21.15.157:0/3444404620 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f933c0b2710 0x7f933c156270 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f932c0090b0 tx=0x7f932c004750 comp rx=0 tx=0).stop 2023-10-16T19:58:19.702 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.696+0000 7f9340e88700 1 -- 172.21.15.157:0/3444404620 reap_dead start 2023-10-16T19:58:19.702 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.696+0000 7f93428eb700 1 -- 172.21.15.157:0/3444404620 shutdown_connections 2023-10-16T19:58:19.702 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.696+0000 7f93428eb700 1 -- 172.21.15.157:0/3444404620 >> 172.21.15.157:0/3444404620 conn(0x7f933c0d0b30 msgr2=0x7f933c13f680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:58:19.703 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.696+0000 7f93428eb700 1 -- 172.21.15.157:0/3444404620 shutdown_connections 2023-10-16T19:58:19.703 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.696+0000 7f93428eb700 1 -- 172.21.15.157:0/3444404620 wait complete. 2023-10-16T19:58:19.710 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2023-10-16T19:58:19.831 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.829+0000 7fce196a9700 1 Processor -- start 2023-10-16T19:58:19.832 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.829+0000 7fce196a9700 1 -- start start 2023-10-16T19:58:19.835 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.830+0000 7fce196a9700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fce1415de00 0x7fce14161a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:19.835 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.830+0000 7fce196a9700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fce14161f50 0x7fce140d2200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:19.835 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.830+0000 7fce196a9700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce140ce870 con 0x7fce140d2740 2023-10-16T19:58:19.836 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.830+0000 7fce196a9700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce14162990 con 0x7fce14161f50 2023-10-16T19:58:19.836 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.830+0000 7fce196a9700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce141623d0 con 0x7fce1415de00 2023-10-16T19:58:19.836 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.830+0000 7fce127fc700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fce14161f50 0x7fce140d2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:19.837 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.830+0000 7fce137fe700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7fce140d2740 0x7fce140ced00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:57756/0 (socket says 172.21.15.157:57756) 2023-10-16T19:58:19.837 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.830+0000 7fce127fc700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fce14161f50 0x7fce140d2200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:48082/0 (socket says 172.21.15.157:48082) 2023-10-16T19:58:19.837 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.830+0000 7fce137fe700 1 -- 172.21.15.157:0/4286636815 learned_addr learned my addr 172.21.15.157:0/4286636815 (peer_addr_for_me v1:172.21.15.157:0/0) 2023-10-16T19:58:19.837 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.830+0000 7fce12ffd700 1 --2- 172.21.15.157:0/4286636815 >> v2:172.21.15.187:3300/0 conn(0x7fce1415de00 0x7fce14161a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:19.838 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.830+0000 7fce127fc700 1 -- 172.21.15.157:0/4286636815 >> v2:172.21.15.187:3300/0 conn(0x7fce1415de00 msgr2=0x7fce14161a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:58:19.838 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.830+0000 7fce127fc700 1 --2- 172.21.15.157:0/4286636815 >> v2:172.21.15.187:3300/0 conn(0x7fce1415de00 0x7fce14161a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:19.838 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.830+0000 7fce127fc700 1 -- 172.21.15.157:0/4286636815 >> v1:172.21.15.157:6789/0 conn(0x7fce140d2740 legacy=0x7fce140ced00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:19.839 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.830+0000 7fce127fc700 1 -- 172.21.15.157:0/4286636815 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce141626b0 con 0x7fce14161f50 2023-10-16T19:58:19.839 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.830+0000 7fce11ffb700 1 -- 172.21.15.157:0/4286636815 <== mon.0 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3277696987 0 0) 0x7fce140ce870 con 0x7fce140d2740 2023-10-16T19:58:19.839 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.831+0000 7fce127fc700 1 --2- 172.21.15.157:0/4286636815 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fce14161f50 0x7fce140d2200 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fce140675b0 tx=0x7fce04009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42011f3ea7514dde server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:58:19.839 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.831+0000 7fce11ffb700 1 -- 172.21.15.157:0/4286636815 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce04011830 con 0x7fce14161f50 2023-10-16T19:58:19.840 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.831+0000 7fce11ffb700 1 -- 172.21.15.157:0/4286636815 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce04011990 con 0x7fce14161f50 2023-10-16T19:58:19.840 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.831+0000 7fce11ffb700 1 -- 172.21.15.157:0/4286636815 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce04011d20 con 0x7fce14161f50 2023-10-16T19:58:19.840 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.831+0000 7fce196a9700 1 -- 172.21.15.157:0/4286636815 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fce14161f50 msgr2=0x7fce140d2200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:19.841 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.831+0000 7fce196a9700 1 --2- 172.21.15.157:0/4286636815 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fce14161f50 0x7fce140d2200 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fce140675b0 tx=0x7fce04009b20 comp rx=0 tx=0).stop 2023-10-16T19:58:19.841 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.831+0000 7fce196a9700 1 -- 172.21.15.157:0/4286636815 shutdown_connections 2023-10-16T19:58:19.841 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.831+0000 7fce196a9700 1 --2- 172.21.15.157:0/4286636815 >> v2:172.21.15.187:3300/0 conn(0x7fce1415de00 0x7fce14161a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:19.841 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.831+0000 7fce196a9700 1 --2- 172.21.15.157:0/4286636815 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fce14161f50 0x7fce140d2200 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:19.842 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.831+0000 7fce196a9700 1 -- 172.21.15.157:0/4286636815 >> 172.21.15.157:0/4286636815 conn(0x7fce140665a0 msgr2=0x7fce14066980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:58:19.842 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.831+0000 7fce196a9700 1 -- 172.21.15.157:0/4286636815 shutdown_connections 2023-10-16T19:58:19.842 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.831+0000 7fce196a9700 1 -- 172.21.15.157:0/4286636815 wait complete. 2023-10-16T19:58:19.842 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.833+0000 7fce196a9700 1 Processor -- start 2023-10-16T19:58:19.843 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.833+0000 7fce196a9700 1 -- start start 2023-10-16T19:58:19.845 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.833+0000 7fce196a9700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fce140d2740 0x7fce140ca2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:19.845 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.833+0000 7fce196a9700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fce1415de00 0x7fce140b3800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:19.846 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.833+0000 7fce196a9700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fce14161f50 0x7fce140b5010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:19.846 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.833+0000 7fce196a9700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce140b3d40 con 0x7fce140d2740 2023-10-16T19:58:19.846 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.833+0000 7fce196a9700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce140b3f70 con 0x7fce14161f50 2023-10-16T19:58:19.847 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.833+0000 7fce196a9700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce140b4250 con 0x7fce1415de00 2023-10-16T19:58:19.847 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.834+0000 7fce12ffd700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fce140d2740 0x7fce140ca2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:19.847 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.834+0000 7fce12ffd700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fce140d2740 0x7fce140ca2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:48086/0 (socket says 172.21.15.157:48086) 2023-10-16T19:58:19.848 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.834+0000 7fce12ffd700 1 -- 172.21.15.157:0/1473868426 learned_addr learned my addr 172.21.15.157:0/1473868426 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:58:19.848 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.834+0000 7fce12ffd700 1 -- 172.21.15.157:0/1473868426 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fce1415de00 msgr2=0x7fce140b3800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:19.848 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.834+0000 7fce127fc700 1 --2- 172.21.15.157:0/1473868426 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fce1415de00 0x7fce140b3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:19.848 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.834+0000 7fce137fe700 1 --2- 172.21.15.157:0/1473868426 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fce14161f50 0x7fce140b5010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:19.849 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.834+0000 7fce12ffd700 1 --2- 172.21.15.157:0/1473868426 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fce1415de00 0x7fce140b3800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:19.849 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.834+0000 7fce12ffd700 1 -- 172.21.15.157:0/1473868426 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fce14161f50 msgr2=0x7fce140b5010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:19.849 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.834+0000 7fce12ffd700 1 --2- 172.21.15.157:0/1473868426 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fce14161f50 0x7fce140b5010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:19.850 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.834+0000 7fce12ffd700 1 -- 172.21.15.157:0/1473868426 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce040094a0 con 0x7fce140d2740 2023-10-16T19:58:19.850 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.834+0000 7fce12ffd700 1 --2- 172.21.15.157:0/1473868426 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fce140d2740 0x7fce140ca2e0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fce0800e810 tx=0x7fce0800ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:58:19.850 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.834+0000 7fcdfb7fe700 1 -- 172.21.15.157:0/1473868426 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce08013610 con 0x7fce140d2740 2023-10-16T19:58:19.850 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.834+0000 7fcdfb7fe700 1 -- 172.21.15.157:0/1473868426 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce08013770 con 0x7fce140d2740 2023-10-16T19:58:19.851 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.834+0000 7fce196a9700 1 -- 172.21.15.157:0/1473868426 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce140b4530 con 0x7fce140d2740 2023-10-16T19:58:19.851 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.834+0000 7fcdfb7fe700 1 -- 172.21.15.157:0/1473868426 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce08013b20 con 0x7fce140d2740 2023-10-16T19:58:19.851 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.834+0000 7fce196a9700 1 -- 172.21.15.157:0/1473868426 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce140b4af0 con 0x7fce140d2740 2023-10-16T19:58:19.851 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.835+0000 7fce196a9700 1 -- 172.21.15.157:0/1473868426 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce1404f400 con 0x7fce140d2740 2023-10-16T19:58:19.852 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.835+0000 7fcdfb7fe700 1 -- 172.21.15.157:0/1473868426 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fce08013c80 con 0x7fce140d2740 2023-10-16T19:58:19.852 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.836+0000 7fcdfb7fe700 1 --2- 172.21.15.157:0/1473868426 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fce0006af00 0x7fce0006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:19.852 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.836+0000 7fcdfb7fe700 1 -- 172.21.15.157:0/1473868426 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5729+0+0 (secure 0 0 0) 0x7fce08089340 con 0x7fce140d2740 2023-10-16T19:58:19.853 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.836+0000 7fce127fc700 1 --2- 172.21.15.157:0/1473868426 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fce0006af00 0x7fce0006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:19.853 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.837+0000 7fce127fc700 1 --2- 172.21.15.157:0/1473868426 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fce0006af00 0x7fce0006d3c0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fce140ce3a0 tx=0x7fce04008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:58:19.853 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:19.840+0000 7fcdfb7fe700 1 -- 172.21.15.157:0/1473868426 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fce080543e0 con 0x7fce140d2740 2023-10-16T19:58:20.030 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:20.028+0000 7fce196a9700 1 -- 172.21.15.157:0/1473868426 --> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7fce140b43c0 con 0x7fce0006af00 2023-10-16T19:58:20.031 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:20.029+0000 7fcdfb7fe700 1 -- 172.21.15.157:0/1473868426 <== mgr.4100 v2:172.21.15.187:6832/2426285296 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fce140b43c0 con 0x7fce0006af00 2023-10-16T19:58:20.034 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:20.031+0000 7fce196a9700 1 -- 172.21.15.157:0/1473868426 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fce0006af00 msgr2=0x7fce0006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:20.034 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:20.031+0000 7fce196a9700 1 --2- 172.21.15.157:0/1473868426 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fce0006af00 0x7fce0006d3c0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fce140ce3a0 tx=0x7fce04008030 comp rx=0 tx=0).stop 2023-10-16T19:58:20.034 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:20.031+0000 7fce196a9700 1 -- 172.21.15.157:0/1473868426 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fce140d2740 msgr2=0x7fce140ca2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:20.035 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:20.031+0000 7fce196a9700 1 --2- 172.21.15.157:0/1473868426 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fce140d2740 0x7fce140ca2e0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fce0800e810 tx=0x7fce0800ebd0 comp rx=0 tx=0).stop 2023-10-16T19:58:20.035 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:20.031+0000 7fce196a9700 1 -- 172.21.15.157:0/1473868426 shutdown_connections 2023-10-16T19:58:20.035 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:20.031+0000 7fce196a9700 1 --2- 172.21.15.157:0/1473868426 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7fce0006af00 0x7fce0006d3c0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:20.036 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:20.031+0000 7fce196a9700 1 --2- 172.21.15.157:0/1473868426 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fce14161f50 0x7fce140b5010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:20.036 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:20.031+0000 7fce196a9700 1 --2- 172.21.15.157:0/1473868426 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fce140d2740 0x7fce140ca2e0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:20.036 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:20.031+0000 7fce196a9700 1 --2- 172.21.15.157:0/1473868426 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fce1415de00 0x7fce140b3800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:20.036 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:20.031+0000 7fce196a9700 1 -- 172.21.15.157:0/1473868426 >> 172.21.15.157:0/1473868426 conn(0x7fce140665a0 msgr2=0x7fce140d2bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:58:20.037 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:20.032+0000 7fce196a9700 1 -- 172.21.15.157:0/1473868426 shutdown_connections 2023-10-16T19:58:20.037 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:20.032+0000 7fce196a9700 1 -- 172.21.15.157:0/1473868426 wait complete. 2023-10-16T19:58:20.038 INFO:teuthology.orchestra.run.smithi157.stderr:instructed osd(s) 7 to deep-scrub 2023-10-16T19:58:20.046 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-16T19:58:20.166 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:20.164+0000 7f98e3087700 1 Processor -- start 2023-10-16T19:58:20.167 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:20.164+0000 7f98e3087700 1 -- start start 2023-10-16T19:58:20.169 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:20.165+0000 7f98e3087700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f98dc06af60 0x7f98dc06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:20.169 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:20.165+0000 7f98e3087700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f98dc06de00 0x7f98dc0ce910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:20.170 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:20.165+0000 7f98e3087700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98dc0d08b0 con 0x7f98dc15e2f0 2023-10-16T19:58:20.170 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:20.165+0000 7f98e3087700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98dc1628f0 con 0x7f98dc06af60 2023-10-16T19:58:20.170 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:20.165+0000 7f98e3087700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98dc162bd0 con 0x7f98dc06de00 2023-10-16T19:58:20.171 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:20.165+0000 7f98dbfff700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f98dc06af60 0x7f98dc06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:20.171 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:20.165+0000 7f98dbfff700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f98dc06af60 0x7f98dc06d0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:48096/0 (socket says 172.21.15.157:48096) 2023-10-16T19:58:20.171 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:20.165+0000 7f98dbfff700 1 -- 172.21.15.157:0/1811002863 learned_addr learned my addr 172.21.15.157:0/1811002863 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:58:20.172 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:20.165+0000 7f98e1624700 1 --2- 172.21.15.157:0/1811002863 >> v2:172.21.15.187:3300/0 conn(0x7f98dc06de00 0x7f98dc0ce910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:20.172 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:20.165+0000 7f98dbfff700 1 -- 172.21.15.157:0/1811002863 >> v2:172.21.15.187:3300/0 conn(0x7f98dc06de00 msgr2=0x7f98dc0ce910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:58:20.172 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:20.165+0000 7f98dbfff700 1 --2- 172.21.15.157:0/1811002863 >> v2:172.21.15.187:3300/0 conn(0x7f98dc06de00 0x7f98dc0ce910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:20.172 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:20.165+0000 7f98dbfff700 1 -- 172.21.15.157:0/1811002863 >> v1:172.21.15.187:6789/0 conn(0x7f98dc15e2f0 legacy=0x7f98dc06a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:58:20.173 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:20.165+0000 7f98dbfff700 1 -- 172.21.15.157:0/1811002863 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98dc0d05d0 con 0x7f98dc06af60 2023-10-16T19:58:20.173 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:20.165+0000 7f98dbfff700 1 --2- 172.21.15.157:0/1811002863 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f98dc06af60 0x7f98dc06d0f0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f98dc06fbc0 tx=0x7f98c8009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e140b90f3b6be486 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:58:20.173 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:20.165+0000 7f98db7fe700 1 -- 172.21.15.157:0/1811002863 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98c800b870 con 0x7f98dc06af60 2023-10-16T19:58:20.174 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:20.165+0000 7f98db7fe700 1 -- 172.21.15.157:0/1811002863 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98c800b9d0 con 0x7f98dc06af60 2023-10-16T19:58:20.174 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:20.165+0000 7f98db7fe700 1 -- 172.21.15.157:0/1811002863 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98c800bd60 con 0x7f98dc06af60 2023-10-16T19:58:20.174 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:20.166+0000 7f98e3087700 1 -- 172.21.15.157:0/1811002863 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f98dc06af60 msgr2=0x7f98dc06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:20.174 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:20.166+0000 7f98e3087700 1 --2- 172.21.15.157:0/1811002863 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f98dc06af60 0x7f98dc06d0f0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f98dc06fbc0 tx=0x7f98c8009bd0 comp rx=0 tx=0).stop 2023-10-16T19:58:20.175 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:20.166+0000 7f98e3087700 1 -- 172.21.15.157:0/1811002863 shutdown_connections 2023-10-16T19:58:20.175 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:20.166+0000 7f98e3087700 1 --2- 172.21.15.157:0/1811002863 >> v2:172.21.15.187:3300/0 conn(0x7f98dc06de00 0x7f98dc0ce910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:20.175 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:20.166+0000 7f98e3087700 1 --2- 172.21.15.157:0/1811002863 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f98dc06af60 0x7f98dc06d0f0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:20.176 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:20.166+0000 7f98e3087700 1 -- 172.21.15.157:0/1811002863 >> 172.21.15.157:0/1811002863 conn(0x7f98dc0cd4e0 msgr2=0x7f98dc0cd8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:58:20.176 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:20.166+0000 7f98e3087700 1 -- 172.21.15.157:0/1811002863 shutdown_connections 2023-10-16T19:58:20.176 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:20.166+0000 7f98e3087700 1 -- 172.21.15.157:0/1811002863 wait complete. 2023-10-16T19:58:20.176 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:20.167+0000 7f98e3087700 1 Processor -- start 2023-10-16T19:58:20.177 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:20.167+0000 7f98e3087700 1 -- start start 2023-10-16T19:58:20.179 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:20.168+0000 7f98e3087700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f98dc06af60 0x7f98dc0b2880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:20.179 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:20.168+0000 7f98e3087700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f98dc06de00 0x7f98dc1f3f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:20.180 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:20.168+0000 7f98e3087700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f98dc15e2f0 0x7f98dc1f44a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:20.180 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:20.168+0000 7f98e3087700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98dc0c5d70 con 0x7f98dc06af60 2023-10-16T19:58:20.180 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:20.168+0000 7f98e3087700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98dc0c6580 con 0x7f98dc06de00 2023-10-16T19:58:20.180 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:20.168+0000 7f98e3087700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98dc0c5fc0 con 0x7f98dc15e2f0 2023-10-16T19:58:20.181 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:20.168+0000 7f98e0e23700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f98dc06af60 0x7f98dc0b2880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:20.181 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:20.168+0000 7f98e0e23700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f98dc06af60 0x7f98dc0b2880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:48100/0 (socket says 172.21.15.157:48100) 2023-10-16T19:58:20.181 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:20.168+0000 7f98e0e23700 1 -- 172.21.15.157:0/2704993356 learned_addr learned my addr 172.21.15.157:0/2704993356 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:58:20.182 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:20.168+0000 7f98e1624700 1 --2- 172.21.15.157:0/2704993356 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f98dc15e2f0 0x7f98dc1f44a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:20.182 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:20.168+0000 7f98e0e23700 1 -- 172.21.15.157:0/2704993356 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f98dc15e2f0 msgr2=0x7f98dc1f44a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:20.182 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:20.168+0000 7f98e0e23700 1 --2- 172.21.15.157:0/2704993356 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f98dc15e2f0 0x7f98dc1f44a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:20.182 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:20.168+0000 7f98e0e23700 1 -- 172.21.15.157:0/2704993356 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f98dc06de00 msgr2=0x7f98dc1f3f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:20.183 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:20.168+0000 7f98dbfff700 1 --2- 172.21.15.157:0/2704993356 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f98dc06de00 0x7f98dc1f3f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:20.183 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:20.168+0000 7f98e0e23700 1 --2- 172.21.15.157:0/2704993356 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f98dc06de00 0x7f98dc1f3f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:20.183 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:20.169+0000 7f98e0e23700 1 -- 172.21.15.157:0/2704993356 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98c8009550 con 0x7f98dc06af60 2023-10-16T19:58:20.184 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:20.169+0000 7f98e0e23700 1 --2- 172.21.15.157:0/2704993356 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f98dc06af60 0x7f98dc0b2880 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f98d000c450 tx=0x7f98d000c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:58:20.184 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:20.169+0000 7f98d97fa700 1 -- 172.21.15.157:0/2704993356 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98d00052d0 con 0x7f98dc06af60 2023-10-16T19:58:20.184 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:20.169+0000 7f98d97fa700 1 -- 172.21.15.157:0/2704993356 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98d0005430 con 0x7f98dc06af60 2023-10-16T19:58:20.184 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:20.169+0000 7f98d97fa700 1 -- 172.21.15.157:0/2704993356 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98d00038c0 con 0x7f98dc06af60 2023-10-16T19:58:20.185 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:20.169+0000 7f98e3087700 1 -- 172.21.15.157:0/2704993356 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98dc0c62a0 con 0x7f98dc06af60 2023-10-16T19:58:20.185 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:20.169+0000 7f98e3087700 1 -- 172.21.15.157:0/2704993356 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98dc15f670 con 0x7f98dc06af60 2023-10-16T19:58:20.185 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:20.170+0000 7f98e3087700 1 -- 172.21.15.157:0/2704993356 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98dc04f400 con 0x7f98dc06af60 2023-10-16T19:58:20.185 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:20.170+0000 7f98d97fa700 1 -- 172.21.15.157:0/2704993356 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f98d0003a20 con 0x7f98dc06af60 2023-10-16T19:58:20.186 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:20.171+0000 7f98d97fa700 1 --2- 172.21.15.157:0/2704993356 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f98c006af00 0x7f98c006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:20.186 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:20.171+0000 7f98d97fa700 1 -- 172.21.15.157:0/2704993356 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5729+0+0 (secure 0 0 0) 0x7f98d0088960 con 0x7f98dc06af60 2023-10-16T19:58:20.186 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:20.171+0000 7f98dbfff700 1 --2- 172.21.15.157:0/2704993356 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f98c006af00 0x7f98c006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:20.187 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:20.171+0000 7f98dbfff700 1 --2- 172.21.15.157:0/2704993356 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f98c006af00 0x7f98c006d3c0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f98dc1586b0 tx=0x7f98c8008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:58:20.187 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:20.175+0000 7f98d97fa700 1 -- 172.21.15.157:0/2704993356 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f98d00539e0 con 0x7f98dc06af60 2023-10-16T19:58:20.361 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:20.359+0000 7f98e3087700 1 -- 172.21.15.157:0/2704993356 --> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f98dc0b02a0 con 0x7f98c006af00 2023-10-16T19:58:20.369 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:20.367+0000 7f98d97fa700 1 -- 172.21.15.157:0/2704993356 <== mgr.4100 v2:172.21.15.187:6832/2426285296 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+284543 (secure 0 0 0) 0x7f98c801f070 con 0x7f98c006af00 2023-10-16T19:58:20.373 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-10-16T19:58:20.376 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:20.371+0000 7f98e3087700 1 -- 172.21.15.157:0/2704993356 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f98c006af00 msgr2=0x7f98c006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:20.376 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:20.371+0000 7f98e3087700 1 --2- 172.21.15.157:0/2704993356 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f98c006af00 0x7f98c006d3c0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f98dc1586b0 tx=0x7f98c8008030 comp rx=0 tx=0).stop 2023-10-16T19:58:20.376 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:20.371+0000 7f98e3087700 1 -- 172.21.15.157:0/2704993356 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f98dc06af60 msgr2=0x7f98dc0b2880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:20.377 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:20.371+0000 7f98e3087700 1 --2- 172.21.15.157:0/2704993356 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f98dc06af60 0x7f98dc0b2880 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f98d000c450 tx=0x7f98d000c810 comp rx=0 tx=0).stop 2023-10-16T19:58:20.377 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:20.371+0000 7f98e3087700 1 -- 172.21.15.157:0/2704993356 shutdown_connections 2023-10-16T19:58:20.377 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:20.371+0000 7f98e3087700 1 --2- 172.21.15.157:0/2704993356 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f98dc15e2f0 0x7f98dc1f44a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:20.377 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:20.371+0000 7f98e3087700 1 --2- 172.21.15.157:0/2704993356 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f98dc06af60 0x7f98dc0b2880 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:20.378 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:20.371+0000 7f98e3087700 1 --2- 172.21.15.157:0/2704993356 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f98c006af00 0x7f98c006d3c0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:20.378 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:20.371+0000 7f98e3087700 1 --2- 172.21.15.157:0/2704993356 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f98dc06de00 0x7f98dc1f3f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:20.378 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:20.371+0000 7f98e3087700 1 -- 172.21.15.157:0/2704993356 >> 172.21.15.157:0/2704993356 conn(0x7f98dc0cd4e0 msgr2=0x7f98dc0ad8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:58:20.379 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:20.371+0000 7f98e3087700 1 -- 172.21.15.157:0/2704993356 shutdown_connections 2023-10-16T19:58:20.379 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:20.371+0000 7f98e3087700 1 -- 172.21.15.157:0/2704993356 wait complete. 2023-10-16T19:58:20.379 INFO:teuthology.orchestra.run.smithi157.stderr:dumped all 2023-10-16T19:58:20.385 INFO:teuthology.orchestra.run.smithi157.stdout:{"pg_ready":true,"pg_map":{"version":65,"stamp":"2023-10-16T19:58:18.908384+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":2292,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560207,"statfs":{"total":1600000000,"available":1597652652,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003062"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:07.027378+0000","last_change":"2023-10-16T19:58:05.597289+0000","last_active":"2023-10-16T19:58:07.027378+0000","last_peered":"2023-10-16T19:58:07.027378+0000","last_clean":"2023-10-16T19:58:07.027378+0000","last_became_active":"2023-10-16T19:58:05.597025+0000","last_became_peered":"2023-10-16T19:58:05.597025+0000","last_unstale":"2023-10-16T19:58:07.027378+0000","last_undegraded":"2023-10-16T19:58:07.027378+0000","last_fullsized":"2023-10-16T19:58:07.027378+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:57:53.793532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:07.027896+0000","last_change":"2023-10-16T19:58:05.606250+0000","last_active":"2023-10-16T19:58:07.027896+0000","last_peered":"2023-10-16T19:58:07.027896+0000","last_clean":"2023-10-16T19:58:07.027896+0000","last_became_active":"2023-10-16T19:58:05.605969+0000","last_became_peered":"2023-10-16T19:58:05.605969+0000","last_unstale":"2023-10-16T19:58:07.027896+0000","last_undegraded":"2023-10-16T19:58:07.027896+0000","last_fullsized":"2023-10-16T19:58:07.027896+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:25:36.321203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:06.908178+0000","last_change":"2023-10-16T19:58:05.601472+0000","last_active":"2023-10-16T19:58:06.908178+0000","last_peered":"2023-10-16T19:58:06.908178+0000","last_clean":"2023-10-16T19:58:06.908178+0000","last_became_active":"2023-10-16T19:58:05.601072+0000","last_became_peered":"2023-10-16T19:58:05.601072+0000","last_unstale":"2023-10-16T19:58:06.908178+0000","last_undegraded":"2023-10-16T19:58:06.908178+0000","last_fullsized":"2023-10-16T19:58:06.908178+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:16:44.802078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:06.907743+0000","last_change":"2023-10-16T19:58:05.603410+0000","last_active":"2023-10-16T19:58:06.907743+0000","last_peered":"2023-10-16T19:58:06.907743+0000","last_clean":"2023-10-16T19:58:06.907743+0000","last_became_active":"2023-10-16T19:58:05.603003+0000","last_became_peered":"2023-10-16T19:58:05.603003+0000","last_unstale":"2023-10-16T19:58:06.907743+0000","last_undegraded":"2023-10-16T19:58:06.907743+0000","last_fullsized":"2023-10-16T19:58:06.907743+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:45:35.921925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:06.599174+0000","last_change":"2023-10-16T19:58:05.603205+0000","last_active":"2023-10-16T19:58:06.599174+0000","last_peered":"2023-10-16T19:58:06.599174+0000","last_clean":"2023-10-16T19:58:06.599174+0000","last_became_active":"2023-10-16T19:58:05.602976+0000","last_became_peered":"2023-10-16T19:58:05.602976+0000","last_unstale":"2023-10-16T19:58:06.599174+0000","last_undegraded":"2023-10-16T19:58:06.599174+0000","last_fullsized":"2023-10-16T19:58:06.599174+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:45:26.140866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:07.027617+0000","last_change":"2023-10-16T19:58:05.602575+0000","last_active":"2023-10-16T19:58:07.027617+0000","last_peered":"2023-10-16T19:58:07.027617+0000","last_clean":"2023-10-16T19:58:07.027617+0000","last_became_active":"2023-10-16T19:58:05.601803+0000","last_became_peered":"2023-10-16T19:58:05.601803+0000","last_unstale":"2023-10-16T19:58:07.027617+0000","last_undegraded":"2023-10-16T19:58:07.027617+0000","last_fullsized":"2023-10-16T19:58:07.027617+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:16:05.497063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:08.048629+0000","last_change":"2023-10-16T19:58:05.605393+0000","last_active":"2023-10-16T19:58:08.048629+0000","last_peered":"2023-10-16T19:58:08.048629+0000","last_clean":"2023-10-16T19:58:08.048629+0000","last_became_active":"2023-10-16T19:58:05.605148+0000","last_became_peered":"2023-10-16T19:58:05.605148+0000","last_unstale":"2023-10-16T19:58:08.048629+0000","last_undegraded":"2023-10-16T19:58:08.048629+0000","last_fullsized":"2023-10-16T19:58:08.048629+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:22:44.892357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:08.048675+0000","last_change":"2023-10-16T19:58:05.605461+0000","last_active":"2023-10-16T19:58:08.048675+0000","last_peered":"2023-10-16T19:58:08.048675+0000","last_clean":"2023-10-16T19:58:08.048675+0000","last_became_active":"2023-10-16T19:58:05.605200+0000","last_became_peered":"2023-10-16T19:58:05.605200+0000","last_unstale":"2023-10-16T19:58:08.048675+0000","last_undegraded":"2023-10-16T19:58:08.048675+0000","last_fullsized":"2023-10-16T19:58:08.048675+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:47:35.655272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:06.600844+0000","last_change":"2023-10-16T19:58:05.602243+0000","last_active":"2023-10-16T19:58:06.600844+0000","last_peered":"2023-10-16T19:58:06.600844+0000","last_clean":"2023-10-16T19:58:06.600844+0000","last_became_active":"2023-10-16T19:58:05.601910+0000","last_became_peered":"2023-10-16T19:58:05.601910+0000","last_unstale":"2023-10-16T19:58:06.600844+0000","last_undegraded":"2023-10-16T19:58:06.600844+0000","last_fullsized":"2023-10-16T19:58:06.600844+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:07:11.937484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:06.907450+0000","last_change":"2023-10-16T19:58:05.600582+0000","last_active":"2023-10-16T19:58:06.907450+0000","last_peered":"2023-10-16T19:58:06.907450+0000","last_clean":"2023-10-16T19:58:06.907450+0000","last_became_active":"2023-10-16T19:58:05.600356+0000","last_became_peered":"2023-10-16T19:58:05.600356+0000","last_unstale":"2023-10-16T19:58:06.907450+0000","last_undegraded":"2023-10-16T19:58:06.907450+0000","last_fullsized":"2023-10-16T19:58:06.907450+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:26:33.490004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:08.048860+0000","last_change":"2023-10-16T19:58:05.610325+0000","last_active":"2023-10-16T19:58:08.048860+0000","last_peered":"2023-10-16T19:58:08.048860+0000","last_clean":"2023-10-16T19:58:08.048860+0000","last_became_active":"2023-10-16T19:58:05.609979+0000","last_became_peered":"2023-10-16T19:58:05.609979+0000","last_unstale":"2023-10-16T19:58:08.048860+0000","last_undegraded":"2023-10-16T19:58:08.048860+0000","last_fullsized":"2023-10-16T19:58:08.048860+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:30:57.464645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:06.907718+0000","last_change":"2023-10-16T19:58:05.602076+0000","last_active":"2023-10-16T19:58:06.907718+0000","last_peered":"2023-10-16T19:58:06.907718+0000","last_clean":"2023-10-16T19:58:06.907718+0000","last_became_active":"2023-10-16T19:58:05.600490+0000","last_became_peered":"2023-10-16T19:58:05.600490+0000","last_unstale":"2023-10-16T19:58:06.907718+0000","last_undegraded":"2023-10-16T19:58:06.907718+0000","last_fullsized":"2023-10-16T19:58:06.907718+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:45:35.921925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:06.599132+0000","last_change":"2023-10-16T19:58:05.600961+0000","last_active":"2023-10-16T19:58:06.599132+0000","last_peered":"2023-10-16T19:58:06.599132+0000","last_clean":"2023-10-16T19:58:06.599132+0000","last_became_active":"2023-10-16T19:58:05.600614+0000","last_became_peered":"2023-10-16T19:58:05.600614+0000","last_unstale":"2023-10-16T19:58:06.599132+0000","last_undegraded":"2023-10-16T19:58:06.599132+0000","last_fullsized":"2023-10-16T19:58:06.599132+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:46:16.568366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:07.028165+0000","last_change":"2023-10-16T19:58:05.602410+0000","last_active":"2023-10-16T19:58:07.028165+0000","last_peered":"2023-10-16T19:58:07.028165+0000","last_clean":"2023-10-16T19:58:07.028165+0000","last_became_active":"2023-10-16T19:58:05.601569+0000","last_became_peered":"2023-10-16T19:58:05.601569+0000","last_unstale":"2023-10-16T19:58:07.028165+0000","last_undegraded":"2023-10-16T19:58:07.028165+0000","last_fullsized":"2023-10-16T19:58:07.028165+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:15:53.489096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:06.908030+0000","last_change":"2023-10-16T19:58:05.599789+0000","last_active":"2023-10-16T19:58:06.908030+0000","last_peered":"2023-10-16T19:58:06.908030+0000","last_clean":"2023-10-16T19:58:06.908030+0000","last_became_active":"2023-10-16T19:58:05.599026+0000","last_became_peered":"2023-10-16T19:58:05.599026+0000","last_unstale":"2023-10-16T19:58:06.908030+0000","last_undegraded":"2023-10-16T19:58:06.908030+0000","last_fullsized":"2023-10-16T19:58:06.908030+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:04:03.788625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:08.048995+0000","last_change":"2023-10-16T19:58:05.610219+0000","last_active":"2023-10-16T19:58:08.048995+0000","last_peered":"2023-10-16T19:58:08.048995+0000","last_clean":"2023-10-16T19:58:08.048995+0000","last_became_active":"2023-10-16T19:58:05.609613+0000","last_became_peered":"2023-10-16T19:58:05.609613+0000","last_unstale":"2023-10-16T19:58:08.048995+0000","last_undegraded":"2023-10-16T19:58:08.048995+0000","last_fullsized":"2023-10-16T19:58:08.048995+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:03:27.064265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:08.048854+0000","last_change":"2023-10-16T19:58:05.608855+0000","last_active":"2023-10-16T19:58:08.048854+0000","last_peered":"2023-10-16T19:58:08.048854+0000","last_clean":"2023-10-16T19:58:08.048854+0000","last_became_active":"2023-10-16T19:58:05.608184+0000","last_became_peered":"2023-10-16T19:58:05.608184+0000","last_unstale":"2023-10-16T19:58:08.048854+0000","last_undegraded":"2023-10-16T19:58:08.048854+0000","last_fullsized":"2023-10-16T19:58:08.048854+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:15:51.793903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:07.027692+0000","last_change":"2023-10-16T19:58:05.601271+0000","last_active":"2023-10-16T19:58:07.027692+0000","last_peered":"2023-10-16T19:58:07.027692+0000","last_clean":"2023-10-16T19:58:07.027692+0000","last_became_active":"2023-10-16T19:58:05.600977+0000","last_became_peered":"2023-10-16T19:58:05.600977+0000","last_unstale":"2023-10-16T19:58:07.027692+0000","last_undegraded":"2023-10-16T19:58:07.027692+0000","last_fullsized":"2023-10-16T19:58:07.027692+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:04:03.788625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:07.027493+0000","last_change":"2023-10-16T19:58:05.602564+0000","last_active":"2023-10-16T19:58:07.027493+0000","last_peered":"2023-10-16T19:58:07.027493+0000","last_clean":"2023-10-16T19:58:07.027493+0000","last_became_active":"2023-10-16T19:58:05.601866+0000","last_became_peered":"2023-10-16T19:58:05.601866+0000","last_unstale":"2023-10-16T19:58:07.027493+0000","last_undegraded":"2023-10-16T19:58:07.027493+0000","last_fullsized":"2023-10-16T19:58:07.027493+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:15:51.793903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:06.599266+0000","last_change":"2023-10-16T19:58:05.603764+0000","last_active":"2023-10-16T19:58:06.599266+0000","last_peered":"2023-10-16T19:58:06.599266+0000","last_clean":"2023-10-16T19:58:06.599266+0000","last_became_active":"2023-10-16T19:58:05.603536+0000","last_became_peered":"2023-10-16T19:58:05.603536+0000","last_unstale":"2023-10-16T19:58:06.599266+0000","last_undegraded":"2023-10-16T19:58:06.599266+0000","last_fullsized":"2023-10-16T19:58:06.599266+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:20:13.830601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:06.600643+0000","last_change":"2023-10-16T19:58:05.607035+0000","last_active":"2023-10-16T19:58:06.600643+0000","last_peered":"2023-10-16T19:58:06.600643+0000","last_clean":"2023-10-16T19:58:06.600643+0000","last_became_active":"2023-10-16T19:58:05.606725+0000","last_became_peered":"2023-10-16T19:58:05.606725+0000","last_unstale":"2023-10-16T19:58:06.600643+0000","last_undegraded":"2023-10-16T19:58:06.600643+0000","last_fullsized":"2023-10-16T19:58:06.600643+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:05:23.390163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:06.600926+0000","last_change":"2023-10-16T19:58:05.606076+0000","last_active":"2023-10-16T19:58:06.600926+0000","last_peered":"2023-10-16T19:58:06.600926+0000","last_clean":"2023-10-16T19:58:06.600926+0000","last_became_active":"2023-10-16T19:58:05.605335+0000","last_became_peered":"2023-10-16T19:58:05.605335+0000","last_unstale":"2023-10-16T19:58:06.600926+0000","last_undegraded":"2023-10-16T19:58:06.600926+0000","last_fullsized":"2023-10-16T19:58:06.600926+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:09:04.664112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:06.600504+0000","last_change":"2023-10-16T19:58:05.609361+0000","last_active":"2023-10-16T19:58:06.600504+0000","last_peered":"2023-10-16T19:58:06.600504+0000","last_clean":"2023-10-16T19:58:06.600504+0000","last_became_active":"2023-10-16T19:58:05.609123+0000","last_became_peered":"2023-10-16T19:58:05.609123+0000","last_unstale":"2023-10-16T19:58:06.600504+0000","last_undegraded":"2023-10-16T19:58:06.600504+0000","last_fullsized":"2023-10-16T19:58:06.600504+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:29:55.757064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:06.907737+0000","last_change":"2023-10-16T19:58:05.599645+0000","last_active":"2023-10-16T19:58:06.907737+0000","last_peered":"2023-10-16T19:58:06.907737+0000","last_clean":"2023-10-16T19:58:06.907737+0000","last_became_active":"2023-10-16T19:58:05.599210+0000","last_became_peered":"2023-10-16T19:58:05.599210+0000","last_unstale":"2023-10-16T19:58:06.907737+0000","last_undegraded":"2023-10-16T19:58:06.907737+0000","last_fullsized":"2023-10-16T19:58:06.907737+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:47:35.655272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:06.907710+0000","last_change":"2023-10-16T19:58:05.608218+0000","last_active":"2023-10-16T19:58:06.907710+0000","last_peered":"2023-10-16T19:58:06.907710+0000","last_clean":"2023-10-16T19:58:06.907710+0000","last_became_active":"2023-10-16T19:58:05.608010+0000","last_became_peered":"2023-10-16T19:58:05.608010+0000","last_unstale":"2023-10-16T19:58:06.907710+0000","last_undegraded":"2023-10-16T19:58:06.907710+0000","last_fullsized":"2023-10-16T19:58:06.907710+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:10:06.943190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:07.027753+0000","last_change":"2023-10-16T19:58:05.607417+0000","last_active":"2023-10-16T19:58:07.027753+0000","last_peered":"2023-10-16T19:58:07.027753+0000","last_clean":"2023-10-16T19:58:07.027753+0000","last_became_active":"2023-10-16T19:58:05.607185+0000","last_became_peered":"2023-10-16T19:58:05.607185+0000","last_unstale":"2023-10-16T19:58:07.027753+0000","last_undegraded":"2023-10-16T19:58:07.027753+0000","last_fullsized":"2023-10-16T19:58:07.027753+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:03:27.064265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:06.907334+0000","last_change":"2023-10-16T19:58:05.606277+0000","last_active":"2023-10-16T19:58:06.907334+0000","last_peered":"2023-10-16T19:58:06.907334+0000","last_clean":"2023-10-16T19:58:06.907334+0000","last_became_active":"2023-10-16T19:58:05.606043+0000","last_became_peered":"2023-10-16T19:58:05.606043+0000","last_unstale":"2023-10-16T19:58:06.907334+0000","last_undegraded":"2023-10-16T19:58:06.907334+0000","last_fullsized":"2023-10-16T19:58:06.907334+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:09:04.664112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:06.907996+0000","last_change":"2023-10-16T19:58:05.607969+0000","last_active":"2023-10-16T19:58:06.907996+0000","last_peered":"2023-10-16T19:58:06.907996+0000","last_clean":"2023-10-16T19:58:06.907996+0000","last_became_active":"2023-10-16T19:58:05.607763+0000","last_became_peered":"2023-10-16T19:58:05.607763+0000","last_unstale":"2023-10-16T19:58:06.907996+0000","last_undegraded":"2023-10-16T19:58:06.907996+0000","last_fullsized":"2023-10-16T19:58:06.907996+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:30:57.464645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:06.601107+0000","last_change":"2023-10-16T19:58:05.604754+0000","last_active":"2023-10-16T19:58:06.601107+0000","last_peered":"2023-10-16T19:58:06.601107+0000","last_clean":"2023-10-16T19:58:06.601107+0000","last_became_active":"2023-10-16T19:58:05.604309+0000","last_became_peered":"2023-10-16T19:58:05.604309+0000","last_unstale":"2023-10-16T19:58:06.601107+0000","last_undegraded":"2023-10-16T19:58:06.601107+0000","last_fullsized":"2023-10-16T19:58:06.601107+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:26:33.490004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:08.048842+0000","last_change":"2023-10-16T19:58:05.606380+0000","last_active":"2023-10-16T19:58:08.048842+0000","last_peered":"2023-10-16T19:58:08.048842+0000","last_clean":"2023-10-16T19:58:08.048842+0000","last_became_active":"2023-10-16T19:58:05.606102+0000","last_became_peered":"2023-10-16T19:58:05.606102+0000","last_unstale":"2023-10-16T19:58:08.048842+0000","last_undegraded":"2023-10-16T19:58:08.048842+0000","last_fullsized":"2023-10-16T19:58:08.048842+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:04:03.788625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:07.027526+0000","last_change":"2023-10-16T19:58:05.600187+0000","last_active":"2023-10-16T19:58:07.027526+0000","last_peered":"2023-10-16T19:58:07.027526+0000","last_clean":"2023-10-16T19:58:07.027526+0000","last_became_active":"2023-10-16T19:58:05.599955+0000","last_became_peered":"2023-10-16T19:58:05.599955+0000","last_unstale":"2023-10-16T19:58:07.027526+0000","last_undegraded":"2023-10-16T19:58:07.027526+0000","last_fullsized":"2023-10-16T19:58:07.027526+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:05:23.390163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:08.049001+0000","last_change":"2023-10-16T19:58:05.609019+0000","last_active":"2023-10-16T19:58:08.049001+0000","last_peered":"2023-10-16T19:58:08.049001+0000","last_clean":"2023-10-16T19:58:08.049001+0000","last_became_active":"2023-10-16T19:58:05.608571+0000","last_became_peered":"2023-10-16T19:58:05.608571+0000","last_unstale":"2023-10-16T19:58:08.049001+0000","last_undegraded":"2023-10-16T19:58:08.049001+0000","last_fullsized":"2023-10-16T19:58:08.049001+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:17:36.021934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:06.600335+0000","last_change":"2023-10-16T19:58:05.609465+0000","last_active":"2023-10-16T19:58:06.600335+0000","last_peered":"2023-10-16T19:58:06.600335+0000","last_clean":"2023-10-16T19:58:06.600335+0000","last_became_active":"2023-10-16T19:58:05.609211+0000","last_became_peered":"2023-10-16T19:58:05.609211+0000","last_unstale":"2023-10-16T19:58:06.600335+0000","last_undegraded":"2023-10-16T19:58:06.600335+0000","last_fullsized":"2023-10-16T19:58:06.600335+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:05:23.390163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"32'4","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.904227+0000","last_change":"2023-10-16T19:58:04.587769+0000","last_active":"2023-10-16T19:58:05.904227+0000","last_peered":"2023-10-16T19:58:05.904227+0000","last_clean":"2023-10-16T19:58:05.904227+0000","last_became_active":"2023-10-16T19:58:04.587523+0000","last_became_peered":"2023-10-16T19:58:04.587523+0000","last_unstale":"2023-10-16T19:58:05.904227+0000","last_undegraded":"2023-10-16T19:58:05.904227+0000","last_fullsized":"2023-10-16T19:58:05.904227+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_clean_scrub_stamp":"2023-10-16T19:58:03.569082+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:20:12.826040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:07.027183+0000","last_change":"2023-10-16T19:58:05.598729+0000","last_active":"2023-10-16T19:58:07.027183+0000","last_peered":"2023-10-16T19:58:07.027183+0000","last_clean":"2023-10-16T19:58:07.027183+0000","last_became_active":"2023-10-16T19:58:05.598478+0000","last_became_peered":"2023-10-16T19:58:05.598478+0000","last_unstale":"2023-10-16T19:58:07.027183+0000","last_undegraded":"2023-10-16T19:58:07.027183+0000","last_fullsized":"2023-10-16T19:58:07.027183+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:36:40.381344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"32'1","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.902612+0000","last_change":"2023-10-16T19:58:04.589820+0000","last_active":"2023-10-16T19:58:05.902612+0000","last_peered":"2023-10-16T19:58:05.902612+0000","last_clean":"2023-10-16T19:58:05.902612+0000","last_became_active":"2023-10-16T19:58:04.589624+0000","last_became_peered":"2023-10-16T19:58:04.589624+0000","last_unstale":"2023-10-16T19:58:05.902612+0000","last_undegraded":"2023-10-16T19:58:05.902612+0000","last_fullsized":"2023-10-16T19:58:05.902612+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_clean_scrub_stamp":"2023-10-16T19:58:03.569082+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:50:59.901042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:06.600772+0000","last_change":"2023-10-16T19:58:05.603987+0000","last_active":"2023-10-16T19:58:06.600772+0000","last_peered":"2023-10-16T19:58:06.600772+0000","last_clean":"2023-10-16T19:58:06.600772+0000","last_became_active":"2023-10-16T19:58:05.603733+0000","last_became_peered":"2023-10-16T19:58:05.603733+0000","last_unstale":"2023-10-16T19:58:06.600772+0000","last_undegraded":"2023-10-16T19:58:06.600772+0000","last_fullsized":"2023-10-16T19:58:06.600772+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:29:55.757064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"32'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.900393+0000","last_change":"2023-10-16T19:58:04.587285+0000","last_active":"2023-10-16T19:58:05.900393+0000","last_peered":"2023-10-16T19:58:05.900393+0000","last_clean":"2023-10-16T19:58:05.900393+0000","last_became_active":"2023-10-16T19:58:04.587076+0000","last_became_peered":"2023-10-16T19:58:04.587076+0000","last_unstale":"2023-10-16T19:58:05.900393+0000","last_undegraded":"2023-10-16T19:58:05.900393+0000","last_fullsized":"2023-10-16T19:58:05.900393+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_clean_scrub_stamp":"2023-10-16T19:58:03.569082+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:05:22.385602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:06.907582+0000","last_change":"2023-10-16T19:58:05.603529+0000","last_active":"2023-10-16T19:58:06.907582+0000","last_peered":"2023-10-16T19:58:06.907582+0000","last_clean":"2023-10-16T19:58:06.907582+0000","last_became_active":"2023-10-16T19:58:05.603317+0000","last_became_peered":"2023-10-16T19:58:05.603317+0000","last_unstale":"2023-10-16T19:58:06.907582+0000","last_undegraded":"2023-10-16T19:58:06.907582+0000","last_fullsized":"2023-10-16T19:58:06.907582+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:57:59.985913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"32'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.900113+0000","last_change":"2023-10-16T19:58:04.581625+0000","last_active":"2023-10-16T19:58:05.900113+0000","last_peered":"2023-10-16T19:58:05.900113+0000","last_clean":"2023-10-16T19:58:05.900113+0000","last_became_active":"2023-10-16T19:58:04.580982+0000","last_became_peered":"2023-10-16T19:58:04.580982+0000","last_unstale":"2023-10-16T19:58:05.900113+0000","last_undegraded":"2023-10-16T19:58:05.900113+0000","last_fullsized":"2023-10-16T19:58:05.900113+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_clean_scrub_stamp":"2023-10-16T19:58:03.569082+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:10:41.518249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:08.048999+0000","last_change":"2023-10-16T19:58:05.609638+0000","last_active":"2023-10-16T19:58:08.048999+0000","last_peered":"2023-10-16T19:58:08.048999+0000","last_clean":"2023-10-16T19:58:08.048999+0000","last_became_active":"2023-10-16T19:58:05.609287+0000","last_became_peered":"2023-10-16T19:58:05.609287+0000","last_unstale":"2023-10-16T19:58:08.048999+0000","last_undegraded":"2023-10-16T19:58:08.048999+0000","last_fullsized":"2023-10-16T19:58:08.048999+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:16:44.802078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"32'1","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.903123+0000","last_change":"2023-10-16T19:58:04.592222+0000","last_active":"2023-10-16T19:58:05.903123+0000","last_peered":"2023-10-16T19:58:05.903123+0000","last_clean":"2023-10-16T19:58:05.903123+0000","last_became_active":"2023-10-16T19:58:04.591382+0000","last_became_peered":"2023-10-16T19:58:04.591382+0000","last_unstale":"2023-10-16T19:58:05.903123+0000","last_undegraded":"2023-10-16T19:58:05.903123+0000","last_fullsized":"2023-10-16T19:58:05.903123+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_clean_scrub_stamp":"2023-10-16T19:58:03.569082+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:43:50.906516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:06.907902+0000","last_change":"2023-10-16T19:58:05.606948+0000","last_active":"2023-10-16T19:58:06.907902+0000","last_peered":"2023-10-16T19:58:06.907902+0000","last_clean":"2023-10-16T19:58:06.907902+0000","last_became_active":"2023-10-16T19:58:05.606777+0000","last_became_peered":"2023-10-16T19:58:05.606777+0000","last_unstale":"2023-10-16T19:58:06.907902+0000","last_undegraded":"2023-10-16T19:58:06.907902+0000","last_fullsized":"2023-10-16T19:58:06.907902+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:16:05.497063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"32'1","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.903086+0000","last_change":"2023-10-16T19:58:04.584929+0000","last_active":"2023-10-16T19:58:05.903086+0000","last_peered":"2023-10-16T19:58:05.903086+0000","last_clean":"2023-10-16T19:58:05.903086+0000","last_became_active":"2023-10-16T19:58:04.584702+0000","last_became_peered":"2023-10-16T19:58:04.584702+0000","last_unstale":"2023-10-16T19:58:05.903086+0000","last_undegraded":"2023-10-16T19:58:05.903086+0000","last_fullsized":"2023-10-16T19:58:05.903086+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_clean_scrub_stamp":"2023-10-16T19:58:03.569082+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:04:37.242998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:06.601149+0000","last_change":"2023-10-16T19:58:05.601585+0000","last_active":"2023-10-16T19:58:06.601149+0000","last_peered":"2023-10-16T19:58:06.601149+0000","last_clean":"2023-10-16T19:58:06.601149+0000","last_became_active":"2023-10-16T19:58:05.600813+0000","last_became_peered":"2023-10-16T19:58:05.600813+0000","last_unstale":"2023-10-16T19:58:06.601149+0000","last_undegraded":"2023-10-16T19:58:06.601149+0000","last_fullsized":"2023-10-16T19:58:06.601149+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:42:51.289673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.900155+0000","last_change":"2023-10-16T19:58:04.585183+0000","last_active":"2023-10-16T19:58:05.900155+0000","last_peered":"2023-10-16T19:58:05.900155+0000","last_clean":"2023-10-16T19:58:05.900155+0000","last_became_active":"2023-10-16T19:58:04.584173+0000","last_became_peered":"2023-10-16T19:58:04.584173+0000","last_unstale":"2023-10-16T19:58:05.900155+0000","last_undegraded":"2023-10-16T19:58:05.900155+0000","last_fullsized":"2023-10-16T19:58:05.900155+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_clean_scrub_stamp":"2023-10-16T19:58:03.569082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:09:03.659551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:06.907620+0000","last_change":"2023-10-16T19:58:05.601649+0000","last_active":"2023-10-16T19:58:06.907620+0000","last_peered":"2023-10-16T19:58:06.907620+0000","last_clean":"2023-10-16T19:58:06.907620+0000","last_became_active":"2023-10-16T19:58:05.601416+0000","last_became_peered":"2023-10-16T19:58:05.601416+0000","last_unstale":"2023-10-16T19:58:06.907620+0000","last_undegraded":"2023-10-16T19:58:06.907620+0000","last_fullsized":"2023-10-16T19:58:06.907620+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:41:58.386070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.903214+0000","last_change":"2023-10-16T19:58:04.590433+0000","last_active":"2023-10-16T19:58:05.903214+0000","last_peered":"2023-10-16T19:58:05.903214+0000","last_clean":"2023-10-16T19:58:05.903214+0000","last_became_active":"2023-10-16T19:58:04.589891+0000","last_became_peered":"2023-10-16T19:58:04.589891+0000","last_unstale":"2023-10-16T19:58:05.903214+0000","last_undegraded":"2023-10-16T19:58:05.903214+0000","last_fullsized":"2023-10-16T19:58:05.903214+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_clean_scrub_stamp":"2023-10-16T19:58:03.569082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:31:31.566550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:06.908068+0000","last_change":"2023-10-16T19:58:05.603341+0000","last_active":"2023-10-16T19:58:06.908068+0000","last_peered":"2023-10-16T19:58:06.908068+0000","last_clean":"2023-10-16T19:58:06.908068+0000","last_became_active":"2023-10-16T19:58:05.603042+0000","last_became_peered":"2023-10-16T19:58:05.603042+0000","last_unstale":"2023-10-16T19:58:06.908068+0000","last_undegraded":"2023-10-16T19:58:06.908068+0000","last_fullsized":"2023-10-16T19:58:06.908068+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:03:27.064265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.900339+0000","last_change":"2023-10-16T19:58:04.589480+0000","last_active":"2023-10-16T19:58:05.900339+0000","last_peered":"2023-10-16T19:58:05.900339+0000","last_clean":"2023-10-16T19:58:05.900339+0000","last_became_active":"2023-10-16T19:58:04.589253+0000","last_became_peered":"2023-10-16T19:58:04.589253+0000","last_unstale":"2023-10-16T19:58:05.900339+0000","last_undegraded":"2023-10-16T19:58:05.900339+0000","last_fullsized":"2023-10-16T19:58:05.900339+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_clean_scrub_stamp":"2023-10-16T19:58:03.569082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:45:34.917364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:07.028095+0000","last_change":"2023-10-16T19:58:05.602710+0000","last_active":"2023-10-16T19:58:07.028095+0000","last_peered":"2023-10-16T19:58:07.028095+0000","last_clean":"2023-10-16T19:58:07.028095+0000","last_became_active":"2023-10-16T19:58:05.602336+0000","last_became_peered":"2023-10-16T19:58:05.602336+0000","last_unstale":"2023-10-16T19:58:07.028095+0000","last_undegraded":"2023-10-16T19:58:07.028095+0000","last_fullsized":"2023-10-16T19:58:07.028095+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:23:18.475974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.902719+0000","last_change":"2023-10-16T19:58:04.586281+0000","last_active":"2023-10-16T19:58:05.902719+0000","last_peered":"2023-10-16T19:58:05.902719+0000","last_clean":"2023-10-16T19:58:05.902719+0000","last_became_active":"2023-10-16T19:58:04.586047+0000","last_became_peered":"2023-10-16T19:58:04.586047+0000","last_unstale":"2023-10-16T19:58:05.902719+0000","last_undegraded":"2023-10-16T19:58:05.902719+0000","last_fullsized":"2023-10-16T19:58:05.902719+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_clean_scrub_stamp":"2023-10-16T19:58:03.569082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:31:31.566550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:07.027615+0000","last_change":"2023-10-16T19:58:05.606519+0000","last_active":"2023-10-16T19:58:07.027615+0000","last_peered":"2023-10-16T19:58:07.027615+0000","last_clean":"2023-10-16T19:58:07.027615+0000","last_became_active":"2023-10-16T19:58:05.606148+0000","last_became_peered":"2023-10-16T19:58:05.606148+0000","last_unstale":"2023-10-16T19:58:07.027615+0000","last_undegraded":"2023-10-16T19:58:07.027615+0000","last_fullsized":"2023-10-16T19:58:07.027615+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:30:57.464645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"32'3","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.903980+0000","last_change":"2023-10-16T19:58:04.589426+0000","last_active":"2023-10-16T19:58:05.903980+0000","last_peered":"2023-10-16T19:58:05.903980+0000","last_clean":"2023-10-16T19:58:05.903980+0000","last_became_active":"2023-10-16T19:58:04.589139+0000","last_became_peered":"2023-10-16T19:58:04.589139+0000","last_unstale":"2023-10-16T19:58:05.903980+0000","last_undegraded":"2023-10-16T19:58:05.903980+0000","last_fullsized":"2023-10-16T19:58:05.903980+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_clean_scrub_stamp":"2023-10-16T19:58:03.569082+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:55:48.953087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:06.907817+0000","last_change":"2023-10-16T19:58:05.601316+0000","last_active":"2023-10-16T19:58:06.907817+0000","last_peered":"2023-10-16T19:58:06.907817+0000","last_clean":"2023-10-16T19:58:06.907817+0000","last_became_active":"2023-10-16T19:58:05.600598+0000","last_became_peered":"2023-10-16T19:58:05.600598+0000","last_unstale":"2023-10-16T19:58:06.907817+0000","last_undegraded":"2023-10-16T19:58:06.907817+0000","last_fullsized":"2023-10-16T19:58:06.907817+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:22:44.892357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"32'6","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.900175+0000","last_change":"2023-10-16T19:58:04.585306+0000","last_active":"2023-10-16T19:58:05.900175+0000","last_peered":"2023-10-16T19:58:05.900175+0000","last_clean":"2023-10-16T19:58:05.900175+0000","last_became_active":"2023-10-16T19:58:04.584588+0000","last_became_peered":"2023-10-16T19:58:04.584588+0000","last_unstale":"2023-10-16T19:58:05.900175+0000","last_undegraded":"2023-10-16T19:58:05.900175+0000","last_fullsized":"2023-10-16T19:58:05.900175+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_clean_scrub_stamp":"2023-10-16T19:58:03.569082+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:26:32.485443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:06.907587+0000","last_change":"2023-10-16T19:58:05.602640+0000","last_active":"2023-10-16T19:58:06.907587+0000","last_peered":"2023-10-16T19:58:06.907587+0000","last_clean":"2023-10-16T19:58:06.907587+0000","last_became_active":"2023-10-16T19:58:05.602386+0000","last_became_peered":"2023-10-16T19:58:05.602386+0000","last_unstale":"2023-10-16T19:58:06.907587+0000","last_undegraded":"2023-10-16T19:58:06.907587+0000","last_fullsized":"2023-10-16T19:58:06.907587+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:24:38.118997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"32'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.903229+0000","last_change":"2023-10-16T19:58:04.586869+0000","last_active":"2023-10-16T19:58:05.903229+0000","last_peered":"2023-10-16T19:58:05.903229+0000","last_clean":"2023-10-16T19:58:05.903229+0000","last_became_active":"2023-10-16T19:58:04.586290+0000","last_became_peered":"2023-10-16T19:58:04.586290+0000","last_unstale":"2023-10-16T19:58:05.903229+0000","last_undegraded":"2023-10-16T19:58:05.903229+0000","last_fullsized":"2023-10-16T19:58:05.903229+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_clean_scrub_stamp":"2023-10-16T19:58:03.569082+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:36:39.376783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:07.027826+0000","last_change":"2023-10-16T19:58:05.606176+0000","last_active":"2023-10-16T19:58:07.027826+0000","last_peered":"2023-10-16T19:58:07.027826+0000","last_clean":"2023-10-16T19:58:07.027826+0000","last_became_active":"2023-10-16T19:58:05.605962+0000","last_became_peered":"2023-10-16T19:58:05.605962+0000","last_unstale":"2023-10-16T19:58:07.027826+0000","last_undegraded":"2023-10-16T19:58:07.027826+0000","last_fullsized":"2023-10-16T19:58:07.027826+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:17:36.021934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.900285+0000","last_change":"2023-10-16T19:58:04.587764+0000","last_active":"2023-10-16T19:58:05.900285+0000","last_peered":"2023-10-16T19:58:05.900285+0000","last_clean":"2023-10-16T19:58:05.900285+0000","last_became_active":"2023-10-16T19:58:04.587531+0000","last_became_peered":"2023-10-16T19:58:04.587531+0000","last_unstale":"2023-10-16T19:58:05.900285+0000","last_undegraded":"2023-10-16T19:58:05.900285+0000","last_fullsized":"2023-10-16T19:58:05.900285+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_clean_scrub_stamp":"2023-10-16T19:58:03.569082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:43:31.501292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:08.048860+0000","last_change":"2023-10-16T19:58:05.608149+0000","last_active":"2023-10-16T19:58:08.048860+0000","last_peered":"2023-10-16T19:58:08.048860+0000","last_clean":"2023-10-16T19:58:08.048860+0000","last_became_active":"2023-10-16T19:58:05.607449+0000","last_became_peered":"2023-10-16T19:58:05.607449+0000","last_unstale":"2023-10-16T19:58:08.048860+0000","last_undegraded":"2023-10-16T19:58:08.048860+0000","last_fullsized":"2023-10-16T19:58:08.048860+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:16:05.497063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.900269+0000","last_change":"2023-10-16T19:58:04.588496+0000","last_active":"2023-10-16T19:58:05.900269+0000","last_peered":"2023-10-16T19:58:05.900269+0000","last_clean":"2023-10-16T19:58:05.900269+0000","last_became_active":"2023-10-16T19:58:04.588305+0000","last_became_peered":"2023-10-16T19:58:04.588305+0000","last_unstale":"2023-10-16T19:58:05.900269+0000","last_undegraded":"2023-10-16T19:58:05.900269+0000","last_fullsized":"2023-10-16T19:58:05.900269+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_clean_scrub_stamp":"2023-10-16T19:58:03.569082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:29:54.752503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:07.027380+0000","last_change":"2023-10-16T19:58:05.599594+0000","last_active":"2023-10-16T19:58:07.027380+0000","last_peered":"2023-10-16T19:58:07.027380+0000","last_clean":"2023-10-16T19:58:07.027380+0000","last_became_active":"2023-10-16T19:58:05.599356+0000","last_became_peered":"2023-10-16T19:58:05.599356+0000","last_unstale":"2023-10-16T19:58:07.027380+0000","last_undegraded":"2023-10-16T19:58:07.027380+0000","last_fullsized":"2023-10-16T19:58:07.027380+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:55:49.957648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"32'8","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.900249+0000","last_change":"2023-10-16T19:58:04.580974+0000","last_active":"2023-10-16T19:58:05.900249+0000","last_peered":"2023-10-16T19:58:05.900249+0000","last_clean":"2023-10-16T19:58:05.900249+0000","last_became_active":"2023-10-16T19:58:04.580648+0000","last_became_peered":"2023-10-16T19:58:04.580648+0000","last_unstale":"2023-10-16T19:58:05.900249+0000","last_undegraded":"2023-10-16T19:58:05.900249+0000","last_fullsized":"2023-10-16T19:58:05.900249+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_clean_scrub_stamp":"2023-10-16T19:58:03.569082+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:26:45.146069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:06.601286+0000","last_change":"2023-10-16T19:58:05.600582+0000","last_active":"2023-10-16T19:58:06.601286+0000","last_peered":"2023-10-16T19:58:06.601286+0000","last_clean":"2023-10-16T19:58:06.601286+0000","last_became_active":"2023-10-16T19:58:05.600333+0000","last_became_peered":"2023-10-16T19:58:05.600333+0000","last_unstale":"2023-10-16T19:58:06.601286+0000","last_undegraded":"2023-10-16T19:58:06.601286+0000","last_fullsized":"2023-10-16T19:58:06.601286+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:57:59.985913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"32'1","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.900190+0000","last_change":"2023-10-16T19:58:04.587935+0000","last_active":"2023-10-16T19:58:05.900190+0000","last_peered":"2023-10-16T19:58:05.900190+0000","last_clean":"2023-10-16T19:58:05.900190+0000","last_became_active":"2023-10-16T19:58:04.587576+0000","last_became_peered":"2023-10-16T19:58:04.587576+0000","last_unstale":"2023-10-16T19:58:05.900190+0000","last_undegraded":"2023-10-16T19:58:05.900190+0000","last_fullsized":"2023-10-16T19:58:05.900190+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_clean_scrub_stamp":"2023-10-16T19:58:03.569082+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:05:22.385602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:06.907877+0000","last_change":"2023-10-16T19:58:05.599461+0000","last_active":"2023-10-16T19:58:06.907877+0000","last_peered":"2023-10-16T19:58:06.907877+0000","last_clean":"2023-10-16T19:58:06.907877+0000","last_became_active":"2023-10-16T19:58:05.598861+0000","last_became_peered":"2023-10-16T19:58:05.598861+0000","last_unstale":"2023-10-16T19:58:06.907877+0000","last_undegraded":"2023-10-16T19:58:06.907877+0000","last_fullsized":"2023-10-16T19:58:06.907877+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:15:51.793903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"32'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.903256+0000","last_change":"2023-10-16T19:58:04.586713+0000","last_active":"2023-10-16T19:58:05.903256+0000","last_peered":"2023-10-16T19:58:05.903256+0000","last_clean":"2023-10-16T19:58:05.903256+0000","last_became_active":"2023-10-16T19:58:04.585973+0000","last_became_peered":"2023-10-16T19:58:04.585973+0000","last_unstale":"2023-10-16T19:58:05.903256+0000","last_undegraded":"2023-10-16T19:58:05.903256+0000","last_fullsized":"2023-10-16T19:58:05.903256+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_clean_scrub_stamp":"2023-10-16T19:58:03.569082+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:55:48.953087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:06.907571+0000","last_change":"2023-10-16T19:58:05.606948+0000","last_active":"2023-10-16T19:58:06.907571+0000","last_peered":"2023-10-16T19:58:06.907571+0000","last_clean":"2023-10-16T19:58:06.907571+0000","last_became_active":"2023-10-16T19:58:05.606722+0000","last_became_peered":"2023-10-16T19:58:05.606722+0000","last_unstale":"2023-10-16T19:58:06.907571+0000","last_undegraded":"2023-10-16T19:58:06.907571+0000","last_fullsized":"2023-10-16T19:58:06.907571+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:42:51.289673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"32'1","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.903176+0000","last_change":"2023-10-16T19:58:04.587531+0000","last_active":"2023-10-16T19:58:05.903176+0000","last_peered":"2023-10-16T19:58:05.903176+0000","last_clean":"2023-10-16T19:58:05.903176+0000","last_became_active":"2023-10-16T19:58:04.586934+0000","last_became_peered":"2023-10-16T19:58:04.586934+0000","last_unstale":"2023-10-16T19:58:05.903176+0000","last_undegraded":"2023-10-16T19:58:05.903176+0000","last_fullsized":"2023-10-16T19:58:05.903176+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_clean_scrub_stamp":"2023-10-16T19:58:03.569082+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:50:59.901042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:06.599160+0000","last_change":"2023-10-16T19:58:05.607501+0000","last_active":"2023-10-16T19:58:06.599160+0000","last_peered":"2023-10-16T19:58:06.599160+0000","last_clean":"2023-10-16T19:58:06.599160+0000","last_became_active":"2023-10-16T19:58:05.607269+0000","last_became_peered":"2023-10-16T19:58:05.607269+0000","last_unstale":"2023-10-16T19:58:06.599160+0000","last_undegraded":"2023-10-16T19:58:06.599160+0000","last_fullsized":"2023-10-16T19:58:06.599160+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:43:51.911077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.903109+0000","last_change":"2023-10-16T19:58:04.592403+0000","last_active":"2023-10-16T19:58:05.903109+0000","last_peered":"2023-10-16T19:58:05.903109+0000","last_clean":"2023-10-16T19:58:05.903109+0000","last_became_active":"2023-10-16T19:58:04.591967+0000","last_became_peered":"2023-10-16T19:58:04.591967+0000","last_unstale":"2023-10-16T19:58:05.903109+0000","last_undegraded":"2023-10-16T19:58:05.903109+0000","last_fullsized":"2023-10-16T19:58:05.903109+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_clean_scrub_stamp":"2023-10-16T19:58:03.569082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:46:15.563804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:06.599199+0000","last_change":"2023-10-16T19:58:05.600386+0000","last_active":"2023-10-16T19:58:06.599199+0000","last_peered":"2023-10-16T19:58:06.599199+0000","last_clean":"2023-10-16T19:58:06.599199+0000","last_became_active":"2023-10-16T19:58:05.600081+0000","last_became_peered":"2023-10-16T19:58:05.600081+0000","last_unstale":"2023-10-16T19:58:06.599199+0000","last_undegraded":"2023-10-16T19:58:06.599199+0000","last_fullsized":"2023-10-16T19:58:06.599199+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:11:36.806952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"32'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.902674+0000","last_change":"2023-10-16T19:58:04.588001+0000","last_active":"2023-10-16T19:58:05.902674+0000","last_peered":"2023-10-16T19:58:05.902674+0000","last_clean":"2023-10-16T19:58:05.902674+0000","last_became_active":"2023-10-16T19:58:04.587629+0000","last_became_peered":"2023-10-16T19:58:04.587629+0000","last_unstale":"2023-10-16T19:58:05.902674+0000","last_undegraded":"2023-10-16T19:58:05.902674+0000","last_fullsized":"2023-10-16T19:58:05.902674+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_clean_scrub_stamp":"2023-10-16T19:58:03.569082+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:57:52.788971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:06.599279+0000","last_change":"2023-10-16T19:58:05.607547+0000","last_active":"2023-10-16T19:58:06.599279+0000","last_peered":"2023-10-16T19:58:06.599279+0000","last_clean":"2023-10-16T19:58:06.599279+0000","last_became_active":"2023-10-16T19:58:05.607311+0000","last_became_peered":"2023-10-16T19:58:05.607311+0000","last_unstale":"2023-10-16T19:58:06.599279+0000","last_undegraded":"2023-10-16T19:58:06.599279+0000","last_fullsized":"2023-10-16T19:58:06.599279+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:04:38.247560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.904154+0000","last_change":"2023-10-16T19:58:04.583596+0000","last_active":"2023-10-16T19:58:05.904154+0000","last_peered":"2023-10-16T19:58:05.904154+0000","last_clean":"2023-10-16T19:58:05.904154+0000","last_became_active":"2023-10-16T19:58:04.583346+0000","last_became_peered":"2023-10-16T19:58:04.583346+0000","last_unstale":"2023-10-16T19:58:05.904154+0000","last_undegraded":"2023-10-16T19:58:05.904154+0000","last_fullsized":"2023-10-16T19:58:05.904154+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_clean_scrub_stamp":"2023-10-16T19:58:03.569082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:08:50.287071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:06.599374+0000","last_change":"2023-10-16T19:58:05.605758+0000","last_active":"2023-10-16T19:58:06.599374+0000","last_peered":"2023-10-16T19:58:06.599374+0000","last_clean":"2023-10-16T19:58:06.599374+0000","last_became_active":"2023-10-16T19:58:05.605529+0000","last_became_peered":"2023-10-16T19:58:05.605529+0000","last_unstale":"2023-10-16T19:58:06.599374+0000","last_undegraded":"2023-10-16T19:58:06.599374+0000","last_fullsized":"2023-10-16T19:58:06.599374+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:56:22.040826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.903243+0000","last_change":"2023-10-16T19:58:04.590215+0000","last_active":"2023-10-16T19:58:05.903243+0000","last_peered":"2023-10-16T19:58:05.903243+0000","last_clean":"2023-10-16T19:58:05.903243+0000","last_became_active":"2023-10-16T19:58:04.589542+0000","last_became_peered":"2023-10-16T19:58:04.589542+0000","last_unstale":"2023-10-16T19:58:05.903243+0000","last_undegraded":"2023-10-16T19:58:05.903243+0000","last_fullsized":"2023-10-16T19:58:05.903243+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_clean_scrub_stamp":"2023-10-16T19:58:03.569082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:57:52.788971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:08.049050+0000","last_change":"2023-10-16T19:58:05.608889+0000","last_active":"2023-10-16T19:58:08.049050+0000","last_peered":"2023-10-16T19:58:08.049050+0000","last_clean":"2023-10-16T19:58:08.049050+0000","last_became_active":"2023-10-16T19:58:05.608517+0000","last_became_peered":"2023-10-16T19:58:05.608517+0000","last_unstale":"2023-10-16T19:58:08.049050+0000","last_undegraded":"2023-10-16T19:58:08.049050+0000","last_fullsized":"2023-10-16T19:58:08.049050+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:25:36.321203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.904109+0000","last_change":"2023-10-16T19:58:04.587619+0000","last_active":"2023-10-16T19:58:05.904109+0000","last_peered":"2023-10-16T19:58:05.904109+0000","last_clean":"2023-10-16T19:58:05.904109+0000","last_became_active":"2023-10-16T19:58:04.587332+0000","last_became_peered":"2023-10-16T19:58:04.587332+0000","last_unstale":"2023-10-16T19:58:05.904109+0000","last_undegraded":"2023-10-16T19:58:05.904109+0000","last_fullsized":"2023-10-16T19:58:05.904109+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_clean_scrub_stamp":"2023-10-16T19:58:03.569082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:09:03.659551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:06.599401+0000","last_change":"2023-10-16T19:58:05.600830+0000","last_active":"2023-10-16T19:58:06.599401+0000","last_peered":"2023-10-16T19:58:06.599401+0000","last_clean":"2023-10-16T19:58:06.599401+0000","last_became_active":"2023-10-16T19:58:05.600305+0000","last_became_peered":"2023-10-16T19:58:05.600305+0000","last_unstale":"2023-10-16T19:58:06.599401+0000","last_undegraded":"2023-10-16T19:58:06.599401+0000","last_fullsized":"2023-10-16T19:58:06.599401+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:43:32.505853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"32'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.900264+0000","last_change":"2023-10-16T19:58:04.582724+0000","last_active":"2023-10-16T19:58:05.900264+0000","last_peered":"2023-10-16T19:58:05.900264+0000","last_clean":"2023-10-16T19:58:05.900264+0000","last_became_active":"2023-10-16T19:58:04.582012+0000","last_became_peered":"2023-10-16T19:58:04.582012+0000","last_unstale":"2023-10-16T19:58:05.900264+0000","last_undegraded":"2023-10-16T19:58:05.900264+0000","last_fullsized":"2023-10-16T19:58:05.900264+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_clean_scrub_stamp":"2023-10-16T19:58:03.569082+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:55:48.953087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:06.908225+0000","last_change":"2023-10-16T19:58:05.602250+0000","last_active":"2023-10-16T19:58:06.908225+0000","last_peered":"2023-10-16T19:58:06.908225+0000","last_clean":"2023-10-16T19:58:06.908225+0000","last_became_active":"2023-10-16T19:58:05.600830+0000","last_became_peered":"2023-10-16T19:58:05.600830+0000","last_unstale":"2023-10-16T19:58:06.908225+0000","last_undegraded":"2023-10-16T19:58:06.908225+0000","last_fullsized":"2023-10-16T19:58:06.908225+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:17:36.021934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"33'1","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:06.600649+0000","last_change":"2023-10-16T19:58:04.587844+0000","last_active":"2023-10-16T19:58:06.600649+0000","last_peered":"2023-10-16T19:58:06.600649+0000","last_clean":"2023-10-16T19:58:06.600649+0000","last_became_active":"2023-10-16T19:58:04.587329+0000","last_became_peered":"2023-10-16T19:58:04.587329+0000","last_unstale":"2023-10-16T19:58:06.600649+0000","last_undegraded":"2023-10-16T19:58:06.600649+0000","last_fullsized":"2023-10-16T19:58:06.600649+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_clean_scrub_stamp":"2023-10-16T19:58:03.569082+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:55:48.953087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:06.600449+0000","last_change":"2023-10-16T19:58:05.606214+0000","last_active":"2023-10-16T19:58:06.600449+0000","last_peered":"2023-10-16T19:58:06.600449+0000","last_clean":"2023-10-16T19:58:06.600449+0000","last_became_active":"2023-10-16T19:58:05.605958+0000","last_became_peered":"2023-10-16T19:58:05.605958+0000","last_unstale":"2023-10-16T19:58:06.600449+0000","last_undegraded":"2023-10-16T19:58:06.600449+0000","last_fullsized":"2023-10-16T19:58:06.600449+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:26:46.150630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.900321+0000","last_change":"2023-10-16T19:58:04.587092+0000","last_active":"2023-10-16T19:58:05.900321+0000","last_peered":"2023-10-16T19:58:05.900321+0000","last_clean":"2023-10-16T19:58:05.900321+0000","last_became_active":"2023-10-16T19:58:04.586851+0000","last_became_peered":"2023-10-16T19:58:04.586851+0000","last_unstale":"2023-10-16T19:58:05.900321+0000","last_undegraded":"2023-10-16T19:58:05.900321+0000","last_fullsized":"2023-10-16T19:58:05.900321+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_clean_scrub_stamp":"2023-10-16T19:58:03.569082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:36:39.376783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:07.027640+0000","last_change":"2023-10-16T19:58:05.606520+0000","last_active":"2023-10-16T19:58:07.027640+0000","last_peered":"2023-10-16T19:58:07.027640+0000","last_clean":"2023-10-16T19:58:07.027640+0000","last_became_active":"2023-10-16T19:58:05.606081+0000","last_became_peered":"2023-10-16T19:58:05.606081+0000","last_unstale":"2023-10-16T19:58:07.027640+0000","last_undegraded":"2023-10-16T19:58:07.027640+0000","last_fullsized":"2023-10-16T19:58:07.027640+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:26:46.150630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.902760+0000","last_change":"2023-10-16T19:58:04.588408+0000","last_active":"2023-10-16T19:58:05.902760+0000","last_peered":"2023-10-16T19:58:05.902760+0000","last_clean":"2023-10-16T19:58:05.902760+0000","last_became_active":"2023-10-16T19:58:04.588050+0000","last_became_peered":"2023-10-16T19:58:04.588050+0000","last_unstale":"2023-10-16T19:58:05.902760+0000","last_undegraded":"2023-10-16T19:58:05.902760+0000","last_fullsized":"2023-10-16T19:58:05.902760+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_clean_scrub_stamp":"2023-10-16T19:58:03.569082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:36:39.376783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:06.600631+0000","last_change":"2023-10-16T19:58:05.607522+0000","last_active":"2023-10-16T19:58:06.600631+0000","last_peered":"2023-10-16T19:58:06.600631+0000","last_clean":"2023-10-16T19:58:06.600631+0000","last_became_active":"2023-10-16T19:58:05.607381+0000","last_became_peered":"2023-10-16T19:58:05.607381+0000","last_unstale":"2023-10-16T19:58:06.600631+0000","last_undegraded":"2023-10-16T19:58:06.600631+0000","last_fullsized":"2023-10-16T19:58:06.600631+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:07:11.937484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.900254+0000","last_change":"2023-10-16T19:58:04.582574+0000","last_active":"2023-10-16T19:58:05.900254+0000","last_peered":"2023-10-16T19:58:05.900254+0000","last_clean":"2023-10-16T19:58:05.900254+0000","last_became_active":"2023-10-16T19:58:04.581711+0000","last_became_peered":"2023-10-16T19:58:04.581711+0000","last_unstale":"2023-10-16T19:58:05.900254+0000","last_undegraded":"2023-10-16T19:58:05.900254+0000","last_fullsized":"2023-10-16T19:58:05.900254+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_clean_scrub_stamp":"2023-10-16T19:58:03.569082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:57:52.788971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:07.027751+0000","last_change":"2023-10-16T19:58:05.602722+0000","last_active":"2023-10-16T19:58:07.027751+0000","last_peered":"2023-10-16T19:58:07.027751+0000","last_clean":"2023-10-16T19:58:07.027751+0000","last_became_active":"2023-10-16T19:58:05.602184+0000","last_became_peered":"2023-10-16T19:58:05.602184+0000","last_unstale":"2023-10-16T19:58:07.027751+0000","last_undegraded":"2023-10-16T19:58:07.027751+0000","last_fullsized":"2023-10-16T19:58:07.027751+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:16:44.802078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.903097+0000","last_change":"2023-10-16T19:58:04.589600+0000","last_active":"2023-10-16T19:58:05.903097+0000","last_peered":"2023-10-16T19:58:05.903097+0000","last_clean":"2023-10-16T19:58:05.903097+0000","last_became_active":"2023-10-16T19:58:04.587683+0000","last_became_peered":"2023-10-16T19:58:04.587683+0000","last_unstale":"2023-10-16T19:58:05.903097+0000","last_undegraded":"2023-10-16T19:58:05.903097+0000","last_fullsized":"2023-10-16T19:58:05.903097+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_clean_scrub_stamp":"2023-10-16T19:58:03.569082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:56:21.036265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:06.600727+0000","last_change":"2023-10-16T19:58:05.601329+0000","last_active":"2023-10-16T19:58:06.600727+0000","last_peered":"2023-10-16T19:58:06.600727+0000","last_clean":"2023-10-16T19:58:06.600727+0000","last_became_active":"2023-10-16T19:58:05.601074+0000","last_became_peered":"2023-10-16T19:58:05.601074+0000","last_unstale":"2023-10-16T19:58:06.600727+0000","last_undegraded":"2023-10-16T19:58:06.600727+0000","last_fullsized":"2023-10-16T19:58:06.600727+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:26:46.150630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.900213+0000","last_change":"2023-10-16T19:58:04.588810+0000","last_active":"2023-10-16T19:58:05.900213+0000","last_peered":"2023-10-16T19:58:05.900213+0000","last_clean":"2023-10-16T19:58:05.900213+0000","last_became_active":"2023-10-16T19:58:04.588392+0000","last_became_peered":"2023-10-16T19:58:04.588392+0000","last_unstale":"2023-10-16T19:58:05.900213+0000","last_undegraded":"2023-10-16T19:58:05.900213+0000","last_fullsized":"2023-10-16T19:58:05.900213+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_clean_scrub_stamp":"2023-10-16T19:58:03.569082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:41:57.381509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:08.049197+0000","last_change":"2023-10-16T19:58:05.609385+0000","last_active":"2023-10-16T19:58:08.049197+0000","last_peered":"2023-10-16T19:58:08.049197+0000","last_clean":"2023-10-16T19:58:08.049197+0000","last_became_active":"2023-10-16T19:58:05.609118+0000","last_became_peered":"2023-10-16T19:58:05.609118+0000","last_unstale":"2023-10-16T19:58:08.049197+0000","last_undegraded":"2023-10-16T19:58:08.049197+0000","last_fullsized":"2023-10-16T19:58:08.049197+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:23:18.475974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.904186+0000","last_change":"2023-10-16T19:58:04.586182+0000","last_active":"2023-10-16T19:58:05.904186+0000","last_peered":"2023-10-16T19:58:05.904186+0000","last_clean":"2023-10-16T19:58:05.904186+0000","last_became_active":"2023-10-16T19:58:04.585930+0000","last_became_peered":"2023-10-16T19:58:04.585930+0000","last_unstale":"2023-10-16T19:58:05.904186+0000","last_undegraded":"2023-10-16T19:58:05.904186+0000","last_fullsized":"2023-10-16T19:58:05.904186+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_clean_scrub_stamp":"2023-10-16T19:58:03.569082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:50:59.901042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":175,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-16T19:58:05.602583+0000","last_change":"2023-10-16T19:56:58.775782+0000","last_active":"2023-10-16T19:58:05.602583+0000","last_peered":"2023-10-16T19:58:05.602583+0000","last_clean":"2023-10-16T19:58:05.602583+0000","last_became_active":"2023-10-16T19:56:58.775567+0000","last_became_peered":"2023-10-16T19:56:58.775567+0000","last_unstale":"2023-10-16T19:58:05.602583+0000","last_undegraded":"2023-10-16T19:58:05.602583+0000","last_fullsized":"2023-10-16T19:58:05.602583+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:56:57.693332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:56:57.693332+0000","last_clean_scrub_stamp":"2023-10-16T19:56:57.693332+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:10:23.849736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574866,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":718,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194594,"statfs":{"total":200000000,"available":199264318,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 19:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.60399999999999998}]},{"osd":1,"last update":"Mon Oct 16 19:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.435},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.56200000000000006}]},{"osd":2,"last update":"Mon Oct 16 19:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.52100000000000002}]},{"osd":3,"last update":"Mon Oct 16 19:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.65400000000000003}]},{"osd":4,"last update":"Mon Oct 16 19:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.63200000000000001}]},{"osd":5,"last update":"Mon Oct 16 19:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"last":0.622}]},{"osd":6,"last update":"Mon Oct 16 19:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.66600000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574866,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":142,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195170,"statfs":{"total":200000000,"available":199854160,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 19:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":7.6479999999999997},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":7.6630000000000003}]},{"osd":1,"last update":"Mon Oct 16 19:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.49199999999999999}]},{"osd":2,"last update":"Mon Oct 16 19:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":8.2829999999999995},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.50600000000000001}]},{"osd":3,"last update":"Mon Oct 16 19:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":8.3339999999999996}]},{"osd":4,"last update":"Mon Oct 16 19:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.38900000000000001}]},{"osd":5,"last update":"Mon Oct 16 19:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.435},{"interface":"front","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.57599999999999996}]},{"osd":7,"last update":"Mon Oct 16 19:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.52100000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574866,"num_pgs":32,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":143,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195169,"statfs":{"total":200000000,"available":199853142,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 19:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"min":{"1min":0.19700000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"last":0.28699999999999998},{"interface":"front","average":{"1min":0.309,"5min":0.309,"15min":0.309},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"last":0.316}]},{"osd":2,"last update":"Mon Oct 16 19:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.443,"5min":0.443,"15min":0.443},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"last":0.35399999999999998}]},{"osd":3,"last update":"Mon Oct 16 19:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"last":0.374}]},{"osd":4,"last update":"Mon Oct 16 19:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.55400000000000005}]},{"osd":5,"last update":"Mon Oct 16 19:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.54400000000000004}]},{"osd":6,"last update":"Mon Oct 16 19:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.499}]},{"osd":7,"last update":"Mon Oct 16 19:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.46100000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574866,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":718,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194594,"statfs":{"total":200000000,"available":199264408,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 16 19:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":11.031000000000001,"5min":11.031000000000001,"15min":11.031000000000001},"last":0.41199999999999998},{"interface":"front","average":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":12.218,"5min":12.218,"15min":12.218},"last":0.434}]},{"osd":2,"last update":"Mon Oct 16 19:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":11.058,"5min":11.058,"15min":11.058},"last":0.34999999999999998},{"interface":"front","average":{"1min":1.123,"5min":1.123,"15min":1.123},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":14.763999999999999,"5min":14.763999999999999,"15min":14.763999999999999},"last":0.38900000000000001}]},{"osd":3,"last update":"Mon Oct 16 19:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":10.935,"5min":10.935,"15min":10.935},"last":0.371},{"interface":"front","average":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":11.083,"5min":11.083,"15min":11.083},"last":0.44900000000000001}]},{"osd":4,"last update":"Mon Oct 16 19:57:58 2023","interfaces":[{"interface":"back","average":{"1min":1.196,"5min":1.196,"15min":1.196},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":12.279,"5min":12.279,"15min":12.279},"last":0.48099999999999998},{"interface":"front","average":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":10.879,"5min":10.879,"15min":10.879},"last":0.46200000000000002}]},{"osd":5,"last update":"Mon Oct 16 19:57:58 2023","interfaces":[{"interface":"back","average":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":10.907,"5min":10.907,"15min":10.907},"last":0.42199999999999999},{"interface":"front","average":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":11,"5min":11,"15min":11},"last":0.53100000000000003}]},{"osd":6,"last update":"Mon Oct 16 19:57:58 2023","interfaces":[{"interface":"back","average":{"1min":1.157,"5min":1.157,"15min":1.157},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":10.972,"5min":10.972,"15min":10.972},"last":0.497},{"interface":"front","average":{"1min":1.24,"5min":1.24,"15min":1.24},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":12.34,"5min":12.34,"15min":12.34},"last":0.54800000000000004}]},{"osd":7,"last update":"Mon Oct 16 19:57:58 2023","interfaces":[{"interface":"back","average":{"1min":1.252,"5min":1.252,"15min":1.252},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":12.311,"5min":12.311,"15min":12.311},"last":0.51800000000000002},{"interface":"front","average":{"1min":1.167,"5min":1.167,"15min":1.167},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":10.845000000000001,"5min":10.845000000000001,"15min":10.845000000000001},"last":0.50600000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574866,"num_pgs":17,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":141,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195170,"statfs":{"total":200000000,"available":199854706,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 19:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"min":{"1min":0.17899999999999999,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"last":0.248},{"interface":"front","average":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"min":{"1min":0.20100000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.29999999999999999}]},{"osd":1,"last update":"Mon Oct 16 19:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.375,"15min":0.375},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.37,"5min":0.37,"15min":0.37},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"last":0.35299999999999998}]},{"osd":3,"last update":"Mon Oct 16 19:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.318}]},{"osd":4,"last update":"Mon Oct 16 19:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.48299999999999998}]},{"osd":5,"last update":"Mon Oct 16 19:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.46300000000000002}]},{"osd":6,"last update":"Mon Oct 16 19:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.51600000000000001}]},{"osd":7,"last update":"Mon Oct 16 19:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.47199999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574866,"num_pgs":31,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":143,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195169,"statfs":{"total":200000000,"available":199853142,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 19:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"last":0.20699999999999999},{"interface":"front","average":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.498,"5min":0.498,"15min":0.498},"last":0.28999999999999998}]},{"osd":1,"last update":"Mon Oct 16 19:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"last":0.309},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"min":{"1min":0.20499999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.27500000000000002}]},{"osd":2,"last update":"Mon Oct 16 19:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.35099999999999998}]},{"osd":4,"last update":"Mon Oct 16 19:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.46700000000000003}]},{"osd":5,"last update":"Mon Oct 16 19:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.57199999999999995}]},{"osd":6,"last update":"Mon Oct 16 19:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.49099999999999999}]},{"osd":7,"last update":"Mon Oct 16 19:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.2030000000000001,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.139,"5min":1.139,"15min":1.139},"last":0.56200000000000006}]}]},{"osd":4,"up_from":13,"seq":55834574866,"num_pgs":29,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":141,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195170,"statfs":{"total":200000000,"available":199854672,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 19:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.51600000000000001}]},{"osd":1,"last update":"Mon Oct 16 19:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.034,"5min":1.034,"15min":1.034},"last":0.376},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.40600000000000003}]},{"osd":2,"last update":"Mon Oct 16 19:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.103,"5min":1.103,"15min":1.103},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.503}]},{"osd":3,"last update":"Mon Oct 16 19:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.071,"5min":1.071,"15min":1.071},"last":0.57999999999999996}]},{"osd":5,"last update":"Mon Oct 16 19:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.56100000000000005}]},{"osd":6,"last update":"Mon Oct 16 19:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.53100000000000003}]},{"osd":7,"last update":"Mon Oct 16 19:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.48699999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574866,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":142,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195170,"statfs":{"total":200000000,"available":199854104,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 19:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.40400000000000003}]},{"osd":1,"last update":"Mon Oct 16 19:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":7.9989999999999997,"5min":7.9989999999999997,"15min":7.9989999999999997},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":8.0150000000000006,"5min":8.0150000000000006,"15min":8.0150000000000006},"last":0.43099999999999999}]},{"osd":2,"last update":"Mon Oct 16 19:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":1.032,"5min":1.032,"15min":1.032},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.38300000000000001}]},{"osd":3,"last update":"Mon Oct 16 19:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":8.077,"5min":8.077,"15min":8.077},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.5}]},{"osd":4,"last update":"Mon Oct 16 19:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.59499999999999997}]},{"osd":6,"last update":"Mon Oct 16 19:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.57799999999999996}]},{"osd":7,"last update":"Mon Oct 16 19:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.56599999999999995}]}]}],"pool_statfs":[]}} 2023-10-16T19:58:20.393 INFO:tasks.ceph:pgid 5.3f last_scrub_stamp 2023-10-16T19:58:04.573644+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=4, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=15, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:58:20.394 INFO:tasks.ceph:pgid 5.3e last_scrub_stamp 2023-10-16T19:58:04.573644+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=4, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=15, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:58:20.395 INFO:tasks.ceph:pgid 5.3d last_scrub_stamp 2023-10-16T19:58:04.573644+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=4, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=15, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:58:20.395 INFO:tasks.ceph:pgid 5.3c last_scrub_stamp 2023-10-16T19:58:04.573644+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=4, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=15, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:58:20.395 INFO:tasks.ceph:pgid 5.3b last_scrub_stamp 2023-10-16T19:58:04.573644+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=4, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=15, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:58:20.396 INFO:tasks.ceph:pgid 5.3a last_scrub_stamp 2023-10-16T19:58:04.573644+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=4, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=15, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:58:20.396 INFO:tasks.ceph:pgid 5.39 last_scrub_stamp 2023-10-16T19:58:04.573644+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=4, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=15, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:58:20.396 INFO:tasks.ceph:pgid 5.38 last_scrub_stamp 2023-10-16T19:58:04.573644+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=4, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=15, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:58:20.397 INFO:tasks.ceph:pgid 5.37 last_scrub_stamp 2023-10-16T19:58:04.573644+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=4, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=15, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:58:20.397 INFO:tasks.ceph:pgid 5.36 last_scrub_stamp 2023-10-16T19:58:04.573644+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=4, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=15, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:58:20.398 INFO:tasks.ceph:pgid 5.35 last_scrub_stamp 2023-10-16T19:58:04.573644+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=4, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=15, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:58:20.398 INFO:tasks.ceph:pgid 5.34 last_scrub_stamp 2023-10-16T19:58:04.573644+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=4, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=15, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:58:20.401 INFO:tasks.ceph:pgid 5.33 last_scrub_stamp 2023-10-16T19:58:04.573644+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=4, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=15, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:58:20.401 INFO:tasks.ceph:pgid 5.32 last_scrub_stamp 2023-10-16T19:58:04.573644+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=4, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=15, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:58:20.402 INFO:tasks.ceph:pgid 5.31 last_scrub_stamp 2023-10-16T19:58:04.573644+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=4, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=15, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:58:20.402 INFO:tasks.ceph:pgid 5.30 last_scrub_stamp 2023-10-16T19:58:04.573644+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=4, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=15, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:58:20.402 INFO:tasks.ceph:pgid 5.2f last_scrub_stamp 2023-10-16T19:58:04.573644+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=4, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=15, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:58:20.403 INFO:tasks.ceph:pgid 5.2e last_scrub_stamp 2023-10-16T19:58:04.573644+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=4, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=15, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:58:20.403 INFO:tasks.ceph:pgid 5.2d last_scrub_stamp 2023-10-16T19:58:04.573644+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=4, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=15, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:58:20.403 INFO:tasks.ceph:pgid 5.2c last_scrub_stamp 2023-10-16T19:58:04.573644+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=4, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=15, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:58:20.404 INFO:tasks.ceph:pgid 5.2b last_scrub_stamp 2023-10-16T19:58:04.573644+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=4, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=15, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:58:20.404 INFO:tasks.ceph:pgid 5.2a last_scrub_stamp 2023-10-16T19:58:04.573644+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=4, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=15, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:58:20.405 INFO:tasks.ceph:pgid 5.29 last_scrub_stamp 2023-10-16T19:58:04.573644+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=4, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=15, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:58:20.405 INFO:tasks.ceph:pgid 5.28 last_scrub_stamp 2023-10-16T19:58:04.573644+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=4, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=15, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:58:20.405 INFO:tasks.ceph:pgid 5.27 last_scrub_stamp 2023-10-16T19:58:04.573644+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=4, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=15, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:58:20.406 INFO:tasks.ceph:pgid 5.26 last_scrub_stamp 2023-10-16T19:58:04.573644+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=4, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=15, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:58:20.406 INFO:tasks.ceph:pgid 5.25 last_scrub_stamp 2023-10-16T19:58:04.573644+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=4, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=15, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:58:20.406 INFO:tasks.ceph:pgid 5.24 last_scrub_stamp 2023-10-16T19:58:04.573644+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=4, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=15, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:58:20.407 INFO:tasks.ceph:pgid 5.23 last_scrub_stamp 2023-10-16T19:58:04.573644+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=4, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=15, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:58:20.407 INFO:tasks.ceph:pgid 5.22 last_scrub_stamp 2023-10-16T19:58:04.573644+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=4, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=15, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:58:20.408 INFO:tasks.ceph:pgid 5.21 last_scrub_stamp 2023-10-16T19:58:04.573644+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=4, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=15, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:58:20.408 INFO:tasks.ceph:pgid 5.20 last_scrub_stamp 2023-10-16T19:58:04.573644+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=4, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=15, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:58:20.408 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2023-10-16T19:58:04.573644+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=4, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=15, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:58:20.409 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2023-10-16T19:58:03.569082+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=3, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=15, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:58:20.409 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2023-10-16T19:58:04.573644+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=4, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=15, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:58:20.409 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2023-10-16T19:58:03.569082+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=3, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=15, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:58:20.410 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2023-10-16T19:58:04.573644+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=4, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=15, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:58:20.410 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2023-10-16T19:58:03.569082+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=3, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=15, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:58:20.411 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2023-10-16T19:58:04.573644+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=4, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=15, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:58:20.411 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2023-10-16T19:58:03.569082+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=3, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=15, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:58:20.411 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2023-10-16T19:58:04.573644+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=4, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=15, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:58:20.412 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2023-10-16T19:58:03.569082+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=3, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=15, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:58:20.412 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2023-10-16T19:58:04.573644+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=4, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=15, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:58:20.412 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2023-10-16T19:58:03.569082+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=3, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=15, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:58:20.413 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2023-10-16T19:58:04.573644+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=4, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=15, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:58:20.413 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2023-10-16T19:58:03.569082+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=3, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=15, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:58:20.414 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2023-10-16T19:58:04.573644+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=4, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=15, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:58:20.414 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2023-10-16T19:58:03.569082+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=3, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=15, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:58:20.414 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2023-10-16T19:58:04.573644+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=4, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=15, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:58:20.415 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2023-10-16T19:58:03.569082+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=3, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=15, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:58:20.415 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2023-10-16T19:58:04.573644+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=4, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=15, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:58:20.415 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2023-10-16T19:58:03.569082+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=3, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=15, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:58:20.416 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2023-10-16T19:58:04.573644+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=4, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=15, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:58:20.416 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2023-10-16T19:58:03.569082+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=3, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=15, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:58:20.417 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2023-10-16T19:58:04.573644+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=4, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=15, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:58:20.417 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2023-10-16T19:58:03.569082+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=3, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=15, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:58:20.417 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2023-10-16T19:58:04.573644+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=4, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=15, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:58:20.418 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2023-10-16T19:58:03.569082+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=3, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=15, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:58:20.418 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2023-10-16T19:58:04.573644+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=4, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=15, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:58:20.418 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2023-10-16T19:58:03.569082+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=3, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=15, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:58:20.419 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2023-10-16T19:58:04.573644+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=4, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=15, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:58:20.419 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2023-10-16T19:58:03.569082+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=3, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=15, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:58:20.419 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2023-10-16T19:58:04.573644+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=4, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=15, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:58:20.420 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2023-10-16T19:58:03.569082+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=3, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=15, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:58:20.420 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2023-10-16T19:58:04.573644+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=4, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=15, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:58:20.421 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2023-10-16T19:58:03.569082+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=3, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=15, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:58:20.421 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2023-10-16T19:58:04.573644+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=4, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=15, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:58:20.421 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2023-10-16T19:58:03.569082+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=3, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=15, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:58:20.422 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2023-10-16T19:58:04.573644+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=4, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=15, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:58:20.422 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2023-10-16T19:58:03.569082+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=3, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=15, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:58:20.422 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2023-10-16T19:58:04.573644+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=4, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=15, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:58:20.423 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2023-10-16T19:58:03.569082+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=3, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=15, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:58:20.423 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2023-10-16T19:58:04.573644+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=4, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=15, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:58:20.424 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2023-10-16T19:58:03.569082+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=3, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=15, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:58:20.424 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2023-10-16T19:58:04.573644+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=4, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=15, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:58:20.424 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2023-10-16T19:58:03.569082+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=3, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=15, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:58:20.425 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2023-10-16T19:58:04.573644+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=4, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=15, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:58:20.425 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2023-10-16T19:58:03.569082+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=3, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=15, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:58:20.425 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2023-10-16T19:58:04.573644+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=4, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=15, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:58:20.426 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2023-10-16T19:58:03.569082+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=3, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=15, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:58:20.426 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2023-10-16T19:58:04.573644+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=4, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=15, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:58:20.427 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2023-10-16T19:58:03.569082+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=3, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=15, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:58:20.427 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2023-10-16T19:58:04.573644+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=4, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=15, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:58:20.427 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2023-10-16T19:58:03.569082+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=3, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=15, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:58:20.428 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2023-10-16T19:58:04.573644+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=4, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=15, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:58:20.428 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2023-10-16T19:58:03.569082+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=3, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=15, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:58:20.429 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2023-10-16T19:58:04.573644+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=4, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=15, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:58:20.429 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2023-10-16T19:58:03.569082+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=3, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=15, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:58:20.429 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2023-10-16T19:58:04.573644+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=4, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=15, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:58:20.430 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2023-10-16T19:58:03.569082+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=3, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=15, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:58:20.430 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2023-10-16T19:58:04.573644+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=4, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=15, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:58:20.431 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2023-10-16T19:58:03.569082+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=3, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=15, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:58:20.431 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2023-10-16T19:58:04.573644+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=4, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=15, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:58:20.431 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2023-10-16T19:58:03.569082+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=3, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=15, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:58:20.432 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2023-10-16T19:58:04.573644+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=4, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=15, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:58:20.432 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2023-10-16T19:58:03.569082+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=3, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=15, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:58:20.432 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-10-16T19:56:57.693332+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=56, tm_sec=57, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=15, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:58:20.433 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-16T19:58:37.163 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T19:58:37.166 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T19:58:40.434 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-16T19:58:40.569 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:40.566+0000 7f88cc8a4700 1 Processor -- start 2023-10-16T19:58:40.569 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:40.566+0000 7f88cc8a4700 1 -- start start 2023-10-16T19:58:40.571 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:40.567+0000 7f88cc8a4700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f88c80b76e0 0x7f88c80cd870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:40.572 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:40.567+0000 7f88cc8a4700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f88c80cddb0 0x7f88c80d0e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:40.572 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:40.567+0000 7f88cc8a4700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88c80cf920 con 0x7f88c815bf50 2023-10-16T19:58:40.572 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:40.567+0000 7f88cc8a4700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88c80cc4b0 con 0x7f88c80b76e0 2023-10-16T19:58:40.572 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:40.567+0000 7f88cc8a4700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88c80cfc00 con 0x7f88c80cddb0 2023-10-16T19:58:40.573 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:40.568+0000 7f88c5d9b700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f88c80b76e0 0x7f88c80cd870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:40.573 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:40.568+0000 7f88c5d9b700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f88c80b76e0 0x7f88c80cd870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:48110/0 (socket says 172.21.15.157:48110) 2023-10-16T19:58:40.573 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:40.568+0000 7f88c5d9b700 1 -- 172.21.15.157:0/4038591289 learned_addr learned my addr 172.21.15.157:0/4038591289 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:58:40.574 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:40.568+0000 7f88c6d9d700 1 --2- 172.21.15.157:0/4038591289 >> v2:172.21.15.187:3300/0 conn(0x7f88c80cddb0 0x7f88c80d0e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:40.574 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:40.568+0000 7f88c5d9b700 1 -- 172.21.15.157:0/4038591289 >> v2:172.21.15.187:3300/0 conn(0x7f88c80cddb0 msgr2=0x7f88c80d0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:58:40.574 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:40.568+0000 7f88c5d9b700 1 --2- 172.21.15.157:0/4038591289 >> v2:172.21.15.187:3300/0 conn(0x7f88c80cddb0 0x7f88c80d0e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:40.574 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:40.568+0000 7f88c5d9b700 1 -- 172.21.15.157:0/4038591289 >> v1:172.21.15.187:6789/0 conn(0x7f88c815bf50 legacy=0x7f88c80cef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:58:40.575 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:40.568+0000 7f88c5d9b700 1 -- 172.21.15.157:0/4038591289 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88c80cfee0 con 0x7f88c80b76e0 2023-10-16T19:58:40.575 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:40.568+0000 7f88c5d9b700 1 --2- 172.21.15.157:0/4038591289 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f88c80b76e0 0x7f88c80cd870 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f88c80cd640 tx=0x7f88b8009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb7f2fafc82eacfc server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:58:40.575 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:40.568+0000 7f88c559a700 1 -- 172.21.15.157:0/4038591289 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88b8004230 con 0x7f88c80b76e0 2023-10-16T19:58:40.576 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:40.568+0000 7f88c559a700 1 -- 172.21.15.157:0/4038591289 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88b8004390 con 0x7f88c80b76e0 2023-10-16T19:58:40.576 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:40.568+0000 7f88c559a700 1 -- 172.21.15.157:0/4038591289 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88b80036a0 con 0x7f88c80b76e0 2023-10-16T19:58:40.576 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:40.569+0000 7f88cc8a4700 1 -- 172.21.15.157:0/4038591289 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f88c80b76e0 msgr2=0x7f88c80cd870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:40.576 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:40.569+0000 7f88cc8a4700 1 --2- 172.21.15.157:0/4038591289 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f88c80b76e0 0x7f88c80cd870 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f88c80cd640 tx=0x7f88b8009bd0 comp rx=0 tx=0).stop 2023-10-16T19:58:40.577 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:40.569+0000 7f88cc8a4700 1 -- 172.21.15.157:0/4038591289 shutdown_connections 2023-10-16T19:58:40.577 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:40.569+0000 7f88cc8a4700 1 --2- 172.21.15.157:0/4038591289 >> v2:172.21.15.187:3300/0 conn(0x7f88c80cddb0 0x7f88c80d0e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:40.577 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:40.569+0000 7f88cc8a4700 1 --2- 172.21.15.157:0/4038591289 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f88c80b76e0 0x7f88c80cd870 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:40.578 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:40.569+0000 7f88cc8a4700 1 -- 172.21.15.157:0/4038591289 >> 172.21.15.157:0/4038591289 conn(0x7f88c806e300 msgr2=0x7f88c806e6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:58:40.578 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:40.569+0000 7f88cc8a4700 1 -- 172.21.15.157:0/4038591289 shutdown_connections 2023-10-16T19:58:40.578 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:40.569+0000 7f88cc8a4700 1 -- 172.21.15.157:0/4038591289 wait complete. 2023-10-16T19:58:40.581 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:40.570+0000 7f88cc8a4700 1 Processor -- start 2023-10-16T19:58:40.581 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:40.570+0000 7f88cc8a4700 1 -- start start 2023-10-16T19:58:40.581 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:40.571+0000 7f88cc8a4700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f88c80b76e0 0x7f88c80c5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:40.582 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:40.571+0000 7f88cc8a4700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f88c80cddb0 0x7f88c8145df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:40.582 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:40.571+0000 7f88cc8a4700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f88c815bf50 0x7f88c80c6ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:40.582 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:40.571+0000 7f88cc8a4700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88c80c5e00 con 0x7f88c80cddb0 2023-10-16T19:58:40.583 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:40.571+0000 7f88cc8a4700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88c80c60e0 con 0x7f88c80b76e0 2023-10-16T19:58:40.583 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:40.571+0000 7f88cc8a4700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88c80c63c0 con 0x7f88c815bf50 2023-10-16T19:58:40.583 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:40.571+0000 7f88c5d9b700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f88c80cddb0 0x7f88c8145df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:40.583 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:40.571+0000 7f88c5d9b700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f88c80cddb0 0x7f88c8145df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:48116/0 (socket says 172.21.15.157:48116) 2023-10-16T19:58:40.584 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:40.571+0000 7f88c5d9b700 1 -- 172.21.15.157:0/250135172 learned_addr learned my addr 172.21.15.157:0/250135172 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:58:40.584 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:40.571+0000 7f88c5d9b700 1 -- 172.21.15.157:0/250135172 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f88c815bf50 msgr2=0x7f88c80c6ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:40.584 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:40.571+0000 7f88c5d9b700 1 --2- 172.21.15.157:0/250135172 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f88c815bf50 0x7f88c80c6ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:40.584 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:40.571+0000 7f88c5d9b700 1 -- 172.21.15.157:0/250135172 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f88c80b76e0 msgr2=0x7f88c80c5700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:40.585 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:40.571+0000 7f88c659c700 1 --2- 172.21.15.157:0/250135172 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f88c80b76e0 0x7f88c80c5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:40.585 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:40.572+0000 7f88c5d9b700 1 --2- 172.21.15.157:0/250135172 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f88c80b76e0 0x7f88c80c5700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:40.585 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:40.572+0000 7f88c5d9b700 1 -- 172.21.15.157:0/250135172 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88b8009550 con 0x7f88c80cddb0 2023-10-16T19:58:40.586 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:40.572+0000 7f88c5d9b700 1 --2- 172.21.15.157:0/250135172 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f88c80cddb0 0x7f88c8145df0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f88c806e110 tx=0x7f88b8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:58:40.586 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:40.572+0000 7f88b6ffd700 1 -- 172.21.15.157:0/250135172 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88b8003de0 con 0x7f88c80cddb0 2023-10-16T19:58:40.586 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:40.572+0000 7f88b6ffd700 1 -- 172.21.15.157:0/250135172 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88b8011630 con 0x7f88c80cddb0 2023-10-16T19:58:40.587 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:40.572+0000 7f88cc8a4700 1 -- 172.21.15.157:0/250135172 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88c80c66a0 con 0x7f88c80cddb0 2023-10-16T19:58:40.587 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:40.572+0000 7f88b6ffd700 1 -- 172.21.15.157:0/250135172 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88b80119c0 con 0x7f88c80cddb0 2023-10-16T19:58:40.587 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:40.572+0000 7f88cc8a4700 1 -- 172.21.15.157:0/250135172 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88c8146330 con 0x7f88c80cddb0 2023-10-16T19:58:40.587 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:40.573+0000 7f88cc8a4700 1 -- 172.21.15.157:0/250135172 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88c80c6b60 con 0x7f88c80cddb0 2023-10-16T19:58:40.588 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:40.573+0000 7f88b6ffd700 1 -- 172.21.15.157:0/250135172 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f88b8021070 con 0x7f88c80cddb0 2023-10-16T19:58:40.588 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:40.574+0000 7f88b6ffd700 1 --2- 172.21.15.157:0/250135172 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f88a806af00 0x7f88a806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:58:40.588 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:40.574+0000 7f88b6ffd700 1 -- 172.21.15.157:0/250135172 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5729+0+0 (secure 0 0 0) 0x7f88b808aba0 con 0x7f88c80cddb0 2023-10-16T19:58:40.588 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:40.574+0000 7f88c659c700 1 --2- 172.21.15.157:0/250135172 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f88a806af00 0x7f88a806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:58:40.589 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:40.574+0000 7f88c659c700 1 --2- 172.21.15.157:0/250135172 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f88a806af00 0x7f88a806d3c0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f88c8152e30 tx=0x7f88bc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:58:40.589 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:40.578+0000 7f88b6ffd700 1 -- 172.21.15.157:0/250135172 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f88b8055cc0 con 0x7f88c80cddb0 2023-10-16T19:58:40.765 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:40.762+0000 7f88cc8a4700 1 -- 172.21.15.157:0/250135172 --> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f88c80d04a0 con 0x7f88a806af00 2023-10-16T19:58:40.774 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:40.771+0000 7f88b6ffd700 1 -- 172.21.15.157:0/250135172 <== mgr.4100 v2:172.21.15.187:6832/2426285296 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+283864 (secure 0 0 0) 0x7f88bc00a490 con 0x7f88a806af00 2023-10-16T19:58:40.778 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-10-16T19:58:40.781 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:40.774+0000 7f88cc8a4700 1 -- 172.21.15.157:0/250135172 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f88a806af00 msgr2=0x7f88a806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:40.781 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:40.774+0000 7f88cc8a4700 1 --2- 172.21.15.157:0/250135172 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f88a806af00 0x7f88a806d3c0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f88c8152e30 tx=0x7f88bc008040 comp rx=0 tx=0).stop 2023-10-16T19:58:40.781 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:40.774+0000 7f88cc8a4700 1 -- 172.21.15.157:0/250135172 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f88c80cddb0 msgr2=0x7f88c8145df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:58:40.781 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:40.774+0000 7f88cc8a4700 1 --2- 172.21.15.157:0/250135172 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f88c80cddb0 0x7f88c8145df0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f88c806e110 tx=0x7f88b8004750 comp rx=0 tx=0).stop 2023-10-16T19:58:40.782 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:40.774+0000 7f88cc8a4700 1 -- 172.21.15.157:0/250135172 shutdown_connections 2023-10-16T19:58:40.782 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:40.774+0000 7f88cc8a4700 1 --2- 172.21.15.157:0/250135172 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f88a806af00 0x7f88a806d3c0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:40.783 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:40.774+0000 7f88cc8a4700 1 --2- 172.21.15.157:0/250135172 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f88c80b76e0 0x7f88c80c5700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:40.783 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:40.774+0000 7f88cc8a4700 1 --2- 172.21.15.157:0/250135172 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f88c815bf50 0x7f88c80c6ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:40.783 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:40.774+0000 7f88cc8a4700 1 --2- 172.21.15.157:0/250135172 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f88c80cddb0 0x7f88c8145df0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:58:40.784 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:40.774+0000 7f88cc8a4700 1 -- 172.21.15.157:0/250135172 >> 172.21.15.157:0/250135172 conn(0x7f88c806e300 msgr2=0x7f88c8159900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:58:40.784 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:40.774+0000 7f88cc8a4700 1 -- 172.21.15.157:0/250135172 shutdown_connections 2023-10-16T19:58:40.784 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:58:40.774+0000 7f88cc8a4700 1 -- 172.21.15.157:0/250135172 wait complete. 2023-10-16T19:58:40.784 INFO:teuthology.orchestra.run.smithi157.stderr:dumped all 2023-10-16T19:58:40.789 INFO:teuthology.orchestra.run.smithi157.stdout:{"pg_ready":true,"pg_map":{"version":75,"stamp":"2023-10-16T19:58:38.913788+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":158,"ondisk_log_size":158,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":2292,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560207,"statfs":{"total":1600000000,"available":1597652652,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003357"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:07.027429+0000","last_change":"2023-10-16T19:58:05.597289+0000","last_active":"2023-10-16T19:58:07.027429+0000","last_peered":"2023-10-16T19:58:07.027429+0000","last_clean":"2023-10-16T19:58:07.027429+0000","last_became_active":"2023-10-16T19:58:05.597025+0000","last_became_peered":"2023-10-16T19:58:05.597025+0000","last_unstale":"2023-10-16T19:58:07.027429+0000","last_undegraded":"2023-10-16T19:58:07.027429+0000","last_fullsized":"2023-10-16T19:58:07.027429+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:07.027921+0000","last_change":"2023-10-16T19:58:05.606250+0000","last_active":"2023-10-16T19:58:07.027921+0000","last_peered":"2023-10-16T19:58:07.027921+0000","last_clean":"2023-10-16T19:58:07.027921+0000","last_became_active":"2023-10-16T19:58:05.605969+0000","last_became_peered":"2023-10-16T19:58:05.605969+0000","last_unstale":"2023-10-16T19:58:07.027921+0000","last_undegraded":"2023-10-16T19:58:07.027921+0000","last_fullsized":"2023-10-16T19:58:07.027921+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:31.829149+0000","last_change":"2023-10-16T19:58:31.829214+0000","last_active":"2023-10-16T19:58:31.829149+0000","last_peered":"2023-10-16T19:58:31.829149+0000","last_clean":"2023-10-16T19:58:31.829149+0000","last_became_active":"2023-10-16T19:58:05.601072+0000","last_became_peered":"2023-10-16T19:58:05.601072+0000","last_unstale":"2023-10-16T19:58:31.829149+0000","last_undegraded":"2023-10-16T19:58:31.829149+0000","last_fullsized":"2023-10-16T19:58:31.829149+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:31.829086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:31.829086+0000","last_clean_scrub_stamp":"2023-10-16T19:58:31.829086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:16:59.183747+0000","scrub_duration":0.002102483,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:06.907768+0000","last_change":"2023-10-16T19:58:05.603410+0000","last_active":"2023-10-16T19:58:06.907768+0000","last_peered":"2023-10-16T19:58:06.907768+0000","last_clean":"2023-10-16T19:58:06.907768+0000","last_became_active":"2023-10-16T19:58:05.603003+0000","last_became_peered":"2023-10-16T19:58:05.603003+0000","last_unstale":"2023-10-16T19:58:06.907768+0000","last_undegraded":"2023-10-16T19:58:06.907768+0000","last_fullsized":"2023-10-16T19:58:06.907768+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:06.599210+0000","last_change":"2023-10-16T19:58:05.603205+0000","last_active":"2023-10-16T19:58:06.599210+0000","last_peered":"2023-10-16T19:58:06.599210+0000","last_clean":"2023-10-16T19:58:06.599210+0000","last_became_active":"2023-10-16T19:58:05.602976+0000","last_became_peered":"2023-10-16T19:58:05.602976+0000","last_unstale":"2023-10-16T19:58:06.599210+0000","last_undegraded":"2023-10-16T19:58:06.599210+0000","last_fullsized":"2023-10-16T19:58:06.599210+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:07.027657+0000","last_change":"2023-10-16T19:58:05.602575+0000","last_active":"2023-10-16T19:58:07.027657+0000","last_peered":"2023-10-16T19:58:07.027657+0000","last_clean":"2023-10-16T19:58:07.027657+0000","last_became_active":"2023-10-16T19:58:05.601803+0000","last_became_peered":"2023-10-16T19:58:05.601803+0000","last_unstale":"2023-10-16T19:58:07.027657+0000","last_undegraded":"2023-10-16T19:58:07.027657+0000","last_fullsized":"2023-10-16T19:58:07.027657+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:27.747272+0000","last_change":"2023-10-16T19:58:27.747352+0000","last_active":"2023-10-16T19:58:27.747272+0000","last_peered":"2023-10-16T19:58:27.747272+0000","last_clean":"2023-10-16T19:58:27.747272+0000","last_became_active":"2023-10-16T19:58:05.605148+0000","last_became_peered":"2023-10-16T19:58:05.605148+0000","last_unstale":"2023-10-16T19:58:27.747272+0000","last_undegraded":"2023-10-16T19:58:27.747272+0000","last_fullsized":"2023-10-16T19:58:27.747272+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:27.747210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:27.747210+0000","last_clean_scrub_stamp":"2023-10-16T19:58:27.747210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:29:30.355570+0000","scrub_duration":0.0011117049999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:29.720322+0000","last_change":"2023-10-16T19:58:29.720365+0000","last_active":"2023-10-16T19:58:29.720322+0000","last_peered":"2023-10-16T19:58:29.720322+0000","last_clean":"2023-10-16T19:58:29.720322+0000","last_became_active":"2023-10-16T19:58:05.605200+0000","last_became_peered":"2023-10-16T19:58:05.605200+0000","last_unstale":"2023-10-16T19:58:29.720322+0000","last_undegraded":"2023-10-16T19:58:29.720322+0000","last_fullsized":"2023-10-16T19:58:29.720322+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:29.720263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:29.720263+0000","last_clean_scrub_stamp":"2023-10-16T19:58:29.720263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:09:36.426578+0000","scrub_duration":0.001250698,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:06.600891+0000","last_change":"2023-10-16T19:58:05.602243+0000","last_active":"2023-10-16T19:58:06.600891+0000","last_peered":"2023-10-16T19:58:06.600891+0000","last_clean":"2023-10-16T19:58:06.600891+0000","last_became_active":"2023-10-16T19:58:05.601910+0000","last_became_peered":"2023-10-16T19:58:05.601910+0000","last_unstale":"2023-10-16T19:58:06.600891+0000","last_undegraded":"2023-10-16T19:58:06.600891+0000","last_fullsized":"2023-10-16T19:58:06.600891+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:30.774857+0000","last_change":"2023-10-16T19:58:30.774939+0000","last_active":"2023-10-16T19:58:30.774857+0000","last_peered":"2023-10-16T19:58:30.774857+0000","last_clean":"2023-10-16T19:58:30.774857+0000","last_became_active":"2023-10-16T19:58:05.600356+0000","last_became_peered":"2023-10-16T19:58:05.600356+0000","last_unstale":"2023-10-16T19:58:30.774857+0000","last_undegraded":"2023-10-16T19:58:30.774857+0000","last_fullsized":"2023-10-16T19:58:30.774857+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:30.774800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:30.774800+0000","last_clean_scrub_stamp":"2023-10-16T19:58:30.774800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:20:26.019319+0000","scrub_duration":0.001101159,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:08.048912+0000","last_change":"2023-10-16T19:58:05.610325+0000","last_active":"2023-10-16T19:58:08.048912+0000","last_peered":"2023-10-16T19:58:08.048912+0000","last_clean":"2023-10-16T19:58:08.048912+0000","last_became_active":"2023-10-16T19:58:05.609979+0000","last_became_peered":"2023-10-16T19:58:05.609979+0000","last_unstale":"2023-10-16T19:58:08.048912+0000","last_undegraded":"2023-10-16T19:58:08.048912+0000","last_fullsized":"2023-10-16T19:58:08.048912+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:23.733969+0000","last_change":"2023-10-16T19:58:23.734041+0000","last_active":"2023-10-16T19:58:23.733969+0000","last_peered":"2023-10-16T19:58:23.733969+0000","last_clean":"2023-10-16T19:58:23.733969+0000","last_became_active":"2023-10-16T19:58:05.600490+0000","last_became_peered":"2023-10-16T19:58:05.600490+0000","last_unstale":"2023-10-16T19:58:23.733969+0000","last_undegraded":"2023-10-16T19:58:23.733969+0000","last_fullsized":"2023-10-16T19:58:23.733969+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:23.733905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:23.733905+0000","last_clean_scrub_stamp":"2023-10-16T19:58:23.733905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:48:39.868641+0000","scrub_duration":0.0016637889999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:29.421483+0000","last_change":"2023-10-16T19:58:29.421528+0000","last_active":"2023-10-16T19:58:29.421483+0000","last_peered":"2023-10-16T19:58:29.421483+0000","last_clean":"2023-10-16T19:58:29.421483+0000","last_became_active":"2023-10-16T19:58:05.600614+0000","last_became_peered":"2023-10-16T19:58:05.600614+0000","last_unstale":"2023-10-16T19:58:29.421483+0000","last_undegraded":"2023-10-16T19:58:29.421483+0000","last_fullsized":"2023-10-16T19:58:29.421483+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:29.421421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:29.421421+0000","last_clean_scrub_stamp":"2023-10-16T19:58:29.421421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:25:02.966775+0000","scrub_duration":0.001050121,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:07.028185+0000","last_change":"2023-10-16T19:58:05.602410+0000","last_active":"2023-10-16T19:58:07.028185+0000","last_peered":"2023-10-16T19:58:07.028185+0000","last_clean":"2023-10-16T19:58:07.028185+0000","last_became_active":"2023-10-16T19:58:05.601569+0000","last_became_peered":"2023-10-16T19:58:05.601569+0000","last_unstale":"2023-10-16T19:58:07.028185+0000","last_undegraded":"2023-10-16T19:58:07.028185+0000","last_fullsized":"2023-10-16T19:58:07.028185+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:30.841918+0000","last_change":"2023-10-16T19:58:30.841995+0000","last_active":"2023-10-16T19:58:30.841918+0000","last_peered":"2023-10-16T19:58:30.841918+0000","last_clean":"2023-10-16T19:58:30.841918+0000","last_became_active":"2023-10-16T19:58:05.599026+0000","last_became_peered":"2023-10-16T19:58:05.599026+0000","last_unstale":"2023-10-16T19:58:30.841918+0000","last_undegraded":"2023-10-16T19:58:30.841918+0000","last_fullsized":"2023-10-16T19:58:30.841918+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:30.841860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:30.841860+0000","last_clean_scrub_stamp":"2023-10-16T19:58:30.841860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:58:17.968086+0000","scrub_duration":0.0011580990000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:08.049046+0000","last_change":"2023-10-16T19:58:05.610219+0000","last_active":"2023-10-16T19:58:08.049046+0000","last_peered":"2023-10-16T19:58:08.049046+0000","last_clean":"2023-10-16T19:58:08.049046+0000","last_became_active":"2023-10-16T19:58:05.609613+0000","last_became_peered":"2023-10-16T19:58:05.609613+0000","last_unstale":"2023-10-16T19:58:08.049046+0000","last_undegraded":"2023-10-16T19:58:08.049046+0000","last_fullsized":"2023-10-16T19:58:08.049046+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:28.729670+0000","last_change":"2023-10-16T19:58:28.729718+0000","last_active":"2023-10-16T19:58:28.729670+0000","last_peered":"2023-10-16T19:58:28.729670+0000","last_clean":"2023-10-16T19:58:28.729670+0000","last_became_active":"2023-10-16T19:58:05.608184+0000","last_became_peered":"2023-10-16T19:58:05.608184+0000","last_unstale":"2023-10-16T19:58:28.729670+0000","last_undegraded":"2023-10-16T19:58:28.729670+0000","last_fullsized":"2023-10-16T19:58:28.729670+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:28.729605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:28.729605+0000","last_clean_scrub_stamp":"2023-10-16T19:58:28.729605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:43:01.890586+0000","scrub_duration":0.0010799519999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:07.027737+0000","last_change":"2023-10-16T19:58:05.601271+0000","last_active":"2023-10-16T19:58:07.027737+0000","last_peered":"2023-10-16T19:58:07.027737+0000","last_clean":"2023-10-16T19:58:07.027737+0000","last_became_active":"2023-10-16T19:58:05.600977+0000","last_became_peered":"2023-10-16T19:58:05.600977+0000","last_unstale":"2023-10-16T19:58:07.027737+0000","last_undegraded":"2023-10-16T19:58:07.027737+0000","last_fullsized":"2023-10-16T19:58:07.027737+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:07.027522+0000","last_change":"2023-10-16T19:58:05.602564+0000","last_active":"2023-10-16T19:58:07.027522+0000","last_peered":"2023-10-16T19:58:07.027522+0000","last_clean":"2023-10-16T19:58:07.027522+0000","last_became_active":"2023-10-16T19:58:05.601866+0000","last_became_peered":"2023-10-16T19:58:05.601866+0000","last_unstale":"2023-10-16T19:58:07.027522+0000","last_undegraded":"2023-10-16T19:58:07.027522+0000","last_fullsized":"2023-10-16T19:58:07.027522+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:06.599294+0000","last_change":"2023-10-16T19:58:05.603764+0000","last_active":"2023-10-16T19:58:06.599294+0000","last_peered":"2023-10-16T19:58:06.599294+0000","last_clean":"2023-10-16T19:58:06.599294+0000","last_became_active":"2023-10-16T19:58:05.603536+0000","last_became_peered":"2023-10-16T19:58:05.603536+0000","last_unstale":"2023-10-16T19:58:06.599294+0000","last_undegraded":"2023-10-16T19:58:06.599294+0000","last_fullsized":"2023-10-16T19:58:06.599294+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:06.600690+0000","last_change":"2023-10-16T19:58:05.607035+0000","last_active":"2023-10-16T19:58:06.600690+0000","last_peered":"2023-10-16T19:58:06.600690+0000","last_clean":"2023-10-16T19:58:06.600690+0000","last_became_active":"2023-10-16T19:58:05.606725+0000","last_became_peered":"2023-10-16T19:58:05.606725+0000","last_unstale":"2023-10-16T19:58:06.600690+0000","last_undegraded":"2023-10-16T19:58:06.600690+0000","last_fullsized":"2023-10-16T19:58:06.600690+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:06.600960+0000","last_change":"2023-10-16T19:58:05.606076+0000","last_active":"2023-10-16T19:58:06.600960+0000","last_peered":"2023-10-16T19:58:06.600960+0000","last_clean":"2023-10-16T19:58:06.600960+0000","last_became_active":"2023-10-16T19:58:05.605335+0000","last_became_peered":"2023-10-16T19:58:05.605335+0000","last_unstale":"2023-10-16T19:58:06.600960+0000","last_undegraded":"2023-10-16T19:58:06.600960+0000","last_fullsized":"2023-10-16T19:58:06.600960+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:06.600535+0000","last_change":"2023-10-16T19:58:05.609361+0000","last_active":"2023-10-16T19:58:06.600535+0000","last_peered":"2023-10-16T19:58:06.600535+0000","last_clean":"2023-10-16T19:58:06.600535+0000","last_became_active":"2023-10-16T19:58:05.609123+0000","last_became_peered":"2023-10-16T19:58:05.609123+0000","last_unstale":"2023-10-16T19:58:06.600535+0000","last_undegraded":"2023-10-16T19:58:06.600535+0000","last_fullsized":"2023-10-16T19:58:06.600535+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:22.683742+0000","last_change":"2023-10-16T19:58:22.683803+0000","last_active":"2023-10-16T19:58:22.683742+0000","last_peered":"2023-10-16T19:58:22.683742+0000","last_clean":"2023-10-16T19:58:22.683742+0000","last_became_active":"2023-10-16T19:58:05.599210+0000","last_became_peered":"2023-10-16T19:58:05.599210+0000","last_unstale":"2023-10-16T19:58:22.683742+0000","last_undegraded":"2023-10-16T19:58:22.683742+0000","last_fullsized":"2023-10-16T19:58:22.683742+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:22.683671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:22.683671+0000","last_clean_scrub_stamp":"2023-10-16T19:58:22.683671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:14:26.928272+0000","scrub_duration":0.0016721489999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:06.907750+0000","last_change":"2023-10-16T19:58:05.608218+0000","last_active":"2023-10-16T19:58:06.907750+0000","last_peered":"2023-10-16T19:58:06.907750+0000","last_clean":"2023-10-16T19:58:06.907750+0000","last_became_active":"2023-10-16T19:58:05.608010+0000","last_became_peered":"2023-10-16T19:58:05.608010+0000","last_unstale":"2023-10-16T19:58:06.907750+0000","last_undegraded":"2023-10-16T19:58:06.907750+0000","last_fullsized":"2023-10-16T19:58:06.907750+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:07.027790+0000","last_change":"2023-10-16T19:58:05.607417+0000","last_active":"2023-10-16T19:58:07.027790+0000","last_peered":"2023-10-16T19:58:07.027790+0000","last_clean":"2023-10-16T19:58:07.027790+0000","last_became_active":"2023-10-16T19:58:05.607185+0000","last_became_peered":"2023-10-16T19:58:05.607185+0000","last_unstale":"2023-10-16T19:58:07.027790+0000","last_undegraded":"2023-10-16T19:58:07.027790+0000","last_fullsized":"2023-10-16T19:58:07.027790+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:06.907382+0000","last_change":"2023-10-16T19:58:05.606277+0000","last_active":"2023-10-16T19:58:06.907382+0000","last_peered":"2023-10-16T19:58:06.907382+0000","last_clean":"2023-10-16T19:58:06.907382+0000","last_became_active":"2023-10-16T19:58:05.606043+0000","last_became_peered":"2023-10-16T19:58:05.606043+0000","last_unstale":"2023-10-16T19:58:06.907382+0000","last_undegraded":"2023-10-16T19:58:06.907382+0000","last_fullsized":"2023-10-16T19:58:06.907382+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:26.803352+0000","last_change":"2023-10-16T19:58:26.803418+0000","last_active":"2023-10-16T19:58:26.803352+0000","last_peered":"2023-10-16T19:58:26.803352+0000","last_clean":"2023-10-16T19:58:26.803352+0000","last_became_active":"2023-10-16T19:58:05.607763+0000","last_became_peered":"2023-10-16T19:58:05.607763+0000","last_unstale":"2023-10-16T19:58:26.803352+0000","last_undegraded":"2023-10-16T19:58:26.803352+0000","last_fullsized":"2023-10-16T19:58:26.803352+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:26.803286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:26.803286+0000","last_clean_scrub_stamp":"2023-10-16T19:58:26.803286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:47:41.021710+0000","scrub_duration":0.0013829269999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:06.601134+0000","last_change":"2023-10-16T19:58:05.604754+0000","last_active":"2023-10-16T19:58:06.601134+0000","last_peered":"2023-10-16T19:58:06.601134+0000","last_clean":"2023-10-16T19:58:06.601134+0000","last_became_active":"2023-10-16T19:58:05.604309+0000","last_became_peered":"2023-10-16T19:58:05.604309+0000","last_unstale":"2023-10-16T19:58:06.601134+0000","last_undegraded":"2023-10-16T19:58:06.601134+0000","last_fullsized":"2023-10-16T19:58:06.601134+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:33.784308+0000","last_change":"2023-10-16T19:58:33.784355+0000","last_active":"2023-10-16T19:58:33.784308+0000","last_peered":"2023-10-16T19:58:33.784308+0000","last_clean":"2023-10-16T19:58:33.784308+0000","last_became_active":"2023-10-16T19:58:05.606102+0000","last_became_peered":"2023-10-16T19:58:05.606102+0000","last_unstale":"2023-10-16T19:58:33.784308+0000","last_undegraded":"2023-10-16T19:58:33.784308+0000","last_fullsized":"2023-10-16T19:58:33.784308+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:33.784248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:33.784248+0000","last_clean_scrub_stamp":"2023-10-16T19:58:33.784248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:05:48.926071+0000","scrub_duration":0.001215055,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:07.027579+0000","last_change":"2023-10-16T19:58:05.600187+0000","last_active":"2023-10-16T19:58:07.027579+0000","last_peered":"2023-10-16T19:58:07.027579+0000","last_clean":"2023-10-16T19:58:07.027579+0000","last_became_active":"2023-10-16T19:58:05.599955+0000","last_became_peered":"2023-10-16T19:58:05.599955+0000","last_unstale":"2023-10-16T19:58:07.027579+0000","last_undegraded":"2023-10-16T19:58:07.027579+0000","last_fullsized":"2023-10-16T19:58:07.027579+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:31.719235+0000","last_change":"2023-10-16T19:58:31.719303+0000","last_active":"2023-10-16T19:58:31.719235+0000","last_peered":"2023-10-16T19:58:31.719235+0000","last_clean":"2023-10-16T19:58:31.719235+0000","last_became_active":"2023-10-16T19:58:05.608571+0000","last_became_peered":"2023-10-16T19:58:05.608571+0000","last_unstale":"2023-10-16T19:58:31.719235+0000","last_undegraded":"2023-10-16T19:58:31.719235+0000","last_fullsized":"2023-10-16T19:58:31.719235+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:31.719175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:31.719175+0000","last_clean_scrub_stamp":"2023-10-16T19:58:31.719175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:00:45.635707+0000","scrub_duration":0.0011065210000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:06.600369+0000","last_change":"2023-10-16T19:58:05.609465+0000","last_active":"2023-10-16T19:58:06.600369+0000","last_peered":"2023-10-16T19:58:06.600369+0000","last_clean":"2023-10-16T19:58:06.600369+0000","last_became_active":"2023-10-16T19:58:05.609211+0000","last_became_peered":"2023-10-16T19:58:05.609211+0000","last_unstale":"2023-10-16T19:58:06.600369+0000","last_undegraded":"2023-10-16T19:58:06.600369+0000","last_fullsized":"2023-10-16T19:58:06.600369+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"32'4","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:21.846435+0000","last_change":"2023-10-16T19:58:21.846485+0000","last_active":"2023-10-16T19:58:21.846435+0000","last_peered":"2023-10-16T19:58:21.846435+0000","last_clean":"2023-10-16T19:58:21.846435+0000","last_became_active":"2023-10-16T19:58:04.587523+0000","last_became_peered":"2023-10-16T19:58:04.587523+0000","last_unstale":"2023-10-16T19:58:21.846435+0000","last_undegraded":"2023-10-16T19:58:21.846435+0000","last_fullsized":"2023-10-16T19:58:21.846435+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2023-10-16T19:58:21.846381+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2023-10-16T19:58:21.846381+0000","last_clean_scrub_stamp":"2023-10-16T19:58:21.846381+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:24:55.391734+0000","scrub_duration":0.0014127810000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:26.719990+0000","last_change":"2023-10-16T19:58:26.720040+0000","last_active":"2023-10-16T19:58:26.719990+0000","last_peered":"2023-10-16T19:58:26.719990+0000","last_clean":"2023-10-16T19:58:26.719990+0000","last_became_active":"2023-10-16T19:58:05.598478+0000","last_became_peered":"2023-10-16T19:58:05.598478+0000","last_unstale":"2023-10-16T19:58:26.719990+0000","last_undegraded":"2023-10-16T19:58:26.719990+0000","last_fullsized":"2023-10-16T19:58:26.719990+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:26.719928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:26.719928+0000","last_clean_scrub_stamp":"2023-10-16T19:58:26.719928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:23:07.038642+0000","scrub_duration":0.00097661199999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"32'1","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:26.579405+0000","last_change":"2023-10-16T19:58:26.579471+0000","last_active":"2023-10-16T19:58:26.579405+0000","last_peered":"2023-10-16T19:58:26.579405+0000","last_clean":"2023-10-16T19:58:26.579405+0000","last_became_active":"2023-10-16T19:58:04.589624+0000","last_became_peered":"2023-10-16T19:58:04.589624+0000","last_unstale":"2023-10-16T19:58:26.579405+0000","last_undegraded":"2023-10-16T19:58:26.579405+0000","last_fullsized":"2023-10-16T19:58:26.579405+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'1","last_scrub_stamp":"2023-10-16T19:58:26.579324+0000","last_deep_scrub":"32'1","last_deep_scrub_stamp":"2023-10-16T19:58:26.579324+0000","last_clean_scrub_stamp":"2023-10-16T19:58:26.579324+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:23:06.898037+0000","scrub_duration":0.001603089,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:06.600814+0000","last_change":"2023-10-16T19:58:05.603987+0000","last_active":"2023-10-16T19:58:06.600814+0000","last_peered":"2023-10-16T19:58:06.600814+0000","last_clean":"2023-10-16T19:58:06.600814+0000","last_became_active":"2023-10-16T19:58:05.603733+0000","last_became_peered":"2023-10-16T19:58:05.603733+0000","last_unstale":"2023-10-16T19:58:06.600814+0000","last_undegraded":"2023-10-16T19:58:06.600814+0000","last_fullsized":"2023-10-16T19:58:06.600814+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"32'2","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:32.148475+0000","last_change":"2023-10-16T19:58:32.148558+0000","last_active":"2023-10-16T19:58:32.148475+0000","last_peered":"2023-10-16T19:58:32.148475+0000","last_clean":"2023-10-16T19:58:32.148475+0000","last_became_active":"2023-10-16T19:58:04.587076+0000","last_became_peered":"2023-10-16T19:58:04.587076+0000","last_unstale":"2023-10-16T19:58:32.148475+0000","last_undegraded":"2023-10-16T19:58:32.148475+0000","last_fullsized":"2023-10-16T19:58:32.148475+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2023-10-16T19:58:32.148408+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2023-10-16T19:58:32.148408+0000","last_clean_scrub_stamp":"2023-10-16T19:58:32.148408+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:00:46.064940+0000","scrub_duration":0.001719134,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:06.907622+0000","last_change":"2023-10-16T19:58:05.603529+0000","last_active":"2023-10-16T19:58:06.907622+0000","last_peered":"2023-10-16T19:58:06.907622+0000","last_clean":"2023-10-16T19:58:06.907622+0000","last_became_active":"2023-10-16T19:58:05.603317+0000","last_became_peered":"2023-10-16T19:58:05.603317+0000","last_unstale":"2023-10-16T19:58:06.907622+0000","last_undegraded":"2023-10-16T19:58:06.907622+0000","last_fullsized":"2023-10-16T19:58:06.907622+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"32'2","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:20.434958+0000","last_change":"2023-10-16T19:58:20.435007+0000","last_active":"2023-10-16T19:58:20.434958+0000","last_peered":"2023-10-16T19:58:20.434958+0000","last_clean":"2023-10-16T19:58:20.434958+0000","last_became_active":"2023-10-16T19:58:04.580982+0000","last_became_peered":"2023-10-16T19:58:04.580982+0000","last_unstale":"2023-10-16T19:58:20.434958+0000","last_undegraded":"2023-10-16T19:58:20.434958+0000","last_fullsized":"2023-10-16T19:58:20.434958+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2023-10-16T19:58:20.434910+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2023-10-16T19:58:20.434910+0000","last_clean_scrub_stamp":"2023-10-16T19:58:20.434910+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:05:39.251429+0000","scrub_duration":0.0011612440000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:08.049048+0000","last_change":"2023-10-16T19:58:05.609638+0000","last_active":"2023-10-16T19:58:08.049048+0000","last_peered":"2023-10-16T19:58:08.049048+0000","last_clean":"2023-10-16T19:58:08.049048+0000","last_became_active":"2023-10-16T19:58:05.609287+0000","last_became_peered":"2023-10-16T19:58:05.609287+0000","last_unstale":"2023-10-16T19:58:08.049048+0000","last_undegraded":"2023-10-16T19:58:08.049048+0000","last_fullsized":"2023-10-16T19:58:08.049048+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"32'1","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:25.891070+0000","last_change":"2023-10-16T19:58:25.891117+0000","last_active":"2023-10-16T19:58:25.891070+0000","last_peered":"2023-10-16T19:58:25.891070+0000","last_clean":"2023-10-16T19:58:25.891070+0000","last_became_active":"2023-10-16T19:58:04.591382+0000","last_became_peered":"2023-10-16T19:58:04.591382+0000","last_unstale":"2023-10-16T19:58:25.891070+0000","last_undegraded":"2023-10-16T19:58:25.891070+0000","last_fullsized":"2023-10-16T19:58:25.891070+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'1","last_scrub_stamp":"2023-10-16T19:58:25.890998+0000","last_deep_scrub":"32'1","last_deep_scrub_stamp":"2023-10-16T19:58:25.890998+0000","last_clean_scrub_stamp":"2023-10-16T19:58:25.890998+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:04:25.105980+0000","scrub_duration":0.0014568630000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:33.800480+0000","last_change":"2023-10-16T19:58:33.800524+0000","last_active":"2023-10-16T19:58:33.800480+0000","last_peered":"2023-10-16T19:58:33.800480+0000","last_clean":"2023-10-16T19:58:33.800480+0000","last_became_active":"2023-10-16T19:58:05.606777+0000","last_became_peered":"2023-10-16T19:58:05.606777+0000","last_unstale":"2023-10-16T19:58:33.800480+0000","last_undegraded":"2023-10-16T19:58:33.800480+0000","last_fullsized":"2023-10-16T19:58:33.800480+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:33.800421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:33.800421+0000","last_clean_scrub_stamp":"2023-10-16T19:58:33.800421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:38:43.180405+0000","scrub_duration":0.001325618,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"32'1","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:24.885637+0000","last_change":"2023-10-16T19:58:24.885721+0000","last_active":"2023-10-16T19:58:24.885637+0000","last_peered":"2023-10-16T19:58:24.885637+0000","last_clean":"2023-10-16T19:58:24.885637+0000","last_became_active":"2023-10-16T19:58:04.584702+0000","last_became_peered":"2023-10-16T19:58:04.584702+0000","last_unstale":"2023-10-16T19:58:24.885637+0000","last_undegraded":"2023-10-16T19:58:24.885637+0000","last_fullsized":"2023-10-16T19:58:24.885637+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'1","last_scrub_stamp":"2023-10-16T19:58:24.885575+0000","last_deep_scrub":"32'1","last_deep_scrub_stamp":"2023-10-16T19:58:24.885575+0000","last_clean_scrub_stamp":"2023-10-16T19:58:24.885575+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:16:25.808994+0000","scrub_duration":0.0015874319999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:06.601190+0000","last_change":"2023-10-16T19:58:05.601585+0000","last_active":"2023-10-16T19:58:06.601190+0000","last_peered":"2023-10-16T19:58:06.601190+0000","last_clean":"2023-10-16T19:58:06.601190+0000","last_became_active":"2023-10-16T19:58:05.600813+0000","last_became_peered":"2023-10-16T19:58:05.600813+0000","last_unstale":"2023-10-16T19:58:06.601190+0000","last_undegraded":"2023-10-16T19:58:06.601190+0000","last_fullsized":"2023-10-16T19:58:06.601190+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:23.096433+0000","last_change":"2023-10-16T19:58:23.096482+0000","last_active":"2023-10-16T19:58:23.096433+0000","last_peered":"2023-10-16T19:58:23.096433+0000","last_clean":"2023-10-16T19:58:23.096433+0000","last_became_active":"2023-10-16T19:58:04.584173+0000","last_became_peered":"2023-10-16T19:58:04.584173+0000","last_unstale":"2023-10-16T19:58:23.096433+0000","last_undegraded":"2023-10-16T19:58:23.096433+0000","last_fullsized":"2023-10-16T19:58:23.096433+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:23.096365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:23.096365+0000","last_clean_scrub_stamp":"2023-10-16T19:58:23.096365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:14:27.340966+0000","scrub_duration":0.0011138140000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:06.907646+0000","last_change":"2023-10-16T19:58:05.601649+0000","last_active":"2023-10-16T19:58:06.907646+0000","last_peered":"2023-10-16T19:58:06.907646+0000","last_clean":"2023-10-16T19:58:06.907646+0000","last_became_active":"2023-10-16T19:58:05.601416+0000","last_became_peered":"2023-10-16T19:58:05.601416+0000","last_unstale":"2023-10-16T19:58:06.907646+0000","last_undegraded":"2023-10-16T19:58:06.907646+0000","last_fullsized":"2023-10-16T19:58:06.907646+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:21.962408+0000","last_change":"2023-10-16T19:58:21.962453+0000","last_active":"2023-10-16T19:58:21.962408+0000","last_peered":"2023-10-16T19:58:21.962408+0000","last_clean":"2023-10-16T19:58:21.962408+0000","last_became_active":"2023-10-16T19:58:04.589891+0000","last_became_peered":"2023-10-16T19:58:04.589891+0000","last_unstale":"2023-10-16T19:58:21.962408+0000","last_undegraded":"2023-10-16T19:58:21.962408+0000","last_fullsized":"2023-10-16T19:58:21.962408+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:21.962351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:21.962351+0000","last_clean_scrub_stamp":"2023-10-16T19:58:21.962351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:47:53.043979+0000","scrub_duration":0.0009951929999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:35.836966+0000","last_change":"2023-10-16T19:58:35.837007+0000","last_active":"2023-10-16T19:58:35.836966+0000","last_peered":"2023-10-16T19:58:35.836966+0000","last_clean":"2023-10-16T19:58:35.836966+0000","last_became_active":"2023-10-16T19:58:05.603042+0000","last_became_peered":"2023-10-16T19:58:05.603042+0000","last_unstale":"2023-10-16T19:58:35.836966+0000","last_undegraded":"2023-10-16T19:58:35.836966+0000","last_fullsized":"2023-10-16T19:58:35.836966+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:35.836905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:35.836905+0000","last_clean_scrub_stamp":"2023-10-16T19:58:35.836905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:51:44.896637+0000","scrub_duration":0.0011687589999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:31.181629+0000","last_change":"2023-10-16T19:58:31.181709+0000","last_active":"2023-10-16T19:58:31.181629+0000","last_peered":"2023-10-16T19:58:31.181629+0000","last_clean":"2023-10-16T19:58:31.181629+0000","last_became_active":"2023-10-16T19:58:04.589253+0000","last_became_peered":"2023-10-16T19:58:04.589253+0000","last_unstale":"2023-10-16T19:58:31.181629+0000","last_undegraded":"2023-10-16T19:58:31.181629+0000","last_fullsized":"2023-10-16T19:58:31.181629+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:31.181571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:31.181571+0000","last_clean_scrub_stamp":"2023-10-16T19:58:31.181571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:09:37.887886+0000","scrub_duration":0.0019320749999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:07.028133+0000","last_change":"2023-10-16T19:58:05.602710+0000","last_active":"2023-10-16T19:58:07.028133+0000","last_peered":"2023-10-16T19:58:07.028133+0000","last_clean":"2023-10-16T19:58:07.028133+0000","last_became_active":"2023-10-16T19:58:05.602336+0000","last_became_peered":"2023-10-16T19:58:05.602336+0000","last_unstale":"2023-10-16T19:58:07.028133+0000","last_undegraded":"2023-10-16T19:58:07.028133+0000","last_fullsized":"2023-10-16T19:58:07.028133+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:35.631480+0000","last_change":"2023-10-16T19:58:35.631529+0000","last_active":"2023-10-16T19:58:35.631480+0000","last_peered":"2023-10-16T19:58:35.631480+0000","last_clean":"2023-10-16T19:58:35.631480+0000","last_became_active":"2023-10-16T19:58:04.586047+0000","last_became_peered":"2023-10-16T19:58:04.586047+0000","last_unstale":"2023-10-16T19:58:35.631480+0000","last_undegraded":"2023-10-16T19:58:35.631480+0000","last_fullsized":"2023-10-16T19:58:35.631480+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:35.631427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:35.631427+0000","last_clean_scrub_stamp":"2023-10-16T19:58:35.631427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:23:49.533757+0000","scrub_duration":0.001124863,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:07.027654+0000","last_change":"2023-10-16T19:58:05.606519+0000","last_active":"2023-10-16T19:58:07.027654+0000","last_peered":"2023-10-16T19:58:07.027654+0000","last_clean":"2023-10-16T19:58:07.027654+0000","last_became_active":"2023-10-16T19:58:05.606148+0000","last_became_peered":"2023-10-16T19:58:05.606148+0000","last_unstale":"2023-10-16T19:58:07.027654+0000","last_undegraded":"2023-10-16T19:58:07.027654+0000","last_fullsized":"2023-10-16T19:58:07.027654+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"32'3","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:21.645944+0000","last_change":"2023-10-16T19:58:21.645994+0000","last_active":"2023-10-16T19:58:21.645944+0000","last_peered":"2023-10-16T19:58:21.645944+0000","last_clean":"2023-10-16T19:58:21.645944+0000","last_became_active":"2023-10-16T19:58:04.589139+0000","last_became_peered":"2023-10-16T19:58:04.589139+0000","last_unstale":"2023-10-16T19:58:21.645944+0000","last_undegraded":"2023-10-16T19:58:21.645944+0000","last_fullsized":"2023-10-16T19:58:21.645944+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3","last_scrub_stamp":"2023-10-16T19:58:21.645882+0000","last_deep_scrub":"32'3","last_deep_scrub_stamp":"2023-10-16T19:58:21.645882+0000","last_clean_scrub_stamp":"2023-10-16T19:58:21.645882+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:20:16.890402+0000","scrub_duration":0.0016449870000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:24.763359+0000","last_change":"2023-10-16T19:58:24.763421+0000","last_active":"2023-10-16T19:58:24.763359+0000","last_peered":"2023-10-16T19:58:24.763359+0000","last_clean":"2023-10-16T19:58:24.763359+0000","last_became_active":"2023-10-16T19:58:05.600598+0000","last_became_peered":"2023-10-16T19:58:05.600598+0000","last_unstale":"2023-10-16T19:58:24.763359+0000","last_undegraded":"2023-10-16T19:58:24.763359+0000","last_fullsized":"2023-10-16T19:58:24.763359+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:24.763278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:24.763278+0000","last_clean_scrub_stamp":"2023-10-16T19:58:24.763278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:14:14.087647+0000","scrub_duration":0.001597677,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"32'6","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:28.108190+0000","last_change":"2023-10-16T19:58:28.108247+0000","last_active":"2023-10-16T19:58:28.108190+0000","last_peered":"2023-10-16T19:58:28.108190+0000","last_clean":"2023-10-16T19:58:28.108190+0000","last_became_active":"2023-10-16T19:58:04.584588+0000","last_became_peered":"2023-10-16T19:58:04.584588+0000","last_unstale":"2023-10-16T19:58:28.108190+0000","last_undegraded":"2023-10-16T19:58:28.108190+0000","last_fullsized":"2023-10-16T19:58:28.108190+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2023-10-16T19:58:28.108132+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2023-10-16T19:58:28.108132+0000","last_clean_scrub_stamp":"2023-10-16T19:58:28.108132+0000","objects_scrubbed":4,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:43:01.269113+0000","scrub_duration":0.0016545329999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:33.881969+0000","last_change":"2023-10-16T19:58:33.882043+0000","last_active":"2023-10-16T19:58:33.881969+0000","last_peered":"2023-10-16T19:58:33.881969+0000","last_clean":"2023-10-16T19:58:33.881969+0000","last_became_active":"2023-10-16T19:58:05.602386+0000","last_became_peered":"2023-10-16T19:58:05.602386+0000","last_unstale":"2023-10-16T19:58:33.881969+0000","last_undegraded":"2023-10-16T19:58:33.881969+0000","last_fullsized":"2023-10-16T19:58:33.881969+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:33.881891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:33.881891+0000","last_clean_scrub_stamp":"2023-10-16T19:58:33.881891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:48:50.016627+0000","scrub_duration":0.001250496,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"32'2","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:06.601499+0000","last_change":"2023-10-16T19:58:04.586869+0000","last_active":"2023-10-16T19:58:06.601499+0000","last_peered":"2023-10-16T19:58:06.601499+0000","last_clean":"2023-10-16T19:58:06.601499+0000","last_became_active":"2023-10-16T19:58:04.586290+0000","last_became_peered":"2023-10-16T19:58:04.586290+0000","last_unstale":"2023-10-16T19:58:06.601499+0000","last_undegraded":"2023-10-16T19:58:06.601499+0000","last_fullsized":"2023-10-16T19:58:06.601499+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_clean_scrub_stamp":"2023-10-16T19:58:03.569082+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:19.039160+0000","last_change":"2023-10-16T19:58:19.039195+0000","last_active":"2023-10-16T19:58:19.039160+0000","last_peered":"2023-10-16T19:58:19.039160+0000","last_clean":"2023-10-16T19:58:19.039160+0000","last_became_active":"2023-10-16T19:58:05.605962+0000","last_became_peered":"2023-10-16T19:58:05.605962+0000","last_unstale":"2023-10-16T19:58:19.039160+0000","last_undegraded":"2023-10-16T19:58:19.039160+0000","last_fullsized":"2023-10-16T19:58:19.039160+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:19.039113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:19.039113+0000","last_clean_scrub_stamp":"2023-10-16T19:58:19.039113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:12:55.467133+0000","scrub_duration":0.000870695,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:19.676983+0000","last_change":"2023-10-16T19:58:19.677037+0000","last_active":"2023-10-16T19:58:19.676983+0000","last_peered":"2023-10-16T19:58:19.676983+0000","last_clean":"2023-10-16T19:58:19.676983+0000","last_became_active":"2023-10-16T19:58:04.587531+0000","last_became_peered":"2023-10-16T19:58:04.587531+0000","last_unstale":"2023-10-16T19:58:19.676983+0000","last_undegraded":"2023-10-16T19:58:19.676983+0000","last_fullsized":"2023-10-16T19:58:19.676983+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:19.676913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:19.676913+0000","last_clean_scrub_stamp":"2023-10-16T19:58:19.676913+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:03:42.167534+0000","scrub_duration":0.0011117410000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:32.761671+0000","last_change":"2023-10-16T19:58:32.761717+0000","last_active":"2023-10-16T19:58:32.761671+0000","last_peered":"2023-10-16T19:58:32.761671+0000","last_clean":"2023-10-16T19:58:32.761671+0000","last_became_active":"2023-10-16T19:58:05.607449+0000","last_became_peered":"2023-10-16T19:58:05.607449+0000","last_unstale":"2023-10-16T19:58:32.761671+0000","last_undegraded":"2023-10-16T19:58:32.761671+0000","last_fullsized":"2023-10-16T19:58:32.761671+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:32.761603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:32.761603+0000","last_clean_scrub_stamp":"2023-10-16T19:58:32.761603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:25:26.996828+0000","scrub_duration":0.001069866,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:07.027773+0000","last_change":"2023-10-16T19:58:04.588496+0000","last_active":"2023-10-16T19:58:07.027773+0000","last_peered":"2023-10-16T19:58:07.027773+0000","last_clean":"2023-10-16T19:58:07.027773+0000","last_became_active":"2023-10-16T19:58:04.588305+0000","last_became_peered":"2023-10-16T19:58:04.588305+0000","last_unstale":"2023-10-16T19:58:07.027773+0000","last_undegraded":"2023-10-16T19:58:07.027773+0000","last_fullsized":"2023-10-16T19:58:07.027773+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_clean_scrub_stamp":"2023-10-16T19:58:03.569082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:28.708653+0000","last_change":"2023-10-16T19:58:28.708698+0000","last_active":"2023-10-16T19:58:28.708653+0000","last_peered":"2023-10-16T19:58:28.708653+0000","last_clean":"2023-10-16T19:58:28.708653+0000","last_became_active":"2023-10-16T19:58:05.599356+0000","last_became_peered":"2023-10-16T19:58:05.599356+0000","last_unstale":"2023-10-16T19:58:28.708653+0000","last_undegraded":"2023-10-16T19:58:28.708653+0000","last_fullsized":"2023-10-16T19:58:28.708653+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:28.708592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:28.708592+0000","last_clean_scrub_stamp":"2023-10-16T19:58:28.708592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:16:29.632011+0000","scrub_duration":0.001058738,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"32'8","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:22.083215+0000","last_change":"2023-10-16T19:58:22.083266+0000","last_active":"2023-10-16T19:58:22.083215+0000","last_peered":"2023-10-16T19:58:22.083215+0000","last_clean":"2023-10-16T19:58:22.083215+0000","last_became_active":"2023-10-16T19:58:04.580648+0000","last_became_peered":"2023-10-16T19:58:04.580648+0000","last_unstale":"2023-10-16T19:58:22.083215+0000","last_undegraded":"2023-10-16T19:58:22.083215+0000","last_fullsized":"2023-10-16T19:58:22.083215+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2023-10-16T19:58:22.083152+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2023-10-16T19:58:22.083152+0000","last_clean_scrub_stamp":"2023-10-16T19:58:22.083152+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:20:17.327671+0000","scrub_duration":0.001902965,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:06.601320+0000","last_change":"2023-10-16T19:58:05.600582+0000","last_active":"2023-10-16T19:58:06.601320+0000","last_peered":"2023-10-16T19:58:06.601320+0000","last_clean":"2023-10-16T19:58:06.601320+0000","last_became_active":"2023-10-16T19:58:05.600333+0000","last_became_peered":"2023-10-16T19:58:05.600333+0000","last_unstale":"2023-10-16T19:58:06.601320+0000","last_undegraded":"2023-10-16T19:58:06.601320+0000","last_fullsized":"2023-10-16T19:58:06.601320+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"32'1","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:24.691734+0000","last_change":"2023-10-16T19:58:24.691784+0000","last_active":"2023-10-16T19:58:24.691734+0000","last_peered":"2023-10-16T19:58:24.691734+0000","last_clean":"2023-10-16T19:58:24.691734+0000","last_became_active":"2023-10-16T19:58:04.587576+0000","last_became_peered":"2023-10-16T19:58:04.587576+0000","last_unstale":"2023-10-16T19:58:24.691734+0000","last_undegraded":"2023-10-16T19:58:24.691734+0000","last_fullsized":"2023-10-16T19:58:24.691734+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'1","last_scrub_stamp":"2023-10-16T19:58:24.691678+0000","last_deep_scrub":"32'1","last_deep_scrub_stamp":"2023-10-16T19:58:24.691678+0000","last_clean_scrub_stamp":"2023-10-16T19:58:24.691678+0000","objects_scrubbed":1,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:16:13.607131+0000","scrub_duration":0.001286595,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:25.761868+0000","last_change":"2023-10-16T19:58:25.761913+0000","last_active":"2023-10-16T19:58:25.761868+0000","last_peered":"2023-10-16T19:58:25.761868+0000","last_clean":"2023-10-16T19:58:25.761868+0000","last_became_active":"2023-10-16T19:58:05.598861+0000","last_became_peered":"2023-10-16T19:58:05.598861+0000","last_unstale":"2023-10-16T19:58:25.761868+0000","last_undegraded":"2023-10-16T19:58:25.761868+0000","last_fullsized":"2023-10-16T19:58:25.761868+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:25.761813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:25.761813+0000","last_clean_scrub_stamp":"2023-10-16T19:58:25.761813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:00:39.678346+0000","scrub_duration":0.0010256320000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"32'2","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:06.601666+0000","last_change":"2023-10-16T19:58:04.586713+0000","last_active":"2023-10-16T19:58:06.601666+0000","last_peered":"2023-10-16T19:58:06.601666+0000","last_clean":"2023-10-16T19:58:06.601666+0000","last_became_active":"2023-10-16T19:58:04.585973+0000","last_became_peered":"2023-10-16T19:58:04.585973+0000","last_unstale":"2023-10-16T19:58:06.601666+0000","last_undegraded":"2023-10-16T19:58:06.601666+0000","last_fullsized":"2023-10-16T19:58:06.601666+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_clean_scrub_stamp":"2023-10-16T19:58:03.569082+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:06.907612+0000","last_change":"2023-10-16T19:58:05.606948+0000","last_active":"2023-10-16T19:58:06.907612+0000","last_peered":"2023-10-16T19:58:06.907612+0000","last_clean":"2023-10-16T19:58:06.907612+0000","last_became_active":"2023-10-16T19:58:05.606722+0000","last_became_peered":"2023-10-16T19:58:05.606722+0000","last_unstale":"2023-10-16T19:58:06.907612+0000","last_undegraded":"2023-10-16T19:58:06.907612+0000","last_fullsized":"2023-10-16T19:58:06.907612+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"32'1","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:32.979463+0000","last_change":"2023-10-16T19:58:32.979532+0000","last_active":"2023-10-16T19:58:32.979463+0000","last_peered":"2023-10-16T19:58:32.979463+0000","last_clean":"2023-10-16T19:58:32.979463+0000","last_became_active":"2023-10-16T19:58:04.586934+0000","last_became_peered":"2023-10-16T19:58:04.586934+0000","last_unstale":"2023-10-16T19:58:32.979463+0000","last_undegraded":"2023-10-16T19:58:32.979463+0000","last_fullsized":"2023-10-16T19:58:32.979463+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'1","last_scrub_stamp":"2023-10-16T19:58:32.979401+0000","last_deep_scrub":"32'1","last_deep_scrub_stamp":"2023-10-16T19:58:32.979401+0000","last_clean_scrub_stamp":"2023-10-16T19:58:32.979401+0000","objects_scrubbed":1,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:34:33.599720+0000","scrub_duration":0.0018833140000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:25.455034+0000","last_change":"2023-10-16T19:58:25.455086+0000","last_active":"2023-10-16T19:58:25.455034+0000","last_peered":"2023-10-16T19:58:25.455034+0000","last_clean":"2023-10-16T19:58:25.455034+0000","last_became_active":"2023-10-16T19:58:05.607269+0000","last_became_peered":"2023-10-16T19:58:05.607269+0000","last_unstale":"2023-10-16T19:58:25.455034+0000","last_undegraded":"2023-10-16T19:58:25.455034+0000","last_fullsized":"2023-10-16T19:58:25.455034+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:25.454944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:25.454944+0000","last_clean_scrub_stamp":"2023-10-16T19:58:25.454944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:09:25.545413+0000","scrub_duration":0.0017519180000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:06.600770+0000","last_change":"2023-10-16T19:58:04.592403+0000","last_active":"2023-10-16T19:58:06.600770+0000","last_peered":"2023-10-16T19:58:06.600770+0000","last_clean":"2023-10-16T19:58:06.600770+0000","last_became_active":"2023-10-16T19:58:04.591967+0000","last_became_peered":"2023-10-16T19:58:04.591967+0000","last_unstale":"2023-10-16T19:58:06.600770+0000","last_undegraded":"2023-10-16T19:58:06.600770+0000","last_fullsized":"2023-10-16T19:58:06.600770+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_clean_scrub_stamp":"2023-10-16T19:58:03.569082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:35.425410+0000","last_change":"2023-10-16T19:58:35.425463+0000","last_active":"2023-10-16T19:58:35.425410+0000","last_peered":"2023-10-16T19:58:35.425410+0000","last_clean":"2023-10-16T19:58:35.425410+0000","last_became_active":"2023-10-16T19:58:05.600081+0000","last_became_peered":"2023-10-16T19:58:05.600081+0000","last_unstale":"2023-10-16T19:58:35.425410+0000","last_undegraded":"2023-10-16T19:58:35.425410+0000","last_fullsized":"2023-10-16T19:58:35.425410+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:35.425348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:35.425348+0000","last_clean_scrub_stamp":"2023-10-16T19:58:35.425348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:18:06.873638+0000","scrub_duration":0.0014506300000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"32'2","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:29.560596+0000","last_change":"2023-10-16T19:58:29.560680+0000","last_active":"2023-10-16T19:58:29.560596+0000","last_peered":"2023-10-16T19:58:29.560596+0000","last_clean":"2023-10-16T19:58:29.560596+0000","last_became_active":"2023-10-16T19:58:04.587629+0000","last_became_peered":"2023-10-16T19:58:04.587629+0000","last_unstale":"2023-10-16T19:58:29.560596+0000","last_undegraded":"2023-10-16T19:58:29.560596+0000","last_fullsized":"2023-10-16T19:58:29.560596+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2023-10-16T19:58:29.560524+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2023-10-16T19:58:29.560524+0000","last_clean_scrub_stamp":"2023-10-16T19:58:29.560524+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:31:22.451525+0000","scrub_duration":0.00173325,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:31.420756+0000","last_change":"2023-10-16T19:58:31.420804+0000","last_active":"2023-10-16T19:58:31.420756+0000","last_peered":"2023-10-16T19:58:31.420756+0000","last_clean":"2023-10-16T19:58:31.420756+0000","last_became_active":"2023-10-16T19:58:05.607311+0000","last_became_peered":"2023-10-16T19:58:05.607311+0000","last_unstale":"2023-10-16T19:58:31.420756+0000","last_undegraded":"2023-10-16T19:58:31.420756+0000","last_fullsized":"2023-10-16T19:58:31.420756+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:31.420696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:31.420696+0000","last_clean_scrub_stamp":"2023-10-16T19:58:31.420696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:10:33.790242+0000","scrub_duration":0.0012437870000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:19.890802+0000","last_change":"2023-10-16T19:58:19.890848+0000","last_active":"2023-10-16T19:58:19.890802+0000","last_peered":"2023-10-16T19:58:19.890802+0000","last_clean":"2023-10-16T19:58:19.890802+0000","last_became_active":"2023-10-16T19:58:04.583346+0000","last_became_peered":"2023-10-16T19:58:04.583346+0000","last_unstale":"2023-10-16T19:58:19.890802+0000","last_undegraded":"2023-10-16T19:58:19.890802+0000","last_fullsized":"2023-10-16T19:58:19.890802+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:19.890752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:19.890752+0000","last_clean_scrub_stamp":"2023-10-16T19:58:19.890752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:26:48.807112+0000","scrub_duration":0.0011159919999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:32.410743+0000","last_change":"2023-10-16T19:58:32.410810+0000","last_active":"2023-10-16T19:58:32.410743+0000","last_peered":"2023-10-16T19:58:32.410743+0000","last_clean":"2023-10-16T19:58:32.410743+0000","last_became_active":"2023-10-16T19:58:05.605529+0000","last_became_peered":"2023-10-16T19:58:05.605529+0000","last_unstale":"2023-10-16T19:58:32.410743+0000","last_undegraded":"2023-10-16T19:58:32.410743+0000","last_fullsized":"2023-10-16T19:58:32.410743+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:32.410677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:32.410677+0000","last_clean_scrub_stamp":"2023-10-16T19:58:32.410677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:23:12.729390+0000","scrub_duration":0.0014308979999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:06.601580+0000","last_change":"2023-10-16T19:58:04.590215+0000","last_active":"2023-10-16T19:58:06.601580+0000","last_peered":"2023-10-16T19:58:06.601580+0000","last_clean":"2023-10-16T19:58:06.601580+0000","last_became_active":"2023-10-16T19:58:04.589542+0000","last_became_peered":"2023-10-16T19:58:04.589542+0000","last_unstale":"2023-10-16T19:58:06.601580+0000","last_undegraded":"2023-10-16T19:58:06.601580+0000","last_fullsized":"2023-10-16T19:58:06.601580+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_clean_scrub_stamp":"2023-10-16T19:58:03.569082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:08.049091+0000","last_change":"2023-10-16T19:58:05.608889+0000","last_active":"2023-10-16T19:58:08.049091+0000","last_peered":"2023-10-16T19:58:08.049091+0000","last_clean":"2023-10-16T19:58:08.049091+0000","last_became_active":"2023-10-16T19:58:05.608517+0000","last_became_peered":"2023-10-16T19:58:05.608517+0000","last_unstale":"2023-10-16T19:58:08.049091+0000","last_undegraded":"2023-10-16T19:58:08.049091+0000","last_fullsized":"2023-10-16T19:58:08.049091+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:19.657543+0000","last_change":"2023-10-16T19:58:19.657585+0000","last_active":"2023-10-16T19:58:19.657543+0000","last_peered":"2023-10-16T19:58:19.657543+0000","last_clean":"2023-10-16T19:58:19.657543+0000","last_became_active":"2023-10-16T19:58:04.587332+0000","last_became_peered":"2023-10-16T19:58:04.587332+0000","last_unstale":"2023-10-16T19:58:19.657543+0000","last_undegraded":"2023-10-16T19:58:19.657543+0000","last_fullsized":"2023-10-16T19:58:19.657543+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:19.657476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:19.657476+0000","last_clean_scrub_stamp":"2023-10-16T19:58:19.657476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:12:56.085496+0000","scrub_duration":0.0010951520000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:33.420366+0000","last_change":"2023-10-16T19:58:33.420451+0000","last_active":"2023-10-16T19:58:33.420366+0000","last_peered":"2023-10-16T19:58:33.420366+0000","last_clean":"2023-10-16T19:58:33.420366+0000","last_became_active":"2023-10-16T19:58:05.600305+0000","last_became_peered":"2023-10-16T19:58:05.600305+0000","last_unstale":"2023-10-16T19:58:33.420366+0000","last_undegraded":"2023-10-16T19:58:33.420366+0000","last_fullsized":"2023-10-16T19:58:33.420366+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:33.420305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:33.420305+0000","last_clean_scrub_stamp":"2023-10-16T19:58:33.420305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:16:34.343724+0000","scrub_duration":0.001548645,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"32'2","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:25.729426+0000","last_change":"2023-10-16T19:58:25.729476+0000","last_active":"2023-10-16T19:58:25.729426+0000","last_peered":"2023-10-16T19:58:25.729426+0000","last_clean":"2023-10-16T19:58:25.729426+0000","last_became_active":"2023-10-16T19:58:04.582012+0000","last_became_peered":"2023-10-16T19:58:04.582012+0000","last_unstale":"2023-10-16T19:58:25.729426+0000","last_undegraded":"2023-10-16T19:58:25.729426+0000","last_fullsized":"2023-10-16T19:58:25.729426+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2023-10-16T19:58:25.729370+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2023-10-16T19:58:25.729370+0000","last_clean_scrub_stamp":"2023-10-16T19:58:25.729370+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:09:10.976762+0000","scrub_duration":0.0017710670000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:06.908256+0000","last_change":"2023-10-16T19:58:05.602250+0000","last_active":"2023-10-16T19:58:06.908256+0000","last_peered":"2023-10-16T19:58:06.908256+0000","last_clean":"2023-10-16T19:58:06.908256+0000","last_became_active":"2023-10-16T19:58:05.600830+0000","last_became_peered":"2023-10-16T19:58:05.600830+0000","last_unstale":"2023-10-16T19:58:06.908256+0000","last_undegraded":"2023-10-16T19:58:06.908256+0000","last_fullsized":"2023-10-16T19:58:06.908256+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"33'1","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:24.515716+0000","last_change":"2023-10-16T19:58:24.515782+0000","last_active":"2023-10-16T19:58:24.515716+0000","last_peered":"2023-10-16T19:58:24.515716+0000","last_clean":"2023-10-16T19:58:24.515716+0000","last_became_active":"2023-10-16T19:58:04.587329+0000","last_became_peered":"2023-10-16T19:58:04.587329+0000","last_unstale":"2023-10-16T19:58:24.515716+0000","last_undegraded":"2023-10-16T19:58:24.515716+0000","last_fullsized":"2023-10-16T19:58:24.515716+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'1","last_scrub_stamp":"2023-10-16T19:58:24.515637+0000","last_deep_scrub":"33'1","last_deep_scrub_stamp":"2023-10-16T19:58:24.515637+0000","last_clean_scrub_stamp":"2023-10-16T19:58:24.515637+0000","objects_scrubbed":1,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:45:55.863919+0000","scrub_duration":0.0017599650000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:06.600492+0000","last_change":"2023-10-16T19:58:05.606214+0000","last_active":"2023-10-16T19:58:06.600492+0000","last_peered":"2023-10-16T19:58:06.600492+0000","last_clean":"2023-10-16T19:58:06.600492+0000","last_became_active":"2023-10-16T19:58:05.605958+0000","last_became_peered":"2023-10-16T19:58:05.605958+0000","last_unstale":"2023-10-16T19:58:06.600492+0000","last_undegraded":"2023-10-16T19:58:06.600492+0000","last_fullsized":"2023-10-16T19:58:06.600492+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:27.703678+0000","last_change":"2023-10-16T19:58:27.703723+0000","last_active":"2023-10-16T19:58:27.703678+0000","last_peered":"2023-10-16T19:58:27.703678+0000","last_clean":"2023-10-16T19:58:27.703678+0000","last_became_active":"2023-10-16T19:58:04.586851+0000","last_became_peered":"2023-10-16T19:58:04.586851+0000","last_unstale":"2023-10-16T19:58:27.703678+0000","last_undegraded":"2023-10-16T19:58:27.703678+0000","last_fullsized":"2023-10-16T19:58:27.703678+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:27.703618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:27.703618+0000","last_clean_scrub_stamp":"2023-10-16T19:58:27.703618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:13:04.131638+0000","scrub_duration":0.001147449,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:07.027682+0000","last_change":"2023-10-16T19:58:05.606520+0000","last_active":"2023-10-16T19:58:07.027682+0000","last_peered":"2023-10-16T19:58:07.027682+0000","last_clean":"2023-10-16T19:58:07.027682+0000","last_became_active":"2023-10-16T19:58:05.606081+0000","last_became_peered":"2023-10-16T19:58:05.606081+0000","last_unstale":"2023-10-16T19:58:07.027682+0000","last_undegraded":"2023-10-16T19:58:07.027682+0000","last_fullsized":"2023-10-16T19:58:07.027682+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:30.562350+0000","last_change":"2023-10-16T19:58:30.562415+0000","last_active":"2023-10-16T19:58:30.562350+0000","last_peered":"2023-10-16T19:58:30.562350+0000","last_clean":"2023-10-16T19:58:30.562350+0000","last_became_active":"2023-10-16T19:58:04.588050+0000","last_became_peered":"2023-10-16T19:58:04.588050+0000","last_unstale":"2023-10-16T19:58:30.562350+0000","last_undegraded":"2023-10-16T19:58:30.562350+0000","last_fullsized":"2023-10-16T19:58:30.562350+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:30.562272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:30.562272+0000","last_clean_scrub_stamp":"2023-10-16T19:58:30.562272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:03:53.052894+0000","scrub_duration":0.001599874,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:06.600681+0000","last_change":"2023-10-16T19:58:05.607522+0000","last_active":"2023-10-16T19:58:06.600681+0000","last_peered":"2023-10-16T19:58:06.600681+0000","last_clean":"2023-10-16T19:58:06.600681+0000","last_became_active":"2023-10-16T19:58:05.607381+0000","last_became_peered":"2023-10-16T19:58:05.607381+0000","last_unstale":"2023-10-16T19:58:06.600681+0000","last_undegraded":"2023-10-16T19:58:06.600681+0000","last_fullsized":"2023-10-16T19:58:06.600681+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:18.716208+0000","last_change":"2023-10-16T19:58:18.716246+0000","last_active":"2023-10-16T19:58:18.716208+0000","last_peered":"2023-10-16T19:58:18.716208+0000","last_clean":"2023-10-16T19:58:18.716208+0000","last_became_active":"2023-10-16T19:58:04.581711+0000","last_became_peered":"2023-10-16T19:58:04.581711+0000","last_unstale":"2023-10-16T19:58:18.716208+0000","last_undegraded":"2023-10-16T19:58:18.716208+0000","last_fullsized":"2023-10-16T19:58:18.716208+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:18.716159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:18.716159+0000","last_clean_scrub_stamp":"2023-10-16T19:58:18.716159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:16:19.639578+0000","scrub_duration":0.001305716,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:07.027791+0000","last_change":"2023-10-16T19:58:05.602722+0000","last_active":"2023-10-16T19:58:07.027791+0000","last_peered":"2023-10-16T19:58:07.027791+0000","last_clean":"2023-10-16T19:58:07.027791+0000","last_became_active":"2023-10-16T19:58:05.602184+0000","last_became_peered":"2023-10-16T19:58:05.602184+0000","last_unstale":"2023-10-16T19:58:07.027791+0000","last_undegraded":"2023-10-16T19:58:07.027791+0000","last_fullsized":"2023-10-16T19:58:07.027791+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:31.972750+0000","last_change":"2023-10-16T19:58:31.972795+0000","last_active":"2023-10-16T19:58:31.972750+0000","last_peered":"2023-10-16T19:58:31.972750+0000","last_clean":"2023-10-16T19:58:31.972750+0000","last_became_active":"2023-10-16T19:58:04.587683+0000","last_became_peered":"2023-10-16T19:58:04.587683+0000","last_unstale":"2023-10-16T19:58:31.972750+0000","last_undegraded":"2023-10-16T19:58:31.972750+0000","last_fullsized":"2023-10-16T19:58:31.972750+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:31.972697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:31.972697+0000","last_clean_scrub_stamp":"2023-10-16T19:58:31.972697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:23:45.875027+0000","scrub_duration":0.0010629109999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:06.600781+0000","last_change":"2023-10-16T19:58:05.601329+0000","last_active":"2023-10-16T19:58:06.600781+0000","last_peered":"2023-10-16T19:58:06.600781+0000","last_clean":"2023-10-16T19:58:06.600781+0000","last_became_active":"2023-10-16T19:58:05.601074+0000","last_became_peered":"2023-10-16T19:58:05.601074+0000","last_unstale":"2023-10-16T19:58:06.600781+0000","last_undegraded":"2023-10-16T19:58:06.600781+0000","last_fullsized":"2023-10-16T19:58:06.600781+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:07.028226+0000","last_change":"2023-10-16T19:58:04.588810+0000","last_active":"2023-10-16T19:58:07.028226+0000","last_peered":"2023-10-16T19:58:07.028226+0000","last_clean":"2023-10-16T19:58:07.028226+0000","last_became_active":"2023-10-16T19:58:04.588392+0000","last_became_peered":"2023-10-16T19:58:04.588392+0000","last_unstale":"2023-10-16T19:58:07.028226+0000","last_undegraded":"2023-10-16T19:58:07.028226+0000","last_fullsized":"2023-10-16T19:58:07.028226+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:03.569082+0000","last_clean_scrub_stamp":"2023-10-16T19:58:03.569082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:08.049237+0000","last_change":"2023-10-16T19:58:05.609385+0000","last_active":"2023-10-16T19:58:08.049237+0000","last_peered":"2023-10-16T19:58:08.049237+0000","last_clean":"2023-10-16T19:58:08.049237+0000","last_became_active":"2023-10-16T19:58:05.609118+0000","last_became_peered":"2023-10-16T19:58:05.609118+0000","last_unstale":"2023-10-16T19:58:08.049237+0000","last_undegraded":"2023-10-16T19:58:08.049237+0000","last_fullsized":"2023-10-16T19:58:08.049237+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:25.733115+0000","last_change":"2023-10-16T19:58:25.733158+0000","last_active":"2023-10-16T19:58:25.733115+0000","last_peered":"2023-10-16T19:58:25.733115+0000","last_clean":"2023-10-16T19:58:25.733115+0000","last_became_active":"2023-10-16T19:58:04.585930+0000","last_became_peered":"2023-10-16T19:58:04.585930+0000","last_unstale":"2023-10-16T19:58:25.733115+0000","last_undegraded":"2023-10-16T19:58:25.733115+0000","last_fullsized":"2023-10-16T19:58:25.733115+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:25.733051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:25.733051+0000","last_clean_scrub_stamp":"2023-10-16T19:58:25.733051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:45:57.081332+0000","scrub_duration":0.0011102449999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"33'119","reported_seq":186,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:22.694653+0000","last_change":"2023-10-16T19:58:22.694722+0000","last_active":"2023-10-16T19:58:22.694653+0000","last_peered":"2023-10-16T19:58:22.694653+0000","last_clean":"2023-10-16T19:58:22.694653+0000","last_became_active":"2023-10-16T19:56:58.775567+0000","last_became_peered":"2023-10-16T19:56:58.775567+0000","last_unstale":"2023-10-16T19:58:22.694653+0000","last_undegraded":"2023-10-16T19:58:22.694653+0000","last_fullsized":"2023-10-16T19:58:22.694653+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'119","last_scrub_stamp":"2023-10-16T19:58:22.694592+0000","last_deep_scrub":"33'119","last_deep_scrub_stamp":"2023-10-16T19:58:22.694592+0000","last_clean_scrub_stamp":"2023-10-16T19:58:22.694592+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:08:57.161893+0000","scrub_duration":0.003477178,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574870,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":718,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194594,"statfs":{"total":200000000,"available":199264318,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 19:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.59299999999999997}]},{"osd":1,"last update":"Mon Oct 16 19:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.42799999999999999}]},{"osd":2,"last update":"Mon Oct 16 19:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.47699999999999998}]},{"osd":3,"last update":"Mon Oct 16 19:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.625},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.57099999999999995}]},{"osd":4,"last update":"Mon Oct 16 19:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.498}]},{"osd":5,"last update":"Mon Oct 16 19:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"last":0.53200000000000003}]},{"osd":6,"last update":"Mon Oct 16 19:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.63600000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574870,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":142,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195170,"statfs":{"total":200000000,"available":199854160,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 19:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.63100000000000001}]},{"osd":1,"last update":"Mon Oct 16 19:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.59599999999999997}]},{"osd":2,"last update":"Mon Oct 16 19:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.58299999999999996}]},{"osd":3,"last update":"Mon Oct 16 19:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.61299999999999999}]},{"osd":4,"last update":"Mon Oct 16 19:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.435},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.38700000000000001}]},{"osd":5,"last update":"Mon Oct 16 19:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.52100000000000002}]},{"osd":7,"last update":"Mon Oct 16 19:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.497},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.47099999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574870,"num_pgs":32,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":143,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195169,"statfs":{"total":200000000,"available":199853142,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 19:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"min":{"1min":0.19700000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"last":0.27400000000000002},{"interface":"front","average":{"1min":0.309,"5min":0.309,"15min":0.309},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"last":0.36499999999999999}]},{"osd":2,"last update":"Mon Oct 16 19:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.443,"5min":0.443,"15min":0.443},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"last":0.42299999999999999}]},{"osd":3,"last update":"Mon Oct 16 19:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"last":0.34300000000000003}]},{"osd":4,"last update":"Mon Oct 16 19:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.629},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.51500000000000001}]},{"osd":5,"last update":"Mon Oct 16 19:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.56899999999999995}]},{"osd":6,"last update":"Mon Oct 16 19:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.53100000000000003}]},{"osd":7,"last update":"Mon Oct 16 19:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.54500000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574870,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":718,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194594,"statfs":{"total":200000000,"available":199264408,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 16 19:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":11.031000000000001,"5min":11.031000000000001,"15min":11.031000000000001},"last":0.41699999999999998},{"interface":"front","average":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":12.218,"5min":12.218,"15min":12.218},"last":0.46400000000000002}]},{"osd":2,"last update":"Mon Oct 16 19:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":11.058,"5min":11.058,"15min":11.058},"last":0.30099999999999999},{"interface":"front","average":{"1min":1.123,"5min":1.123,"15min":1.123},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":14.763999999999999,"5min":14.763999999999999,"15min":14.763999999999999},"last":0.39500000000000002}]},{"osd":3,"last update":"Mon Oct 16 19:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":10.935,"5min":10.935,"15min":10.935},"last":0.436},{"interface":"front","average":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":11.083,"5min":11.083,"15min":11.083},"last":0.34899999999999998}]},{"osd":4,"last update":"Mon Oct 16 19:57:58 2023","interfaces":[{"interface":"back","average":{"1min":1.196,"5min":1.196,"15min":1.196},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":12.279,"5min":12.279,"15min":12.279},"last":0.69699999999999995},{"interface":"front","average":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":10.879,"5min":10.879,"15min":10.879},"last":0.70999999999999996}]},{"osd":5,"last update":"Mon Oct 16 19:57:58 2023","interfaces":[{"interface":"back","average":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":10.907,"5min":10.907,"15min":10.907},"last":0.74199999999999999},{"interface":"front","average":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":11,"5min":11,"15min":11},"last":0.55000000000000004}]},{"osd":6,"last update":"Mon Oct 16 19:57:58 2023","interfaces":[{"interface":"back","average":{"1min":1.157,"5min":1.157,"15min":1.157},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":10.972,"5min":10.972,"15min":10.972},"last":0.67900000000000005},{"interface":"front","average":{"1min":1.24,"5min":1.24,"15min":1.24},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":12.34,"5min":12.34,"15min":12.34},"last":0.56399999999999995}]},{"osd":7,"last update":"Mon Oct 16 19:57:58 2023","interfaces":[{"interface":"back","average":{"1min":1.252,"5min":1.252,"15min":1.252},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":12.311,"5min":12.311,"15min":12.311},"last":0.60799999999999998},{"interface":"front","average":{"1min":1.167,"5min":1.167,"15min":1.167},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":10.845000000000001,"5min":10.845000000000001,"15min":10.845000000000001},"last":0.65000000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574870,"num_pgs":17,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":141,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195170,"statfs":{"total":200000000,"available":199854706,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 19:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"min":{"1min":0.17899999999999999,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"min":{"1min":0.20100000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.50700000000000001}]},{"osd":1,"last update":"Mon Oct 16 19:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.375,"15min":0.375},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.37,"5min":0.37,"15min":0.37},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"last":0.55600000000000005}]},{"osd":3,"last update":"Mon Oct 16 19:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.628}]},{"osd":4,"last update":"Mon Oct 16 19:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.81299999999999994}]},{"osd":5,"last update":"Mon Oct 16 19:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.89800000000000002}]},{"osd":6,"last update":"Mon Oct 16 19:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.69399999999999995}]},{"osd":7,"last update":"Mon Oct 16 19:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.86899999999999999},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.82799999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574870,"num_pgs":31,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":143,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195169,"statfs":{"total":200000000,"available":199853142,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 19:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"last":0.30599999999999999},{"interface":"front","average":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.498,"5min":0.498,"15min":0.498},"last":0.42599999999999999}]},{"osd":1,"last update":"Mon Oct 16 19:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"min":{"1min":0.20499999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.40699999999999997}]},{"osd":2,"last update":"Mon Oct 16 19:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.47199999999999998}]},{"osd":4,"last update":"Mon Oct 16 19:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.63700000000000001}]},{"osd":5,"last update":"Mon Oct 16 19:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.626},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.65700000000000003}]},{"osd":6,"last update":"Mon Oct 16 19:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.56799999999999995}]},{"osd":7,"last update":"Mon Oct 16 19:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.2030000000000001,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.139,"5min":1.139,"15min":1.139},"last":0.58499999999999996}]}]},{"osd":4,"up_from":13,"seq":55834574870,"num_pgs":29,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":141,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195170,"statfs":{"total":200000000,"available":199854672,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 19:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.33800000000000002},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.40899999999999997}]},{"osd":1,"last update":"Mon Oct 16 19:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.034,"5min":1.034,"15min":1.034},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.47399999999999998}]},{"osd":2,"last update":"Mon Oct 16 19:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.103,"5min":1.103,"15min":1.103},"last":0.63},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.38900000000000001}]},{"osd":3,"last update":"Mon Oct 16 19:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.071,"5min":1.071,"15min":1.071},"last":0.59799999999999998}]},{"osd":5,"last update":"Mon Oct 16 19:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.58099999999999996}]},{"osd":6,"last update":"Mon Oct 16 19:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.54200000000000004}]},{"osd":7,"last update":"Mon Oct 16 19:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.67100000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574870,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":142,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195170,"statfs":{"total":200000000,"available":199854104,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 19:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.56100000000000005}]},{"osd":1,"last update":"Mon Oct 16 19:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":7.9989999999999997,"5min":7.9989999999999997,"15min":7.9989999999999997},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":8.0150000000000006,"5min":8.0150000000000006,"15min":8.0150000000000006},"last":0.57899999999999996}]},{"osd":2,"last update":"Mon Oct 16 19:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":1.032,"5min":1.032,"15min":1.032},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.59099999999999997}]},{"osd":3,"last update":"Mon Oct 16 19:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":8.077,"5min":8.077,"15min":8.077},"last":0.624},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.65100000000000002}]},{"osd":4,"last update":"Mon Oct 16 19:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.47299999999999998}]},{"osd":6,"last update":"Mon Oct 16 19:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.66000000000000003}]},{"osd":7,"last update":"Mon Oct 16 19:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.70499999999999996}]}]}],"pool_statfs":[]}} 2023-10-16T19:58:40.796 INFO:tasks.ceph:pgid 5.3f last_scrub_stamp 2023-10-16T19:58:04.573644+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=4, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=15, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:58:40.796 INFO:tasks.ceph:pgid 5.3e last_scrub_stamp 2023-10-16T19:58:04.573644+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=4, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=15, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:58:40.797 INFO:tasks.ceph:pgid 5.3c last_scrub_stamp 2023-10-16T19:58:04.573644+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=4, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=15, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:58:40.797 INFO:tasks.ceph:pgid 5.3b last_scrub_stamp 2023-10-16T19:58:04.573644+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=4, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=15, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:58:40.798 INFO:tasks.ceph:pgid 5.3a last_scrub_stamp 2023-10-16T19:58:04.573644+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=4, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=15, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:58:40.798 INFO:tasks.ceph:pgid 5.37 last_scrub_stamp 2023-10-16T19:58:04.573644+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=4, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=15, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:58:40.798 INFO:tasks.ceph:pgid 5.35 last_scrub_stamp 2023-10-16T19:58:04.573644+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=4, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=15, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:58:40.799 INFO:tasks.ceph:pgid 5.32 last_scrub_stamp 2023-10-16T19:58:04.573644+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=4, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=15, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:58:40.799 INFO:tasks.ceph:pgid 5.30 last_scrub_stamp 2023-10-16T19:58:04.573644+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=4, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=15, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:58:40.800 INFO:tasks.ceph:pgid 5.2e last_scrub_stamp 2023-10-16T19:58:04.573644+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=4, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=15, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:58:40.800 INFO:tasks.ceph:pgid 5.2d last_scrub_stamp 2023-10-16T19:58:04.573644+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=4, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=15, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:58:40.800 INFO:tasks.ceph:pgid 5.2c last_scrub_stamp 2023-10-16T19:58:04.573644+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=4, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=15, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:58:40.801 INFO:tasks.ceph:pgid 5.2b last_scrub_stamp 2023-10-16T19:58:04.573644+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=4, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=15, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:58:40.801 INFO:tasks.ceph:pgid 5.2a last_scrub_stamp 2023-10-16T19:58:04.573644+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=4, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=15, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:58:40.801 INFO:tasks.ceph:pgid 5.29 last_scrub_stamp 2023-10-16T19:58:04.573644+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=4, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=15, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:58:40.802 INFO:tasks.ceph:pgid 5.27 last_scrub_stamp 2023-10-16T19:58:04.573644+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=4, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=15, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:58:40.802 INFO:tasks.ceph:pgid 5.26 last_scrub_stamp 2023-10-16T19:58:04.573644+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=4, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=15, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:58:40.802 INFO:tasks.ceph:pgid 5.25 last_scrub_stamp 2023-10-16T19:58:04.573644+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=4, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=15, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:58:40.803 INFO:tasks.ceph:pgid 5.23 last_scrub_stamp 2023-10-16T19:58:04.573644+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=4, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=15, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:58:40.803 INFO:tasks.ceph:pgid 5.21 last_scrub_stamp 2023-10-16T19:58:04.573644+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=4, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=15, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:58:40.804 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2023-10-16T19:58:04.573644+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=4, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=15, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:58:40.804 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2023-10-16T19:58:04.573644+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=4, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=15, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:58:40.804 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2023-10-16T19:58:04.573644+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=4, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=15, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:58:40.805 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2023-10-16T19:58:04.573644+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=4, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=15, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:58:40.805 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2023-10-16T19:58:04.573644+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=4, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=15, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:58:40.806 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2023-10-16T19:58:04.573644+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=4, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=15, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:58:40.806 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2023-10-16T19:58:04.573644+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=4, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=15, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:58:40.807 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2023-10-16T19:58:04.573644+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=4, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=15, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:58:40.807 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2023-10-16T19:58:03.569082+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=3, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=15, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:58:40.807 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2023-10-16T19:58:03.569082+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=3, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=15, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:58:40.808 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2023-10-16T19:58:04.573644+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=4, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=15, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:58:40.808 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2023-10-16T19:58:03.569082+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=3, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=15, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:58:40.809 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2023-10-16T19:58:04.573644+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=4, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=15, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:58:40.809 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2023-10-16T19:58:03.569082+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=3, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=15, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:58:40.810 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2023-10-16T19:58:03.569082+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=3, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=15, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:58:40.810 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2023-10-16T19:58:04.573644+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=4, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=15, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:58:40.811 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2023-10-16T19:58:04.573644+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=4, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=15, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:58:40.811 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2023-10-16T19:58:04.573644+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=4, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=15, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:58:40.812 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2023-10-16T19:58:04.573644+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=4, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=15, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:58:40.812 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2023-10-16T19:58:04.573644+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=4, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=15, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:58:40.813 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2023-10-16T19:58:04.573644+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=4, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=15, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:58:40.813 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2023-10-16T19:58:04.573644+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=4, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=15, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:58:40.813 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2023-10-16T19:58:03.569082+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=3, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=15, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:58:40.814 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2023-10-16T19:58:04.573644+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=4, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=15, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:58:40.814 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-16T19:59:00.816 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-16T19:59:00.950 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:00.947+0000 7f1effd71700 1 Processor -- start 2023-10-16T19:59:00.950 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:00.947+0000 7f1effd71700 1 -- start start 2023-10-16T19:59:00.954 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:00.948+0000 7f1effd71700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f1ef815b130 0x7f1ef8071f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:59:00.954 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:00.948+0000 7f1effd71700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ef80cefc0 con 0x7f1ef806eb20 2023-10-16T19:59:00.955 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:00.948+0000 7f1effd71700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ef806e090 con 0x7f1ef806d0f0 2023-10-16T19:59:00.955 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:00.948+0000 7f1effd71700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ef80b0050 con 0x7f1ef815b130 2023-10-16T19:59:00.955 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:00.948+0000 7f1efe30e700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f1ef806eb20 0x7f1ef80cf450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:57798/0 (socket says 172.21.15.157:57798) 2023-10-16T19:59:00.955 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:00.948+0000 7f1efe30e700 1 -- 172.21.15.157:0/2221102222 learned_addr learned my addr 172.21.15.157:0/2221102222 (peer_addr_for_me v1:172.21.15.157:0/0) 2023-10-16T19:59:00.956 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:00.949+0000 7f1efdb0d700 1 --2- 172.21.15.157:0/2221102222 >> v2:172.21.15.187:3300/0 conn(0x7f1ef815b130 0x7f1ef8071f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:59:00.956 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:00.949+0000 7f1efcb0b700 1 -- 172.21.15.157:0/2221102222 <== mon.0 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 226848072 0 0) 0x7f1ef80cefc0 con 0x7f1ef806eb20 2023-10-16T19:59:00.956 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:00.949+0000 7f1efcb0b700 1 -- 172.21.15.157:0/2221102222 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1ee40035b0 con 0x7f1ef806eb20 2023-10-16T19:59:00.956 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:00.949+0000 7f1efcb0b700 1 -- 172.21.15.157:0/2221102222 <== mon.0 v1:172.21.15.157:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2394650943 0 0) 0x7f1ee40035b0 con 0x7f1ef806eb20 2023-10-16T19:59:00.957 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:00.949+0000 7f1efcb0b700 1 -- 172.21.15.157:0/2221102222 >> v2:172.21.15.187:3300/0 conn(0x7f1ef815b130 msgr2=0x7f1ef8071f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:59:00.957 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:00.949+0000 7f1efcb0b700 1 --2- 172.21.15.157:0/2221102222 >> v2:172.21.15.187:3300/0 conn(0x7f1ef815b130 0x7f1ef8071f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:59:00.957 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:00.949+0000 7f1efcb0b700 1 -- 172.21.15.157:0/2221102222 >> v1:172.21.15.187:6789/0 conn(0x7f1ef806d0f0 legacy=0x7f1ef80cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:59:00.958 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:00.949+0000 7f1efcb0b700 1 -- 172.21.15.157:0/2221102222 --> v1:172.21.15.157:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ef806d570 con 0x7f1ef806eb20 2023-10-16T19:59:00.958 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:00.949+0000 7f1efcb0b700 1 -- 172.21.15.157:0/2221102222 <== mon.0 v1:172.21.15.157:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4021145519 0 0) 0x7f1ef0001a40 con 0x7f1ef806eb20 2023-10-16T19:59:00.958 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:00.949+0000 7f1efcb0b700 1 -- 172.21.15.157:0/2221102222 >> v1:172.21.15.157:6789/0 conn(0x7f1ef806eb20 legacy=0x7f1ef80cf450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:59:00.959 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:00.949+0000 7f1efcb0b700 1 --2- 172.21.15.157:0/2221102222 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1ee4003a00 0x7f1ee4003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:59:00.959 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:00.949+0000 7f1efcb0b700 1 --2- 172.21.15.157:0/2221102222 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1ee4004850 0x7f1ee4004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:59:00.959 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:00.949+0000 7f1efcb0b700 1 --2- 172.21.15.157:0/2221102222 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1ee4005330 0x7f1ee400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:59:00.959 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:00.949+0000 7f1efcb0b700 1 -- 172.21.15.157:0/2221102222 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ee400c1d0 con 0x7f1ee4005330 2023-10-16T19:59:00.960 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:00.949+0000 7f1efcb0b700 1 -- 172.21.15.157:0/2221102222 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ee400c340 con 0x7f1ee4004850 2023-10-16T19:59:00.960 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:00.949+0000 7f1efcb0b700 1 -- 172.21.15.157:0/2221102222 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ee400c500 con 0x7f1ee4003a00 2023-10-16T19:59:00.960 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:00.949+0000 7f1efe30e700 1 --2- 172.21.15.157:0/2221102222 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1ee4005330 0x7f1ee400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:59:00.961 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:00.949+0000 7f1efdb0d700 1 --2- 172.21.15.157:0/2221102222 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1ee4003a00 0x7f1ee4003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:59:00.961 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:00.949+0000 7f1efd30c700 1 --2- 172.21.15.157:0/2221102222 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1ee4004850 0x7f1ee4004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:59:00.961 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:00.949+0000 7f1efe30e700 1 -- 172.21.15.157:0/2221102222 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1ee4003a00 msgr2=0x7f1ee4003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:59:00.961 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:00.949+0000 7f1efe30e700 1 --2- 172.21.15.157:0/2221102222 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1ee4003a00 0x7f1ee4003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:59:00.962 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:00.949+0000 7f1efe30e700 1 -- 172.21.15.157:0/2221102222 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1ee4004850 msgr2=0x7f1ee4004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:59:00.962 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:00.949+0000 7f1efe30e700 1 --2- 172.21.15.157:0/2221102222 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1ee4004850 0x7f1ee4004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:59:00.962 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:00.949+0000 7f1efe30e700 1 -- 172.21.15.157:0/2221102222 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ee40035b0 con 0x7f1ee4005330 2023-10-16T19:59:00.962 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:00.949+0000 7f1efe30e700 1 -- 172.21.15.157:0/2221102222 reap_dead start 2023-10-16T19:59:00.963 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:00.950+0000 7f1efe30e700 1 --2- 172.21.15.157:0/2221102222 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1ee4005330 0x7f1ee400ba10 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f1ef0002280 tx=0x7f1ee4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd57b0bedace47be server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:59:00.963 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:00.950+0000 7f1efcb0b700 1 -- 172.21.15.157:0/2221102222 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ef00072d0 con 0x7f1ee4005330 2023-10-16T19:59:00.963 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:00.950+0000 7f1efcb0b700 1 -- 172.21.15.157:0/2221102222 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ef0007430 con 0x7f1ee4005330 2023-10-16T19:59:00.964 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:00.950+0000 7f1efcb0b700 1 -- 172.21.15.157:0/2221102222 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ef00077e0 con 0x7f1ee4005330 2023-10-16T19:59:00.964 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:00.950+0000 7f1effd71700 1 -- 172.21.15.157:0/2221102222 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1ee4005330 msgr2=0x7f1ee400ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:59:00.964 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:00.950+0000 7f1effd71700 1 --2- 172.21.15.157:0/2221102222 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1ee4005330 0x7f1ee400ba10 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f1ef0002280 tx=0x7f1ee4005880 comp rx=0 tx=0).stop 2023-10-16T19:59:00.964 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:00.950+0000 7f1effd71700 1 -- 172.21.15.157:0/2221102222 shutdown_connections 2023-10-16T19:59:00.965 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:00.950+0000 7f1effd71700 1 --2- 172.21.15.157:0/2221102222 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1ee4005330 0x7f1ee400ba10 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:59:00.965 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:00.950+0000 7f1effd71700 1 -- 172.21.15.157:0/2221102222 >> 172.21.15.157:0/2221102222 conn(0x7f1ef80cd4e0 msgr2=0x7f1ef80cd8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:59:00.965 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:00.950+0000 7f1effd71700 1 -- 172.21.15.157:0/2221102222 shutdown_connections 2023-10-16T19:59:00.966 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:00.950+0000 7f1effd71700 1 -- 172.21.15.157:0/2221102222 wait complete. 2023-10-16T19:59:00.966 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:00.951+0000 7f1effd71700 1 Processor -- start 2023-10-16T19:59:00.966 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:00.952+0000 7f1effd71700 1 -- start start 2023-10-16T19:59:00.969 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:00.952+0000 7f1effd71700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1ee4005330 0x7f1ef80b4990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:59:00.969 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:00.952+0000 7f1effd71700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1ef8157a80 0x7f1ef8157fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:59:00.969 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:00.952+0000 7f1effd71700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1ef8157360 0x7f1ef80cf170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:59:00.970 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:00.952+0000 7f1effd71700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ef80b41d0 con 0x7f1ee4005330 2023-10-16T19:59:00.970 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:00.952+0000 7f1effd71700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ef80b50f0 con 0x7f1ef8157a80 2023-10-16T19:59:00.970 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:00.952+0000 7f1effd71700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ef80b53d0 con 0x7f1ef8157360 2023-10-16T19:59:00.971 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:00.952+0000 7f1efdb0d700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1ee4005330 0x7f1ef80b4990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:59:00.971 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:00.952+0000 7f1efdb0d700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1ee4005330 0x7f1ef80b4990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:48134/0 (socket says 172.21.15.157:48134) 2023-10-16T19:59:00.971 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:00.952+0000 7f1efdb0d700 1 -- 172.21.15.157:0/3754519513 learned_addr learned my addr 172.21.15.157:0/3754519513 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:59:00.971 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:00.952+0000 7f1efd30c700 1 --2- 172.21.15.157:0/3754519513 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1ef8157a80 0x7f1ef8157fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:59:00.972 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:00.952+0000 7f1efe30e700 1 --2- 172.21.15.157:0/3754519513 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1ef8157360 0x7f1ef80cf170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:59:00.972 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:00.953+0000 7f1efdb0d700 1 -- 172.21.15.157:0/3754519513 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1ef8157360 msgr2=0x7f1ef80cf170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:59:00.972 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:00.953+0000 7f1efdb0d700 1 --2- 172.21.15.157:0/3754519513 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1ef8157360 0x7f1ef80cf170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:59:00.973 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:00.953+0000 7f1efdb0d700 1 -- 172.21.15.157:0/3754519513 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1ef8157a80 msgr2=0x7f1ef8157fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:59:00.973 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:00.953+0000 7f1efdb0d700 1 --2- 172.21.15.157:0/3754519513 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1ef8157a80 0x7f1ef8157fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:59:00.973 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:00.953+0000 7f1efdb0d700 1 -- 172.21.15.157:0/3754519513 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ef80b4470 con 0x7f1ee4005330 2023-10-16T19:59:00.973 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:00.953+0000 7f1efd30c700 1 --2- 172.21.15.157:0/3754519513 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1ef8157a80 0x7f1ef8157fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T19:59:00.974 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:00.953+0000 7f1efdb0d700 1 --2- 172.21.15.157:0/3754519513 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1ee4005330 0x7f1ef80b4990 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f1ee80119a0 tx=0x7f1ee8011d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:59:00.974 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:00.953+0000 7f1eee7fc700 1 -- 172.21.15.157:0/3754519513 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ee800f940 con 0x7f1ee4005330 2023-10-16T19:59:00.974 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:00.953+0000 7f1eee7fc700 1 -- 172.21.15.157:0/3754519513 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ee800faa0 con 0x7f1ee4005330 2023-10-16T19:59:00.975 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:00.953+0000 7f1effd71700 1 -- 172.21.15.157:0/3754519513 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ef81577f0 con 0x7f1ee4005330 2023-10-16T19:59:00.975 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:00.953+0000 7f1eee7fc700 1 -- 172.21.15.157:0/3754519513 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ee800fe30 con 0x7f1ee4005330 2023-10-16T19:59:00.975 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:00.953+0000 7f1effd71700 1 -- 172.21.15.157:0/3754519513 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ef80c9c80 con 0x7f1ee4005330 2023-10-16T19:59:00.975 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:00.954+0000 7f1effd71700 1 -- 172.21.15.157:0/3754519513 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ef804f400 con 0x7f1ee4005330 2023-10-16T19:59:00.976 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:00.954+0000 7f1eee7fc700 1 -- 172.21.15.157:0/3754519513 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f1ee8014440 con 0x7f1ee4005330 2023-10-16T19:59:00.976 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:00.955+0000 7f1eee7fc700 1 --2- 172.21.15.157:0/3754519513 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f1edc06af00 0x7f1edc06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:59:00.976 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:00.955+0000 7f1eee7fc700 1 -- 172.21.15.157:0/3754519513 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5729+0+0 (secure 0 0 0) 0x7f1ee8089dd0 con 0x7f1ee4005330 2023-10-16T19:59:00.977 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:00.955+0000 7f1efd30c700 1 --2- 172.21.15.157:0/3754519513 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f1edc06af00 0x7f1edc06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:59:00.977 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:00.955+0000 7f1efd30c700 1 --2- 172.21.15.157:0/3754519513 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f1edc06af00 0x7f1edc06d3c0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f1ef81593e0 tx=0x7f1ef4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:59:00.977 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:00.959+0000 7f1eee7fc700 1 -- 172.21.15.157:0/3754519513 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1ee8054e60 con 0x7f1ee4005330 2023-10-16T19:59:01.144 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:01.142+0000 7f1effd71700 1 -- 172.21.15.157:0/3754519513 --> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1ef806dad0 con 0x7f1edc06af00 2023-10-16T19:59:01.153 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:01.151+0000 7f1eee7fc700 1 -- 172.21.15.157:0/3754519513 <== mgr.4100 v2:172.21.15.187:6832/2426285296 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286018 (secure 0 0 0) 0x7f1ef40013b0 con 0x7f1edc06af00 2023-10-16T19:59:01.157 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-10-16T19:59:01.159 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:01.154+0000 7f1effd71700 1 -- 172.21.15.157:0/3754519513 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f1edc06af00 msgr2=0x7f1edc06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:59:01.160 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:01.154+0000 7f1effd71700 1 --2- 172.21.15.157:0/3754519513 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f1edc06af00 0x7f1edc06d3c0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f1ef81593e0 tx=0x7f1ef4009040 comp rx=0 tx=0).stop 2023-10-16T19:59:01.160 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:01.154+0000 7f1effd71700 1 -- 172.21.15.157:0/3754519513 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1ee4005330 msgr2=0x7f1ef80b4990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:59:01.160 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:01.154+0000 7f1effd71700 1 --2- 172.21.15.157:0/3754519513 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1ee4005330 0x7f1ef80b4990 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f1ee80119a0 tx=0x7f1ee8011d60 comp rx=0 tx=0).stop 2023-10-16T19:59:01.160 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:01.154+0000 7f1effd71700 1 -- 172.21.15.157:0/3754519513 shutdown_connections 2023-10-16T19:59:01.161 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:01.154+0000 7f1effd71700 1 --2- 172.21.15.157:0/3754519513 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1ef8157360 0x7f1ef80cf170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:59:01.161 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:01.154+0000 7f1effd71700 1 --2- 172.21.15.157:0/3754519513 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1ee4005330 0x7f1ef80b4990 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:59:01.161 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:01.154+0000 7f1effd71700 1 --2- 172.21.15.157:0/3754519513 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f1edc06af00 0x7f1edc06d3c0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:59:01.162 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:01.154+0000 7f1effd71700 1 --2- 172.21.15.157:0/3754519513 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1ef8157a80 0x7f1ef8157fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:59:01.162 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:01.154+0000 7f1effd71700 1 -- 172.21.15.157:0/3754519513 >> 172.21.15.157:0/3754519513 conn(0x7f1ef80cd4e0 msgr2=0x7f1ef80b6360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:59:01.162 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:01.154+0000 7f1effd71700 1 -- 172.21.15.157:0/3754519513 shutdown_connections 2023-10-16T19:59:01.162 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:01.154+0000 7f1effd71700 1 -- 172.21.15.157:0/3754519513 wait complete. 2023-10-16T19:59:01.163 INFO:teuthology.orchestra.run.smithi157.stderr:dumped all 2023-10-16T19:59:01.168 INFO:teuthology.orchestra.run.smithi157.stdout:{"pg_ready":true,"pg_map":{"version":86,"stamp":"2023-10-16T19:59:00.919459+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161,"ondisk_log_size":161,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":2292,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560207,"statfs":{"total":1600000000,"available":1597652652,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003145"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:40.629629+0000","last_change":"2023-10-16T19:58:40.629706+0000","last_active":"2023-10-16T19:58:40.629629+0000","last_peered":"2023-10-16T19:58:40.629629+0000","last_clean":"2023-10-16T19:58:40.629629+0000","last_became_active":"2023-10-16T19:58:05.597025+0000","last_became_peered":"2023-10-16T19:58:05.597025+0000","last_unstale":"2023-10-16T19:58:40.629629+0000","last_undegraded":"2023-10-16T19:58:40.629629+0000","last_fullsized":"2023-10-16T19:58:40.629629+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:40.629567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:40.629567+0000","last_clean_scrub_stamp":"2023-10-16T19:58:40.629567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:13:17.057587+0000","scrub_duration":0.001095866,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:54.090772+0000","last_change":"2023-10-16T19:58:54.090815+0000","last_active":"2023-10-16T19:58:54.090772+0000","last_peered":"2023-10-16T19:58:54.090772+0000","last_clean":"2023-10-16T19:58:54.090772+0000","last_became_active":"2023-10-16T19:58:05.605969+0000","last_became_peered":"2023-10-16T19:58:05.605969+0000","last_unstale":"2023-10-16T19:58:54.090772+0000","last_undegraded":"2023-10-16T19:58:54.090772+0000","last_fullsized":"2023-10-16T19:58:54.090772+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:54.090695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:54.090695+0000","last_clean_scrub_stamp":"2023-10-16T19:58:54.090695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:38:48.133425+0000","scrub_duration":0.001185649,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:31.829149+0000","last_change":"2023-10-16T19:58:31.829214+0000","last_active":"2023-10-16T19:58:31.829149+0000","last_peered":"2023-10-16T19:58:31.829149+0000","last_clean":"2023-10-16T19:58:31.829149+0000","last_became_active":"2023-10-16T19:58:05.601072+0000","last_became_peered":"2023-10-16T19:58:05.601072+0000","last_unstale":"2023-10-16T19:58:31.829149+0000","last_undegraded":"2023-10-16T19:58:31.829149+0000","last_fullsized":"2023-10-16T19:58:31.829149+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:31.829086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:31.829086+0000","last_clean_scrub_stamp":"2023-10-16T19:58:31.829086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:16:59.183747+0000","scrub_duration":0.002102483,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:56.025035+0000","last_change":"2023-10-16T19:58:56.025119+0000","last_active":"2023-10-16T19:58:56.025035+0000","last_peered":"2023-10-16T19:58:56.025035+0000","last_clean":"2023-10-16T19:58:56.025035+0000","last_became_active":"2023-10-16T19:58:05.603003+0000","last_became_peered":"2023-10-16T19:58:05.603003+0000","last_unstale":"2023-10-16T19:58:56.025035+0000","last_undegraded":"2023-10-16T19:58:56.025035+0000","last_fullsized":"2023-10-16T19:58:56.025035+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:56.024962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:56.024962+0000","last_clean_scrub_stamp":"2023-10-16T19:58:56.024962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:52:05.084694+0000","scrub_duration":0.001872308,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:37.412052+0000","last_change":"2023-10-16T19:58:37.412118+0000","last_active":"2023-10-16T19:58:37.412052+0000","last_peered":"2023-10-16T19:58:37.412052+0000","last_clean":"2023-10-16T19:58:37.412052+0000","last_became_active":"2023-10-16T19:58:05.602976+0000","last_became_peered":"2023-10-16T19:58:05.602976+0000","last_unstale":"2023-10-16T19:58:37.412052+0000","last_undegraded":"2023-10-16T19:58:37.412052+0000","last_fullsized":"2023-10-16T19:58:37.412052+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:37.411990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:37.411990+0000","last_clean_scrub_stamp":"2023-10-16T19:58:37.411990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:11:37.091739+0000","scrub_duration":0.0012063040000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:49.087777+0000","last_change":"2023-10-16T19:58:49.087827+0000","last_active":"2023-10-16T19:58:49.087777+0000","last_peered":"2023-10-16T19:58:49.087777+0000","last_clean":"2023-10-16T19:58:49.087777+0000","last_became_active":"2023-10-16T19:58:05.601803+0000","last_became_peered":"2023-10-16T19:58:05.601803+0000","last_unstale":"2023-10-16T19:58:49.087777+0000","last_undegraded":"2023-10-16T19:58:49.087777+0000","last_fullsized":"2023-10-16T19:58:49.087777+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:49.087720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:49.087720+0000","last_clean_scrub_stamp":"2023-10-16T19:58:49.087720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:33:07.393010+0000","scrub_duration":0.0013391049999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:27.747272+0000","last_change":"2023-10-16T19:58:27.747352+0000","last_active":"2023-10-16T19:58:27.747272+0000","last_peered":"2023-10-16T19:58:27.747272+0000","last_clean":"2023-10-16T19:58:27.747272+0000","last_became_active":"2023-10-16T19:58:05.605148+0000","last_became_peered":"2023-10-16T19:58:05.605148+0000","last_unstale":"2023-10-16T19:58:27.747272+0000","last_undegraded":"2023-10-16T19:58:27.747272+0000","last_fullsized":"2023-10-16T19:58:27.747272+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:27.747210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:27.747210+0000","last_clean_scrub_stamp":"2023-10-16T19:58:27.747210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:29:30.355570+0000","scrub_duration":0.0011117049999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:29.720322+0000","last_change":"2023-10-16T19:58:29.720365+0000","last_active":"2023-10-16T19:58:29.720322+0000","last_peered":"2023-10-16T19:58:29.720322+0000","last_clean":"2023-10-16T19:58:29.720322+0000","last_became_active":"2023-10-16T19:58:05.605200+0000","last_became_peered":"2023-10-16T19:58:05.605200+0000","last_unstale":"2023-10-16T19:58:29.720322+0000","last_undegraded":"2023-10-16T19:58:29.720322+0000","last_fullsized":"2023-10-16T19:58:29.720322+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:29.720263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:29.720263+0000","last_clean_scrub_stamp":"2023-10-16T19:58:29.720263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:09:36.426578+0000","scrub_duration":0.001250698,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:55.010296+0000","last_change":"2023-10-16T19:58:55.010363+0000","last_active":"2023-10-16T19:58:55.010296+0000","last_peered":"2023-10-16T19:58:55.010296+0000","last_clean":"2023-10-16T19:58:55.010296+0000","last_became_active":"2023-10-16T19:58:05.601910+0000","last_became_peered":"2023-10-16T19:58:05.601910+0000","last_unstale":"2023-10-16T19:58:55.010296+0000","last_undegraded":"2023-10-16T19:58:55.010296+0000","last_fullsized":"2023-10-16T19:58:55.010296+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:55.010208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:55.010208+0000","last_clean_scrub_stamp":"2023-10-16T19:58:55.010208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:58:42.136434+0000","scrub_duration":0.001463982,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:30.774857+0000","last_change":"2023-10-16T19:58:30.774939+0000","last_active":"2023-10-16T19:58:30.774857+0000","last_peered":"2023-10-16T19:58:30.774857+0000","last_clean":"2023-10-16T19:58:30.774857+0000","last_became_active":"2023-10-16T19:58:05.600356+0000","last_became_peered":"2023-10-16T19:58:05.600356+0000","last_unstale":"2023-10-16T19:58:30.774857+0000","last_undegraded":"2023-10-16T19:58:30.774857+0000","last_fullsized":"2023-10-16T19:58:30.774857+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:30.774800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:30.774800+0000","last_clean_scrub_stamp":"2023-10-16T19:58:30.774800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:20:26.019319+0000","scrub_duration":0.001101159,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:43.829863+0000","last_change":"2023-10-16T19:58:43.829930+0000","last_active":"2023-10-16T19:58:43.829863+0000","last_peered":"2023-10-16T19:58:43.829863+0000","last_clean":"2023-10-16T19:58:43.829863+0000","last_became_active":"2023-10-16T19:58:05.609979+0000","last_became_peered":"2023-10-16T19:58:05.609979+0000","last_unstale":"2023-10-16T19:58:43.829863+0000","last_undegraded":"2023-10-16T19:58:43.829863+0000","last_fullsized":"2023-10-16T19:58:43.829863+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:43.829781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:43.829781+0000","last_clean_scrub_stamp":"2023-10-16T19:58:43.829781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:51:52.889513+0000","scrub_duration":0.0015848959999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:23.733969+0000","last_change":"2023-10-16T19:58:23.734041+0000","last_active":"2023-10-16T19:58:23.733969+0000","last_peered":"2023-10-16T19:58:23.733969+0000","last_clean":"2023-10-16T19:58:23.733969+0000","last_became_active":"2023-10-16T19:58:05.600490+0000","last_became_peered":"2023-10-16T19:58:05.600490+0000","last_unstale":"2023-10-16T19:58:23.733969+0000","last_undegraded":"2023-10-16T19:58:23.733969+0000","last_fullsized":"2023-10-16T19:58:23.733969+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:23.733905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:23.733905+0000","last_clean_scrub_stamp":"2023-10-16T19:58:23.733905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:48:39.868641+0000","scrub_duration":0.0016637889999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:29.421483+0000","last_change":"2023-10-16T19:58:29.421528+0000","last_active":"2023-10-16T19:58:29.421483+0000","last_peered":"2023-10-16T19:58:29.421483+0000","last_clean":"2023-10-16T19:58:29.421483+0000","last_became_active":"2023-10-16T19:58:05.600614+0000","last_became_peered":"2023-10-16T19:58:05.600614+0000","last_unstale":"2023-10-16T19:58:29.421483+0000","last_undegraded":"2023-10-16T19:58:29.421483+0000","last_fullsized":"2023-10-16T19:58:29.421483+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:29.421421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:29.421421+0000","last_clean_scrub_stamp":"2023-10-16T19:58:29.421421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:25:02.966775+0000","scrub_duration":0.001050121,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:50.094082+0000","last_change":"2023-10-16T19:58:50.094124+0000","last_active":"2023-10-16T19:58:50.094082+0000","last_peered":"2023-10-16T19:58:50.094082+0000","last_clean":"2023-10-16T19:58:50.094082+0000","last_became_active":"2023-10-16T19:58:05.601569+0000","last_became_peered":"2023-10-16T19:58:05.601569+0000","last_unstale":"2023-10-16T19:58:50.094082+0000","last_undegraded":"2023-10-16T19:58:50.094082+0000","last_fullsized":"2023-10-16T19:58:50.094082+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:50.094021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:50.094021+0000","last_clean_scrub_stamp":"2023-10-16T19:58:50.094021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:22:39.892150+0000","scrub_duration":0.001091526,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:30.841918+0000","last_change":"2023-10-16T19:58:30.841995+0000","last_active":"2023-10-16T19:58:30.841918+0000","last_peered":"2023-10-16T19:58:30.841918+0000","last_clean":"2023-10-16T19:58:30.841918+0000","last_became_active":"2023-10-16T19:58:05.599026+0000","last_became_peered":"2023-10-16T19:58:05.599026+0000","last_unstale":"2023-10-16T19:58:30.841918+0000","last_undegraded":"2023-10-16T19:58:30.841918+0000","last_fullsized":"2023-10-16T19:58:30.841918+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:30.841860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:30.841860+0000","last_clean_scrub_stamp":"2023-10-16T19:58:30.841860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:58:17.968086+0000","scrub_duration":0.0011580990000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:45.874227+0000","last_change":"2023-10-16T19:58:45.874277+0000","last_active":"2023-10-16T19:58:45.874227+0000","last_peered":"2023-10-16T19:58:45.874227+0000","last_clean":"2023-10-16T19:58:45.874227+0000","last_became_active":"2023-10-16T19:58:05.609613+0000","last_became_peered":"2023-10-16T19:58:05.609613+0000","last_unstale":"2023-10-16T19:58:45.874227+0000","last_undegraded":"2023-10-16T19:58:45.874227+0000","last_fullsized":"2023-10-16T19:58:45.874227+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:45.874158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:45.874158+0000","last_clean_scrub_stamp":"2023-10-16T19:58:45.874158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:19:50.442372+0000","scrub_duration":0.00141573,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:28.729670+0000","last_change":"2023-10-16T19:58:28.729718+0000","last_active":"2023-10-16T19:58:28.729670+0000","last_peered":"2023-10-16T19:58:28.729670+0000","last_clean":"2023-10-16T19:58:28.729670+0000","last_became_active":"2023-10-16T19:58:05.608184+0000","last_became_peered":"2023-10-16T19:58:05.608184+0000","last_unstale":"2023-10-16T19:58:28.729670+0000","last_undegraded":"2023-10-16T19:58:28.729670+0000","last_fullsized":"2023-10-16T19:58:28.729670+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:28.729605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:28.729605+0000","last_clean_scrub_stamp":"2023-10-16T19:58:28.729605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:43:01.890586+0000","scrub_duration":0.0010799519999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:45.149133+0000","last_change":"2023-10-16T19:58:45.149181+0000","last_active":"2023-10-16T19:58:45.149133+0000","last_peered":"2023-10-16T19:58:45.149133+0000","last_clean":"2023-10-16T19:58:45.149133+0000","last_became_active":"2023-10-16T19:58:05.600977+0000","last_became_peered":"2023-10-16T19:58:05.600977+0000","last_unstale":"2023-10-16T19:58:45.149133+0000","last_undegraded":"2023-10-16T19:58:45.149133+0000","last_fullsized":"2023-10-16T19:58:45.149133+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:45.149076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:45.149076+0000","last_clean_scrub_stamp":"2023-10-16T19:58:45.149076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:38:54.529059+0000","scrub_duration":0.00099815699999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:43.158379+0000","last_change":"2023-10-16T19:58:43.158419+0000","last_active":"2023-10-16T19:58:43.158379+0000","last_peered":"2023-10-16T19:58:43.158379+0000","last_clean":"2023-10-16T19:58:43.158379+0000","last_became_active":"2023-10-16T19:58:05.601866+0000","last_became_peered":"2023-10-16T19:58:05.601866+0000","last_unstale":"2023-10-16T19:58:43.158379+0000","last_undegraded":"2023-10-16T19:58:43.158379+0000","last_fullsized":"2023-10-16T19:58:43.158379+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:43.158320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:43.158320+0000","last_clean_scrub_stamp":"2023-10-16T19:58:43.158320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:11:20.790744+0000","scrub_duration":0.0010806349999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:41.321085+0000","last_change":"2023-10-16T19:58:41.321127+0000","last_active":"2023-10-16T19:58:41.321085+0000","last_peered":"2023-10-16T19:58:41.321085+0000","last_clean":"2023-10-16T19:58:41.321085+0000","last_became_active":"2023-10-16T19:58:05.603536+0000","last_became_peered":"2023-10-16T19:58:05.603536+0000","last_unstale":"2023-10-16T19:58:41.321085+0000","last_undegraded":"2023-10-16T19:58:41.321085+0000","last_fullsized":"2023-10-16T19:58:41.321085+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:41.321033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:41.321033+0000","last_clean_scrub_stamp":"2023-10-16T19:58:41.321033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:45:08.998230+0000","scrub_duration":0.001431915,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:06.600690+0000","last_change":"2023-10-16T19:58:05.607035+0000","last_active":"2023-10-16T19:58:06.600690+0000","last_peered":"2023-10-16T19:58:06.600690+0000","last_clean":"2023-10-16T19:58:06.600690+0000","last_became_active":"2023-10-16T19:58:05.606725+0000","last_became_peered":"2023-10-16T19:58:05.606725+0000","last_unstale":"2023-10-16T19:58:06.600690+0000","last_undegraded":"2023-10-16T19:58:06.600690+0000","last_fullsized":"2023-10-16T19:58:06.600690+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:49.096785+0000","last_change":"2023-10-16T19:58:49.096833+0000","last_active":"2023-10-16T19:58:49.096785+0000","last_peered":"2023-10-16T19:58:49.096785+0000","last_clean":"2023-10-16T19:58:49.096785+0000","last_became_active":"2023-10-16T19:58:05.605335+0000","last_became_peered":"2023-10-16T19:58:05.605335+0000","last_unstale":"2023-10-16T19:58:49.096785+0000","last_undegraded":"2023-10-16T19:58:49.096785+0000","last_fullsized":"2023-10-16T19:58:49.096785+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:49.096717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:49.096717+0000","last_clean_scrub_stamp":"2023-10-16T19:58:49.096717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:57:27.151314+0000","scrub_duration":0.0014750150000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:52.693501+0000","last_change":"2023-10-16T19:58:52.693545+0000","last_active":"2023-10-16T19:58:52.693501+0000","last_peered":"2023-10-16T19:58:52.693501+0000","last_clean":"2023-10-16T19:58:52.693501+0000","last_became_active":"2023-10-16T19:58:05.609123+0000","last_became_peered":"2023-10-16T19:58:05.609123+0000","last_unstale":"2023-10-16T19:58:52.693501+0000","last_undegraded":"2023-10-16T19:58:52.693501+0000","last_fullsized":"2023-10-16T19:58:52.693501+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:52.693448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:52.693448+0000","last_clean_scrub_stamp":"2023-10-16T19:58:52.693448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:29:55.301808+0000","scrub_duration":0.001108337,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:22.683742+0000","last_change":"2023-10-16T19:58:22.683803+0000","last_active":"2023-10-16T19:58:22.683742+0000","last_peered":"2023-10-16T19:58:22.683742+0000","last_clean":"2023-10-16T19:58:22.683742+0000","last_became_active":"2023-10-16T19:58:05.599210+0000","last_became_peered":"2023-10-16T19:58:05.599210+0000","last_unstale":"2023-10-16T19:58:22.683742+0000","last_undegraded":"2023-10-16T19:58:22.683742+0000","last_fullsized":"2023-10-16T19:58:22.683742+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:22.683671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:22.683671+0000","last_clean_scrub_stamp":"2023-10-16T19:58:22.683671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:14:26.928272+0000","scrub_duration":0.0016721489999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:47.936597+0000","last_change":"2023-10-16T19:58:47.936646+0000","last_active":"2023-10-16T19:58:47.936597+0000","last_peered":"2023-10-16T19:58:47.936597+0000","last_clean":"2023-10-16T19:58:47.936597+0000","last_became_active":"2023-10-16T19:58:05.608010+0000","last_became_peered":"2023-10-16T19:58:05.608010+0000","last_unstale":"2023-10-16T19:58:47.936597+0000","last_undegraded":"2023-10-16T19:58:47.936597+0000","last_fullsized":"2023-10-16T19:58:47.936597+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:47.936533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:47.936533+0000","last_clean_scrub_stamp":"2023-10-16T19:58:47.936533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:06:03.078356+0000","scrub_duration":0.0014174140000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:55.064681+0000","last_change":"2023-10-16T19:58:55.064763+0000","last_active":"2023-10-16T19:58:55.064681+0000","last_peered":"2023-10-16T19:58:55.064681+0000","last_clean":"2023-10-16T19:58:55.064681+0000","last_became_active":"2023-10-16T19:58:05.607185+0000","last_became_peered":"2023-10-16T19:58:05.607185+0000","last_unstale":"2023-10-16T19:58:55.064681+0000","last_undegraded":"2023-10-16T19:58:55.064681+0000","last_fullsized":"2023-10-16T19:58:55.064681+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:55.064627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:55.064627+0000","last_clean_scrub_stamp":"2023-10-16T19:58:55.064627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:49:31.811824+0000","scrub_duration":0.001865561,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:45.902537+0000","last_change":"2023-10-16T19:58:45.902585+0000","last_active":"2023-10-16T19:58:45.902537+0000","last_peered":"2023-10-16T19:58:45.902537+0000","last_clean":"2023-10-16T19:58:45.902537+0000","last_became_active":"2023-10-16T19:58:05.606043+0000","last_became_peered":"2023-10-16T19:58:05.606043+0000","last_unstale":"2023-10-16T19:58:45.902537+0000","last_undegraded":"2023-10-16T19:58:45.902537+0000","last_fullsized":"2023-10-16T19:58:45.902537+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:45.902469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:45.902469+0000","last_clean_scrub_stamp":"2023-10-16T19:58:45.902469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:25:40.137694+0000","scrub_duration":0.0012828379999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:26.803352+0000","last_change":"2023-10-16T19:58:26.803418+0000","last_active":"2023-10-16T19:58:26.803352+0000","last_peered":"2023-10-16T19:58:26.803352+0000","last_clean":"2023-10-16T19:58:26.803352+0000","last_became_active":"2023-10-16T19:58:05.607763+0000","last_became_peered":"2023-10-16T19:58:05.607763+0000","last_unstale":"2023-10-16T19:58:26.803352+0000","last_undegraded":"2023-10-16T19:58:26.803352+0000","last_fullsized":"2023-10-16T19:58:26.803352+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:26.803286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:26.803286+0000","last_clean_scrub_stamp":"2023-10-16T19:58:26.803286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:47:41.021710+0000","scrub_duration":0.0013829269999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:48.084825+0000","last_change":"2023-10-16T19:58:48.084899+0000","last_active":"2023-10-16T19:58:48.084825+0000","last_peered":"2023-10-16T19:58:48.084825+0000","last_clean":"2023-10-16T19:58:48.084825+0000","last_became_active":"2023-10-16T19:58:05.604309+0000","last_became_peered":"2023-10-16T19:58:05.604309+0000","last_unstale":"2023-10-16T19:58:48.084825+0000","last_undegraded":"2023-10-16T19:58:48.084825+0000","last_fullsized":"2023-10-16T19:58:48.084825+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:48.084736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:48.084736+0000","last_clean_scrub_stamp":"2023-10-16T19:58:48.084736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:09:54.791051+0000","scrub_duration":0.0014806400000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:33.784308+0000","last_change":"2023-10-16T19:58:33.784355+0000","last_active":"2023-10-16T19:58:33.784308+0000","last_peered":"2023-10-16T19:58:33.784308+0000","last_clean":"2023-10-16T19:58:33.784308+0000","last_became_active":"2023-10-16T19:58:05.606102+0000","last_became_peered":"2023-10-16T19:58:05.606102+0000","last_unstale":"2023-10-16T19:58:33.784308+0000","last_undegraded":"2023-10-16T19:58:33.784308+0000","last_fullsized":"2023-10-16T19:58:33.784308+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:33.784248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:33.784248+0000","last_clean_scrub_stamp":"2023-10-16T19:58:33.784248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:05:48.926071+0000","scrub_duration":0.001215055,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:41.585892+0000","last_change":"2023-10-16T19:58:41.585937+0000","last_active":"2023-10-16T19:58:41.585892+0000","last_peered":"2023-10-16T19:58:41.585892+0000","last_clean":"2023-10-16T19:58:41.585892+0000","last_became_active":"2023-10-16T19:58:05.599955+0000","last_became_peered":"2023-10-16T19:58:05.599955+0000","last_unstale":"2023-10-16T19:58:41.585892+0000","last_undegraded":"2023-10-16T19:58:41.585892+0000","last_fullsized":"2023-10-16T19:58:41.585892+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:41.585836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:41.585836+0000","last_clean_scrub_stamp":"2023-10-16T19:58:41.585836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:42:54.647037+0000","scrub_duration":0.0011150070000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:31.719235+0000","last_change":"2023-10-16T19:58:31.719303+0000","last_active":"2023-10-16T19:58:31.719235+0000","last_peered":"2023-10-16T19:58:31.719235+0000","last_clean":"2023-10-16T19:58:31.719235+0000","last_became_active":"2023-10-16T19:58:05.608571+0000","last_became_peered":"2023-10-16T19:58:05.608571+0000","last_unstale":"2023-10-16T19:58:31.719235+0000","last_undegraded":"2023-10-16T19:58:31.719235+0000","last_fullsized":"2023-10-16T19:58:31.719235+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:31.719175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:31.719175+0000","last_clean_scrub_stamp":"2023-10-16T19:58:31.719175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:00:45.635707+0000","scrub_duration":0.0011065210000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:53.723233+0000","last_change":"2023-10-16T19:58:53.723284+0000","last_active":"2023-10-16T19:58:53.723233+0000","last_peered":"2023-10-16T19:58:53.723233+0000","last_clean":"2023-10-16T19:58:53.723233+0000","last_became_active":"2023-10-16T19:58:05.609211+0000","last_became_peered":"2023-10-16T19:58:05.609211+0000","last_unstale":"2023-10-16T19:58:53.723233+0000","last_undegraded":"2023-10-16T19:58:53.723233+0000","last_fullsized":"2023-10-16T19:58:53.723233+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:53.723170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:53.723170+0000","last_clean_scrub_stamp":"2023-10-16T19:58:53.723170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:14:43.047539+0000","scrub_duration":0.0013977519999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"32'4","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:21.846435+0000","last_change":"2023-10-16T19:58:21.846485+0000","last_active":"2023-10-16T19:58:21.846435+0000","last_peered":"2023-10-16T19:58:21.846435+0000","last_clean":"2023-10-16T19:58:21.846435+0000","last_became_active":"2023-10-16T19:58:04.587523+0000","last_became_peered":"2023-10-16T19:58:04.587523+0000","last_unstale":"2023-10-16T19:58:21.846435+0000","last_undegraded":"2023-10-16T19:58:21.846435+0000","last_fullsized":"2023-10-16T19:58:21.846435+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2023-10-16T19:58:21.846381+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2023-10-16T19:58:21.846381+0000","last_clean_scrub_stamp":"2023-10-16T19:58:21.846381+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:24:55.391734+0000","scrub_duration":0.0014127810000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:26.719990+0000","last_change":"2023-10-16T19:58:26.720040+0000","last_active":"2023-10-16T19:58:26.719990+0000","last_peered":"2023-10-16T19:58:26.719990+0000","last_clean":"2023-10-16T19:58:26.719990+0000","last_became_active":"2023-10-16T19:58:05.598478+0000","last_became_peered":"2023-10-16T19:58:05.598478+0000","last_unstale":"2023-10-16T19:58:26.719990+0000","last_undegraded":"2023-10-16T19:58:26.719990+0000","last_fullsized":"2023-10-16T19:58:26.719990+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:26.719928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:26.719928+0000","last_clean_scrub_stamp":"2023-10-16T19:58:26.719928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:23:07.038642+0000","scrub_duration":0.00097661199999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"32'1","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:26.579405+0000","last_change":"2023-10-16T19:58:26.579471+0000","last_active":"2023-10-16T19:58:26.579405+0000","last_peered":"2023-10-16T19:58:26.579405+0000","last_clean":"2023-10-16T19:58:26.579405+0000","last_became_active":"2023-10-16T19:58:04.589624+0000","last_became_peered":"2023-10-16T19:58:04.589624+0000","last_unstale":"2023-10-16T19:58:26.579405+0000","last_undegraded":"2023-10-16T19:58:26.579405+0000","last_fullsized":"2023-10-16T19:58:26.579405+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'1","last_scrub_stamp":"2023-10-16T19:58:26.579324+0000","last_deep_scrub":"32'1","last_deep_scrub_stamp":"2023-10-16T19:58:26.579324+0000","last_clean_scrub_stamp":"2023-10-16T19:58:26.579324+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:23:06.898037+0000","scrub_duration":0.001603089,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:52.118824+0000","last_change":"2023-10-16T19:58:52.118905+0000","last_active":"2023-10-16T19:58:52.118824+0000","last_peered":"2023-10-16T19:58:52.118824+0000","last_clean":"2023-10-16T19:58:52.118824+0000","last_became_active":"2023-10-16T19:58:05.603733+0000","last_became_peered":"2023-10-16T19:58:05.603733+0000","last_unstale":"2023-10-16T19:58:52.118824+0000","last_undegraded":"2023-10-16T19:58:52.118824+0000","last_fullsized":"2023-10-16T19:58:52.118824+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:52.118753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:52.118753+0000","last_clean_scrub_stamp":"2023-10-16T19:58:52.118753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:15:17.393610+0000","scrub_duration":0.001768127,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"32'2","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:32.148475+0000","last_change":"2023-10-16T19:58:32.148558+0000","last_active":"2023-10-16T19:58:32.148475+0000","last_peered":"2023-10-16T19:58:32.148475+0000","last_clean":"2023-10-16T19:58:32.148475+0000","last_became_active":"2023-10-16T19:58:04.587076+0000","last_became_peered":"2023-10-16T19:58:04.587076+0000","last_unstale":"2023-10-16T19:58:32.148475+0000","last_undegraded":"2023-10-16T19:58:32.148475+0000","last_fullsized":"2023-10-16T19:58:32.148475+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2023-10-16T19:58:32.148408+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2023-10-16T19:58:32.148408+0000","last_clean_scrub_stamp":"2023-10-16T19:58:32.148408+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:00:46.064940+0000","scrub_duration":0.001719134,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:38.950008+0000","last_change":"2023-10-16T19:58:38.950092+0000","last_active":"2023-10-16T19:58:38.950008+0000","last_peered":"2023-10-16T19:58:38.950008+0000","last_clean":"2023-10-16T19:58:38.950008+0000","last_became_active":"2023-10-16T19:58:05.603317+0000","last_became_peered":"2023-10-16T19:58:05.603317+0000","last_unstale":"2023-10-16T19:58:38.950008+0000","last_undegraded":"2023-10-16T19:58:38.950008+0000","last_fullsized":"2023-10-16T19:58:38.950008+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:38.949945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:38.949945+0000","last_clean_scrub_stamp":"2023-10-16T19:58:38.949945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:48:50.496951+0000","scrub_duration":0.001372004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"32'2","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:20.434958+0000","last_change":"2023-10-16T19:58:20.435007+0000","last_active":"2023-10-16T19:58:20.434958+0000","last_peered":"2023-10-16T19:58:20.434958+0000","last_clean":"2023-10-16T19:58:20.434958+0000","last_became_active":"2023-10-16T19:58:04.580982+0000","last_became_peered":"2023-10-16T19:58:04.580982+0000","last_unstale":"2023-10-16T19:58:20.434958+0000","last_undegraded":"2023-10-16T19:58:20.434958+0000","last_fullsized":"2023-10-16T19:58:20.434958+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2023-10-16T19:58:20.434910+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2023-10-16T19:58:20.434910+0000","last_clean_scrub_stamp":"2023-10-16T19:58:20.434910+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:05:39.251429+0000","scrub_duration":0.0011612440000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:37.773373+0000","last_change":"2023-10-16T19:58:37.773416+0000","last_active":"2023-10-16T19:58:37.773373+0000","last_peered":"2023-10-16T19:58:37.773373+0000","last_clean":"2023-10-16T19:58:37.773373+0000","last_became_active":"2023-10-16T19:58:05.609287+0000","last_became_peered":"2023-10-16T19:58:05.609287+0000","last_unstale":"2023-10-16T19:58:37.773373+0000","last_undegraded":"2023-10-16T19:58:37.773373+0000","last_fullsized":"2023-10-16T19:58:37.773373+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:37.773308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:37.773308+0000","last_clean_scrub_stamp":"2023-10-16T19:58:37.773308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:11:15.405732+0000","scrub_duration":0.0011155970000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"32'1","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:25.891070+0000","last_change":"2023-10-16T19:58:25.891117+0000","last_active":"2023-10-16T19:58:25.891070+0000","last_peered":"2023-10-16T19:58:25.891070+0000","last_clean":"2023-10-16T19:58:25.891070+0000","last_became_active":"2023-10-16T19:58:04.591382+0000","last_became_peered":"2023-10-16T19:58:04.591382+0000","last_unstale":"2023-10-16T19:58:25.891070+0000","last_undegraded":"2023-10-16T19:58:25.891070+0000","last_fullsized":"2023-10-16T19:58:25.891070+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'1","last_scrub_stamp":"2023-10-16T19:58:25.890998+0000","last_deep_scrub":"32'1","last_deep_scrub_stamp":"2023-10-16T19:58:25.890998+0000","last_clean_scrub_stamp":"2023-10-16T19:58:25.890998+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:04:25.105980+0000","scrub_duration":0.0014568630000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:33.800480+0000","last_change":"2023-10-16T19:58:33.800524+0000","last_active":"2023-10-16T19:58:33.800480+0000","last_peered":"2023-10-16T19:58:33.800480+0000","last_clean":"2023-10-16T19:58:33.800480+0000","last_became_active":"2023-10-16T19:58:05.606777+0000","last_became_peered":"2023-10-16T19:58:05.606777+0000","last_unstale":"2023-10-16T19:58:33.800480+0000","last_undegraded":"2023-10-16T19:58:33.800480+0000","last_fullsized":"2023-10-16T19:58:33.800480+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:33.800421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:33.800421+0000","last_clean_scrub_stamp":"2023-10-16T19:58:33.800421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:38:43.180405+0000","scrub_duration":0.001325618,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"32'1","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:24.885637+0000","last_change":"2023-10-16T19:58:24.885721+0000","last_active":"2023-10-16T19:58:24.885637+0000","last_peered":"2023-10-16T19:58:24.885637+0000","last_clean":"2023-10-16T19:58:24.885637+0000","last_became_active":"2023-10-16T19:58:04.584702+0000","last_became_peered":"2023-10-16T19:58:04.584702+0000","last_unstale":"2023-10-16T19:58:24.885637+0000","last_undegraded":"2023-10-16T19:58:24.885637+0000","last_fullsized":"2023-10-16T19:58:24.885637+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'1","last_scrub_stamp":"2023-10-16T19:58:24.885575+0000","last_deep_scrub":"32'1","last_deep_scrub_stamp":"2023-10-16T19:58:24.885575+0000","last_clean_scrub_stamp":"2023-10-16T19:58:24.885575+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:16:25.808994+0000","scrub_duration":0.0015874319999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:06.601190+0000","last_change":"2023-10-16T19:58:05.601585+0000","last_active":"2023-10-16T19:58:06.601190+0000","last_peered":"2023-10-16T19:58:06.601190+0000","last_clean":"2023-10-16T19:58:06.601190+0000","last_became_active":"2023-10-16T19:58:05.600813+0000","last_became_peered":"2023-10-16T19:58:05.600813+0000","last_unstale":"2023-10-16T19:58:06.601190+0000","last_undegraded":"2023-10-16T19:58:06.601190+0000","last_fullsized":"2023-10-16T19:58:06.601190+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:04.573644+0000","last_clean_scrub_stamp":"2023-10-16T19:58:04.573644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:23.096433+0000","last_change":"2023-10-16T19:58:23.096482+0000","last_active":"2023-10-16T19:58:23.096433+0000","last_peered":"2023-10-16T19:58:23.096433+0000","last_clean":"2023-10-16T19:58:23.096433+0000","last_became_active":"2023-10-16T19:58:04.584173+0000","last_became_peered":"2023-10-16T19:58:04.584173+0000","last_unstale":"2023-10-16T19:58:23.096433+0000","last_undegraded":"2023-10-16T19:58:23.096433+0000","last_fullsized":"2023-10-16T19:58:23.096433+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:23.096365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:23.096365+0000","last_clean_scrub_stamp":"2023-10-16T19:58:23.096365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:14:27.340966+0000","scrub_duration":0.0011138140000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:52.999394+0000","last_change":"2023-10-16T19:58:52.999436+0000","last_active":"2023-10-16T19:58:52.999394+0000","last_peered":"2023-10-16T19:58:52.999394+0000","last_clean":"2023-10-16T19:58:52.999394+0000","last_became_active":"2023-10-16T19:58:05.601416+0000","last_became_peered":"2023-10-16T19:58:05.601416+0000","last_unstale":"2023-10-16T19:58:52.999394+0000","last_undegraded":"2023-10-16T19:58:52.999394+0000","last_fullsized":"2023-10-16T19:58:52.999394+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:52.999339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:52.999339+0000","last_clean_scrub_stamp":"2023-10-16T19:58:52.999339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:39:02.379323+0000","scrub_duration":0.001502242,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:21.962408+0000","last_change":"2023-10-16T19:58:21.962453+0000","last_active":"2023-10-16T19:58:21.962408+0000","last_peered":"2023-10-16T19:58:21.962408+0000","last_clean":"2023-10-16T19:58:21.962408+0000","last_became_active":"2023-10-16T19:58:04.589891+0000","last_became_peered":"2023-10-16T19:58:04.589891+0000","last_unstale":"2023-10-16T19:58:21.962408+0000","last_undegraded":"2023-10-16T19:58:21.962408+0000","last_fullsized":"2023-10-16T19:58:21.962408+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:21.962351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:21.962351+0000","last_clean_scrub_stamp":"2023-10-16T19:58:21.962351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:47:53.043979+0000","scrub_duration":0.0009951929999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:35.836966+0000","last_change":"2023-10-16T19:58:35.837007+0000","last_active":"2023-10-16T19:58:35.836966+0000","last_peered":"2023-10-16T19:58:35.836966+0000","last_clean":"2023-10-16T19:58:35.836966+0000","last_became_active":"2023-10-16T19:58:05.603042+0000","last_became_peered":"2023-10-16T19:58:05.603042+0000","last_unstale":"2023-10-16T19:58:35.836966+0000","last_undegraded":"2023-10-16T19:58:35.836966+0000","last_fullsized":"2023-10-16T19:58:35.836966+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:35.836905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:35.836905+0000","last_clean_scrub_stamp":"2023-10-16T19:58:35.836905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:51:44.896637+0000","scrub_duration":0.0011687589999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:31.181629+0000","last_change":"2023-10-16T19:58:31.181709+0000","last_active":"2023-10-16T19:58:31.181629+0000","last_peered":"2023-10-16T19:58:31.181629+0000","last_clean":"2023-10-16T19:58:31.181629+0000","last_became_active":"2023-10-16T19:58:04.589253+0000","last_became_peered":"2023-10-16T19:58:04.589253+0000","last_unstale":"2023-10-16T19:58:31.181629+0000","last_undegraded":"2023-10-16T19:58:31.181629+0000","last_fullsized":"2023-10-16T19:58:31.181629+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:31.181571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:31.181571+0000","last_clean_scrub_stamp":"2023-10-16T19:58:31.181571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:09:37.887886+0000","scrub_duration":0.0019320749999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:57.147564+0000","last_change":"2023-10-16T19:58:57.147615+0000","last_active":"2023-10-16T19:58:57.147564+0000","last_peered":"2023-10-16T19:58:57.147564+0000","last_clean":"2023-10-16T19:58:57.147564+0000","last_became_active":"2023-10-16T19:58:05.602336+0000","last_became_peered":"2023-10-16T19:58:05.602336+0000","last_unstale":"2023-10-16T19:58:57.147564+0000","last_undegraded":"2023-10-16T19:58:57.147564+0000","last_fullsized":"2023-10-16T19:58:57.147564+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:57.147502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:57.147502+0000","last_clean_scrub_stamp":"2023-10-16T19:58:57.147502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:39:45.441685+0000","scrub_duration":0.001143254,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:35.631480+0000","last_change":"2023-10-16T19:58:35.631529+0000","last_active":"2023-10-16T19:58:35.631480+0000","last_peered":"2023-10-16T19:58:35.631480+0000","last_clean":"2023-10-16T19:58:35.631480+0000","last_became_active":"2023-10-16T19:58:04.586047+0000","last_became_peered":"2023-10-16T19:58:04.586047+0000","last_unstale":"2023-10-16T19:58:35.631480+0000","last_undegraded":"2023-10-16T19:58:35.631480+0000","last_fullsized":"2023-10-16T19:58:35.631480+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:35.631427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:35.631427+0000","last_clean_scrub_stamp":"2023-10-16T19:58:35.631427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:23:49.533757+0000","scrub_duration":0.001124863,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:47.096496+0000","last_change":"2023-10-16T19:58:47.096545+0000","last_active":"2023-10-16T19:58:47.096496+0000","last_peered":"2023-10-16T19:58:47.096496+0000","last_clean":"2023-10-16T19:58:47.096496+0000","last_became_active":"2023-10-16T19:58:05.606148+0000","last_became_peered":"2023-10-16T19:58:05.606148+0000","last_unstale":"2023-10-16T19:58:47.096496+0000","last_undegraded":"2023-10-16T19:58:47.096496+0000","last_fullsized":"2023-10-16T19:58:47.096496+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:47.096430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:47.096430+0000","last_clean_scrub_stamp":"2023-10-16T19:58:47.096430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:51:56.156162+0000","scrub_duration":0.0012542149999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"32'3","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:21.645944+0000","last_change":"2023-10-16T19:58:21.645994+0000","last_active":"2023-10-16T19:58:21.645944+0000","last_peered":"2023-10-16T19:58:21.645944+0000","last_clean":"2023-10-16T19:58:21.645944+0000","last_became_active":"2023-10-16T19:58:04.589139+0000","last_became_peered":"2023-10-16T19:58:04.589139+0000","last_unstale":"2023-10-16T19:58:21.645944+0000","last_undegraded":"2023-10-16T19:58:21.645944+0000","last_fullsized":"2023-10-16T19:58:21.645944+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3","last_scrub_stamp":"2023-10-16T19:58:21.645882+0000","last_deep_scrub":"32'3","last_deep_scrub_stamp":"2023-10-16T19:58:21.645882+0000","last_clean_scrub_stamp":"2023-10-16T19:58:21.645882+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:20:16.890402+0000","scrub_duration":0.0016449870000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:24.763359+0000","last_change":"2023-10-16T19:58:24.763421+0000","last_active":"2023-10-16T19:58:24.763359+0000","last_peered":"2023-10-16T19:58:24.763359+0000","last_clean":"2023-10-16T19:58:24.763359+0000","last_became_active":"2023-10-16T19:58:05.600598+0000","last_became_peered":"2023-10-16T19:58:05.600598+0000","last_unstale":"2023-10-16T19:58:24.763359+0000","last_undegraded":"2023-10-16T19:58:24.763359+0000","last_fullsized":"2023-10-16T19:58:24.763359+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:24.763278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:24.763278+0000","last_clean_scrub_stamp":"2023-10-16T19:58:24.763278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:14:14.087647+0000","scrub_duration":0.001597677,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"32'6","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:28.108190+0000","last_change":"2023-10-16T19:58:28.108247+0000","last_active":"2023-10-16T19:58:28.108190+0000","last_peered":"2023-10-16T19:58:28.108190+0000","last_clean":"2023-10-16T19:58:28.108190+0000","last_became_active":"2023-10-16T19:58:04.584588+0000","last_became_peered":"2023-10-16T19:58:04.584588+0000","last_unstale":"2023-10-16T19:58:28.108190+0000","last_undegraded":"2023-10-16T19:58:28.108190+0000","last_fullsized":"2023-10-16T19:58:28.108190+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2023-10-16T19:58:28.108132+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2023-10-16T19:58:28.108132+0000","last_clean_scrub_stamp":"2023-10-16T19:58:28.108132+0000","objects_scrubbed":4,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:43:01.269113+0000","scrub_duration":0.0016545329999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:33.881969+0000","last_change":"2023-10-16T19:58:33.882043+0000","last_active":"2023-10-16T19:58:33.881969+0000","last_peered":"2023-10-16T19:58:33.881969+0000","last_clean":"2023-10-16T19:58:33.881969+0000","last_became_active":"2023-10-16T19:58:05.602386+0000","last_became_peered":"2023-10-16T19:58:05.602386+0000","last_unstale":"2023-10-16T19:58:33.881969+0000","last_undegraded":"2023-10-16T19:58:33.881969+0000","last_fullsized":"2023-10-16T19:58:33.881969+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:33.881891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:33.881891+0000","last_clean_scrub_stamp":"2023-10-16T19:58:33.881891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:48:50.016627+0000","scrub_duration":0.001250496,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"33'4","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:46.159935+0000","last_change":"2023-10-16T19:58:46.159986+0000","last_active":"2023-10-16T19:58:46.159935+0000","last_peered":"2023-10-16T19:58:46.159935+0000","last_clean":"2023-10-16T19:58:46.159935+0000","last_became_active":"2023-10-16T19:58:04.586290+0000","last_became_peered":"2023-10-16T19:58:04.586290+0000","last_unstale":"2023-10-16T19:58:46.159935+0000","last_undegraded":"2023-10-16T19:58:46.159935+0000","last_fullsized":"2023-10-16T19:58:46.159935+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2023-10-16T19:58:46.159884+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2023-10-16T19:58:46.159884+0000","last_clean_scrub_stamp":"2023-10-16T19:58:46.159884+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:14:35.484253+0000","scrub_duration":0.0021927470000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:19.039160+0000","last_change":"2023-10-16T19:58:19.039195+0000","last_active":"2023-10-16T19:58:19.039160+0000","last_peered":"2023-10-16T19:58:19.039160+0000","last_clean":"2023-10-16T19:58:19.039160+0000","last_became_active":"2023-10-16T19:58:05.605962+0000","last_became_peered":"2023-10-16T19:58:05.605962+0000","last_unstale":"2023-10-16T19:58:19.039160+0000","last_undegraded":"2023-10-16T19:58:19.039160+0000","last_fullsized":"2023-10-16T19:58:19.039160+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:19.039113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:19.039113+0000","last_clean_scrub_stamp":"2023-10-16T19:58:19.039113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:12:55.467133+0000","scrub_duration":0.000870695,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:19.676983+0000","last_change":"2023-10-16T19:58:19.677037+0000","last_active":"2023-10-16T19:58:19.676983+0000","last_peered":"2023-10-16T19:58:19.676983+0000","last_clean":"2023-10-16T19:58:19.676983+0000","last_became_active":"2023-10-16T19:58:04.587531+0000","last_became_peered":"2023-10-16T19:58:04.587531+0000","last_unstale":"2023-10-16T19:58:19.676983+0000","last_undegraded":"2023-10-16T19:58:19.676983+0000","last_fullsized":"2023-10-16T19:58:19.676983+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:19.676913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:19.676913+0000","last_clean_scrub_stamp":"2023-10-16T19:58:19.676913+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:03:42.167534+0000","scrub_duration":0.0011117410000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:32.761671+0000","last_change":"2023-10-16T19:58:32.761717+0000","last_active":"2023-10-16T19:58:32.761671+0000","last_peered":"2023-10-16T19:58:32.761671+0000","last_clean":"2023-10-16T19:58:32.761671+0000","last_became_active":"2023-10-16T19:58:05.607449+0000","last_became_peered":"2023-10-16T19:58:05.607449+0000","last_unstale":"2023-10-16T19:58:32.761671+0000","last_undegraded":"2023-10-16T19:58:32.761671+0000","last_fullsized":"2023-10-16T19:58:32.761671+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:32.761603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:32.761603+0000","last_clean_scrub_stamp":"2023-10-16T19:58:32.761603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:25:26.996828+0000","scrub_duration":0.001069866,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:39.085274+0000","last_change":"2023-10-16T19:58:39.085319+0000","last_active":"2023-10-16T19:58:39.085274+0000","last_peered":"2023-10-16T19:58:39.085274+0000","last_clean":"2023-10-16T19:58:39.085274+0000","last_became_active":"2023-10-16T19:58:04.588305+0000","last_became_peered":"2023-10-16T19:58:04.588305+0000","last_unstale":"2023-10-16T19:58:39.085274+0000","last_undegraded":"2023-10-16T19:58:39.085274+0000","last_fullsized":"2023-10-16T19:58:39.085274+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:39.085200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:39.085200+0000","last_clean_scrub_stamp":"2023-10-16T19:58:39.085200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:58:26.211426+0000","scrub_duration":0.0015299140000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:28.708653+0000","last_change":"2023-10-16T19:58:28.708698+0000","last_active":"2023-10-16T19:58:28.708653+0000","last_peered":"2023-10-16T19:58:28.708653+0000","last_clean":"2023-10-16T19:58:28.708653+0000","last_became_active":"2023-10-16T19:58:05.599356+0000","last_became_peered":"2023-10-16T19:58:05.599356+0000","last_unstale":"2023-10-16T19:58:28.708653+0000","last_undegraded":"2023-10-16T19:58:28.708653+0000","last_fullsized":"2023-10-16T19:58:28.708653+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:28.708592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:28.708592+0000","last_clean_scrub_stamp":"2023-10-16T19:58:28.708592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:16:29.632011+0000","scrub_duration":0.001058738,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"32'8","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:22.083215+0000","last_change":"2023-10-16T19:58:22.083266+0000","last_active":"2023-10-16T19:58:22.083215+0000","last_peered":"2023-10-16T19:58:22.083215+0000","last_clean":"2023-10-16T19:58:22.083215+0000","last_became_active":"2023-10-16T19:58:04.580648+0000","last_became_peered":"2023-10-16T19:58:04.580648+0000","last_unstale":"2023-10-16T19:58:22.083215+0000","last_undegraded":"2023-10-16T19:58:22.083215+0000","last_fullsized":"2023-10-16T19:58:22.083215+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2023-10-16T19:58:22.083152+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2023-10-16T19:58:22.083152+0000","last_clean_scrub_stamp":"2023-10-16T19:58:22.083152+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:20:17.327671+0000","scrub_duration":0.001902965,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:57.906825+0000","last_change":"2023-10-16T19:58:57.906872+0000","last_active":"2023-10-16T19:58:57.906825+0000","last_peered":"2023-10-16T19:58:57.906825+0000","last_clean":"2023-10-16T19:58:57.906825+0000","last_became_active":"2023-10-16T19:58:05.600333+0000","last_became_peered":"2023-10-16T19:58:05.600333+0000","last_unstale":"2023-10-16T19:58:57.906825+0000","last_undegraded":"2023-10-16T19:58:57.906825+0000","last_fullsized":"2023-10-16T19:58:57.906825+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:57.906763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:57.906763+0000","last_clean_scrub_stamp":"2023-10-16T19:58:57.906763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:39:07.286747+0000","scrub_duration":0.001132468,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"32'1","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:24.691734+0000","last_change":"2023-10-16T19:58:24.691784+0000","last_active":"2023-10-16T19:58:24.691734+0000","last_peered":"2023-10-16T19:58:24.691734+0000","last_clean":"2023-10-16T19:58:24.691734+0000","last_became_active":"2023-10-16T19:58:04.587576+0000","last_became_peered":"2023-10-16T19:58:04.587576+0000","last_unstale":"2023-10-16T19:58:24.691734+0000","last_undegraded":"2023-10-16T19:58:24.691734+0000","last_fullsized":"2023-10-16T19:58:24.691734+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'1","last_scrub_stamp":"2023-10-16T19:58:24.691678+0000","last_deep_scrub":"32'1","last_deep_scrub_stamp":"2023-10-16T19:58:24.691678+0000","last_clean_scrub_stamp":"2023-10-16T19:58:24.691678+0000","objects_scrubbed":1,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:16:13.607131+0000","scrub_duration":0.001286595,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:25.761868+0000","last_change":"2023-10-16T19:58:25.761913+0000","last_active":"2023-10-16T19:58:25.761868+0000","last_peered":"2023-10-16T19:58:25.761868+0000","last_clean":"2023-10-16T19:58:25.761868+0000","last_became_active":"2023-10-16T19:58:05.598861+0000","last_became_peered":"2023-10-16T19:58:05.598861+0000","last_unstale":"2023-10-16T19:58:25.761868+0000","last_undegraded":"2023-10-16T19:58:25.761868+0000","last_fullsized":"2023-10-16T19:58:25.761868+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:25.761813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:25.761813+0000","last_clean_scrub_stamp":"2023-10-16T19:58:25.761813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:00:39.678346+0000","scrub_duration":0.0010256320000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"33'3","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:44.151091+0000","last_change":"2023-10-16T19:58:44.151137+0000","last_active":"2023-10-16T19:58:44.151091+0000","last_peered":"2023-10-16T19:58:44.151091+0000","last_clean":"2023-10-16T19:58:44.151091+0000","last_became_active":"2023-10-16T19:58:04.585973+0000","last_became_peered":"2023-10-16T19:58:04.585973+0000","last_unstale":"2023-10-16T19:58:44.151091+0000","last_undegraded":"2023-10-16T19:58:44.151091+0000","last_fullsized":"2023-10-16T19:58:44.151091+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'3","last_scrub_stamp":"2023-10-16T19:58:44.151037+0000","last_deep_scrub":"33'3","last_deep_scrub_stamp":"2023-10-16T19:58:44.151037+0000","last_clean_scrub_stamp":"2023-10-16T19:58:44.151037+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:29:46.759397+0000","scrub_duration":0.0019678899999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:50.983596+0000","last_change":"2023-10-16T19:58:50.983646+0000","last_active":"2023-10-16T19:58:50.983596+0000","last_peered":"2023-10-16T19:58:50.983596+0000","last_clean":"2023-10-16T19:58:50.983596+0000","last_became_active":"2023-10-16T19:58:05.606722+0000","last_became_peered":"2023-10-16T19:58:05.606722+0000","last_unstale":"2023-10-16T19:58:50.983596+0000","last_undegraded":"2023-10-16T19:58:50.983596+0000","last_fullsized":"2023-10-16T19:58:50.983596+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:50.983519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:50.983519+0000","last_clean_scrub_stamp":"2023-10-16T19:58:50.983519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:11:28.615943+0000","scrub_duration":0.0013861419999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"32'1","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:32.979463+0000","last_change":"2023-10-16T19:58:32.979532+0000","last_active":"2023-10-16T19:58:32.979463+0000","last_peered":"2023-10-16T19:58:32.979463+0000","last_clean":"2023-10-16T19:58:32.979463+0000","last_became_active":"2023-10-16T19:58:04.586934+0000","last_became_peered":"2023-10-16T19:58:04.586934+0000","last_unstale":"2023-10-16T19:58:32.979463+0000","last_undegraded":"2023-10-16T19:58:32.979463+0000","last_fullsized":"2023-10-16T19:58:32.979463+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'1","last_scrub_stamp":"2023-10-16T19:58:32.979401+0000","last_deep_scrub":"32'1","last_deep_scrub_stamp":"2023-10-16T19:58:32.979401+0000","last_clean_scrub_stamp":"2023-10-16T19:58:32.979401+0000","objects_scrubbed":1,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:34:33.599720+0000","scrub_duration":0.0018833140000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:25.455034+0000","last_change":"2023-10-16T19:58:25.455086+0000","last_active":"2023-10-16T19:58:25.455034+0000","last_peered":"2023-10-16T19:58:25.455034+0000","last_clean":"2023-10-16T19:58:25.455034+0000","last_became_active":"2023-10-16T19:58:05.607269+0000","last_became_peered":"2023-10-16T19:58:05.607269+0000","last_unstale":"2023-10-16T19:58:25.455034+0000","last_undegraded":"2023-10-16T19:58:25.455034+0000","last_fullsized":"2023-10-16T19:58:25.455034+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:25.454944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:25.454944+0000","last_clean_scrub_stamp":"2023-10-16T19:58:25.454944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:09:25.545413+0000","scrub_duration":0.0017519180000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:41.105467+0000","last_change":"2023-10-16T19:58:41.105527+0000","last_active":"2023-10-16T19:58:41.105467+0000","last_peered":"2023-10-16T19:58:41.105467+0000","last_clean":"2023-10-16T19:58:41.105467+0000","last_became_active":"2023-10-16T19:58:04.591967+0000","last_became_peered":"2023-10-16T19:58:04.591967+0000","last_unstale":"2023-10-16T19:58:41.105467+0000","last_undegraded":"2023-10-16T19:58:41.105467+0000","last_fullsized":"2023-10-16T19:58:41.105467+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:41.105372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:41.105372+0000","last_clean_scrub_stamp":"2023-10-16T19:58:41.105372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:42:54.166573+0000","scrub_duration":0.001681975,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:35.425410+0000","last_change":"2023-10-16T19:58:35.425463+0000","last_active":"2023-10-16T19:58:35.425410+0000","last_peered":"2023-10-16T19:58:35.425410+0000","last_clean":"2023-10-16T19:58:35.425410+0000","last_became_active":"2023-10-16T19:58:05.600081+0000","last_became_peered":"2023-10-16T19:58:05.600081+0000","last_unstale":"2023-10-16T19:58:35.425410+0000","last_undegraded":"2023-10-16T19:58:35.425410+0000","last_fullsized":"2023-10-16T19:58:35.425410+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:35.425348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:35.425348+0000","last_clean_scrub_stamp":"2023-10-16T19:58:35.425348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:18:06.873638+0000","scrub_duration":0.0014506300000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"32'2","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:29.560596+0000","last_change":"2023-10-16T19:58:29.560680+0000","last_active":"2023-10-16T19:58:29.560596+0000","last_peered":"2023-10-16T19:58:29.560596+0000","last_clean":"2023-10-16T19:58:29.560596+0000","last_became_active":"2023-10-16T19:58:04.587629+0000","last_became_peered":"2023-10-16T19:58:04.587629+0000","last_unstale":"2023-10-16T19:58:29.560596+0000","last_undegraded":"2023-10-16T19:58:29.560596+0000","last_fullsized":"2023-10-16T19:58:29.560596+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2023-10-16T19:58:29.560524+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2023-10-16T19:58:29.560524+0000","last_clean_scrub_stamp":"2023-10-16T19:58:29.560524+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:31:22.451525+0000","scrub_duration":0.00173325,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:31.420756+0000","last_change":"2023-10-16T19:58:31.420804+0000","last_active":"2023-10-16T19:58:31.420756+0000","last_peered":"2023-10-16T19:58:31.420756+0000","last_clean":"2023-10-16T19:58:31.420756+0000","last_became_active":"2023-10-16T19:58:05.607311+0000","last_became_peered":"2023-10-16T19:58:05.607311+0000","last_unstale":"2023-10-16T19:58:31.420756+0000","last_undegraded":"2023-10-16T19:58:31.420756+0000","last_fullsized":"2023-10-16T19:58:31.420756+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:31.420696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:31.420696+0000","last_clean_scrub_stamp":"2023-10-16T19:58:31.420696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:10:33.790242+0000","scrub_duration":0.0012437870000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:19.890802+0000","last_change":"2023-10-16T19:58:19.890848+0000","last_active":"2023-10-16T19:58:19.890802+0000","last_peered":"2023-10-16T19:58:19.890802+0000","last_clean":"2023-10-16T19:58:19.890802+0000","last_became_active":"2023-10-16T19:58:04.583346+0000","last_became_peered":"2023-10-16T19:58:04.583346+0000","last_unstale":"2023-10-16T19:58:19.890802+0000","last_undegraded":"2023-10-16T19:58:19.890802+0000","last_fullsized":"2023-10-16T19:58:19.890802+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:19.890752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:19.890752+0000","last_clean_scrub_stamp":"2023-10-16T19:58:19.890752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:26:48.807112+0000","scrub_duration":0.0011159919999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:32.410743+0000","last_change":"2023-10-16T19:58:32.410810+0000","last_active":"2023-10-16T19:58:32.410743+0000","last_peered":"2023-10-16T19:58:32.410743+0000","last_clean":"2023-10-16T19:58:32.410743+0000","last_became_active":"2023-10-16T19:58:05.605529+0000","last_became_peered":"2023-10-16T19:58:05.605529+0000","last_unstale":"2023-10-16T19:58:32.410743+0000","last_undegraded":"2023-10-16T19:58:32.410743+0000","last_fullsized":"2023-10-16T19:58:32.410743+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:32.410677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:32.410677+0000","last_clean_scrub_stamp":"2023-10-16T19:58:32.410677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:23:12.729390+0000","scrub_duration":0.0014308979999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:42.135483+0000","last_change":"2023-10-16T19:58:42.135532+0000","last_active":"2023-10-16T19:58:42.135483+0000","last_peered":"2023-10-16T19:58:42.135483+0000","last_clean":"2023-10-16T19:58:42.135483+0000","last_became_active":"2023-10-16T19:58:04.589542+0000","last_became_peered":"2023-10-16T19:58:04.589542+0000","last_unstale":"2023-10-16T19:58:42.135483+0000","last_undegraded":"2023-10-16T19:58:42.135483+0000","last_fullsized":"2023-10-16T19:58:42.135483+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:42.135400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:42.135400+0000","last_clean_scrub_stamp":"2023-10-16T19:58:42.135400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:37:58.179668+0000","scrub_duration":0.001316446,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:41.823499+0000","last_change":"2023-10-16T19:58:41.823559+0000","last_active":"2023-10-16T19:58:41.823499+0000","last_peered":"2023-10-16T19:58:41.823499+0000","last_clean":"2023-10-16T19:58:41.823499+0000","last_became_active":"2023-10-16T19:58:05.608517+0000","last_became_peered":"2023-10-16T19:58:05.608517+0000","last_unstale":"2023-10-16T19:58:41.823499+0000","last_undegraded":"2023-10-16T19:58:41.823499+0000","last_fullsized":"2023-10-16T19:58:41.823499+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:41.823419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:41.823419+0000","last_clean_scrub_stamp":"2023-10-16T19:58:41.823419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:42:23.080410+0000","scrub_duration":0.001286655,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:19.657543+0000","last_change":"2023-10-16T19:58:19.657585+0000","last_active":"2023-10-16T19:58:19.657543+0000","last_peered":"2023-10-16T19:58:19.657543+0000","last_clean":"2023-10-16T19:58:19.657543+0000","last_became_active":"2023-10-16T19:58:04.587332+0000","last_became_peered":"2023-10-16T19:58:04.587332+0000","last_unstale":"2023-10-16T19:58:19.657543+0000","last_undegraded":"2023-10-16T19:58:19.657543+0000","last_fullsized":"2023-10-16T19:58:19.657543+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:19.657476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:19.657476+0000","last_clean_scrub_stamp":"2023-10-16T19:58:19.657476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:12:56.085496+0000","scrub_duration":0.0010951520000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:33.420366+0000","last_change":"2023-10-16T19:58:33.420451+0000","last_active":"2023-10-16T19:58:33.420366+0000","last_peered":"2023-10-16T19:58:33.420366+0000","last_clean":"2023-10-16T19:58:33.420366+0000","last_became_active":"2023-10-16T19:58:05.600305+0000","last_became_peered":"2023-10-16T19:58:05.600305+0000","last_unstale":"2023-10-16T19:58:33.420366+0000","last_undegraded":"2023-10-16T19:58:33.420366+0000","last_fullsized":"2023-10-16T19:58:33.420366+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:33.420305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:33.420305+0000","last_clean_scrub_stamp":"2023-10-16T19:58:33.420305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:16:34.343724+0000","scrub_duration":0.001548645,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"32'2","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:25.729426+0000","last_change":"2023-10-16T19:58:25.729476+0000","last_active":"2023-10-16T19:58:25.729426+0000","last_peered":"2023-10-16T19:58:25.729426+0000","last_clean":"2023-10-16T19:58:25.729426+0000","last_became_active":"2023-10-16T19:58:04.582012+0000","last_became_peered":"2023-10-16T19:58:04.582012+0000","last_unstale":"2023-10-16T19:58:25.729426+0000","last_undegraded":"2023-10-16T19:58:25.729426+0000","last_fullsized":"2023-10-16T19:58:25.729426+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2023-10-16T19:58:25.729370+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2023-10-16T19:58:25.729370+0000","last_clean_scrub_stamp":"2023-10-16T19:58:25.729370+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:09:10.976762+0000","scrub_duration":0.0017710670000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:36.851911+0000","last_change":"2023-10-16T19:58:36.851957+0000","last_active":"2023-10-16T19:58:36.851911+0000","last_peered":"2023-10-16T19:58:36.851911+0000","last_clean":"2023-10-16T19:58:36.851911+0000","last_became_active":"2023-10-16T19:58:05.600830+0000","last_became_peered":"2023-10-16T19:58:05.600830+0000","last_unstale":"2023-10-16T19:58:36.851911+0000","last_undegraded":"2023-10-16T19:58:36.851911+0000","last_fullsized":"2023-10-16T19:58:36.851911+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:36.851853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:36.851853+0000","last_clean_scrub_stamp":"2023-10-16T19:58:36.851853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:09:06.952786+0000","scrub_duration":0.001489074,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"33'1","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:24.515716+0000","last_change":"2023-10-16T19:58:24.515782+0000","last_active":"2023-10-16T19:58:24.515716+0000","last_peered":"2023-10-16T19:58:24.515716+0000","last_clean":"2023-10-16T19:58:24.515716+0000","last_became_active":"2023-10-16T19:58:04.587329+0000","last_became_peered":"2023-10-16T19:58:04.587329+0000","last_unstale":"2023-10-16T19:58:24.515716+0000","last_undegraded":"2023-10-16T19:58:24.515716+0000","last_fullsized":"2023-10-16T19:58:24.515716+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'1","last_scrub_stamp":"2023-10-16T19:58:24.515637+0000","last_deep_scrub":"33'1","last_deep_scrub_stamp":"2023-10-16T19:58:24.515637+0000","last_clean_scrub_stamp":"2023-10-16T19:58:24.515637+0000","objects_scrubbed":1,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:45:55.863919+0000","scrub_duration":0.0017599650000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:45.765414+0000","last_change":"2023-10-16T19:58:45.765497+0000","last_active":"2023-10-16T19:58:45.765414+0000","last_peered":"2023-10-16T19:58:45.765414+0000","last_clean":"2023-10-16T19:58:45.765414+0000","last_became_active":"2023-10-16T19:58:05.605958+0000","last_became_peered":"2023-10-16T19:58:05.605958+0000","last_unstale":"2023-10-16T19:58:45.765414+0000","last_undegraded":"2023-10-16T19:58:45.765414+0000","last_fullsized":"2023-10-16T19:58:45.765414+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:45.765348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:45.765348+0000","last_clean_scrub_stamp":"2023-10-16T19:58:45.765348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:09:20.232649+0000","scrub_duration":0.0011021519999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:27.703678+0000","last_change":"2023-10-16T19:58:27.703723+0000","last_active":"2023-10-16T19:58:27.703678+0000","last_peered":"2023-10-16T19:58:27.703678+0000","last_clean":"2023-10-16T19:58:27.703678+0000","last_became_active":"2023-10-16T19:58:04.586851+0000","last_became_peered":"2023-10-16T19:58:04.586851+0000","last_unstale":"2023-10-16T19:58:27.703678+0000","last_undegraded":"2023-10-16T19:58:27.703678+0000","last_fullsized":"2023-10-16T19:58:27.703678+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:27.703618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:27.703618+0000","last_clean_scrub_stamp":"2023-10-16T19:58:27.703618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:13:04.131638+0000","scrub_duration":0.001147449,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:39.645042+0000","last_change":"2023-10-16T19:58:39.645104+0000","last_active":"2023-10-16T19:58:39.645042+0000","last_peered":"2023-10-16T19:58:39.645042+0000","last_clean":"2023-10-16T19:58:39.645042+0000","last_became_active":"2023-10-16T19:58:05.606081+0000","last_became_peered":"2023-10-16T19:58:05.606081+0000","last_unstale":"2023-10-16T19:58:39.645042+0000","last_undegraded":"2023-10-16T19:58:39.645042+0000","last_fullsized":"2023-10-16T19:58:39.645042+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:39.644945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:39.644945+0000","last_clean_scrub_stamp":"2023-10-16T19:58:39.644945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:09:24.892337+0000","scrub_duration":0.001790104,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:30.562350+0000","last_change":"2023-10-16T19:58:30.562415+0000","last_active":"2023-10-16T19:58:30.562350+0000","last_peered":"2023-10-16T19:58:30.562350+0000","last_clean":"2023-10-16T19:58:30.562350+0000","last_became_active":"2023-10-16T19:58:04.588050+0000","last_became_peered":"2023-10-16T19:58:04.588050+0000","last_unstale":"2023-10-16T19:58:30.562350+0000","last_undegraded":"2023-10-16T19:58:30.562350+0000","last_fullsized":"2023-10-16T19:58:30.562350+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:30.562272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:30.562272+0000","last_clean_scrub_stamp":"2023-10-16T19:58:30.562272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:03:53.052894+0000","scrub_duration":0.001599874,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:36.670169+0000","last_change":"2023-10-16T19:58:36.670221+0000","last_active":"2023-10-16T19:58:36.670169+0000","last_peered":"2023-10-16T19:58:36.670169+0000","last_clean":"2023-10-16T19:58:36.670169+0000","last_became_active":"2023-10-16T19:58:05.607381+0000","last_became_peered":"2023-10-16T19:58:05.607381+0000","last_unstale":"2023-10-16T19:58:36.670169+0000","last_undegraded":"2023-10-16T19:58:36.670169+0000","last_fullsized":"2023-10-16T19:58:36.670169+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:36.670111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:36.670111+0000","last_clean_scrub_stamp":"2023-10-16T19:58:36.670111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:11:36.349860+0000","scrub_duration":0.001654279,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:18.716208+0000","last_change":"2023-10-16T19:58:18.716246+0000","last_active":"2023-10-16T19:58:18.716208+0000","last_peered":"2023-10-16T19:58:18.716208+0000","last_clean":"2023-10-16T19:58:18.716208+0000","last_became_active":"2023-10-16T19:58:04.581711+0000","last_became_peered":"2023-10-16T19:58:04.581711+0000","last_unstale":"2023-10-16T19:58:18.716208+0000","last_undegraded":"2023-10-16T19:58:18.716208+0000","last_fullsized":"2023-10-16T19:58:18.716208+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:18.716159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:18.716159+0000","last_clean_scrub_stamp":"2023-10-16T19:58:18.716159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:16:19.639578+0000","scrub_duration":0.001305716,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:48.127634+0000","last_change":"2023-10-16T19:58:48.127681+0000","last_active":"2023-10-16T19:58:48.127634+0000","last_peered":"2023-10-16T19:58:48.127634+0000","last_clean":"2023-10-16T19:58:48.127634+0000","last_became_active":"2023-10-16T19:58:05.602184+0000","last_became_peered":"2023-10-16T19:58:05.602184+0000","last_unstale":"2023-10-16T19:58:48.127634+0000","last_undegraded":"2023-10-16T19:58:48.127634+0000","last_fullsized":"2023-10-16T19:58:48.127634+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:48.127580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:48.127580+0000","last_clean_scrub_stamp":"2023-10-16T19:58:48.127580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:09:18.228512+0000","scrub_duration":0.00107934,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:31.972750+0000","last_change":"2023-10-16T19:58:31.972795+0000","last_active":"2023-10-16T19:58:31.972750+0000","last_peered":"2023-10-16T19:58:31.972750+0000","last_clean":"2023-10-16T19:58:31.972750+0000","last_became_active":"2023-10-16T19:58:04.587683+0000","last_became_peered":"2023-10-16T19:58:04.587683+0000","last_unstale":"2023-10-16T19:58:31.972750+0000","last_undegraded":"2023-10-16T19:58:31.972750+0000","last_fullsized":"2023-10-16T19:58:31.972750+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:31.972697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:31.972697+0000","last_clean_scrub_stamp":"2023-10-16T19:58:31.972697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:23:45.875027+0000","scrub_duration":0.0010629109999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:55.980977+0000","last_change":"2023-10-16T19:58:55.981046+0000","last_active":"2023-10-16T19:58:55.980977+0000","last_peered":"2023-10-16T19:58:55.980977+0000","last_clean":"2023-10-16T19:58:55.980977+0000","last_became_active":"2023-10-16T19:58:05.601074+0000","last_became_peered":"2023-10-16T19:58:05.601074+0000","last_unstale":"2023-10-16T19:58:55.980977+0000","last_undegraded":"2023-10-16T19:58:55.980977+0000","last_fullsized":"2023-10-16T19:58:55.980977+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:55.980892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:55.980892+0000","last_clean_scrub_stamp":"2023-10-16T19:58:55.980892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:11:33.613317+0000","scrub_duration":0.0013897919999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:38.103104+0000","last_change":"2023-10-16T19:58:38.103151+0000","last_active":"2023-10-16T19:58:38.103104+0000","last_peered":"2023-10-16T19:58:38.103104+0000","last_clean":"2023-10-16T19:58:38.103104+0000","last_became_active":"2023-10-16T19:58:04.588392+0000","last_became_peered":"2023-10-16T19:58:04.588392+0000","last_unstale":"2023-10-16T19:58:38.103104+0000","last_undegraded":"2023-10-16T19:58:38.103104+0000","last_fullsized":"2023-10-16T19:58:38.103104+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:38.103044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:38.103044+0000","last_clean_scrub_stamp":"2023-10-16T19:58:38.103044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:15:03.377900+0000","scrub_duration":0.0015910539999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:44.858661+0000","last_change":"2023-10-16T19:58:44.858720+0000","last_active":"2023-10-16T19:58:44.858661+0000","last_peered":"2023-10-16T19:58:44.858661+0000","last_clean":"2023-10-16T19:58:44.858661+0000","last_became_active":"2023-10-16T19:58:05.609118+0000","last_became_peered":"2023-10-16T19:58:05.609118+0000","last_unstale":"2023-10-16T19:58:44.858661+0000","last_undegraded":"2023-10-16T19:58:44.858661+0000","last_fullsized":"2023-10-16T19:58:44.858661+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:44.858597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:44.858597+0000","last_clean_scrub_stamp":"2023-10-16T19:58:44.858597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:38:21.595525+0000","scrub_duration":0.0014324889999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:25.733115+0000","last_change":"2023-10-16T19:58:25.733158+0000","last_active":"2023-10-16T19:58:25.733115+0000","last_peered":"2023-10-16T19:58:25.733115+0000","last_clean":"2023-10-16T19:58:25.733115+0000","last_became_active":"2023-10-16T19:58:04.585930+0000","last_became_peered":"2023-10-16T19:58:04.585930+0000","last_unstale":"2023-10-16T19:58:25.733115+0000","last_undegraded":"2023-10-16T19:58:25.733115+0000","last_fullsized":"2023-10-16T19:58:25.733115+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:25.733051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:25.733051+0000","last_clean_scrub_stamp":"2023-10-16T19:58:25.733051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:45:57.081332+0000","scrub_duration":0.0011102449999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"33'119","reported_seq":187,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:22.694722+0000","last_change":"2023-10-16T19:58:22.694722+0000","last_active":"2023-10-16T19:58:22.694722+0000","last_peered":"2023-10-16T19:58:22.694722+0000","last_clean":"2023-10-16T19:58:22.694722+0000","last_became_active":"2023-10-16T19:56:58.775567+0000","last_became_peered":"2023-10-16T19:56:58.775567+0000","last_unstale":"2023-10-16T19:58:22.694722+0000","last_undegraded":"2023-10-16T19:58:22.694722+0000","last_fullsized":"2023-10-16T19:58:22.694722+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'119","last_scrub_stamp":"2023-10-16T19:58:22.694592+0000","last_deep_scrub":"33'119","last_deep_scrub_stamp":"2023-10-16T19:58:22.694592+0000","last_clean_scrub_stamp":"2023-10-16T19:58:22.694592+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:08:57.161893+0000","scrub_duration":0.003477178,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574875,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":718,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194594,"statfs":{"total":200000000,"available":199264318,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 19:59:00 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.52600000000000002,"15min":0.51700000000000002},"min":{"1min":0.46100000000000002,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.68500000000000005,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.499},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.58399999999999996,"15min":0.57899999999999996},"min":{"1min":0.40799999999999997,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.59399999999999997}]},{"osd":1,"last update":"Mon Oct 16 19:59:00 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.51800000000000002,"15min":0.51200000000000001},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.626},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.58999999999999997,"15min":0.58899999999999997},"min":{"1min":0.38300000000000001,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.745,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.63900000000000001}]},{"osd":2,"last update":"Mon Oct 16 19:59:00 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.55700000000000005,"15min":0.55100000000000005},"min":{"1min":0.42899999999999999,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.80100000000000005,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.37,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.57999999999999996}]},{"osd":3,"last update":"Mon Oct 16 19:59:00 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.55800000000000005,"15min":0.54900000000000004},"min":{"1min":0.498,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.57099999999999995,"15min":0.56699999999999995},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.78400000000000003,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.56899999999999995}]},{"osd":4,"last update":"Mon Oct 16 19:59:00 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.52500000000000002,"15min":0.52300000000000002},"min":{"1min":0.36899999999999999,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.54000000000000004,"15min":0.53500000000000003},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.42699999999999999}]},{"osd":5,"last update":"Mon Oct 16 19:59:00 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.52900000000000003,"15min":0.52500000000000002},"min":{"1min":0.39200000000000002,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.56100000000000005,"15min":0.55500000000000005},"min":{"1min":0.432,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.45100000000000001}]},{"osd":6,"last update":"Mon Oct 16 19:59:00 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.60999999999999999,"15min":0.60899999999999999},"min":{"1min":0.46899999999999997,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.78000000000000003,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.61899999999999999,"15min":0.61399999999999999},"min":{"1min":0.46899999999999997,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.54400000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574875,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":142,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195170,"statfs":{"total":200000000,"available":199854160,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 19:58:56 2023","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.59499999999999997,"15min":0.54500000000000004},"min":{"1min":0.442,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":7.6479999999999997,"5min":7.6479999999999997,"15min":7.6479999999999997},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.93300000000000005,"5min":0.60899999999999999,"15min":0.55500000000000005},"min":{"1min":0.41399999999999998,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":7.6630000000000003,"5min":7.6630000000000003,"15min":7.6630000000000003},"last":0.56699999999999995}]},{"osd":1,"last update":"Mon Oct 16 19:58:56 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.499,"15min":0.48499999999999999},"min":{"1min":0.39300000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.52900000000000003,"15min":0.51900000000000002},"min":{"1min":0.45900000000000002,"5min":0.376,"15min":0.376},"max":{"1min":0.74299999999999999,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.58199999999999996}]},{"osd":2,"last update":"Mon Oct 16 19:58:56 2023","interfaces":[{"interface":"back","average":{"1min":0.95699999999999996,"5min":0.629,"15min":0.57399999999999995},"min":{"1min":0.47499999999999998,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":8.2829999999999995,"5min":8.2829999999999995,"15min":8.2829999999999995},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.56000000000000005,"15min":0.55500000000000005},"min":{"1min":0.42899999999999999,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.752,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.502}]},{"osd":3,"last update":"Mon Oct 16 19:58:56 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.57899999999999996,"15min":0.57299999999999995},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.77400000000000002,"5min":0.879,"15min":0.879},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.94199999999999995,"5min":0.623,"15min":0.56999999999999995},"min":{"1min":0.45300000000000001,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":8.3339999999999996,"5min":8.3339999999999996,"15min":8.3339999999999996},"last":0.55200000000000005}]},{"osd":4,"last update":"Mon Oct 16 19:58:56 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.52300000000000002,"15min":0.52700000000000002},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.69599999999999995,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.56299999999999994,"15min":0.56699999999999995},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.71399999999999997,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.39900000000000002}]},{"osd":5,"last update":"Mon Oct 16 19:58:56 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.52900000000000003,"15min":0.53100000000000003},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.69899999999999995,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.629,"5min":0.623,"15min":0.622},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.84899999999999998,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.47999999999999998}]},{"osd":7,"last update":"Mon Oct 16 19:58:56 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.61299999999999999,"15min":0.61699999999999999},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.75700000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58099999999999996,"15min":0.57999999999999996},"min":{"1min":0.40999999999999998,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.80700000000000005,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.44700000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574875,"num_pgs":32,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":143,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195169,"statfs":{"total":200000000,"available":199853142,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 19:58:59 2023","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.33900000000000002,"15min":0.33500000000000002},"min":{"1min":0.24399999999999999,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.373,"5min":0.32100000000000001,"15min":0.313},"min":{"1min":0.26800000000000002,"5min":0.247,"15min":0.247},"max":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"last":0.32900000000000001}]},{"osd":2,"last update":"Mon Oct 16 19:58:59 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.35699999999999998,"15min":0.35099999999999998},"min":{"1min":0.29299999999999998,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"last":0.29299999999999998},{"interface":"front","average":{"1min":0.42399999999999999,"5min":0.40100000000000002,"15min":0.39700000000000002},"min":{"1min":0.32200000000000001,"5min":0.308,"15min":0.308},"max":{"1min":0.56200000000000006,"5min":0.56899999999999995,"15min":0.56899999999999995},"last":0.42199999999999999}]},{"osd":3,"last update":"Mon Oct 16 19:58:59 2023","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.41799999999999998,"15min":0.41499999999999998},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.41099999999999998,"5min":0.39100000000000001,"15min":0.38800000000000001},"min":{"1min":0.32300000000000001,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.504,"5min":0.52400000000000002,"15min":0.52400000000000002},"last":0.44400000000000001}]},{"osd":4,"last update":"Mon Oct 16 19:58:59 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.57999999999999996,"15min":0.57599999999999996},"min":{"1min":0.45200000000000001,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.76700000000000002,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.62},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.59399999999999997,"15min":0.58999999999999997},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.80900000000000005,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.76600000000000001}]},{"osd":5,"last update":"Mon Oct 16 19:58:59 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.59899999999999998,"15min":0.59399999999999997},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.86399999999999999},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.64700000000000002,"15min":0.64200000000000002},"min":{"1min":0.48899999999999999,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.88700000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.876}]},{"osd":6,"last update":"Mon Oct 16 19:58:59 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.59299999999999997,"15min":0.59099999999999997},"min":{"1min":0.46600000000000003,"5min":0.436,"15min":0.436},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.627,"5min":0.61199999999999999,"15min":0.60999999999999999},"min":{"1min":0.47399999999999998,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.85399999999999998,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.80000000000000004}]},{"osd":7,"last update":"Mon Oct 16 19:58:59 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.63300000000000001,"15min":0.63200000000000001},"min":{"1min":0.47299999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.85099999999999998,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.58799999999999997,"15min":0.58399999999999996},"min":{"1min":0.46100000000000002,"5min":0.374,"15min":0.374},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.63300000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574875,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":718,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194594,"statfs":{"total":200000000,"available":199264408,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 16 19:58:59 2023","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.81000000000000005,"15min":0.88400000000000001},"min":{"1min":0.26200000000000001,"5min":0.249,"15min":0.249},"max":{"1min":0.55700000000000005,"5min":11.031000000000001,"15min":11.031000000000001},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.90000000000000002,"15min":0.97899999999999998},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.53800000000000003,"5min":12.218,"15min":12.218},"last":0.46800000000000003}]},{"osd":2,"last update":"Mon Oct 16 19:58:59 2023","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.81999999999999995,"15min":0.89300000000000002},"min":{"1min":0.26200000000000001,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.501,"5min":11.058,"15min":11.058},"last":0.37},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.97699999999999998,"15min":1.0740000000000001},"min":{"1min":0.29499999999999998,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.58099999999999996,"5min":14.763999999999999,"15min":14.763999999999999},"last":0.41199999999999998}]},{"osd":3,"last update":"Mon Oct 16 19:58:59 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.80900000000000005,"15min":0.88100000000000001},"min":{"1min":0.29899999999999999,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.52100000000000002,"5min":10.935,"15min":10.935},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.874,"15min":0.94799999999999995},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.59899999999999998,"5min":11.083,"15min":11.083},"last":0.59899999999999998}]},{"osd":4,"last update":"Mon Oct 16 19:58:59 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":1.073,"15min":1.155},"min":{"1min":0.42899999999999999,"5min":0.314,"15min":0.314},"max":{"1min":0.753,"5min":12.279,"15min":12.279},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.58299999999999996,"5min":1.0389999999999999,"15min":1.115},"min":{"1min":0.40300000000000002,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.78500000000000003,"5min":10.879,"15min":10.879},"last":0.63200000000000001}]},{"osd":5,"last update":"Mon Oct 16 19:58:59 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":1.0620000000000001,"15min":1.1359999999999999},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.78700000000000003,"5min":10.907,"15min":10.907},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.629,"5min":1.085,"15min":1.161},"min":{"1min":0.45700000000000002,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.83399999999999996,"5min":11,"15min":11},"last":0.64600000000000002}]},{"osd":6,"last update":"Mon Oct 16 19:58:59 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":1.0409999999999999,"15min":1.1180000000000001},"min":{"1min":0.41999999999999998,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.78700000000000003,"5min":10.972,"15min":10.972},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.61699999999999999,"5min":1.115,"15min":1.198},"min":{"1min":0.45200000000000001,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.72699999999999998,"5min":12.34,"15min":12.34},"last":0.56200000000000006}]},{"osd":7,"last update":"Mon Oct 16 19:58:59 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":1.1279999999999999,"15min":1.21},"min":{"1min":0.48799999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.73199999999999998,"5min":12.311,"15min":12.311},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.59999999999999998,"5min":1.0529999999999999,"15min":1.129},"min":{"1min":0.432,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.77100000000000002,"5min":10.845000000000001,"15min":10.845000000000001},"last":0.57999999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574875,"num_pgs":17,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":141,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195170,"statfs":{"total":200000000,"available":199854706,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 19:58:56 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.33600000000000002,"15min":0.33200000000000002},"min":{"1min":0.248,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"last":0.313},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.35699999999999998,"15min":0.35299999999999998},"min":{"1min":0.27600000000000002,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.60199999999999998,"5min":0.749,"15min":0.749},"last":0.33700000000000002}]},{"osd":1,"last update":"Mon Oct 16 19:58:56 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.38,"15min":0.376},"min":{"1min":0.30199999999999999,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.377,"15min":0.372},"min":{"1min":0.28799999999999998,"5min":0.219,"15min":0.219},"max":{"1min":0.55600000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"last":0.38800000000000001}]},{"osd":3,"last update":"Mon Oct 16 19:58:56 2023","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.36299999999999999,"15min":0.35799999999999998},"min":{"1min":0.29399999999999998,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.435,"5min":0.42399999999999999,"15min":0.42199999999999999},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.628,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.42299999999999999}]},{"osd":4,"last update":"Mon Oct 16 19:58:56 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.60599999999999998,"15min":0.59999999999999998},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.628},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.63100000000000001,"15min":0.63},"min":{"1min":0.48299999999999998,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.82699999999999996,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.64300000000000002}]},{"osd":5,"last update":"Mon Oct 16 19:58:56 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.59699999999999998,"15min":0.60099999999999998},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.60299999999999998,"15min":0.60499999999999998},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.89800000000000002,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.55300000000000005}]},{"osd":6,"last update":"Mon Oct 16 19:58:56 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59599999999999997,"15min":0.59499999999999997},"min":{"1min":0.44500000000000001,"5min":0.433,"15min":0.433},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.622,"5min":0.60499999999999998,"15min":0.60199999999999998},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.81499999999999995,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.56799999999999995}]},{"osd":7,"last update":"Mon Oct 16 19:58:56 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.64100000000000001,"15min":0.64400000000000002},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.86899999999999999,"5min":1.046,"15min":1.046},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.625,"5min":0.64500000000000002,"15min":0.64800000000000002},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.82799999999999996,"5min":1.002,"15min":1.002},"last":0.69499999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574875,"num_pgs":31,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":143,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195169,"statfs":{"total":200000000,"available":199853142,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 19:58:56 2023","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.33000000000000002,"15min":0.32500000000000001},"min":{"1min":0.20699999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.40500000000000003,"5min":0.36499999999999999,"15min":0.35799999999999998},"min":{"1min":0.28999999999999998,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"last":0.435}]},{"osd":1,"last update":"Mon Oct 16 19:58:56 2023","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.33100000000000002,"15min":0.32400000000000001},"min":{"1min":0.249,"5min":0.222,"15min":0.222},"max":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"last":0.37},{"interface":"front","average":{"1min":0.41599999999999998,"5min":0.373,"15min":0.36599999999999999},"min":{"1min":0.27500000000000002,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.60199999999999998,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.39000000000000001}]},{"osd":2,"last update":"Mon Oct 16 19:58:56 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.32700000000000001,"15min":0.32200000000000001},"min":{"1min":0.26400000000000001,"5min":0.22,"15min":0.22},"max":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"last":0.311},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.41699999999999998,"15min":0.40999999999999998},"min":{"1min":0.35099999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"last":0.46800000000000003}]},{"osd":4,"last update":"Mon Oct 16 19:58:56 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.56899999999999995,"15min":0.56399999999999995},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.497},{"interface":"front","average":{"1min":0.625,"5min":0.58999999999999997,"15min":0.58399999999999996},"min":{"1min":0.46700000000000003,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.45500000000000002}]},{"osd":5,"last update":"Mon Oct 16 19:58:56 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.57999999999999996,"15min":0.57799999999999996},"min":{"1min":0.439,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.57599999999999996,"15min":0.56599999999999995},"min":{"1min":0.47599999999999998,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.53700000000000003}]},{"osd":6,"last update":"Mon Oct 16 19:58:56 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.53400000000000003,"15min":0.52700000000000002},"min":{"1min":0.42499999999999999,"5min":0.38,"15min":0.38},"max":{"1min":0.75800000000000001,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.57699999999999996,"15min":0.57299999999999995},"min":{"1min":0.44,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.84899999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.51100000000000001}]},{"osd":7,"last update":"Mon Oct 16 19:58:56 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.58299999999999996,"15min":0.57899999999999996},"min":{"1min":0.41599999999999998,"5min":0.377,"15min":0.377},"max":{"1min":0.94199999999999995,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.626,"5min":0.61699999999999999,"15min":0.61499999999999999},"min":{"1min":0.47999999999999998,"5min":0.438,"15min":0.438},"max":{"1min":0.78700000000000003,"5min":1.139,"15min":1.139},"last":0.48699999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574875,"num_pgs":29,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":141,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195170,"statfs":{"total":200000000,"available":199854672,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 19:58:59 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.54600000000000004,"15min":0.54200000000000004},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.72699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.55300000000000005,"15min":0.55400000000000005},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.71499999999999997,"5min":0.749,"15min":0.749},"last":0.54600000000000004}]},{"osd":1,"last update":"Mon Oct 16 19:58:59 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.55700000000000005,"15min":0.55900000000000005},"min":{"1min":0.376,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.73499999999999999,"5min":1.034,"15min":1.034},"last":0.626},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.53100000000000003,"15min":0.52900000000000003},"min":{"1min":0.40400000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.77600000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.61399999999999999}]},{"osd":2,"last update":"Mon Oct 16 19:58:59 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.42299999999999999,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.70199999999999996,"5min":1.103,"15min":1.103},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.56599999999999995,"15min":0.56999999999999995},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.745,"5min":0.754,"15min":0.754},"last":0.52800000000000002}]},{"osd":3,"last update":"Mon Oct 16 19:58:59 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.67400000000000004,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59199999999999997,"15min":0.59099999999999997},"min":{"1min":0.40600000000000003,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.78900000000000003,"5min":1.071,"15min":1.071},"last":0.65300000000000002}]},{"osd":5,"last update":"Mon Oct 16 19:58:59 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.49399999999999999,"15min":0.498},"min":{"1min":0.32100000000000001,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.55700000000000005,"15min":0.55500000000000005},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.46700000000000003}]},{"osd":6,"last update":"Mon Oct 16 19:58:59 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.53400000000000003,"15min":0.53000000000000003},"min":{"1min":0.42399999999999999,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.55300000000000005,"15min":0.55500000000000005},"min":{"1min":0.40000000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.40000000000000002}]},{"osd":7,"last update":"Mon Oct 16 19:58:59 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.51000000000000001,"15min":0.51200000000000001},"min":{"1min":0.36099999999999999,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.64300000000000002,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.57599999999999996,"15min":0.57099999999999995},"min":{"1min":0.41699999999999998,"5min":0.379,"15min":0.379},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.496}]}]},{"osd":5,"up_from":13,"seq":55834574875,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":142,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195170,"statfs":{"total":200000000,"available":199854104,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 19:58:56 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.68600000000000005,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.55200000000000005,"15min":0.55000000000000004},"min":{"1min":0.39900000000000002,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.81100000000000005,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.621}]},{"osd":1,"last update":"Mon Oct 16 19:58:56 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.89100000000000001,"15min":0.94299999999999995},"min":{"1min":0.435,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.754,"5min":7.9989999999999997,"15min":7.9989999999999997},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.91000000000000003,"15min":0.96199999999999997},"min":{"1min":0.43099999999999999,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.76700000000000002,"5min":8.0150000000000006,"15min":8.0150000000000006},"last":0.63600000000000001}]},{"osd":2,"last update":"Mon Oct 16 19:58:56 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.56899999999999995,"15min":0.56699999999999995},"min":{"1min":0.44600000000000001,"5min":0.372,"15min":0.372},"max":{"1min":0.77600000000000002,"5min":1.032,"15min":1.032},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.54500000000000004,"15min":0.55100000000000005},"min":{"1min":0.379,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.67900000000000005,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.47699999999999998}]},{"osd":3,"last update":"Mon Oct 16 19:58:56 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.872,"15min":0.92600000000000005},"min":{"1min":0.35599999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.72299999999999998,"5min":8.077,"15min":8.077},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.59399999999999997,"15min":0.59799999999999998},"min":{"1min":0.46400000000000002,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.73699999999999999,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.64900000000000002}]},{"osd":4,"last update":"Mon Oct 16 19:58:56 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.498,"15min":0.497},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.55700000000000005,"15min":0.56000000000000005},"min":{"1min":0.373,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.70599999999999996,"5min":0.754,"15min":0.754},"last":0.435}]},{"osd":6,"last update":"Mon Oct 16 19:58:56 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.55800000000000005,"15min":0.56200000000000006},"min":{"1min":0.38100000000000001,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.73399999999999999,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.61399999999999999,"15min":0.60999999999999999},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.54800000000000004}]},{"osd":7,"last update":"Mon Oct 16 19:58:56 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.60299999999999998,"15min":0.60699999999999998},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.746,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.623,"15min":0.624},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.78100000000000003,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.53500000000000003}]}]}],"pool_statfs":[]}} 2023-10-16T19:59:01.217 INFO:tasks.ceph:pgid 5.2b last_scrub_stamp 2023-10-16T19:58:04.573644+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=4, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=15, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:59:01.218 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2023-10-16T19:58:04.573644+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=4, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=19, tm_min=58, tm_sec=15, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T19:59:01.219 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-16T19:59:07.259 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T19:59:07.263 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T19:59:21.221 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-16T19:59:21.357 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:21.354+0000 7f3a7a635700 1 Processor -- start 2023-10-16T19:59:21.357 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:21.354+0000 7f3a7a635700 1 -- start start 2023-10-16T19:59:21.360 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:21.355+0000 7f3a7a635700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f3a7415b130 0x7f3a74071f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:59:21.360 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:21.355+0000 7f3a7a635700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3a7406d0f0 0x7f3a740cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:59:21.360 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:21.355+0000 7f3a7a635700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a740cefc0 con 0x7f3a740cbeb0 2023-10-16T19:59:21.361 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:21.355+0000 7f3a7a635700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a740b0050 con 0x7f3a7415b130 2023-10-16T19:59:21.361 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:21.355+0000 7f3a7a635700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a7406e090 con 0x7f3a7406d0f0 2023-10-16T19:59:21.361 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:21.355+0000 7f3a73fff700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f3a7415b130 0x7f3a74071f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:59:21.362 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:21.355+0000 7f3a73fff700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f3a7415b130 0x7f3a74071f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:48142/0 (socket says 172.21.15.157:48142) 2023-10-16T19:59:21.362 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:21.355+0000 7f3a73fff700 1 -- 172.21.15.157:0/2565504522 learned_addr learned my addr 172.21.15.157:0/2565504522 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:59:21.362 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:21.355+0000 7f3a737fe700 1 --2- 172.21.15.157:0/2565504522 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3a7406d0f0 0x7f3a740cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:59:21.362 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:21.355+0000 7f3a73fff700 1 -- 172.21.15.157:0/2565504522 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3a7406d0f0 msgr2=0x7f3a740cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:59:21.363 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:21.355+0000 7f3a73fff700 1 --2- 172.21.15.157:0/2565504522 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3a7406d0f0 0x7f3a740cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:59:21.363 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:21.355+0000 7f3a73fff700 1 -- 172.21.15.157:0/2565504522 >> v1:172.21.15.187:6789/0 conn(0x7f3a740cbeb0 legacy=0x7f3a7406eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:59:21.363 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:21.355+0000 7f3a73fff700 1 -- 172.21.15.157:0/2565504522 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a7406d570 con 0x7f3a7415b130 2023-10-16T19:59:21.364 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:21.355+0000 7f3a737fe700 1 --2- 172.21.15.157:0/2565504522 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3a7406d0f0 0x7f3a740cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T19:59:21.364 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:21.356+0000 7f3a73fff700 1 --2- 172.21.15.157:0/2565504522 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3a7415b130 0x7f3a74071f60 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f3a680098f0 tx=0x7f3a68009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4f082046011b02f server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:59:21.364 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:21.356+0000 7f3a72ffd700 1 -- 172.21.15.157:0/2565504522 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a68004230 con 0x7f3a7415b130 2023-10-16T19:59:21.364 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:21.356+0000 7f3a72ffd700 1 -- 172.21.15.157:0/2565504522 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a68004390 con 0x7f3a7415b130 2023-10-16T19:59:21.365 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:21.356+0000 7f3a72ffd700 1 -- 172.21.15.157:0/2565504522 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a680036a0 con 0x7f3a7415b130 2023-10-16T19:59:21.365 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:21.356+0000 7f3a7a635700 1 -- 172.21.15.157:0/2565504522 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3a7415b130 msgr2=0x7f3a74071f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:59:21.365 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:21.356+0000 7f3a7a635700 1 --2- 172.21.15.157:0/2565504522 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3a7415b130 0x7f3a74071f60 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f3a680098f0 tx=0x7f3a68009c00 comp rx=0 tx=0).stop 2023-10-16T19:59:21.366 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:21.356+0000 7f3a7a635700 1 -- 172.21.15.157:0/2565504522 shutdown_connections 2023-10-16T19:59:21.366 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:21.356+0000 7f3a7a635700 1 --2- 172.21.15.157:0/2565504522 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3a7415b130 0x7f3a74071f60 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:59:21.366 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:21.356+0000 7f3a7a635700 1 --2- 172.21.15.157:0/2565504522 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3a7406d0f0 0x7f3a740cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:59:21.366 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:21.356+0000 7f3a7a635700 1 -- 172.21.15.157:0/2565504522 >> 172.21.15.157:0/2565504522 conn(0x7f3a740cd4e0 msgr2=0x7f3a740cd8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:59:21.367 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:21.356+0000 7f3a7a635700 1 -- 172.21.15.157:0/2565504522 shutdown_connections 2023-10-16T19:59:21.367 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:21.356+0000 7f3a7a635700 1 -- 172.21.15.157:0/2565504522 wait complete. 2023-10-16T19:59:21.367 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:21.358+0000 7f3a7a635700 1 Processor -- start 2023-10-16T19:59:21.370 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:21.358+0000 7f3a7a635700 1 -- start start 2023-10-16T19:59:21.371 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:21.359+0000 7f3a7a635700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3a7406d0f0 0x7f3a741f4530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:59:21.371 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:21.359+0000 7f3a7a635700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3a740cbeb0 0x7f3a7415ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:59:21.371 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:21.359+0000 7f3a7a635700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3a7415b130 0x7f3a7415f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:59:21.371 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:21.359+0000 7f3a7a635700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a740b6020 con 0x7f3a740cbeb0 2023-10-16T19:59:21.372 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:21.359+0000 7f3a7a635700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a740b5410 con 0x7f3a7406d0f0 2023-10-16T19:59:21.372 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:21.359+0000 7f3a7a635700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a740b56f0 con 0x7f3a7415b130 2023-10-16T19:59:21.372 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:21.359+0000 7f3a737fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3a740cbeb0 0x7f3a7415ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:59:21.373 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:21.359+0000 7f3a737fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3a740cbeb0 0x7f3a7415ebd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:48148/0 (socket says 172.21.15.157:48148) 2023-10-16T19:59:21.373 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:21.359+0000 7f3a737fe700 1 -- 172.21.15.157:0/3493883251 learned_addr learned my addr 172.21.15.157:0/3493883251 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:59:21.373 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:21.359+0000 7f3a73fff700 1 --2- 172.21.15.157:0/3493883251 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3a7406d0f0 0x7f3a741f4530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:59:21.373 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:21.359+0000 7f3a78bd2700 1 --2- 172.21.15.157:0/3493883251 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3a7415b130 0x7f3a7415f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:59:21.374 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:21.359+0000 7f3a737fe700 1 -- 172.21.15.157:0/3493883251 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3a7415b130 msgr2=0x7f3a7415f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:59:21.374 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:21.359+0000 7f3a737fe700 1 --2- 172.21.15.157:0/3493883251 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3a7415b130 0x7f3a7415f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:59:21.374 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:21.359+0000 7f3a737fe700 1 -- 172.21.15.157:0/3493883251 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3a7406d0f0 msgr2=0x7f3a741f4530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:59:21.375 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:21.359+0000 7f3a737fe700 1 --2- 172.21.15.157:0/3493883251 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3a7406d0f0 0x7f3a741f4530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:59:21.375 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:21.359+0000 7f3a737fe700 1 -- 172.21.15.157:0/3493883251 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a68009550 con 0x7f3a740cbeb0 2023-10-16T19:59:21.375 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:21.359+0000 7f3a78bd2700 1 --2- 172.21.15.157:0/3493883251 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3a7415b130 0x7f3a7415f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T19:59:21.375 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:21.360+0000 7f3a737fe700 1 --2- 172.21.15.157:0/3493883251 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3a740cbeb0 0x7f3a7415ebd0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f3a6400eb60 tx=0x7f3a6400ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:59:21.376 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:21.360+0000 7f3a70ff9700 1 -- 172.21.15.157:0/3493883251 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a64007a40 con 0x7f3a740cbeb0 2023-10-16T19:59:21.376 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:21.360+0000 7f3a70ff9700 1 -- 172.21.15.157:0/3493883251 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a64007ba0 con 0x7f3a740cbeb0 2023-10-16T19:59:21.376 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:21.360+0000 7f3a7a635700 1 -- 172.21.15.157:0/3493883251 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a740b59d0 con 0x7f3a740cbeb0 2023-10-16T19:59:21.376 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:21.360+0000 7f3a70ff9700 1 -- 172.21.15.157:0/3493883251 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a64010440 con 0x7f3a740cbeb0 2023-10-16T19:59:21.377 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:21.360+0000 7f3a7a635700 1 -- 172.21.15.157:0/3493883251 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a741f4a70 con 0x7f3a740cbeb0 2023-10-16T19:59:21.377 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:21.361+0000 7f3a7a635700 1 -- 172.21.15.157:0/3493883251 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a741f1750 con 0x7f3a740cbeb0 2023-10-16T19:59:21.377 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:21.361+0000 7f3a70ff9700 1 -- 172.21.15.157:0/3493883251 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f3a640105a0 con 0x7f3a740cbeb0 2023-10-16T19:59:21.377 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:21.362+0000 7f3a70ff9700 1 --2- 172.21.15.157:0/3493883251 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f3a6006af00 0x7f3a6006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:59:21.378 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:21.362+0000 7f3a70ff9700 1 -- 172.21.15.157:0/3493883251 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5729+0+0 (secure 0 0 0) 0x7f3a64014070 con 0x7f3a740cbeb0 2023-10-16T19:59:21.378 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:21.362+0000 7f3a73fff700 1 --2- 172.21.15.157:0/3493883251 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f3a6006af00 0x7f3a6006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:59:21.378 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:21.362+0000 7f3a73fff700 1 --2- 172.21.15.157:0/3493883251 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f3a6006af00 0x7f3a6006d3c0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f3a68009130 tx=0x7f3a68008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:59:21.379 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:21.366+0000 7f3a70ff9700 1 -- 172.21.15.157:0/3493883251 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3a64051ca0 con 0x7f3a740cbeb0 2023-10-16T19:59:21.553 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:21.551+0000 7f3a7a635700 1 -- 172.21.15.157:0/3493883251 --> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3a7406dad0 con 0x7f3a6006af00 2023-10-16T19:59:21.562 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:21.559+0000 7f3a70ff9700 1 -- 172.21.15.157:0/3493883251 <== mgr.4100 v2:172.21.15.187:6832/2426285296 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286177 (secure 0 0 0) 0x7f3a680036a0 con 0x7f3a6006af00 2023-10-16T19:59:21.565 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-10-16T19:59:21.568 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:21.562+0000 7f3a7a635700 1 -- 172.21.15.157:0/3493883251 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f3a6006af00 msgr2=0x7f3a6006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:59:21.568 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:21.562+0000 7f3a7a635700 1 --2- 172.21.15.157:0/3493883251 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f3a6006af00 0x7f3a6006d3c0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f3a68009130 tx=0x7f3a68008030 comp rx=0 tx=0).stop 2023-10-16T19:59:21.569 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:21.562+0000 7f3a7a635700 1 -- 172.21.15.157:0/3493883251 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3a740cbeb0 msgr2=0x7f3a7415ebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:59:21.569 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:21.562+0000 7f3a7a635700 1 --2- 172.21.15.157:0/3493883251 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3a740cbeb0 0x7f3a7415ebd0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f3a6400eb60 tx=0x7f3a6400ee70 comp rx=0 tx=0).stop 2023-10-16T19:59:21.569 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:21.563+0000 7f3a7a635700 1 -- 172.21.15.157:0/3493883251 shutdown_connections 2023-10-16T19:59:21.570 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:21.563+0000 7f3a7a635700 1 --2- 172.21.15.157:0/3493883251 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f3a6006af00 0x7f3a6006d3c0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:59:21.570 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:21.563+0000 7f3a7a635700 1 --2- 172.21.15.157:0/3493883251 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3a7406d0f0 0x7f3a741f4530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:59:21.570 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:21.563+0000 7f3a7a635700 1 --2- 172.21.15.157:0/3493883251 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3a7415b130 0x7f3a7415f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:59:21.571 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:21.563+0000 7f3a7a635700 1 --2- 172.21.15.157:0/3493883251 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3a740cbeb0 0x7f3a7415ebd0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:59:21.571 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:21.563+0000 7f3a7a635700 1 -- 172.21.15.157:0/3493883251 >> 172.21.15.157:0/3493883251 conn(0x7f3a740cd4e0 msgr2=0x7f3a740c6fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:59:21.571 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:21.563+0000 7f3a7a635700 1 -- 172.21.15.157:0/3493883251 shutdown_connections 2023-10-16T19:59:21.571 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:21.563+0000 7f3a7a635700 1 -- 172.21.15.157:0/3493883251 wait complete. 2023-10-16T19:59:21.572 INFO:teuthology.orchestra.run.smithi157.stderr:dumped all 2023-10-16T19:59:21.577 INFO:teuthology.orchestra.run.smithi157.stdout:{"pg_ready":true,"pg_map":{"version":96,"stamp":"2023-10-16T19:59:20.924767+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161,"ondisk_log_size":161,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":2292,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560207,"statfs":{"total":1600000000,"available":1597652652,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003024"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:40.629629+0000","last_change":"2023-10-16T19:58:40.629706+0000","last_active":"2023-10-16T19:58:40.629629+0000","last_peered":"2023-10-16T19:58:40.629629+0000","last_clean":"2023-10-16T19:58:40.629629+0000","last_became_active":"2023-10-16T19:58:05.597025+0000","last_became_peered":"2023-10-16T19:58:05.597025+0000","last_unstale":"2023-10-16T19:58:40.629629+0000","last_undegraded":"2023-10-16T19:58:40.629629+0000","last_fullsized":"2023-10-16T19:58:40.629629+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:40.629567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:40.629567+0000","last_clean_scrub_stamp":"2023-10-16T19:58:40.629567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:13:17.057587+0000","scrub_duration":0.001095866,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:54.090772+0000","last_change":"2023-10-16T19:58:54.090815+0000","last_active":"2023-10-16T19:58:54.090772+0000","last_peered":"2023-10-16T19:58:54.090772+0000","last_clean":"2023-10-16T19:58:54.090772+0000","last_became_active":"2023-10-16T19:58:05.605969+0000","last_became_peered":"2023-10-16T19:58:05.605969+0000","last_unstale":"2023-10-16T19:58:54.090772+0000","last_undegraded":"2023-10-16T19:58:54.090772+0000","last_fullsized":"2023-10-16T19:58:54.090772+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:54.090695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:54.090695+0000","last_clean_scrub_stamp":"2023-10-16T19:58:54.090695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:38:48.133425+0000","scrub_duration":0.001185649,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:31.829149+0000","last_change":"2023-10-16T19:58:31.829214+0000","last_active":"2023-10-16T19:58:31.829149+0000","last_peered":"2023-10-16T19:58:31.829149+0000","last_clean":"2023-10-16T19:58:31.829149+0000","last_became_active":"2023-10-16T19:58:05.601072+0000","last_became_peered":"2023-10-16T19:58:05.601072+0000","last_unstale":"2023-10-16T19:58:31.829149+0000","last_undegraded":"2023-10-16T19:58:31.829149+0000","last_fullsized":"2023-10-16T19:58:31.829149+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:31.829086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:31.829086+0000","last_clean_scrub_stamp":"2023-10-16T19:58:31.829086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:16:59.183747+0000","scrub_duration":0.002102483,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:56.025035+0000","last_change":"2023-10-16T19:58:56.025119+0000","last_active":"2023-10-16T19:58:56.025035+0000","last_peered":"2023-10-16T19:58:56.025035+0000","last_clean":"2023-10-16T19:58:56.025035+0000","last_became_active":"2023-10-16T19:58:05.603003+0000","last_became_peered":"2023-10-16T19:58:05.603003+0000","last_unstale":"2023-10-16T19:58:56.025035+0000","last_undegraded":"2023-10-16T19:58:56.025035+0000","last_fullsized":"2023-10-16T19:58:56.025035+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:56.024962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:56.024962+0000","last_clean_scrub_stamp":"2023-10-16T19:58:56.024962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:52:05.084694+0000","scrub_duration":0.001872308,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:37.412052+0000","last_change":"2023-10-16T19:58:37.412118+0000","last_active":"2023-10-16T19:58:37.412052+0000","last_peered":"2023-10-16T19:58:37.412052+0000","last_clean":"2023-10-16T19:58:37.412052+0000","last_became_active":"2023-10-16T19:58:05.602976+0000","last_became_peered":"2023-10-16T19:58:05.602976+0000","last_unstale":"2023-10-16T19:58:37.412052+0000","last_undegraded":"2023-10-16T19:58:37.412052+0000","last_fullsized":"2023-10-16T19:58:37.412052+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:37.411990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:37.411990+0000","last_clean_scrub_stamp":"2023-10-16T19:58:37.411990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:11:37.091739+0000","scrub_duration":0.0012063040000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:49.087777+0000","last_change":"2023-10-16T19:58:49.087827+0000","last_active":"2023-10-16T19:58:49.087777+0000","last_peered":"2023-10-16T19:58:49.087777+0000","last_clean":"2023-10-16T19:58:49.087777+0000","last_became_active":"2023-10-16T19:58:05.601803+0000","last_became_peered":"2023-10-16T19:58:05.601803+0000","last_unstale":"2023-10-16T19:58:49.087777+0000","last_undegraded":"2023-10-16T19:58:49.087777+0000","last_fullsized":"2023-10-16T19:58:49.087777+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:49.087720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:49.087720+0000","last_clean_scrub_stamp":"2023-10-16T19:58:49.087720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:33:07.393010+0000","scrub_duration":0.0013391049999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:27.747272+0000","last_change":"2023-10-16T19:58:27.747352+0000","last_active":"2023-10-16T19:58:27.747272+0000","last_peered":"2023-10-16T19:58:27.747272+0000","last_clean":"2023-10-16T19:58:27.747272+0000","last_became_active":"2023-10-16T19:58:05.605148+0000","last_became_peered":"2023-10-16T19:58:05.605148+0000","last_unstale":"2023-10-16T19:58:27.747272+0000","last_undegraded":"2023-10-16T19:58:27.747272+0000","last_fullsized":"2023-10-16T19:58:27.747272+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:27.747210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:27.747210+0000","last_clean_scrub_stamp":"2023-10-16T19:58:27.747210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:29:30.355570+0000","scrub_duration":0.0011117049999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:29.720322+0000","last_change":"2023-10-16T19:58:29.720365+0000","last_active":"2023-10-16T19:58:29.720322+0000","last_peered":"2023-10-16T19:58:29.720322+0000","last_clean":"2023-10-16T19:58:29.720322+0000","last_became_active":"2023-10-16T19:58:05.605200+0000","last_became_peered":"2023-10-16T19:58:05.605200+0000","last_unstale":"2023-10-16T19:58:29.720322+0000","last_undegraded":"2023-10-16T19:58:29.720322+0000","last_fullsized":"2023-10-16T19:58:29.720322+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:29.720263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:29.720263+0000","last_clean_scrub_stamp":"2023-10-16T19:58:29.720263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:09:36.426578+0000","scrub_duration":0.001250698,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:55.010296+0000","last_change":"2023-10-16T19:58:55.010363+0000","last_active":"2023-10-16T19:58:55.010296+0000","last_peered":"2023-10-16T19:58:55.010296+0000","last_clean":"2023-10-16T19:58:55.010296+0000","last_became_active":"2023-10-16T19:58:05.601910+0000","last_became_peered":"2023-10-16T19:58:05.601910+0000","last_unstale":"2023-10-16T19:58:55.010296+0000","last_undegraded":"2023-10-16T19:58:55.010296+0000","last_fullsized":"2023-10-16T19:58:55.010296+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:55.010208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:55.010208+0000","last_clean_scrub_stamp":"2023-10-16T19:58:55.010208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:58:42.136434+0000","scrub_duration":0.001463982,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:30.774857+0000","last_change":"2023-10-16T19:58:30.774939+0000","last_active":"2023-10-16T19:58:30.774857+0000","last_peered":"2023-10-16T19:58:30.774857+0000","last_clean":"2023-10-16T19:58:30.774857+0000","last_became_active":"2023-10-16T19:58:05.600356+0000","last_became_peered":"2023-10-16T19:58:05.600356+0000","last_unstale":"2023-10-16T19:58:30.774857+0000","last_undegraded":"2023-10-16T19:58:30.774857+0000","last_fullsized":"2023-10-16T19:58:30.774857+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:30.774800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:30.774800+0000","last_clean_scrub_stamp":"2023-10-16T19:58:30.774800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:20:26.019319+0000","scrub_duration":0.001101159,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:43.829863+0000","last_change":"2023-10-16T19:58:43.829930+0000","last_active":"2023-10-16T19:58:43.829863+0000","last_peered":"2023-10-16T19:58:43.829863+0000","last_clean":"2023-10-16T19:58:43.829863+0000","last_became_active":"2023-10-16T19:58:05.609979+0000","last_became_peered":"2023-10-16T19:58:05.609979+0000","last_unstale":"2023-10-16T19:58:43.829863+0000","last_undegraded":"2023-10-16T19:58:43.829863+0000","last_fullsized":"2023-10-16T19:58:43.829863+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:43.829781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:43.829781+0000","last_clean_scrub_stamp":"2023-10-16T19:58:43.829781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:51:52.889513+0000","scrub_duration":0.0015848959999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:23.733969+0000","last_change":"2023-10-16T19:58:23.734041+0000","last_active":"2023-10-16T19:58:23.733969+0000","last_peered":"2023-10-16T19:58:23.733969+0000","last_clean":"2023-10-16T19:58:23.733969+0000","last_became_active":"2023-10-16T19:58:05.600490+0000","last_became_peered":"2023-10-16T19:58:05.600490+0000","last_unstale":"2023-10-16T19:58:23.733969+0000","last_undegraded":"2023-10-16T19:58:23.733969+0000","last_fullsized":"2023-10-16T19:58:23.733969+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:23.733905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:23.733905+0000","last_clean_scrub_stamp":"2023-10-16T19:58:23.733905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:48:39.868641+0000","scrub_duration":0.0016637889999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:29.421483+0000","last_change":"2023-10-16T19:58:29.421528+0000","last_active":"2023-10-16T19:58:29.421483+0000","last_peered":"2023-10-16T19:58:29.421483+0000","last_clean":"2023-10-16T19:58:29.421483+0000","last_became_active":"2023-10-16T19:58:05.600614+0000","last_became_peered":"2023-10-16T19:58:05.600614+0000","last_unstale":"2023-10-16T19:58:29.421483+0000","last_undegraded":"2023-10-16T19:58:29.421483+0000","last_fullsized":"2023-10-16T19:58:29.421483+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:29.421421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:29.421421+0000","last_clean_scrub_stamp":"2023-10-16T19:58:29.421421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:25:02.966775+0000","scrub_duration":0.001050121,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:50.094082+0000","last_change":"2023-10-16T19:58:50.094124+0000","last_active":"2023-10-16T19:58:50.094082+0000","last_peered":"2023-10-16T19:58:50.094082+0000","last_clean":"2023-10-16T19:58:50.094082+0000","last_became_active":"2023-10-16T19:58:05.601569+0000","last_became_peered":"2023-10-16T19:58:05.601569+0000","last_unstale":"2023-10-16T19:58:50.094082+0000","last_undegraded":"2023-10-16T19:58:50.094082+0000","last_fullsized":"2023-10-16T19:58:50.094082+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:50.094021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:50.094021+0000","last_clean_scrub_stamp":"2023-10-16T19:58:50.094021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:22:39.892150+0000","scrub_duration":0.001091526,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:30.841918+0000","last_change":"2023-10-16T19:58:30.841995+0000","last_active":"2023-10-16T19:58:30.841918+0000","last_peered":"2023-10-16T19:58:30.841918+0000","last_clean":"2023-10-16T19:58:30.841918+0000","last_became_active":"2023-10-16T19:58:05.599026+0000","last_became_peered":"2023-10-16T19:58:05.599026+0000","last_unstale":"2023-10-16T19:58:30.841918+0000","last_undegraded":"2023-10-16T19:58:30.841918+0000","last_fullsized":"2023-10-16T19:58:30.841918+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:30.841860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:30.841860+0000","last_clean_scrub_stamp":"2023-10-16T19:58:30.841860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:58:17.968086+0000","scrub_duration":0.0011580990000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:45.874227+0000","last_change":"2023-10-16T19:58:45.874277+0000","last_active":"2023-10-16T19:58:45.874227+0000","last_peered":"2023-10-16T19:58:45.874227+0000","last_clean":"2023-10-16T19:58:45.874227+0000","last_became_active":"2023-10-16T19:58:05.609613+0000","last_became_peered":"2023-10-16T19:58:05.609613+0000","last_unstale":"2023-10-16T19:58:45.874227+0000","last_undegraded":"2023-10-16T19:58:45.874227+0000","last_fullsized":"2023-10-16T19:58:45.874227+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:45.874158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:45.874158+0000","last_clean_scrub_stamp":"2023-10-16T19:58:45.874158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:19:50.442372+0000","scrub_duration":0.00141573,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:28.729670+0000","last_change":"2023-10-16T19:58:28.729718+0000","last_active":"2023-10-16T19:58:28.729670+0000","last_peered":"2023-10-16T19:58:28.729670+0000","last_clean":"2023-10-16T19:58:28.729670+0000","last_became_active":"2023-10-16T19:58:05.608184+0000","last_became_peered":"2023-10-16T19:58:05.608184+0000","last_unstale":"2023-10-16T19:58:28.729670+0000","last_undegraded":"2023-10-16T19:58:28.729670+0000","last_fullsized":"2023-10-16T19:58:28.729670+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:28.729605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:28.729605+0000","last_clean_scrub_stamp":"2023-10-16T19:58:28.729605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:43:01.890586+0000","scrub_duration":0.0010799519999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:45.149133+0000","last_change":"2023-10-16T19:58:45.149181+0000","last_active":"2023-10-16T19:58:45.149133+0000","last_peered":"2023-10-16T19:58:45.149133+0000","last_clean":"2023-10-16T19:58:45.149133+0000","last_became_active":"2023-10-16T19:58:05.600977+0000","last_became_peered":"2023-10-16T19:58:05.600977+0000","last_unstale":"2023-10-16T19:58:45.149133+0000","last_undegraded":"2023-10-16T19:58:45.149133+0000","last_fullsized":"2023-10-16T19:58:45.149133+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:45.149076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:45.149076+0000","last_clean_scrub_stamp":"2023-10-16T19:58:45.149076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:38:54.529059+0000","scrub_duration":0.00099815699999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:43.158379+0000","last_change":"2023-10-16T19:58:43.158419+0000","last_active":"2023-10-16T19:58:43.158379+0000","last_peered":"2023-10-16T19:58:43.158379+0000","last_clean":"2023-10-16T19:58:43.158379+0000","last_became_active":"2023-10-16T19:58:05.601866+0000","last_became_peered":"2023-10-16T19:58:05.601866+0000","last_unstale":"2023-10-16T19:58:43.158379+0000","last_undegraded":"2023-10-16T19:58:43.158379+0000","last_fullsized":"2023-10-16T19:58:43.158379+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:43.158320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:43.158320+0000","last_clean_scrub_stamp":"2023-10-16T19:58:43.158320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:11:20.790744+0000","scrub_duration":0.0010806349999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:41.321085+0000","last_change":"2023-10-16T19:58:41.321127+0000","last_active":"2023-10-16T19:58:41.321085+0000","last_peered":"2023-10-16T19:58:41.321085+0000","last_clean":"2023-10-16T19:58:41.321085+0000","last_became_active":"2023-10-16T19:58:05.603536+0000","last_became_peered":"2023-10-16T19:58:05.603536+0000","last_unstale":"2023-10-16T19:58:41.321085+0000","last_undegraded":"2023-10-16T19:58:41.321085+0000","last_fullsized":"2023-10-16T19:58:41.321085+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:41.321033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:41.321033+0000","last_clean_scrub_stamp":"2023-10-16T19:58:41.321033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:45:08.998230+0000","scrub_duration":0.001431915,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:59:03.839252+0000","last_change":"2023-10-16T19:59:03.839299+0000","last_active":"2023-10-16T19:59:03.839252+0000","last_peered":"2023-10-16T19:59:03.839252+0000","last_clean":"2023-10-16T19:59:03.839252+0000","last_became_active":"2023-10-16T19:58:05.606725+0000","last_became_peered":"2023-10-16T19:58:05.606725+0000","last_unstale":"2023-10-16T19:59:03.839252+0000","last_undegraded":"2023-10-16T19:59:03.839252+0000","last_fullsized":"2023-10-16T19:59:03.839252+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:59:03.839188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:59:03.839188+0000","last_clean_scrub_stamp":"2023-10-16T19:59:03.839188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:52:12.898920+0000","scrub_duration":0.0012237330000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:49.096785+0000","last_change":"2023-10-16T19:58:49.096833+0000","last_active":"2023-10-16T19:58:49.096785+0000","last_peered":"2023-10-16T19:58:49.096785+0000","last_clean":"2023-10-16T19:58:49.096785+0000","last_became_active":"2023-10-16T19:58:05.605335+0000","last_became_peered":"2023-10-16T19:58:05.605335+0000","last_unstale":"2023-10-16T19:58:49.096785+0000","last_undegraded":"2023-10-16T19:58:49.096785+0000","last_fullsized":"2023-10-16T19:58:49.096785+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:49.096717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:49.096717+0000","last_clean_scrub_stamp":"2023-10-16T19:58:49.096717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:57:27.151314+0000","scrub_duration":0.0014750150000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:52.693501+0000","last_change":"2023-10-16T19:58:52.693545+0000","last_active":"2023-10-16T19:58:52.693501+0000","last_peered":"2023-10-16T19:58:52.693501+0000","last_clean":"2023-10-16T19:58:52.693501+0000","last_became_active":"2023-10-16T19:58:05.609123+0000","last_became_peered":"2023-10-16T19:58:05.609123+0000","last_unstale":"2023-10-16T19:58:52.693501+0000","last_undegraded":"2023-10-16T19:58:52.693501+0000","last_fullsized":"2023-10-16T19:58:52.693501+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:52.693448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:52.693448+0000","last_clean_scrub_stamp":"2023-10-16T19:58:52.693448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:29:55.301808+0000","scrub_duration":0.001108337,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:22.683742+0000","last_change":"2023-10-16T19:58:22.683803+0000","last_active":"2023-10-16T19:58:22.683742+0000","last_peered":"2023-10-16T19:58:22.683742+0000","last_clean":"2023-10-16T19:58:22.683742+0000","last_became_active":"2023-10-16T19:58:05.599210+0000","last_became_peered":"2023-10-16T19:58:05.599210+0000","last_unstale":"2023-10-16T19:58:22.683742+0000","last_undegraded":"2023-10-16T19:58:22.683742+0000","last_fullsized":"2023-10-16T19:58:22.683742+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:22.683671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:22.683671+0000","last_clean_scrub_stamp":"2023-10-16T19:58:22.683671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:14:26.928272+0000","scrub_duration":0.0016721489999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:47.936597+0000","last_change":"2023-10-16T19:58:47.936646+0000","last_active":"2023-10-16T19:58:47.936597+0000","last_peered":"2023-10-16T19:58:47.936597+0000","last_clean":"2023-10-16T19:58:47.936597+0000","last_became_active":"2023-10-16T19:58:05.608010+0000","last_became_peered":"2023-10-16T19:58:05.608010+0000","last_unstale":"2023-10-16T19:58:47.936597+0000","last_undegraded":"2023-10-16T19:58:47.936597+0000","last_fullsized":"2023-10-16T19:58:47.936597+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:47.936533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:47.936533+0000","last_clean_scrub_stamp":"2023-10-16T19:58:47.936533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:06:03.078356+0000","scrub_duration":0.0014174140000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:55.064681+0000","last_change":"2023-10-16T19:58:55.064763+0000","last_active":"2023-10-16T19:58:55.064681+0000","last_peered":"2023-10-16T19:58:55.064681+0000","last_clean":"2023-10-16T19:58:55.064681+0000","last_became_active":"2023-10-16T19:58:05.607185+0000","last_became_peered":"2023-10-16T19:58:05.607185+0000","last_unstale":"2023-10-16T19:58:55.064681+0000","last_undegraded":"2023-10-16T19:58:55.064681+0000","last_fullsized":"2023-10-16T19:58:55.064681+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:55.064627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:55.064627+0000","last_clean_scrub_stamp":"2023-10-16T19:58:55.064627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:49:31.811824+0000","scrub_duration":0.001865561,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:45.902537+0000","last_change":"2023-10-16T19:58:45.902585+0000","last_active":"2023-10-16T19:58:45.902537+0000","last_peered":"2023-10-16T19:58:45.902537+0000","last_clean":"2023-10-16T19:58:45.902537+0000","last_became_active":"2023-10-16T19:58:05.606043+0000","last_became_peered":"2023-10-16T19:58:05.606043+0000","last_unstale":"2023-10-16T19:58:45.902537+0000","last_undegraded":"2023-10-16T19:58:45.902537+0000","last_fullsized":"2023-10-16T19:58:45.902537+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:45.902469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:45.902469+0000","last_clean_scrub_stamp":"2023-10-16T19:58:45.902469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:25:40.137694+0000","scrub_duration":0.0012828379999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:26.803352+0000","last_change":"2023-10-16T19:58:26.803418+0000","last_active":"2023-10-16T19:58:26.803352+0000","last_peered":"2023-10-16T19:58:26.803352+0000","last_clean":"2023-10-16T19:58:26.803352+0000","last_became_active":"2023-10-16T19:58:05.607763+0000","last_became_peered":"2023-10-16T19:58:05.607763+0000","last_unstale":"2023-10-16T19:58:26.803352+0000","last_undegraded":"2023-10-16T19:58:26.803352+0000","last_fullsized":"2023-10-16T19:58:26.803352+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:26.803286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:26.803286+0000","last_clean_scrub_stamp":"2023-10-16T19:58:26.803286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:47:41.021710+0000","scrub_duration":0.0013829269999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:48.084825+0000","last_change":"2023-10-16T19:58:48.084899+0000","last_active":"2023-10-16T19:58:48.084825+0000","last_peered":"2023-10-16T19:58:48.084825+0000","last_clean":"2023-10-16T19:58:48.084825+0000","last_became_active":"2023-10-16T19:58:05.604309+0000","last_became_peered":"2023-10-16T19:58:05.604309+0000","last_unstale":"2023-10-16T19:58:48.084825+0000","last_undegraded":"2023-10-16T19:58:48.084825+0000","last_fullsized":"2023-10-16T19:58:48.084825+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:48.084736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:48.084736+0000","last_clean_scrub_stamp":"2023-10-16T19:58:48.084736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:09:54.791051+0000","scrub_duration":0.0014806400000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:33.784308+0000","last_change":"2023-10-16T19:58:33.784355+0000","last_active":"2023-10-16T19:58:33.784308+0000","last_peered":"2023-10-16T19:58:33.784308+0000","last_clean":"2023-10-16T19:58:33.784308+0000","last_became_active":"2023-10-16T19:58:05.606102+0000","last_became_peered":"2023-10-16T19:58:05.606102+0000","last_unstale":"2023-10-16T19:58:33.784308+0000","last_undegraded":"2023-10-16T19:58:33.784308+0000","last_fullsized":"2023-10-16T19:58:33.784308+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:33.784248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:33.784248+0000","last_clean_scrub_stamp":"2023-10-16T19:58:33.784248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:05:48.926071+0000","scrub_duration":0.001215055,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:41.585892+0000","last_change":"2023-10-16T19:58:41.585937+0000","last_active":"2023-10-16T19:58:41.585892+0000","last_peered":"2023-10-16T19:58:41.585892+0000","last_clean":"2023-10-16T19:58:41.585892+0000","last_became_active":"2023-10-16T19:58:05.599955+0000","last_became_peered":"2023-10-16T19:58:05.599955+0000","last_unstale":"2023-10-16T19:58:41.585892+0000","last_undegraded":"2023-10-16T19:58:41.585892+0000","last_fullsized":"2023-10-16T19:58:41.585892+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:41.585836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:41.585836+0000","last_clean_scrub_stamp":"2023-10-16T19:58:41.585836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:42:54.647037+0000","scrub_duration":0.0011150070000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:31.719235+0000","last_change":"2023-10-16T19:58:31.719303+0000","last_active":"2023-10-16T19:58:31.719235+0000","last_peered":"2023-10-16T19:58:31.719235+0000","last_clean":"2023-10-16T19:58:31.719235+0000","last_became_active":"2023-10-16T19:58:05.608571+0000","last_became_peered":"2023-10-16T19:58:05.608571+0000","last_unstale":"2023-10-16T19:58:31.719235+0000","last_undegraded":"2023-10-16T19:58:31.719235+0000","last_fullsized":"2023-10-16T19:58:31.719235+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:31.719175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:31.719175+0000","last_clean_scrub_stamp":"2023-10-16T19:58:31.719175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:00:45.635707+0000","scrub_duration":0.0011065210000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:53.723233+0000","last_change":"2023-10-16T19:58:53.723284+0000","last_active":"2023-10-16T19:58:53.723233+0000","last_peered":"2023-10-16T19:58:53.723233+0000","last_clean":"2023-10-16T19:58:53.723233+0000","last_became_active":"2023-10-16T19:58:05.609211+0000","last_became_peered":"2023-10-16T19:58:05.609211+0000","last_unstale":"2023-10-16T19:58:53.723233+0000","last_undegraded":"2023-10-16T19:58:53.723233+0000","last_fullsized":"2023-10-16T19:58:53.723233+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:53.723170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:53.723170+0000","last_clean_scrub_stamp":"2023-10-16T19:58:53.723170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:14:43.047539+0000","scrub_duration":0.0013977519999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"32'4","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:21.846435+0000","last_change":"2023-10-16T19:58:21.846485+0000","last_active":"2023-10-16T19:58:21.846435+0000","last_peered":"2023-10-16T19:58:21.846435+0000","last_clean":"2023-10-16T19:58:21.846435+0000","last_became_active":"2023-10-16T19:58:04.587523+0000","last_became_peered":"2023-10-16T19:58:04.587523+0000","last_unstale":"2023-10-16T19:58:21.846435+0000","last_undegraded":"2023-10-16T19:58:21.846435+0000","last_fullsized":"2023-10-16T19:58:21.846435+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2023-10-16T19:58:21.846381+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2023-10-16T19:58:21.846381+0000","last_clean_scrub_stamp":"2023-10-16T19:58:21.846381+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:24:55.391734+0000","scrub_duration":0.0014127810000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:26.719990+0000","last_change":"2023-10-16T19:58:26.720040+0000","last_active":"2023-10-16T19:58:26.719990+0000","last_peered":"2023-10-16T19:58:26.719990+0000","last_clean":"2023-10-16T19:58:26.719990+0000","last_became_active":"2023-10-16T19:58:05.598478+0000","last_became_peered":"2023-10-16T19:58:05.598478+0000","last_unstale":"2023-10-16T19:58:26.719990+0000","last_undegraded":"2023-10-16T19:58:26.719990+0000","last_fullsized":"2023-10-16T19:58:26.719990+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:26.719928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:26.719928+0000","last_clean_scrub_stamp":"2023-10-16T19:58:26.719928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:23:07.038642+0000","scrub_duration":0.00097661199999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"32'1","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:26.579405+0000","last_change":"2023-10-16T19:58:26.579471+0000","last_active":"2023-10-16T19:58:26.579405+0000","last_peered":"2023-10-16T19:58:26.579405+0000","last_clean":"2023-10-16T19:58:26.579405+0000","last_became_active":"2023-10-16T19:58:04.589624+0000","last_became_peered":"2023-10-16T19:58:04.589624+0000","last_unstale":"2023-10-16T19:58:26.579405+0000","last_undegraded":"2023-10-16T19:58:26.579405+0000","last_fullsized":"2023-10-16T19:58:26.579405+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'1","last_scrub_stamp":"2023-10-16T19:58:26.579324+0000","last_deep_scrub":"32'1","last_deep_scrub_stamp":"2023-10-16T19:58:26.579324+0000","last_clean_scrub_stamp":"2023-10-16T19:58:26.579324+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:23:06.898037+0000","scrub_duration":0.001603089,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:52.118824+0000","last_change":"2023-10-16T19:58:52.118905+0000","last_active":"2023-10-16T19:58:52.118824+0000","last_peered":"2023-10-16T19:58:52.118824+0000","last_clean":"2023-10-16T19:58:52.118824+0000","last_became_active":"2023-10-16T19:58:05.603733+0000","last_became_peered":"2023-10-16T19:58:05.603733+0000","last_unstale":"2023-10-16T19:58:52.118824+0000","last_undegraded":"2023-10-16T19:58:52.118824+0000","last_fullsized":"2023-10-16T19:58:52.118824+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:52.118753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:52.118753+0000","last_clean_scrub_stamp":"2023-10-16T19:58:52.118753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:15:17.393610+0000","scrub_duration":0.001768127,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"32'2","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:32.148475+0000","last_change":"2023-10-16T19:58:32.148558+0000","last_active":"2023-10-16T19:58:32.148475+0000","last_peered":"2023-10-16T19:58:32.148475+0000","last_clean":"2023-10-16T19:58:32.148475+0000","last_became_active":"2023-10-16T19:58:04.587076+0000","last_became_peered":"2023-10-16T19:58:04.587076+0000","last_unstale":"2023-10-16T19:58:32.148475+0000","last_undegraded":"2023-10-16T19:58:32.148475+0000","last_fullsized":"2023-10-16T19:58:32.148475+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2023-10-16T19:58:32.148408+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2023-10-16T19:58:32.148408+0000","last_clean_scrub_stamp":"2023-10-16T19:58:32.148408+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:00:46.064940+0000","scrub_duration":0.001719134,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:38.950008+0000","last_change":"2023-10-16T19:58:38.950092+0000","last_active":"2023-10-16T19:58:38.950008+0000","last_peered":"2023-10-16T19:58:38.950008+0000","last_clean":"2023-10-16T19:58:38.950008+0000","last_became_active":"2023-10-16T19:58:05.603317+0000","last_became_peered":"2023-10-16T19:58:05.603317+0000","last_unstale":"2023-10-16T19:58:38.950008+0000","last_undegraded":"2023-10-16T19:58:38.950008+0000","last_fullsized":"2023-10-16T19:58:38.950008+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:38.949945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:38.949945+0000","last_clean_scrub_stamp":"2023-10-16T19:58:38.949945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:48:50.496951+0000","scrub_duration":0.001372004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"32'2","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:20.434958+0000","last_change":"2023-10-16T19:58:20.435007+0000","last_active":"2023-10-16T19:58:20.434958+0000","last_peered":"2023-10-16T19:58:20.434958+0000","last_clean":"2023-10-16T19:58:20.434958+0000","last_became_active":"2023-10-16T19:58:04.580982+0000","last_became_peered":"2023-10-16T19:58:04.580982+0000","last_unstale":"2023-10-16T19:58:20.434958+0000","last_undegraded":"2023-10-16T19:58:20.434958+0000","last_fullsized":"2023-10-16T19:58:20.434958+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2023-10-16T19:58:20.434910+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2023-10-16T19:58:20.434910+0000","last_clean_scrub_stamp":"2023-10-16T19:58:20.434910+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:05:39.251429+0000","scrub_duration":0.0011612440000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:37.773373+0000","last_change":"2023-10-16T19:58:37.773416+0000","last_active":"2023-10-16T19:58:37.773373+0000","last_peered":"2023-10-16T19:58:37.773373+0000","last_clean":"2023-10-16T19:58:37.773373+0000","last_became_active":"2023-10-16T19:58:05.609287+0000","last_became_peered":"2023-10-16T19:58:05.609287+0000","last_unstale":"2023-10-16T19:58:37.773373+0000","last_undegraded":"2023-10-16T19:58:37.773373+0000","last_fullsized":"2023-10-16T19:58:37.773373+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:37.773308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:37.773308+0000","last_clean_scrub_stamp":"2023-10-16T19:58:37.773308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:11:15.405732+0000","scrub_duration":0.0011155970000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"32'1","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:25.891070+0000","last_change":"2023-10-16T19:58:25.891117+0000","last_active":"2023-10-16T19:58:25.891070+0000","last_peered":"2023-10-16T19:58:25.891070+0000","last_clean":"2023-10-16T19:58:25.891070+0000","last_became_active":"2023-10-16T19:58:04.591382+0000","last_became_peered":"2023-10-16T19:58:04.591382+0000","last_unstale":"2023-10-16T19:58:25.891070+0000","last_undegraded":"2023-10-16T19:58:25.891070+0000","last_fullsized":"2023-10-16T19:58:25.891070+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'1","last_scrub_stamp":"2023-10-16T19:58:25.890998+0000","last_deep_scrub":"32'1","last_deep_scrub_stamp":"2023-10-16T19:58:25.890998+0000","last_clean_scrub_stamp":"2023-10-16T19:58:25.890998+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:04:25.105980+0000","scrub_duration":0.0014568630000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:33.800480+0000","last_change":"2023-10-16T19:58:33.800524+0000","last_active":"2023-10-16T19:58:33.800480+0000","last_peered":"2023-10-16T19:58:33.800480+0000","last_clean":"2023-10-16T19:58:33.800480+0000","last_became_active":"2023-10-16T19:58:05.606777+0000","last_became_peered":"2023-10-16T19:58:05.606777+0000","last_unstale":"2023-10-16T19:58:33.800480+0000","last_undegraded":"2023-10-16T19:58:33.800480+0000","last_fullsized":"2023-10-16T19:58:33.800480+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:33.800421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:33.800421+0000","last_clean_scrub_stamp":"2023-10-16T19:58:33.800421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:38:43.180405+0000","scrub_duration":0.001325618,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"32'1","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:24.885637+0000","last_change":"2023-10-16T19:58:24.885721+0000","last_active":"2023-10-16T19:58:24.885637+0000","last_peered":"2023-10-16T19:58:24.885637+0000","last_clean":"2023-10-16T19:58:24.885637+0000","last_became_active":"2023-10-16T19:58:04.584702+0000","last_became_peered":"2023-10-16T19:58:04.584702+0000","last_unstale":"2023-10-16T19:58:24.885637+0000","last_undegraded":"2023-10-16T19:58:24.885637+0000","last_fullsized":"2023-10-16T19:58:24.885637+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'1","last_scrub_stamp":"2023-10-16T19:58:24.885575+0000","last_deep_scrub":"32'1","last_deep_scrub_stamp":"2023-10-16T19:58:24.885575+0000","last_clean_scrub_stamp":"2023-10-16T19:58:24.885575+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:16:25.808994+0000","scrub_duration":0.0015874319999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:59:05.846616+0000","last_change":"2023-10-16T19:59:05.846665+0000","last_active":"2023-10-16T19:59:05.846616+0000","last_peered":"2023-10-16T19:59:05.846616+0000","last_clean":"2023-10-16T19:59:05.846616+0000","last_became_active":"2023-10-16T19:58:05.600813+0000","last_became_peered":"2023-10-16T19:58:05.600813+0000","last_unstale":"2023-10-16T19:59:05.846616+0000","last_undegraded":"2023-10-16T19:59:05.846616+0000","last_fullsized":"2023-10-16T19:59:05.846616+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:59:05.846551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:59:05.846551+0000","last_clean_scrub_stamp":"2023-10-16T19:59:05.846551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:38:42.583479+0000","scrub_duration":0.001157424,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:23.096433+0000","last_change":"2023-10-16T19:58:23.096482+0000","last_active":"2023-10-16T19:58:23.096433+0000","last_peered":"2023-10-16T19:58:23.096433+0000","last_clean":"2023-10-16T19:58:23.096433+0000","last_became_active":"2023-10-16T19:58:04.584173+0000","last_became_peered":"2023-10-16T19:58:04.584173+0000","last_unstale":"2023-10-16T19:58:23.096433+0000","last_undegraded":"2023-10-16T19:58:23.096433+0000","last_fullsized":"2023-10-16T19:58:23.096433+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:23.096365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:23.096365+0000","last_clean_scrub_stamp":"2023-10-16T19:58:23.096365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:14:27.340966+0000","scrub_duration":0.0011138140000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:52.999394+0000","last_change":"2023-10-16T19:58:52.999436+0000","last_active":"2023-10-16T19:58:52.999394+0000","last_peered":"2023-10-16T19:58:52.999394+0000","last_clean":"2023-10-16T19:58:52.999394+0000","last_became_active":"2023-10-16T19:58:05.601416+0000","last_became_peered":"2023-10-16T19:58:05.601416+0000","last_unstale":"2023-10-16T19:58:52.999394+0000","last_undegraded":"2023-10-16T19:58:52.999394+0000","last_fullsized":"2023-10-16T19:58:52.999394+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:52.999339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:52.999339+0000","last_clean_scrub_stamp":"2023-10-16T19:58:52.999339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:39:02.379323+0000","scrub_duration":0.001502242,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:21.962408+0000","last_change":"2023-10-16T19:58:21.962453+0000","last_active":"2023-10-16T19:58:21.962408+0000","last_peered":"2023-10-16T19:58:21.962408+0000","last_clean":"2023-10-16T19:58:21.962408+0000","last_became_active":"2023-10-16T19:58:04.589891+0000","last_became_peered":"2023-10-16T19:58:04.589891+0000","last_unstale":"2023-10-16T19:58:21.962408+0000","last_undegraded":"2023-10-16T19:58:21.962408+0000","last_fullsized":"2023-10-16T19:58:21.962408+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:21.962351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:21.962351+0000","last_clean_scrub_stamp":"2023-10-16T19:58:21.962351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:47:53.043979+0000","scrub_duration":0.0009951929999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:35.836966+0000","last_change":"2023-10-16T19:58:35.837007+0000","last_active":"2023-10-16T19:58:35.836966+0000","last_peered":"2023-10-16T19:58:35.836966+0000","last_clean":"2023-10-16T19:58:35.836966+0000","last_became_active":"2023-10-16T19:58:05.603042+0000","last_became_peered":"2023-10-16T19:58:05.603042+0000","last_unstale":"2023-10-16T19:58:35.836966+0000","last_undegraded":"2023-10-16T19:58:35.836966+0000","last_fullsized":"2023-10-16T19:58:35.836966+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:35.836905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:35.836905+0000","last_clean_scrub_stamp":"2023-10-16T19:58:35.836905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:51:44.896637+0000","scrub_duration":0.0011687589999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:31.181629+0000","last_change":"2023-10-16T19:58:31.181709+0000","last_active":"2023-10-16T19:58:31.181629+0000","last_peered":"2023-10-16T19:58:31.181629+0000","last_clean":"2023-10-16T19:58:31.181629+0000","last_became_active":"2023-10-16T19:58:04.589253+0000","last_became_peered":"2023-10-16T19:58:04.589253+0000","last_unstale":"2023-10-16T19:58:31.181629+0000","last_undegraded":"2023-10-16T19:58:31.181629+0000","last_fullsized":"2023-10-16T19:58:31.181629+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:31.181571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:31.181571+0000","last_clean_scrub_stamp":"2023-10-16T19:58:31.181571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:09:37.887886+0000","scrub_duration":0.0019320749999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:57.147564+0000","last_change":"2023-10-16T19:58:57.147615+0000","last_active":"2023-10-16T19:58:57.147564+0000","last_peered":"2023-10-16T19:58:57.147564+0000","last_clean":"2023-10-16T19:58:57.147564+0000","last_became_active":"2023-10-16T19:58:05.602336+0000","last_became_peered":"2023-10-16T19:58:05.602336+0000","last_unstale":"2023-10-16T19:58:57.147564+0000","last_undegraded":"2023-10-16T19:58:57.147564+0000","last_fullsized":"2023-10-16T19:58:57.147564+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:57.147502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:57.147502+0000","last_clean_scrub_stamp":"2023-10-16T19:58:57.147502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:39:45.441685+0000","scrub_duration":0.001143254,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:35.631480+0000","last_change":"2023-10-16T19:58:35.631529+0000","last_active":"2023-10-16T19:58:35.631480+0000","last_peered":"2023-10-16T19:58:35.631480+0000","last_clean":"2023-10-16T19:58:35.631480+0000","last_became_active":"2023-10-16T19:58:04.586047+0000","last_became_peered":"2023-10-16T19:58:04.586047+0000","last_unstale":"2023-10-16T19:58:35.631480+0000","last_undegraded":"2023-10-16T19:58:35.631480+0000","last_fullsized":"2023-10-16T19:58:35.631480+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:35.631427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:35.631427+0000","last_clean_scrub_stamp":"2023-10-16T19:58:35.631427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:23:49.533757+0000","scrub_duration":0.001124863,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:47.096496+0000","last_change":"2023-10-16T19:58:47.096545+0000","last_active":"2023-10-16T19:58:47.096496+0000","last_peered":"2023-10-16T19:58:47.096496+0000","last_clean":"2023-10-16T19:58:47.096496+0000","last_became_active":"2023-10-16T19:58:05.606148+0000","last_became_peered":"2023-10-16T19:58:05.606148+0000","last_unstale":"2023-10-16T19:58:47.096496+0000","last_undegraded":"2023-10-16T19:58:47.096496+0000","last_fullsized":"2023-10-16T19:58:47.096496+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:47.096430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:47.096430+0000","last_clean_scrub_stamp":"2023-10-16T19:58:47.096430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:51:56.156162+0000","scrub_duration":0.0012542149999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"32'3","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:21.645944+0000","last_change":"2023-10-16T19:58:21.645994+0000","last_active":"2023-10-16T19:58:21.645944+0000","last_peered":"2023-10-16T19:58:21.645944+0000","last_clean":"2023-10-16T19:58:21.645944+0000","last_became_active":"2023-10-16T19:58:04.589139+0000","last_became_peered":"2023-10-16T19:58:04.589139+0000","last_unstale":"2023-10-16T19:58:21.645944+0000","last_undegraded":"2023-10-16T19:58:21.645944+0000","last_fullsized":"2023-10-16T19:58:21.645944+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3","last_scrub_stamp":"2023-10-16T19:58:21.645882+0000","last_deep_scrub":"32'3","last_deep_scrub_stamp":"2023-10-16T19:58:21.645882+0000","last_clean_scrub_stamp":"2023-10-16T19:58:21.645882+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:20:16.890402+0000","scrub_duration":0.0016449870000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:24.763359+0000","last_change":"2023-10-16T19:58:24.763421+0000","last_active":"2023-10-16T19:58:24.763359+0000","last_peered":"2023-10-16T19:58:24.763359+0000","last_clean":"2023-10-16T19:58:24.763359+0000","last_became_active":"2023-10-16T19:58:05.600598+0000","last_became_peered":"2023-10-16T19:58:05.600598+0000","last_unstale":"2023-10-16T19:58:24.763359+0000","last_undegraded":"2023-10-16T19:58:24.763359+0000","last_fullsized":"2023-10-16T19:58:24.763359+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:24.763278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:24.763278+0000","last_clean_scrub_stamp":"2023-10-16T19:58:24.763278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:14:14.087647+0000","scrub_duration":0.001597677,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"32'6","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:28.108190+0000","last_change":"2023-10-16T19:58:28.108247+0000","last_active":"2023-10-16T19:58:28.108190+0000","last_peered":"2023-10-16T19:58:28.108190+0000","last_clean":"2023-10-16T19:58:28.108190+0000","last_became_active":"2023-10-16T19:58:04.584588+0000","last_became_peered":"2023-10-16T19:58:04.584588+0000","last_unstale":"2023-10-16T19:58:28.108190+0000","last_undegraded":"2023-10-16T19:58:28.108190+0000","last_fullsized":"2023-10-16T19:58:28.108190+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2023-10-16T19:58:28.108132+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2023-10-16T19:58:28.108132+0000","last_clean_scrub_stamp":"2023-10-16T19:58:28.108132+0000","objects_scrubbed":4,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:43:01.269113+0000","scrub_duration":0.0016545329999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:33.881969+0000","last_change":"2023-10-16T19:58:33.882043+0000","last_active":"2023-10-16T19:58:33.881969+0000","last_peered":"2023-10-16T19:58:33.881969+0000","last_clean":"2023-10-16T19:58:33.881969+0000","last_became_active":"2023-10-16T19:58:05.602386+0000","last_became_peered":"2023-10-16T19:58:05.602386+0000","last_unstale":"2023-10-16T19:58:33.881969+0000","last_undegraded":"2023-10-16T19:58:33.881969+0000","last_fullsized":"2023-10-16T19:58:33.881969+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:33.881891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:33.881891+0000","last_clean_scrub_stamp":"2023-10-16T19:58:33.881891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:48:50.016627+0000","scrub_duration":0.001250496,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"33'4","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:46.159935+0000","last_change":"2023-10-16T19:58:46.159986+0000","last_active":"2023-10-16T19:58:46.159935+0000","last_peered":"2023-10-16T19:58:46.159935+0000","last_clean":"2023-10-16T19:58:46.159935+0000","last_became_active":"2023-10-16T19:58:04.586290+0000","last_became_peered":"2023-10-16T19:58:04.586290+0000","last_unstale":"2023-10-16T19:58:46.159935+0000","last_undegraded":"2023-10-16T19:58:46.159935+0000","last_fullsized":"2023-10-16T19:58:46.159935+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2023-10-16T19:58:46.159884+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2023-10-16T19:58:46.159884+0000","last_clean_scrub_stamp":"2023-10-16T19:58:46.159884+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:14:35.484253+0000","scrub_duration":0.0021927470000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:19.039160+0000","last_change":"2023-10-16T19:58:19.039195+0000","last_active":"2023-10-16T19:58:19.039160+0000","last_peered":"2023-10-16T19:58:19.039160+0000","last_clean":"2023-10-16T19:58:19.039160+0000","last_became_active":"2023-10-16T19:58:05.605962+0000","last_became_peered":"2023-10-16T19:58:05.605962+0000","last_unstale":"2023-10-16T19:58:19.039160+0000","last_undegraded":"2023-10-16T19:58:19.039160+0000","last_fullsized":"2023-10-16T19:58:19.039160+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:19.039113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:19.039113+0000","last_clean_scrub_stamp":"2023-10-16T19:58:19.039113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:12:55.467133+0000","scrub_duration":0.000870695,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:19.676983+0000","last_change":"2023-10-16T19:58:19.677037+0000","last_active":"2023-10-16T19:58:19.676983+0000","last_peered":"2023-10-16T19:58:19.676983+0000","last_clean":"2023-10-16T19:58:19.676983+0000","last_became_active":"2023-10-16T19:58:04.587531+0000","last_became_peered":"2023-10-16T19:58:04.587531+0000","last_unstale":"2023-10-16T19:58:19.676983+0000","last_undegraded":"2023-10-16T19:58:19.676983+0000","last_fullsized":"2023-10-16T19:58:19.676983+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:19.676913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:19.676913+0000","last_clean_scrub_stamp":"2023-10-16T19:58:19.676913+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:03:42.167534+0000","scrub_duration":0.0011117410000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:32.761671+0000","last_change":"2023-10-16T19:58:32.761717+0000","last_active":"2023-10-16T19:58:32.761671+0000","last_peered":"2023-10-16T19:58:32.761671+0000","last_clean":"2023-10-16T19:58:32.761671+0000","last_became_active":"2023-10-16T19:58:05.607449+0000","last_became_peered":"2023-10-16T19:58:05.607449+0000","last_unstale":"2023-10-16T19:58:32.761671+0000","last_undegraded":"2023-10-16T19:58:32.761671+0000","last_fullsized":"2023-10-16T19:58:32.761671+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:32.761603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:32.761603+0000","last_clean_scrub_stamp":"2023-10-16T19:58:32.761603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:25:26.996828+0000","scrub_duration":0.001069866,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:39.085274+0000","last_change":"2023-10-16T19:58:39.085319+0000","last_active":"2023-10-16T19:58:39.085274+0000","last_peered":"2023-10-16T19:58:39.085274+0000","last_clean":"2023-10-16T19:58:39.085274+0000","last_became_active":"2023-10-16T19:58:04.588305+0000","last_became_peered":"2023-10-16T19:58:04.588305+0000","last_unstale":"2023-10-16T19:58:39.085274+0000","last_undegraded":"2023-10-16T19:58:39.085274+0000","last_fullsized":"2023-10-16T19:58:39.085274+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:39.085200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:39.085200+0000","last_clean_scrub_stamp":"2023-10-16T19:58:39.085200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:58:26.211426+0000","scrub_duration":0.0015299140000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:28.708653+0000","last_change":"2023-10-16T19:58:28.708698+0000","last_active":"2023-10-16T19:58:28.708653+0000","last_peered":"2023-10-16T19:58:28.708653+0000","last_clean":"2023-10-16T19:58:28.708653+0000","last_became_active":"2023-10-16T19:58:05.599356+0000","last_became_peered":"2023-10-16T19:58:05.599356+0000","last_unstale":"2023-10-16T19:58:28.708653+0000","last_undegraded":"2023-10-16T19:58:28.708653+0000","last_fullsized":"2023-10-16T19:58:28.708653+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:28.708592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:28.708592+0000","last_clean_scrub_stamp":"2023-10-16T19:58:28.708592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:16:29.632011+0000","scrub_duration":0.001058738,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"32'8","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:22.083215+0000","last_change":"2023-10-16T19:58:22.083266+0000","last_active":"2023-10-16T19:58:22.083215+0000","last_peered":"2023-10-16T19:58:22.083215+0000","last_clean":"2023-10-16T19:58:22.083215+0000","last_became_active":"2023-10-16T19:58:04.580648+0000","last_became_peered":"2023-10-16T19:58:04.580648+0000","last_unstale":"2023-10-16T19:58:22.083215+0000","last_undegraded":"2023-10-16T19:58:22.083215+0000","last_fullsized":"2023-10-16T19:58:22.083215+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2023-10-16T19:58:22.083152+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2023-10-16T19:58:22.083152+0000","last_clean_scrub_stamp":"2023-10-16T19:58:22.083152+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:20:17.327671+0000","scrub_duration":0.001902965,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:57.906825+0000","last_change":"2023-10-16T19:58:57.906872+0000","last_active":"2023-10-16T19:58:57.906825+0000","last_peered":"2023-10-16T19:58:57.906825+0000","last_clean":"2023-10-16T19:58:57.906825+0000","last_became_active":"2023-10-16T19:58:05.600333+0000","last_became_peered":"2023-10-16T19:58:05.600333+0000","last_unstale":"2023-10-16T19:58:57.906825+0000","last_undegraded":"2023-10-16T19:58:57.906825+0000","last_fullsized":"2023-10-16T19:58:57.906825+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:57.906763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:57.906763+0000","last_clean_scrub_stamp":"2023-10-16T19:58:57.906763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:39:07.286747+0000","scrub_duration":0.001132468,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"32'1","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:24.691734+0000","last_change":"2023-10-16T19:58:24.691784+0000","last_active":"2023-10-16T19:58:24.691734+0000","last_peered":"2023-10-16T19:58:24.691734+0000","last_clean":"2023-10-16T19:58:24.691734+0000","last_became_active":"2023-10-16T19:58:04.587576+0000","last_became_peered":"2023-10-16T19:58:04.587576+0000","last_unstale":"2023-10-16T19:58:24.691734+0000","last_undegraded":"2023-10-16T19:58:24.691734+0000","last_fullsized":"2023-10-16T19:58:24.691734+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'1","last_scrub_stamp":"2023-10-16T19:58:24.691678+0000","last_deep_scrub":"32'1","last_deep_scrub_stamp":"2023-10-16T19:58:24.691678+0000","last_clean_scrub_stamp":"2023-10-16T19:58:24.691678+0000","objects_scrubbed":1,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:16:13.607131+0000","scrub_duration":0.001286595,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:25.761868+0000","last_change":"2023-10-16T19:58:25.761913+0000","last_active":"2023-10-16T19:58:25.761868+0000","last_peered":"2023-10-16T19:58:25.761868+0000","last_clean":"2023-10-16T19:58:25.761868+0000","last_became_active":"2023-10-16T19:58:05.598861+0000","last_became_peered":"2023-10-16T19:58:05.598861+0000","last_unstale":"2023-10-16T19:58:25.761868+0000","last_undegraded":"2023-10-16T19:58:25.761868+0000","last_fullsized":"2023-10-16T19:58:25.761868+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:25.761813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:25.761813+0000","last_clean_scrub_stamp":"2023-10-16T19:58:25.761813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:00:39.678346+0000","scrub_duration":0.0010256320000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"33'3","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:44.151091+0000","last_change":"2023-10-16T19:58:44.151137+0000","last_active":"2023-10-16T19:58:44.151091+0000","last_peered":"2023-10-16T19:58:44.151091+0000","last_clean":"2023-10-16T19:58:44.151091+0000","last_became_active":"2023-10-16T19:58:04.585973+0000","last_became_peered":"2023-10-16T19:58:04.585973+0000","last_unstale":"2023-10-16T19:58:44.151091+0000","last_undegraded":"2023-10-16T19:58:44.151091+0000","last_fullsized":"2023-10-16T19:58:44.151091+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'3","last_scrub_stamp":"2023-10-16T19:58:44.151037+0000","last_deep_scrub":"33'3","last_deep_scrub_stamp":"2023-10-16T19:58:44.151037+0000","last_clean_scrub_stamp":"2023-10-16T19:58:44.151037+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:29:46.759397+0000","scrub_duration":0.0019678899999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:50.983596+0000","last_change":"2023-10-16T19:58:50.983646+0000","last_active":"2023-10-16T19:58:50.983596+0000","last_peered":"2023-10-16T19:58:50.983596+0000","last_clean":"2023-10-16T19:58:50.983596+0000","last_became_active":"2023-10-16T19:58:05.606722+0000","last_became_peered":"2023-10-16T19:58:05.606722+0000","last_unstale":"2023-10-16T19:58:50.983596+0000","last_undegraded":"2023-10-16T19:58:50.983596+0000","last_fullsized":"2023-10-16T19:58:50.983596+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:50.983519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:50.983519+0000","last_clean_scrub_stamp":"2023-10-16T19:58:50.983519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:11:28.615943+0000","scrub_duration":0.0013861419999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"32'1","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:32.979463+0000","last_change":"2023-10-16T19:58:32.979532+0000","last_active":"2023-10-16T19:58:32.979463+0000","last_peered":"2023-10-16T19:58:32.979463+0000","last_clean":"2023-10-16T19:58:32.979463+0000","last_became_active":"2023-10-16T19:58:04.586934+0000","last_became_peered":"2023-10-16T19:58:04.586934+0000","last_unstale":"2023-10-16T19:58:32.979463+0000","last_undegraded":"2023-10-16T19:58:32.979463+0000","last_fullsized":"2023-10-16T19:58:32.979463+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'1","last_scrub_stamp":"2023-10-16T19:58:32.979401+0000","last_deep_scrub":"32'1","last_deep_scrub_stamp":"2023-10-16T19:58:32.979401+0000","last_clean_scrub_stamp":"2023-10-16T19:58:32.979401+0000","objects_scrubbed":1,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:34:33.599720+0000","scrub_duration":0.0018833140000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:25.455034+0000","last_change":"2023-10-16T19:58:25.455086+0000","last_active":"2023-10-16T19:58:25.455034+0000","last_peered":"2023-10-16T19:58:25.455034+0000","last_clean":"2023-10-16T19:58:25.455034+0000","last_became_active":"2023-10-16T19:58:05.607269+0000","last_became_peered":"2023-10-16T19:58:05.607269+0000","last_unstale":"2023-10-16T19:58:25.455034+0000","last_undegraded":"2023-10-16T19:58:25.455034+0000","last_fullsized":"2023-10-16T19:58:25.455034+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:25.454944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:25.454944+0000","last_clean_scrub_stamp":"2023-10-16T19:58:25.454944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:09:25.545413+0000","scrub_duration":0.0017519180000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:41.105467+0000","last_change":"2023-10-16T19:58:41.105527+0000","last_active":"2023-10-16T19:58:41.105467+0000","last_peered":"2023-10-16T19:58:41.105467+0000","last_clean":"2023-10-16T19:58:41.105467+0000","last_became_active":"2023-10-16T19:58:04.591967+0000","last_became_peered":"2023-10-16T19:58:04.591967+0000","last_unstale":"2023-10-16T19:58:41.105467+0000","last_undegraded":"2023-10-16T19:58:41.105467+0000","last_fullsized":"2023-10-16T19:58:41.105467+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:41.105372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:41.105372+0000","last_clean_scrub_stamp":"2023-10-16T19:58:41.105372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:42:54.166573+0000","scrub_duration":0.001681975,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:35.425410+0000","last_change":"2023-10-16T19:58:35.425463+0000","last_active":"2023-10-16T19:58:35.425410+0000","last_peered":"2023-10-16T19:58:35.425410+0000","last_clean":"2023-10-16T19:58:35.425410+0000","last_became_active":"2023-10-16T19:58:05.600081+0000","last_became_peered":"2023-10-16T19:58:05.600081+0000","last_unstale":"2023-10-16T19:58:35.425410+0000","last_undegraded":"2023-10-16T19:58:35.425410+0000","last_fullsized":"2023-10-16T19:58:35.425410+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:35.425348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:35.425348+0000","last_clean_scrub_stamp":"2023-10-16T19:58:35.425348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:18:06.873638+0000","scrub_duration":0.0014506300000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"32'2","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:29.560596+0000","last_change":"2023-10-16T19:58:29.560680+0000","last_active":"2023-10-16T19:58:29.560596+0000","last_peered":"2023-10-16T19:58:29.560596+0000","last_clean":"2023-10-16T19:58:29.560596+0000","last_became_active":"2023-10-16T19:58:04.587629+0000","last_became_peered":"2023-10-16T19:58:04.587629+0000","last_unstale":"2023-10-16T19:58:29.560596+0000","last_undegraded":"2023-10-16T19:58:29.560596+0000","last_fullsized":"2023-10-16T19:58:29.560596+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2023-10-16T19:58:29.560524+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2023-10-16T19:58:29.560524+0000","last_clean_scrub_stamp":"2023-10-16T19:58:29.560524+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:31:22.451525+0000","scrub_duration":0.00173325,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:31.420756+0000","last_change":"2023-10-16T19:58:31.420804+0000","last_active":"2023-10-16T19:58:31.420756+0000","last_peered":"2023-10-16T19:58:31.420756+0000","last_clean":"2023-10-16T19:58:31.420756+0000","last_became_active":"2023-10-16T19:58:05.607311+0000","last_became_peered":"2023-10-16T19:58:05.607311+0000","last_unstale":"2023-10-16T19:58:31.420756+0000","last_undegraded":"2023-10-16T19:58:31.420756+0000","last_fullsized":"2023-10-16T19:58:31.420756+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:31.420696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:31.420696+0000","last_clean_scrub_stamp":"2023-10-16T19:58:31.420696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:10:33.790242+0000","scrub_duration":0.0012437870000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:19.890802+0000","last_change":"2023-10-16T19:58:19.890848+0000","last_active":"2023-10-16T19:58:19.890802+0000","last_peered":"2023-10-16T19:58:19.890802+0000","last_clean":"2023-10-16T19:58:19.890802+0000","last_became_active":"2023-10-16T19:58:04.583346+0000","last_became_peered":"2023-10-16T19:58:04.583346+0000","last_unstale":"2023-10-16T19:58:19.890802+0000","last_undegraded":"2023-10-16T19:58:19.890802+0000","last_fullsized":"2023-10-16T19:58:19.890802+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:19.890752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:19.890752+0000","last_clean_scrub_stamp":"2023-10-16T19:58:19.890752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:26:48.807112+0000","scrub_duration":0.0011159919999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:32.410743+0000","last_change":"2023-10-16T19:58:32.410810+0000","last_active":"2023-10-16T19:58:32.410743+0000","last_peered":"2023-10-16T19:58:32.410743+0000","last_clean":"2023-10-16T19:58:32.410743+0000","last_became_active":"2023-10-16T19:58:05.605529+0000","last_became_peered":"2023-10-16T19:58:05.605529+0000","last_unstale":"2023-10-16T19:58:32.410743+0000","last_undegraded":"2023-10-16T19:58:32.410743+0000","last_fullsized":"2023-10-16T19:58:32.410743+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:32.410677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:32.410677+0000","last_clean_scrub_stamp":"2023-10-16T19:58:32.410677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:23:12.729390+0000","scrub_duration":0.0014308979999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:42.135483+0000","last_change":"2023-10-16T19:58:42.135532+0000","last_active":"2023-10-16T19:58:42.135483+0000","last_peered":"2023-10-16T19:58:42.135483+0000","last_clean":"2023-10-16T19:58:42.135483+0000","last_became_active":"2023-10-16T19:58:04.589542+0000","last_became_peered":"2023-10-16T19:58:04.589542+0000","last_unstale":"2023-10-16T19:58:42.135483+0000","last_undegraded":"2023-10-16T19:58:42.135483+0000","last_fullsized":"2023-10-16T19:58:42.135483+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:42.135400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:42.135400+0000","last_clean_scrub_stamp":"2023-10-16T19:58:42.135400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:37:58.179668+0000","scrub_duration":0.001316446,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:41.823499+0000","last_change":"2023-10-16T19:58:41.823559+0000","last_active":"2023-10-16T19:58:41.823499+0000","last_peered":"2023-10-16T19:58:41.823499+0000","last_clean":"2023-10-16T19:58:41.823499+0000","last_became_active":"2023-10-16T19:58:05.608517+0000","last_became_peered":"2023-10-16T19:58:05.608517+0000","last_unstale":"2023-10-16T19:58:41.823499+0000","last_undegraded":"2023-10-16T19:58:41.823499+0000","last_fullsized":"2023-10-16T19:58:41.823499+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:41.823419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:41.823419+0000","last_clean_scrub_stamp":"2023-10-16T19:58:41.823419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:42:23.080410+0000","scrub_duration":0.001286655,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:19.657543+0000","last_change":"2023-10-16T19:58:19.657585+0000","last_active":"2023-10-16T19:58:19.657543+0000","last_peered":"2023-10-16T19:58:19.657543+0000","last_clean":"2023-10-16T19:58:19.657543+0000","last_became_active":"2023-10-16T19:58:04.587332+0000","last_became_peered":"2023-10-16T19:58:04.587332+0000","last_unstale":"2023-10-16T19:58:19.657543+0000","last_undegraded":"2023-10-16T19:58:19.657543+0000","last_fullsized":"2023-10-16T19:58:19.657543+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:19.657476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:19.657476+0000","last_clean_scrub_stamp":"2023-10-16T19:58:19.657476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:12:56.085496+0000","scrub_duration":0.0010951520000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:33.420366+0000","last_change":"2023-10-16T19:58:33.420451+0000","last_active":"2023-10-16T19:58:33.420366+0000","last_peered":"2023-10-16T19:58:33.420366+0000","last_clean":"2023-10-16T19:58:33.420366+0000","last_became_active":"2023-10-16T19:58:05.600305+0000","last_became_peered":"2023-10-16T19:58:05.600305+0000","last_unstale":"2023-10-16T19:58:33.420366+0000","last_undegraded":"2023-10-16T19:58:33.420366+0000","last_fullsized":"2023-10-16T19:58:33.420366+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:33.420305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:33.420305+0000","last_clean_scrub_stamp":"2023-10-16T19:58:33.420305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:16:34.343724+0000","scrub_duration":0.001548645,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"32'2","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:25.729426+0000","last_change":"2023-10-16T19:58:25.729476+0000","last_active":"2023-10-16T19:58:25.729426+0000","last_peered":"2023-10-16T19:58:25.729426+0000","last_clean":"2023-10-16T19:58:25.729426+0000","last_became_active":"2023-10-16T19:58:04.582012+0000","last_became_peered":"2023-10-16T19:58:04.582012+0000","last_unstale":"2023-10-16T19:58:25.729426+0000","last_undegraded":"2023-10-16T19:58:25.729426+0000","last_fullsized":"2023-10-16T19:58:25.729426+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2023-10-16T19:58:25.729370+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2023-10-16T19:58:25.729370+0000","last_clean_scrub_stamp":"2023-10-16T19:58:25.729370+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:09:10.976762+0000","scrub_duration":0.0017710670000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:36.851911+0000","last_change":"2023-10-16T19:58:36.851957+0000","last_active":"2023-10-16T19:58:36.851911+0000","last_peered":"2023-10-16T19:58:36.851911+0000","last_clean":"2023-10-16T19:58:36.851911+0000","last_became_active":"2023-10-16T19:58:05.600830+0000","last_became_peered":"2023-10-16T19:58:05.600830+0000","last_unstale":"2023-10-16T19:58:36.851911+0000","last_undegraded":"2023-10-16T19:58:36.851911+0000","last_fullsized":"2023-10-16T19:58:36.851911+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:36.851853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:36.851853+0000","last_clean_scrub_stamp":"2023-10-16T19:58:36.851853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:09:06.952786+0000","scrub_duration":0.001489074,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"33'1","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:24.515716+0000","last_change":"2023-10-16T19:58:24.515782+0000","last_active":"2023-10-16T19:58:24.515716+0000","last_peered":"2023-10-16T19:58:24.515716+0000","last_clean":"2023-10-16T19:58:24.515716+0000","last_became_active":"2023-10-16T19:58:04.587329+0000","last_became_peered":"2023-10-16T19:58:04.587329+0000","last_unstale":"2023-10-16T19:58:24.515716+0000","last_undegraded":"2023-10-16T19:58:24.515716+0000","last_fullsized":"2023-10-16T19:58:24.515716+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'1","last_scrub_stamp":"2023-10-16T19:58:24.515637+0000","last_deep_scrub":"33'1","last_deep_scrub_stamp":"2023-10-16T19:58:24.515637+0000","last_clean_scrub_stamp":"2023-10-16T19:58:24.515637+0000","objects_scrubbed":1,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:45:55.863919+0000","scrub_duration":0.0017599650000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:45.765414+0000","last_change":"2023-10-16T19:58:45.765497+0000","last_active":"2023-10-16T19:58:45.765414+0000","last_peered":"2023-10-16T19:58:45.765414+0000","last_clean":"2023-10-16T19:58:45.765414+0000","last_became_active":"2023-10-16T19:58:05.605958+0000","last_became_peered":"2023-10-16T19:58:05.605958+0000","last_unstale":"2023-10-16T19:58:45.765414+0000","last_undegraded":"2023-10-16T19:58:45.765414+0000","last_fullsized":"2023-10-16T19:58:45.765414+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:45.765348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:45.765348+0000","last_clean_scrub_stamp":"2023-10-16T19:58:45.765348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:09:20.232649+0000","scrub_duration":0.0011021519999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:27.703678+0000","last_change":"2023-10-16T19:58:27.703723+0000","last_active":"2023-10-16T19:58:27.703678+0000","last_peered":"2023-10-16T19:58:27.703678+0000","last_clean":"2023-10-16T19:58:27.703678+0000","last_became_active":"2023-10-16T19:58:04.586851+0000","last_became_peered":"2023-10-16T19:58:04.586851+0000","last_unstale":"2023-10-16T19:58:27.703678+0000","last_undegraded":"2023-10-16T19:58:27.703678+0000","last_fullsized":"2023-10-16T19:58:27.703678+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:27.703618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:27.703618+0000","last_clean_scrub_stamp":"2023-10-16T19:58:27.703618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:13:04.131638+0000","scrub_duration":0.001147449,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:39.645042+0000","last_change":"2023-10-16T19:58:39.645104+0000","last_active":"2023-10-16T19:58:39.645042+0000","last_peered":"2023-10-16T19:58:39.645042+0000","last_clean":"2023-10-16T19:58:39.645042+0000","last_became_active":"2023-10-16T19:58:05.606081+0000","last_became_peered":"2023-10-16T19:58:05.606081+0000","last_unstale":"2023-10-16T19:58:39.645042+0000","last_undegraded":"2023-10-16T19:58:39.645042+0000","last_fullsized":"2023-10-16T19:58:39.645042+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:39.644945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:39.644945+0000","last_clean_scrub_stamp":"2023-10-16T19:58:39.644945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:09:24.892337+0000","scrub_duration":0.001790104,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:30.562350+0000","last_change":"2023-10-16T19:58:30.562415+0000","last_active":"2023-10-16T19:58:30.562350+0000","last_peered":"2023-10-16T19:58:30.562350+0000","last_clean":"2023-10-16T19:58:30.562350+0000","last_became_active":"2023-10-16T19:58:04.588050+0000","last_became_peered":"2023-10-16T19:58:04.588050+0000","last_unstale":"2023-10-16T19:58:30.562350+0000","last_undegraded":"2023-10-16T19:58:30.562350+0000","last_fullsized":"2023-10-16T19:58:30.562350+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:30.562272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:30.562272+0000","last_clean_scrub_stamp":"2023-10-16T19:58:30.562272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:03:53.052894+0000","scrub_duration":0.001599874,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:36.670169+0000","last_change":"2023-10-16T19:58:36.670221+0000","last_active":"2023-10-16T19:58:36.670169+0000","last_peered":"2023-10-16T19:58:36.670169+0000","last_clean":"2023-10-16T19:58:36.670169+0000","last_became_active":"2023-10-16T19:58:05.607381+0000","last_became_peered":"2023-10-16T19:58:05.607381+0000","last_unstale":"2023-10-16T19:58:36.670169+0000","last_undegraded":"2023-10-16T19:58:36.670169+0000","last_fullsized":"2023-10-16T19:58:36.670169+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:36.670111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:36.670111+0000","last_clean_scrub_stamp":"2023-10-16T19:58:36.670111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:11:36.349860+0000","scrub_duration":0.001654279,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:18.716208+0000","last_change":"2023-10-16T19:58:18.716246+0000","last_active":"2023-10-16T19:58:18.716208+0000","last_peered":"2023-10-16T19:58:18.716208+0000","last_clean":"2023-10-16T19:58:18.716208+0000","last_became_active":"2023-10-16T19:58:04.581711+0000","last_became_peered":"2023-10-16T19:58:04.581711+0000","last_unstale":"2023-10-16T19:58:18.716208+0000","last_undegraded":"2023-10-16T19:58:18.716208+0000","last_fullsized":"2023-10-16T19:58:18.716208+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:18.716159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:18.716159+0000","last_clean_scrub_stamp":"2023-10-16T19:58:18.716159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:16:19.639578+0000","scrub_duration":0.001305716,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:48.127634+0000","last_change":"2023-10-16T19:58:48.127681+0000","last_active":"2023-10-16T19:58:48.127634+0000","last_peered":"2023-10-16T19:58:48.127634+0000","last_clean":"2023-10-16T19:58:48.127634+0000","last_became_active":"2023-10-16T19:58:05.602184+0000","last_became_peered":"2023-10-16T19:58:05.602184+0000","last_unstale":"2023-10-16T19:58:48.127634+0000","last_undegraded":"2023-10-16T19:58:48.127634+0000","last_fullsized":"2023-10-16T19:58:48.127634+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:48.127580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:48.127580+0000","last_clean_scrub_stamp":"2023-10-16T19:58:48.127580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:09:18.228512+0000","scrub_duration":0.00107934,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:31.972750+0000","last_change":"2023-10-16T19:58:31.972795+0000","last_active":"2023-10-16T19:58:31.972750+0000","last_peered":"2023-10-16T19:58:31.972750+0000","last_clean":"2023-10-16T19:58:31.972750+0000","last_became_active":"2023-10-16T19:58:04.587683+0000","last_became_peered":"2023-10-16T19:58:04.587683+0000","last_unstale":"2023-10-16T19:58:31.972750+0000","last_undegraded":"2023-10-16T19:58:31.972750+0000","last_fullsized":"2023-10-16T19:58:31.972750+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:31.972697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:31.972697+0000","last_clean_scrub_stamp":"2023-10-16T19:58:31.972697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:23:45.875027+0000","scrub_duration":0.0010629109999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:55.980977+0000","last_change":"2023-10-16T19:58:55.981046+0000","last_active":"2023-10-16T19:58:55.980977+0000","last_peered":"2023-10-16T19:58:55.980977+0000","last_clean":"2023-10-16T19:58:55.980977+0000","last_became_active":"2023-10-16T19:58:05.601074+0000","last_became_peered":"2023-10-16T19:58:05.601074+0000","last_unstale":"2023-10-16T19:58:55.980977+0000","last_undegraded":"2023-10-16T19:58:55.980977+0000","last_fullsized":"2023-10-16T19:58:55.980977+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:55.980892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:55.980892+0000","last_clean_scrub_stamp":"2023-10-16T19:58:55.980892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:11:33.613317+0000","scrub_duration":0.0013897919999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:38.103104+0000","last_change":"2023-10-16T19:58:38.103151+0000","last_active":"2023-10-16T19:58:38.103104+0000","last_peered":"2023-10-16T19:58:38.103104+0000","last_clean":"2023-10-16T19:58:38.103104+0000","last_became_active":"2023-10-16T19:58:04.588392+0000","last_became_peered":"2023-10-16T19:58:04.588392+0000","last_unstale":"2023-10-16T19:58:38.103104+0000","last_undegraded":"2023-10-16T19:58:38.103104+0000","last_fullsized":"2023-10-16T19:58:38.103104+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:38.103044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:38.103044+0000","last_clean_scrub_stamp":"2023-10-16T19:58:38.103044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:15:03.377900+0000","scrub_duration":0.0015910539999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:44.858661+0000","last_change":"2023-10-16T19:58:44.858720+0000","last_active":"2023-10-16T19:58:44.858661+0000","last_peered":"2023-10-16T19:58:44.858661+0000","last_clean":"2023-10-16T19:58:44.858661+0000","last_became_active":"2023-10-16T19:58:05.609118+0000","last_became_peered":"2023-10-16T19:58:05.609118+0000","last_unstale":"2023-10-16T19:58:44.858661+0000","last_undegraded":"2023-10-16T19:58:44.858661+0000","last_fullsized":"2023-10-16T19:58:44.858661+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:44.858597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:44.858597+0000","last_clean_scrub_stamp":"2023-10-16T19:58:44.858597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:38:21.595525+0000","scrub_duration":0.0014324889999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:25.733115+0000","last_change":"2023-10-16T19:58:25.733158+0000","last_active":"2023-10-16T19:58:25.733115+0000","last_peered":"2023-10-16T19:58:25.733115+0000","last_clean":"2023-10-16T19:58:25.733115+0000","last_became_active":"2023-10-16T19:58:04.585930+0000","last_became_peered":"2023-10-16T19:58:04.585930+0000","last_unstale":"2023-10-16T19:58:25.733115+0000","last_undegraded":"2023-10-16T19:58:25.733115+0000","last_fullsized":"2023-10-16T19:58:25.733115+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T19:58:25.733051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T19:58:25.733051+0000","last_clean_scrub_stamp":"2023-10-16T19:58:25.733051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:45:57.081332+0000","scrub_duration":0.0011102449999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"33'119","reported_seq":187,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-16T19:58:22.694722+0000","last_change":"2023-10-16T19:58:22.694722+0000","last_active":"2023-10-16T19:58:22.694722+0000","last_peered":"2023-10-16T19:58:22.694722+0000","last_clean":"2023-10-16T19:58:22.694722+0000","last_became_active":"2023-10-16T19:56:58.775567+0000","last_became_peered":"2023-10-16T19:56:58.775567+0000","last_unstale":"2023-10-16T19:58:22.694722+0000","last_undegraded":"2023-10-16T19:58:22.694722+0000","last_fullsized":"2023-10-16T19:58:22.694722+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'119","last_scrub_stamp":"2023-10-16T19:58:22.694592+0000","last_deep_scrub":"33'119","last_deep_scrub_stamp":"2023-10-16T19:58:22.694592+0000","last_clean_scrub_stamp":"2023-10-16T19:58:22.694592+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:08:57.161893+0000","scrub_duration":0.003477178,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574879,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":718,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194594,"statfs":{"total":200000000,"available":199264318,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 19:59:00 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.52600000000000002,"15min":0.51700000000000002},"min":{"1min":0.46100000000000002,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.68500000000000005,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.628},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.58399999999999996,"15min":0.57899999999999996},"min":{"1min":0.40799999999999997,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.68999999999999995}]},{"osd":1,"last update":"Mon Oct 16 19:59:00 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.51800000000000002,"15min":0.51200000000000001},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.58999999999999997,"15min":0.58899999999999997},"min":{"1min":0.38300000000000001,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.745,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.64700000000000002}]},{"osd":2,"last update":"Mon Oct 16 19:59:00 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.55700000000000005,"15min":0.55100000000000005},"min":{"1min":0.42899999999999999,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.80100000000000005,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.37,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.745}]},{"osd":3,"last update":"Mon Oct 16 19:59:00 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.55800000000000005,"15min":0.54900000000000004},"min":{"1min":0.498,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.57099999999999995,"15min":0.56699999999999995},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.78400000000000003,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.72299999999999998}]},{"osd":4,"last update":"Mon Oct 16 19:59:00 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.52500000000000002,"15min":0.52300000000000002},"min":{"1min":0.36899999999999999,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.54000000000000004,"15min":0.53500000000000003},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.48499999999999999}]},{"osd":5,"last update":"Mon Oct 16 19:59:00 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.52900000000000003,"15min":0.52500000000000002},"min":{"1min":0.39200000000000002,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.56100000000000005,"15min":0.55500000000000005},"min":{"1min":0.432,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.50800000000000001}]},{"osd":6,"last update":"Mon Oct 16 19:59:00 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.60999999999999999,"15min":0.60899999999999999},"min":{"1min":0.46899999999999997,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.78000000000000003,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.61899999999999999,"15min":0.61399999999999999},"min":{"1min":0.46899999999999997,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.66700000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574879,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":142,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195170,"statfs":{"total":200000000,"available":199854160,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 19:58:56 2023","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.59499999999999997,"15min":0.54500000000000004},"min":{"1min":0.442,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":7.6479999999999997,"5min":7.6479999999999997,"15min":7.6479999999999997},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.93300000000000005,"5min":0.60899999999999999,"15min":0.55500000000000005},"min":{"1min":0.41399999999999998,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":7.6630000000000003,"5min":7.6630000000000003,"15min":7.6630000000000003},"last":0.73099999999999998}]},{"osd":1,"last update":"Mon Oct 16 19:58:56 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.499,"15min":0.48499999999999999},"min":{"1min":0.39300000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.52900000000000003,"15min":0.51900000000000002},"min":{"1min":0.45900000000000002,"5min":0.376,"15min":0.376},"max":{"1min":0.74299999999999999,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.69699999999999995}]},{"osd":2,"last update":"Mon Oct 16 19:58:56 2023","interfaces":[{"interface":"back","average":{"1min":0.95699999999999996,"5min":0.629,"15min":0.57399999999999995},"min":{"1min":0.47499999999999998,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":8.2829999999999995,"5min":8.2829999999999995,"15min":8.2829999999999995},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.56000000000000005,"15min":0.55500000000000005},"min":{"1min":0.42899999999999999,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.752,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.58799999999999997}]},{"osd":3,"last update":"Mon Oct 16 19:58:56 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.57899999999999996,"15min":0.57299999999999995},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.77400000000000002,"5min":0.879,"15min":0.879},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.94199999999999995,"5min":0.623,"15min":0.56999999999999995},"min":{"1min":0.45300000000000001,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":8.3339999999999996,"5min":8.3339999999999996,"15min":8.3339999999999996},"last":0.625}]},{"osd":4,"last update":"Mon Oct 16 19:58:56 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.52300000000000002,"15min":0.52700000000000002},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.69599999999999995,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.56299999999999994,"15min":0.56699999999999995},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.71399999999999997,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.51600000000000001}]},{"osd":5,"last update":"Mon Oct 16 19:58:56 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.52900000000000003,"15min":0.53100000000000003},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.69899999999999995,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.629,"5min":0.623,"15min":0.622},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.84899999999999998,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.54700000000000004}]},{"osd":7,"last update":"Mon Oct 16 19:58:56 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.61299999999999999,"15min":0.61699999999999999},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.75700000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58099999999999996,"15min":0.57999999999999996},"min":{"1min":0.40999999999999998,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.80700000000000005,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.66600000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574879,"num_pgs":32,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":143,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195169,"statfs":{"total":200000000,"available":199853142,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 19:58:59 2023","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.33900000000000002,"15min":0.33500000000000002},"min":{"1min":0.24399999999999999,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.373,"5min":0.32100000000000001,"15min":0.313},"min":{"1min":0.26800000000000002,"5min":0.247,"15min":0.247},"max":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"last":0.34399999999999997}]},{"osd":2,"last update":"Mon Oct 16 19:58:59 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.35699999999999998,"15min":0.35099999999999998},"min":{"1min":0.29299999999999998,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"last":0.375},{"interface":"front","average":{"1min":0.42399999999999999,"5min":0.40100000000000002,"15min":0.39700000000000002},"min":{"1min":0.32200000000000001,"5min":0.308,"15min":0.308},"max":{"1min":0.56200000000000006,"5min":0.56899999999999995,"15min":0.56899999999999995},"last":0.44500000000000001}]},{"osd":3,"last update":"Mon Oct 16 19:58:59 2023","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.41799999999999998,"15min":0.41499999999999998},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.41099999999999998,"5min":0.39100000000000001,"15min":0.38800000000000001},"min":{"1min":0.32300000000000001,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.504,"5min":0.52400000000000002,"15min":0.52400000000000002},"last":0.42899999999999999}]},{"osd":4,"last update":"Mon Oct 16 19:58:59 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.57999999999999996,"15min":0.57599999999999996},"min":{"1min":0.45200000000000001,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.76700000000000002,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.499},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.59399999999999997,"15min":0.58999999999999997},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.80900000000000005,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.51600000000000001}]},{"osd":5,"last update":"Mon Oct 16 19:58:59 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.59899999999999998,"15min":0.59399999999999997},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.64700000000000002,"15min":0.64200000000000002},"min":{"1min":0.48899999999999999,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.88700000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.68799999999999994}]},{"osd":6,"last update":"Mon Oct 16 19:58:59 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.59299999999999997,"15min":0.59099999999999997},"min":{"1min":0.46600000000000003,"5min":0.436,"15min":0.436},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.627,"5min":0.61199999999999999,"15min":0.60999999999999999},"min":{"1min":0.47399999999999998,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.85399999999999998,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.64400000000000002}]},{"osd":7,"last update":"Mon Oct 16 19:58:59 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.63300000000000001,"15min":0.63200000000000001},"min":{"1min":0.47299999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.85099999999999998,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.58799999999999997,"15min":0.58399999999999996},"min":{"1min":0.46100000000000002,"5min":0.374,"15min":0.374},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.53000000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574879,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":718,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194594,"statfs":{"total":200000000,"available":199264408,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 16 19:58:59 2023","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.81000000000000005,"15min":0.88400000000000001},"min":{"1min":0.26200000000000001,"5min":0.249,"15min":0.249},"max":{"1min":0.55700000000000005,"5min":11.031000000000001,"15min":11.031000000000001},"last":0.378},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.90000000000000002,"15min":0.97899999999999998},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.53800000000000003,"5min":12.218,"15min":12.218},"last":0.504}]},{"osd":2,"last update":"Mon Oct 16 19:58:59 2023","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.81999999999999995,"15min":0.89300000000000002},"min":{"1min":0.26200000000000001,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.501,"5min":11.058,"15min":11.058},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.97699999999999998,"15min":1.0740000000000001},"min":{"1min":0.29499999999999998,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.58099999999999996,"5min":14.763999999999999,"15min":14.763999999999999},"last":0.59399999999999997}]},{"osd":3,"last update":"Mon Oct 16 19:58:59 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.80900000000000005,"15min":0.88100000000000001},"min":{"1min":0.29899999999999999,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.52100000000000002,"5min":10.935,"15min":10.935},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.874,"15min":0.94799999999999995},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.59899999999999998,"5min":11.083,"15min":11.083},"last":0.54200000000000004}]},{"osd":4,"last update":"Mon Oct 16 19:58:59 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":1.073,"15min":1.155},"min":{"1min":0.42899999999999999,"5min":0.314,"15min":0.314},"max":{"1min":0.753,"5min":12.279,"15min":12.279},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.58299999999999996,"5min":1.0389999999999999,"15min":1.115},"min":{"1min":0.40300000000000002,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.78500000000000003,"5min":10.879,"15min":10.879},"last":0.55900000000000005}]},{"osd":5,"last update":"Mon Oct 16 19:58:59 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":1.0620000000000001,"15min":1.1359999999999999},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.78700000000000003,"5min":10.907,"15min":10.907},"last":0.626},{"interface":"front","average":{"1min":0.629,"5min":1.085,"15min":1.161},"min":{"1min":0.45700000000000002,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.83399999999999996,"5min":11,"15min":11},"last":0.68600000000000005}]},{"osd":6,"last update":"Mon Oct 16 19:58:59 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":1.0409999999999999,"15min":1.1180000000000001},"min":{"1min":0.41999999999999998,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.78700000000000003,"5min":10.972,"15min":10.972},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.61699999999999999,"5min":1.115,"15min":1.198},"min":{"1min":0.45200000000000001,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.72699999999999998,"5min":12.34,"15min":12.34},"last":0.70099999999999996}]},{"osd":7,"last update":"Mon Oct 16 19:58:59 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":1.1279999999999999,"15min":1.21},"min":{"1min":0.48799999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.73199999999999998,"5min":12.311,"15min":12.311},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.59999999999999998,"5min":1.0529999999999999,"15min":1.129},"min":{"1min":0.432,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.77100000000000002,"5min":10.845000000000001,"15min":10.845000000000001},"last":0.67100000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574879,"num_pgs":17,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":141,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195170,"statfs":{"total":200000000,"available":199854706,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 19:58:56 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.33600000000000002,"15min":0.33200000000000002},"min":{"1min":0.248,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.35699999999999998,"15min":0.35299999999999998},"min":{"1min":0.27600000000000002,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.60199999999999998,"5min":0.749,"15min":0.749},"last":0.51200000000000001}]},{"osd":1,"last update":"Mon Oct 16 19:58:56 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.38,"15min":0.376},"min":{"1min":0.30199999999999999,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.377,"15min":0.372},"min":{"1min":0.28799999999999998,"5min":0.219,"15min":0.219},"max":{"1min":0.55600000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"last":0.46600000000000003}]},{"osd":3,"last update":"Mon Oct 16 19:58:56 2023","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.36299999999999999,"15min":0.35799999999999998},"min":{"1min":0.29399999999999998,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.435,"5min":0.42399999999999999,"15min":0.42199999999999999},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.628,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.53600000000000003}]},{"osd":4,"last update":"Mon Oct 16 19:58:56 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.60599999999999998,"15min":0.59999999999999998},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.63100000000000001,"15min":0.63},"min":{"1min":0.48299999999999998,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.82699999999999996,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.81200000000000006}]},{"osd":5,"last update":"Mon Oct 16 19:58:56 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.59699999999999998,"15min":0.60099999999999998},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.60299999999999998,"15min":0.60499999999999998},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.89800000000000002,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.84499999999999997}]},{"osd":6,"last update":"Mon Oct 16 19:58:56 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59599999999999997,"15min":0.59499999999999997},"min":{"1min":0.44500000000000001,"5min":0.433,"15min":0.433},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.89000000000000001},{"interface":"front","average":{"1min":0.622,"5min":0.60499999999999998,"15min":0.60199999999999998},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.81499999999999995,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.76100000000000001}]},{"osd":7,"last update":"Mon Oct 16 19:58:56 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.64100000000000001,"15min":0.64400000000000002},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.86899999999999999,"5min":1.046,"15min":1.046},"last":0.85999999999999999},{"interface":"front","average":{"1min":0.625,"5min":0.64500000000000002,"15min":0.64800000000000002},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.82799999999999996,"5min":1.002,"15min":1.002},"last":0.78900000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574879,"num_pgs":31,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":143,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195169,"statfs":{"total":200000000,"available":199853142,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 19:58:56 2023","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.33000000000000002,"15min":0.32500000000000001},"min":{"1min":0.20699999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"last":0.29199999999999998},{"interface":"front","average":{"1min":0.40500000000000003,"5min":0.36499999999999999,"15min":0.35799999999999998},"min":{"1min":0.28999999999999998,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"last":0.41199999999999998}]},{"osd":1,"last update":"Mon Oct 16 19:58:56 2023","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.33100000000000002,"15min":0.32400000000000001},"min":{"1min":0.249,"5min":0.222,"15min":0.222},"max":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.41599999999999998,"5min":0.373,"15min":0.36599999999999999},"min":{"1min":0.27500000000000002,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.60199999999999998,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.443}]},{"osd":2,"last update":"Mon Oct 16 19:58:56 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.32700000000000001,"15min":0.32200000000000001},"min":{"1min":0.26400000000000001,"5min":0.22,"15min":0.22},"max":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.41699999999999998,"15min":0.40999999999999998},"min":{"1min":0.35099999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"last":0.55000000000000004}]},{"osd":4,"last update":"Mon Oct 16 19:58:56 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.56899999999999995,"15min":0.56399999999999995},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.627},{"interface":"front","average":{"1min":0.625,"5min":0.58999999999999997,"15min":0.58399999999999996},"min":{"1min":0.46700000000000003,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.63800000000000001}]},{"osd":5,"last update":"Mon Oct 16 19:58:56 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.57999999999999996,"15min":0.57799999999999996},"min":{"1min":0.439,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.57599999999999996,"15min":0.56599999999999995},"min":{"1min":0.47599999999999998,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.51300000000000001}]},{"osd":6,"last update":"Mon Oct 16 19:58:56 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.53400000000000003,"15min":0.52700000000000002},"min":{"1min":0.42499999999999999,"5min":0.38,"15min":0.38},"max":{"1min":0.75800000000000001,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.57699999999999996,"15min":0.57299999999999995},"min":{"1min":0.44,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.84899999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.60799999999999998}]},{"osd":7,"last update":"Mon Oct 16 19:58:56 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.58299999999999996,"15min":0.57899999999999996},"min":{"1min":0.41599999999999998,"5min":0.377,"15min":0.377},"max":{"1min":0.94199999999999995,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.626,"5min":0.61699999999999999,"15min":0.61499999999999999},"min":{"1min":0.47999999999999998,"5min":0.438,"15min":0.438},"max":{"1min":0.78700000000000003,"5min":1.139,"15min":1.139},"last":0.48899999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574879,"num_pgs":29,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":141,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195170,"statfs":{"total":200000000,"available":199854672,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 19:58:59 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.54600000000000004,"15min":0.54200000000000004},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.72699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.55300000000000005,"15min":0.55400000000000005},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.71499999999999997,"5min":0.749,"15min":0.749},"last":0.72599999999999998}]},{"osd":1,"last update":"Mon Oct 16 19:58:59 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.55700000000000005,"15min":0.55900000000000005},"min":{"1min":0.376,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.73499999999999999,"5min":1.034,"15min":1.034},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.53100000000000003,"15min":0.52900000000000003},"min":{"1min":0.40400000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.77600000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.753}]},{"osd":2,"last update":"Mon Oct 16 19:58:59 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.42299999999999999,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.70199999999999996,"5min":1.103,"15min":1.103},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.56599999999999995,"15min":0.56999999999999995},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.745,"5min":0.754,"15min":0.754},"last":0.70399999999999996}]},{"osd":3,"last update":"Mon Oct 16 19:58:59 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.67400000000000004,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59199999999999997,"15min":0.59099999999999997},"min":{"1min":0.40600000000000003,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.78900000000000003,"5min":1.071,"15min":1.071},"last":0.65300000000000002}]},{"osd":5,"last update":"Mon Oct 16 19:58:59 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.49399999999999999,"15min":0.498},"min":{"1min":0.32100000000000001,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.55700000000000005,"15min":0.55500000000000005},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.59999999999999998}]},{"osd":6,"last update":"Mon Oct 16 19:58:59 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.53400000000000003,"15min":0.53000000000000003},"min":{"1min":0.42399999999999999,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.55300000000000005,"15min":0.55500000000000005},"min":{"1min":0.40000000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.57599999999999996}]},{"osd":7,"last update":"Mon Oct 16 19:58:59 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.51000000000000001,"15min":0.51200000000000001},"min":{"1min":0.36099999999999999,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.64300000000000002,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.57599999999999996,"15min":0.57099999999999995},"min":{"1min":0.41699999999999998,"5min":0.379,"15min":0.379},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.61899999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574879,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":142,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195170,"statfs":{"total":200000000,"available":199854104,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 19:58:56 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.68600000000000005,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.55200000000000005,"15min":0.55000000000000004},"min":{"1min":0.39900000000000002,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.81100000000000005,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.69899999999999995}]},{"osd":1,"last update":"Mon Oct 16 19:58:56 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.89100000000000001,"15min":0.94299999999999995},"min":{"1min":0.435,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.754,"5min":7.9989999999999997,"15min":7.9989999999999997},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.91000000000000003,"15min":0.96199999999999997},"min":{"1min":0.43099999999999999,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.76700000000000002,"5min":8.0150000000000006,"15min":8.0150000000000006},"last":0.71499999999999997}]},{"osd":2,"last update":"Mon Oct 16 19:58:56 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.56899999999999995,"15min":0.56699999999999995},"min":{"1min":0.44600000000000001,"5min":0.372,"15min":0.372},"max":{"1min":0.77600000000000002,"5min":1.032,"15min":1.032},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.54500000000000004,"15min":0.55100000000000005},"min":{"1min":0.379,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.67900000000000005,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.57199999999999995}]},{"osd":3,"last update":"Mon Oct 16 19:58:56 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.872,"15min":0.92600000000000005},"min":{"1min":0.35599999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.72299999999999998,"5min":8.077,"15min":8.077},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.59399999999999997,"15min":0.59799999999999998},"min":{"1min":0.46400000000000002,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.73699999999999999,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.59299999999999997}]},{"osd":4,"last update":"Mon Oct 16 19:58:56 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.498,"15min":0.497},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.55700000000000005,"15min":0.56000000000000005},"min":{"1min":0.373,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.70599999999999996,"5min":0.754,"15min":0.754},"last":0.437}]},{"osd":6,"last update":"Mon Oct 16 19:58:56 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.55800000000000005,"15min":0.56200000000000006},"min":{"1min":0.38100000000000001,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.73399999999999999,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.61399999999999999,"15min":0.60999999999999999},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.47699999999999998}]},{"osd":7,"last update":"Mon Oct 16 19:58:56 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.60299999999999998,"15min":0.60699999999999998},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.746,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.623,"15min":0.624},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.78100000000000003,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.54500000000000004}]}]}],"pool_statfs":[]}} 2023-10-16T19:59:21.585 DEBUG:teuthology.orchestra.run.smithi157:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-10-16T19:59:21.736 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:21.734+0000 7f063669c700 1 Processor -- start 2023-10-16T19:59:21.737 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:21.734+0000 7f063669c700 1 -- start start 2023-10-16T19:59:21.740 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:21.735+0000 7f063669c700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f063015bed0 0x7f06300b36b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:59:21.740 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:21.735+0000 7f063669c700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f06300d1610 0x7f063006fa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:59:21.740 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:21.735+0000 7f063669c700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f063015c2b0 con 0x7f06300b3bf0 2023-10-16T19:59:21.740 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:21.735+0000 7f063669c700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06300b4070 con 0x7f06300d1610 2023-10-16T19:59:21.741 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:21.735+0000 7f063669c700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f063015f9e0 con 0x7f063015bed0 2023-10-16T19:59:21.741 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:21.735+0000 7f0634c39700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f06300d1610 0x7f063006fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:59:21.741 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:21.735+0000 7f062f7fe700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f06300b3bf0 0x7f06300d0f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:57828/0 (socket says 172.21.15.157:57828) 2023-10-16T19:59:21.741 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:21.735+0000 7f062f7fe700 1 -- 172.21.15.157:0/238251635 learned_addr learned my addr 172.21.15.157:0/238251635 (peer_addr_for_me v1:172.21.15.157:0/0) 2023-10-16T19:59:21.742 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:21.735+0000 7f062ffff700 1 --2- 172.21.15.157:0/238251635 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f063015bed0 0x7f06300b36b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:59:21.742 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:21.735+0000 7f062effd700 1 -- 172.21.15.157:0/238251635 <== mon.0 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 959118329 0 0) 0x7f063015c2b0 con 0x7f06300b3bf0 2023-10-16T19:59:21.742 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:21.735+0000 7f062effd700 1 -- 172.21.15.157:0/238251635 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f06180035b0 con 0x7f06300b3bf0 2023-10-16T19:59:21.743 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:21.735+0000 7f0634c39700 1 -- 172.21.15.157:0/238251635 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f063015bed0 msgr2=0x7f06300b36b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:59:21.743 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:21.735+0000 7f0634c39700 1 --2- 172.21.15.157:0/238251635 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f063015bed0 0x7f06300b36b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:59:21.743 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:21.735+0000 7f0634c39700 1 -- 172.21.15.157:0/238251635 >> v1:172.21.15.157:6789/0 conn(0x7f06300b3bf0 legacy=0x7f06300d0f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:59:21.743 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:21.735+0000 7f0634c39700 1 -- 172.21.15.157:0/238251635 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f063015fcc0 con 0x7f06300d1610 2023-10-16T19:59:21.744 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:21.735+0000 7f062ffff700 1 --2- 172.21.15.157:0/238251635 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f063015bed0 0x7f06300b36b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T19:59:21.744 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:21.735+0000 7f0634c39700 1 --2- 172.21.15.157:0/238251635 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f06300d1610 0x7f063006fa90 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f0628009d90 tx=0x7f062800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66625a1d6c8cd64b server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:59:21.744 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:21.736+0000 7f062effd700 1 -- 172.21.15.157:0/238251635 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f062800e070 con 0x7f06300d1610 2023-10-16T19:59:21.744 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:21.736+0000 7f062effd700 1 -- 172.21.15.157:0/238251635 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f062800bb20 con 0x7f06300d1610 2023-10-16T19:59:21.745 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:21.736+0000 7f062effd700 1 -- 172.21.15.157:0/238251635 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0628012430 con 0x7f06300d1610 2023-10-16T19:59:21.745 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:21.736+0000 7f063669c700 1 -- 172.21.15.157:0/238251635 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f06300d1610 msgr2=0x7f063006fa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:59:21.745 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:21.736+0000 7f063669c700 1 --2- 172.21.15.157:0/238251635 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f06300d1610 0x7f063006fa90 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f0628009d90 tx=0x7f062800b330 comp rx=0 tx=0).stop 2023-10-16T19:59:21.745 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:21.736+0000 7f063669c700 1 -- 172.21.15.157:0/238251635 shutdown_connections 2023-10-16T19:59:21.746 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:21.736+0000 7f063669c700 1 --2- 172.21.15.157:0/238251635 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f06300d1610 0x7f063006fa90 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:59:21.746 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:21.736+0000 7f063669c700 1 --2- 172.21.15.157:0/238251635 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f063015bed0 0x7f06300b36b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:59:21.746 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:21.736+0000 7f063669c700 1 -- 172.21.15.157:0/238251635 >> 172.21.15.157:0/238251635 conn(0x7f06300ce6b0 msgr2=0x7f06300ceac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:59:21.747 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:21.736+0000 7f063669c700 1 -- 172.21.15.157:0/238251635 shutdown_connections 2023-10-16T19:59:21.747 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:21.736+0000 7f063669c700 1 -- 172.21.15.157:0/238251635 wait complete. 2023-10-16T19:59:21.747 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:21.737+0000 7f063669c700 1 Processor -- start 2023-10-16T19:59:21.747 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:21.738+0000 7f063669c700 1 -- start start 2023-10-16T19:59:21.750 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:21.738+0000 7f063669c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f06300b3bf0 0x7f06300b2f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:59:21.750 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:21.738+0000 7f063669c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f06300d1610 0x7f06300ad860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:59:21.751 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:21.738+0000 7f063669c700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f063015bed0 0x7f06300adda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:59:21.751 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:21.738+0000 7f063669c700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06300cbf10 con 0x7f06300b3bf0 2023-10-16T19:59:21.751 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:21.738+0000 7f063669c700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06300cb300 con 0x7f06300d1610 2023-10-16T19:59:21.751 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:21.738+0000 7f063669c700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06300cb5e0 con 0x7f063015bed0 2023-10-16T19:59:21.752 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:21.738+0000 7f062ffff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f06300b3bf0 0x7f06300b2f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:59:21.752 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:21.738+0000 7f062ffff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f06300b3bf0 0x7f06300b2f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:48162/0 (socket says 172.21.15.157:48162) 2023-10-16T19:59:21.752 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:21.738+0000 7f062ffff700 1 -- 172.21.15.157:0/3542578892 learned_addr learned my addr 172.21.15.157:0/3542578892 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:59:21.752 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:21.739+0000 7f0634c39700 1 --2- 172.21.15.157:0/3542578892 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f063015bed0 0x7f06300adda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:59:21.753 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:21.739+0000 7f062f7fe700 1 --2- 172.21.15.157:0/3542578892 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f06300d1610 0x7f06300ad860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:59:21.753 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:21.739+0000 7f062ffff700 1 -- 172.21.15.157:0/3542578892 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f063015bed0 msgr2=0x7f06300adda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:59:21.753 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:21.739+0000 7f062ffff700 1 --2- 172.21.15.157:0/3542578892 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f063015bed0 0x7f06300adda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:59:21.754 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:21.739+0000 7f062ffff700 1 -- 172.21.15.157:0/3542578892 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f06300d1610 msgr2=0x7f06300ad860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:59:21.754 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:21.739+0000 7f062ffff700 1 --2- 172.21.15.157:0/3542578892 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f06300d1610 0x7f06300ad860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:59:21.754 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:21.739+0000 7f062ffff700 1 -- 172.21.15.157:0/3542578892 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0628009a70 con 0x7f06300b3bf0 2023-10-16T19:59:21.754 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:21.739+0000 7f062f7fe700 1 --2- 172.21.15.157:0/3542578892 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f06300d1610 0x7f06300ad860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T19:59:21.755 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:21.739+0000 7f062ffff700 1 --2- 172.21.15.157:0/3542578892 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f06300b3bf0 0x7f06300b2f20 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f062400e810 tx=0x7f062400ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:59:21.755 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:21.739+0000 7f062cff9700 1 -- 172.21.15.157:0/3542578892 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0624004230 con 0x7f06300b3bf0 2023-10-16T19:59:21.755 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:21.739+0000 7f062cff9700 1 -- 172.21.15.157:0/3542578892 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0624004390 con 0x7f06300b3bf0 2023-10-16T19:59:21.755 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:21.739+0000 7f063669c700 1 -- 172.21.15.157:0/3542578892 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06300cb8c0 con 0x7f06300b3bf0 2023-10-16T19:59:21.756 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:21.739+0000 7f062cff9700 1 -- 172.21.15.157:0/3542578892 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06240036a0 con 0x7f06300b3bf0 2023-10-16T19:59:21.756 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:21.739+0000 7f063669c700 1 -- 172.21.15.157:0/3542578892 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06300b3460 con 0x7f06300b3bf0 2023-10-16T19:59:21.756 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:21.740+0000 7f063669c700 1 -- 172.21.15.157:0/3542578892 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f063006b300 con 0x7f06300b3bf0 2023-10-16T19:59:21.756 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:21.740+0000 7f062cff9700 1 -- 172.21.15.157:0/3542578892 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f0624003800 con 0x7f06300b3bf0 2023-10-16T19:59:21.757 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:21.741+0000 7f062cff9700 1 --2- 172.21.15.157:0/3542578892 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f061c06af00 0x7f061c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:59:21.757 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:21.741+0000 7f062cff9700 1 -- 172.21.15.157:0/3542578892 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5729+0+0 (secure 0 0 0) 0x7f06240890d0 con 0x7f06300b3bf0 2023-10-16T19:59:21.757 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:21.741+0000 7f062f7fe700 1 --2- 172.21.15.157:0/3542578892 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f061c06af00 0x7f061c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:59:21.757 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:21.741+0000 7f062f7fe700 1 --2- 172.21.15.157:0/3542578892 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f061c06af00 0x7f061c06d3c0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f06301f64a0 tx=0x7f0620009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:59:21.758 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:21.745+0000 7f062cff9700 1 -- 172.21.15.157:0/3542578892 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0624054160 con 0x7f06300b3bf0 2023-10-16T19:59:21.934 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:21.932+0000 7f063669c700 1 -- 172.21.15.157:0/3542578892 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f063004f400 con 0x7f06300b3bf0 2023-10-16T19:59:21.938 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:21.935+0000 7f062cff9700 1 -- 172.21.15.157:0/3542578892 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v3)=0 v3) v1 ==== 123+0+0 (secure 0 0 0) 0x7f0624057780 con 0x7f06300b3bf0 2023-10-16T19:59:21.939 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:21.937+0000 7f062cff9700 1 -- 172.21.15.157:0/3542578892 <== mon.0 v2:172.21.15.157:3300/0 8 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f06240094e0 con 0x7f06300b3bf0 2023-10-16T19:59:21.941 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:21.938+0000 7f063669c700 1 -- 172.21.15.157:0/3542578892 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f061c06af00 msgr2=0x7f061c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:59:21.941 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:21.938+0000 7f063669c700 1 --2- 172.21.15.157:0/3542578892 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f061c06af00 0x7f061c06d3c0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f06301f64a0 tx=0x7f0620009040 comp rx=0 tx=0).stop 2023-10-16T19:59:21.941 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:21.938+0000 7f063669c700 1 -- 172.21.15.157:0/3542578892 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f06300b3bf0 msgr2=0x7f06300b2f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:59:21.941 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:21.938+0000 7f063669c700 1 --2- 172.21.15.157:0/3542578892 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f06300b3bf0 0x7f06300b2f20 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f062400e810 tx=0x7f062400ebd0 comp rx=0 tx=0).stop 2023-10-16T19:59:21.942 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:21.938+0000 7f063669c700 1 -- 172.21.15.157:0/3542578892 shutdown_connections 2023-10-16T19:59:21.942 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:21.938+0000 7f063669c700 1 --2- 172.21.15.157:0/3542578892 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f063015bed0 0x7f06300adda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:59:21.942 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:21.938+0000 7f063669c700 1 --2- 172.21.15.157:0/3542578892 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f06300b3bf0 0x7f06300b2f20 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:59:21.942 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:21.938+0000 7f063669c700 1 --2- 172.21.15.157:0/3542578892 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f061c06af00 0x7f061c06d3c0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:59:21.943 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:21.938+0000 7f063669c700 1 --2- 172.21.15.157:0/3542578892 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f06300d1610 0x7f06300ad860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:59:21.943 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:21.938+0000 7f063669c700 1 -- 172.21.15.157:0/3542578892 >> 172.21.15.157:0/3542578892 conn(0x7f06300ce6b0 msgr2=0x7f063015e450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:59:21.943 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:21.938+0000 7f063669c700 1 -- 172.21.15.157:0/3542578892 shutdown_connections 2023-10-16T19:59:21.943 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:21.938+0000 7f063669c700 1 -- 172.21.15.157:0/3542578892 wait complete. 2023-10-16T19:59:21.952 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-16T19:59:21.952 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-16T19:59:22.072 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:22.070+0000 7f8a7005f700 1 Processor -- start 2023-10-16T19:59:22.073 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:22.070+0000 7f8a7005f700 1 -- start start 2023-10-16T19:59:22.075 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:22.071+0000 7f8a7005f700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8a680b5f20 0x7f8a680cf2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:59:22.076 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:22.071+0000 7f8a7005f700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f8a6815e260 0x7f8a68161cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:59:22.076 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:22.071+0000 7f8a7005f700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a680cee50 con 0x7f8a6815de80 2023-10-16T19:59:22.076 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:22.071+0000 7f8a7005f700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a680ce5f0 con 0x7f8a6815e260 2023-10-16T19:59:22.077 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:22.071+0000 7f8a7005f700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a680cf820 con 0x7f8a680b5f20 2023-10-16T19:59:22.077 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:22.071+0000 7f8a6d5fa700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8a680b5f20 0x7f8a680cf2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:59:22.077 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:22.071+0000 7f8a6e5fc700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f8a6815e260 0x7f8a68161cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:59:22.077 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:22.071+0000 7f8a6d5fa700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8a680b5f20 0x7f8a680cf2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.157:57476/0 (socket says 172.21.15.157:57476) 2023-10-16T19:59:22.078 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:22.071+0000 7f8a6e5fc700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f8a6815e260 0x7f8a68161cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.157:43280/0 (socket says 172.21.15.157:43280) 2023-10-16T19:59:22.078 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:22.071+0000 7f8a6d5fa700 1 -- 172.21.15.157:0/3983294150 learned_addr learned my addr 172.21.15.157:0/3983294150 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:59:22.078 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:22.072+0000 7f8a6e5fc700 1 -- 172.21.15.157:0/3983294150 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8a680b5f20 msgr2=0x7f8a680cf2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T19:59:22.079 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:22.072+0000 7f8a6e5fc700 1 --2- 172.21.15.157:0/3983294150 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8a680b5f20 0x7f8a680cf2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:59:22.079 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:22.072+0000 7f8a6e5fc700 1 -- 172.21.15.157:0/3983294150 >> v1:172.21.15.187:6789/0 conn(0x7f8a6815de80 legacy=0x7f8a680b5810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:59:22.079 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:22.072+0000 7f8a6e5fc700 1 -- 172.21.15.157:0/3983294150 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a68162a40 con 0x7f8a6815e260 2023-10-16T19:59:22.079 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:22.072+0000 7f8a6d5fa700 1 --2- 172.21.15.157:0/3983294150 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8a680b5f20 0x7f8a680cf2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T19:59:22.080 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:22.072+0000 7f8a6e5fc700 1 --2- 172.21.15.157:0/3983294150 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8a6815e260 0x7f8a68161cf0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f8a60009d90 tx=0x7f8a6000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9dddd0a823e6f7af server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:59:22.080 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:22.072+0000 7f8a6cdf9700 1 -- 172.21.15.157:0/3983294150 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a6000e070 con 0x7f8a6815e260 2023-10-16T19:59:22.080 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:22.072+0000 7f8a6cdf9700 1 -- 172.21.15.157:0/3983294150 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f8a6000bb20 con 0x7f8a6815e260 2023-10-16T19:59:22.081 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:22.072+0000 7f8a6cdf9700 1 -- 172.21.15.157:0/3983294150 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a60012430 con 0x7f8a6815e260 2023-10-16T19:59:22.081 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:22.073+0000 7f8a7005f700 1 -- 172.21.15.157:0/3983294150 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8a6815e260 msgr2=0x7f8a68161cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:59:22.081 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:22.073+0000 7f8a7005f700 1 --2- 172.21.15.157:0/3983294150 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8a6815e260 0x7f8a68161cf0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f8a60009d90 tx=0x7f8a6000b330 comp rx=0 tx=0).stop 2023-10-16T19:59:22.082 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:22.073+0000 7f8a7005f700 1 -- 172.21.15.157:0/3983294150 shutdown_connections 2023-10-16T19:59:22.082 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:22.073+0000 7f8a7005f700 1 --2- 172.21.15.157:0/3983294150 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8a6815e260 0x7f8a68161cf0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:59:22.082 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:22.073+0000 7f8a7005f700 1 --2- 172.21.15.157:0/3983294150 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8a680b5f20 0x7f8a680cf2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:59:22.083 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:22.073+0000 7f8a7005f700 1 -- 172.21.15.157:0/3983294150 >> 172.21.15.157:0/3983294150 conn(0x7f8a680d0810 msgr2=0x7f8a680d0bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:59:22.083 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:22.073+0000 7f8a7005f700 1 -- 172.21.15.157:0/3983294150 shutdown_connections 2023-10-16T19:59:22.083 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:22.073+0000 7f8a7005f700 1 -- 172.21.15.157:0/3983294150 wait complete. 2023-10-16T19:59:22.086 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:22.074+0000 7f8a7005f700 1 Processor -- start 2023-10-16T19:59:22.086 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:22.074+0000 7f8a7005f700 1 -- start start 2023-10-16T19:59:22.087 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:22.075+0000 7f8a7005f700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8a680b5f20 0x7f8a68159210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:59:22.087 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:22.075+0000 7f8a7005f700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8a6815de80 0x7f8a680cd710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:59:22.087 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:22.075+0000 7f8a7005f700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8a6815e260 0x7f8a680b5290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:59:22.087 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:22.075+0000 7f8a7005f700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a6815ffe0 con 0x7f8a6815de80 2023-10-16T19:59:22.088 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:22.075+0000 7f8a7005f700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a6815f0e0 con 0x7f8a680b5f20 2023-10-16T19:59:22.088 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:22.075+0000 7f8a7005f700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a6815f360 con 0x7f8a6815e260 2023-10-16T19:59:22.088 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:22.075+0000 7f8a6d5fa700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8a6815de80 0x7f8a680cd710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:59:22.089 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:22.075+0000 7f8a6d5fa700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8a6815de80 0x7f8a680cd710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:48176/0 (socket says 172.21.15.157:48176) 2023-10-16T19:59:22.089 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:22.075+0000 7f8a6d5fa700 1 -- 172.21.15.157:0/3405736689 learned_addr learned my addr 172.21.15.157:0/3405736689 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-16T19:59:22.089 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:22.075+0000 7f8a6ddfb700 1 --2- 172.21.15.157:0/3405736689 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8a680b5f20 0x7f8a68159210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:59:22.089 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:22.075+0000 7f8a6e5fc700 1 --2- 172.21.15.157:0/3405736689 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8a6815e260 0x7f8a680b5290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:59:22.090 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:22.075+0000 7f8a6d5fa700 1 -- 172.21.15.157:0/3405736689 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8a6815e260 msgr2=0x7f8a680b5290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:59:22.090 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:22.075+0000 7f8a6d5fa700 1 --2- 172.21.15.157:0/3405736689 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8a6815e260 0x7f8a680b5290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:59:22.090 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:22.075+0000 7f8a6d5fa700 1 -- 172.21.15.157:0/3405736689 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8a680b5f20 msgr2=0x7f8a68159210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:59:22.091 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:22.075+0000 7f8a6d5fa700 1 --2- 172.21.15.157:0/3405736689 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8a680b5f20 0x7f8a68159210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:59:22.091 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:22.075+0000 7f8a6d5fa700 1 -- 172.21.15.157:0/3405736689 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a58009550 con 0x7f8a6815de80 2023-10-16T19:59:22.091 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:22.075+0000 7f8a6d5fa700 1 --2- 172.21.15.157:0/3405736689 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8a6815de80 0x7f8a680cd710 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f8a5800ec10 tx=0x7f8a5800ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:59:22.091 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:22.075+0000 7f8a5e7fc700 1 -- 172.21.15.157:0/3405736689 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a5800c850 con 0x7f8a6815de80 2023-10-16T19:59:22.092 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:22.075+0000 7f8a5e7fc700 1 -- 172.21.15.157:0/3405736689 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f8a5800c9b0 con 0x7f8a6815de80 2023-10-16T19:59:22.092 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:22.075+0000 7f8a7005f700 1 -- 172.21.15.157:0/3405736689 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a60009a70 con 0x7f8a6815de80 2023-10-16T19:59:22.092 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:22.075+0000 7f8a5e7fc700 1 -- 172.21.15.157:0/3405736689 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a5800cd60 con 0x7f8a6815de80 2023-10-16T19:59:22.093 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:22.075+0000 7f8a7005f700 1 -- 172.21.15.157:0/3405736689 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a6815f920 con 0x7f8a6815de80 2023-10-16T19:59:22.093 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:22.076+0000 7f8a7005f700 1 -- 172.21.15.157:0/3405736689 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a68160120 con 0x7f8a6815de80 2023-10-16T19:59:22.093 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:22.077+0000 7f8a5e7fc700 1 -- 172.21.15.157:0/3405736689 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f8a58013470 con 0x7f8a6815de80 2023-10-16T19:59:22.093 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:22.078+0000 7f8a5e7fc700 1 --2- 172.21.15.157:0/3405736689 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f8a4c06af00 0x7f8a4c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T19:59:22.094 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:22.078+0000 7f8a5e7fc700 1 -- 172.21.15.157:0/3405736689 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5729+0+0 (secure 0 0 0) 0x7f8a58089d10 con 0x7f8a6815de80 2023-10-16T19:59:22.094 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:22.078+0000 7f8a6ddfb700 1 --2- 172.21.15.157:0/3405736689 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f8a4c06af00 0x7f8a4c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T19:59:22.094 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:22.079+0000 7f8a6ddfb700 1 --2- 172.21.15.157:0/3405736689 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f8a4c06af00 0x7f8a4c06d3c0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f8a680cc800 tx=0x7f8a64009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T19:59:22.095 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:22.082+0000 7f8a5e7fc700 1 -- 172.21.15.157:0/3405736689 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8a58054e80 con 0x7f8a6815de80 2023-10-16T19:59:22.318 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:22.315+0000 7f8a7005f700 1 -- 172.21.15.157:0/3405736689 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8a68160120 con 0x7f8a6815de80 2023-10-16T19:59:22.318 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:22.316+0000 7f8a5e7fc700 1 -- 172.21.15.157:0/3405736689 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4930 (secure 0 0 0) 0x7f8a68160120 con 0x7f8a6815de80 2023-10-16T19:59:22.319 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-10-16T19:59:22.319 INFO:teuthology.orchestra.run.smithi157.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4766,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6837/4265551180","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6835","nonce":4265551180},{"type":"v1","addr":"172.21.15.187:6837","nonce":4265551180}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4945,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6836/3773301895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6834","nonce":3773301895},{"type":"v1","addr":"172.21.15.187:6836","nonce":3773301895}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5040,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6833/2197855945","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6832","nonce":2197855945},{"type":"v1","addr":"172.21.15.157:6833","nonce":2197855945}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-16T19:58:04.972085+0000","modified":"2023-10-16T19:58:08.009196+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5043},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5043":{"gid":5043,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.157:6835/1166326737","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6834","nonce":1166326737},{"type":"v1","addr":"172.21.15.157:6835","nonce":1166326737}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"testcephfs1","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-10-16T19:59:22.321 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:22.318+0000 7f8a7005f700 1 -- 172.21.15.157:0/3405736689 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f8a4c06af00 msgr2=0x7f8a4c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:59:22.321 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:22.318+0000 7f8a7005f700 1 --2- 172.21.15.157:0/3405736689 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f8a4c06af00 0x7f8a4c06d3c0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f8a680cc800 tx=0x7f8a64009040 comp rx=0 tx=0).stop 2023-10-16T19:59:22.321 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:22.318+0000 7f8a7005f700 1 -- 172.21.15.157:0/3405736689 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8a6815de80 msgr2=0x7f8a680cd710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T19:59:22.322 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:22.318+0000 7f8a7005f700 1 --2- 172.21.15.157:0/3405736689 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8a6815de80 0x7f8a680cd710 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f8a5800ec10 tx=0x7f8a5800ef20 comp rx=0 tx=0).stop 2023-10-16T19:59:22.322 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:22.318+0000 7f8a7005f700 1 -- 172.21.15.157:0/3405736689 shutdown_connections 2023-10-16T19:59:22.322 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:22.318+0000 7f8a7005f700 1 --2- 172.21.15.157:0/3405736689 >> [v2:172.21.15.187:6832/2426285296,v1:172.21.15.187:6833/2426285296] conn(0x7f8a4c06af00 0x7f8a4c06d3c0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:59:22.322 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:22.318+0000 7f8a7005f700 1 --2- 172.21.15.157:0/3405736689 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8a680b5f20 0x7f8a68159210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:59:22.323 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:22.318+0000 7f8a7005f700 1 --2- 172.21.15.157:0/3405736689 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8a6815e260 0x7f8a680b5290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:59:22.323 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:22.318+0000 7f8a7005f700 1 --2- 172.21.15.157:0/3405736689 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8a6815de80 0x7f8a680cd710 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T19:59:22.323 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:22.318+0000 7f8a7005f700 1 -- 172.21.15.157:0/3405736689 >> 172.21.15.157:0/3405736689 conn(0x7f8a680d0810 msgr2=0x7f8a680b7840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T19:59:22.324 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:22.318+0000 7f8a7005f700 1 -- 172.21.15.157:0/3405736689 shutdown_connections 2023-10-16T19:59:22.324 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-16T19:59:22.318+0000 7f8a7005f700 1 -- 172.21.15.157:0/3405736689 wait complete. 2023-10-16T19:59:22.324 INFO:teuthology.orchestra.run.smithi157.stderr:dumped fsmap epoch 17 2023-10-16T19:59:22.333 DEBUG:tasks.cephfs.filesystem:already dead... 2023-10-16T19:59:22.333 INFO:teuthology.misc:Shutting down mds daemons... 2023-10-16T19:59:22.334 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-16T19:59:22.334 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T19:59:22.342 INFO:tasks.ceph.mds.a:Stopped 2023-10-16T19:59:22.343 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-16T19:59:22.343 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T19:59:22.391 INFO:tasks.ceph.mds.c:Stopped 2023-10-16T19:59:22.391 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-16T19:59:22.392 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T19:59:22.401 INFO:tasks.ceph.mds.b:Stopped 2023-10-16T19:59:22.402 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-16T19:59:22.402 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T19:59:22.452 INFO:tasks.ceph.mds.d:Stopped 2023-10-16T19:59:22.453 INFO:teuthology.misc:Shutting down osd daemons... 2023-10-16T19:59:22.454 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-10-16T19:59:22.454 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T19:59:22.464 INFO:tasks.ceph.osd.0:Stopped 2023-10-16T19:59:22.464 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-10-16T19:59:22.465 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T19:59:22.515 INFO:tasks.ceph.osd.1:Stopped 2023-10-16T19:59:22.516 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-10-16T19:59:22.517 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T19:59:22.566 INFO:tasks.ceph.osd.2:Stopped 2023-10-16T19:59:22.567 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-10-16T19:59:22.567 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T19:59:22.616 INFO:tasks.ceph.osd.3:Stopped 2023-10-16T19:59:22.617 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-10-16T19:59:22.617 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T19:59:22.630 INFO:tasks.ceph.osd.4:Stopped 2023-10-16T19:59:22.631 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-10-16T19:59:22.631 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T19:59:22.686 INFO:tasks.ceph.osd.5:Stopped 2023-10-16T19:59:22.687 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-10-16T19:59:22.687 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T19:59:22.739 INFO:tasks.ceph.osd.6:Stopped 2023-10-16T19:59:22.739 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-10-16T19:59:22.740 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T19:59:22.791 INFO:tasks.ceph.osd.7:Stopped 2023-10-16T19:59:22.792 INFO:teuthology.misc:Shutting down mgr daemons... 2023-10-16T19:59:22.792 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-10-16T19:59:22.793 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T19:59:22.814 INFO:tasks.ceph.mgr.y:Stopped 2023-10-16T19:59:22.819 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-10-16T19:59:22.819 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T19:59:22.857 INFO:tasks.ceph.mgr.x:Stopped 2023-10-16T19:59:22.858 INFO:teuthology.misc:Shutting down mon daemons... 2023-10-16T19:59:22.859 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-10-16T19:59:22.859 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T19:59:22.869 INFO:tasks.ceph.mon.a:Stopped 2023-10-16T19:59:22.869 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-10-16T19:59:22.870 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T19:59:22.909 INFO:tasks.ceph.mon.b:Stopped 2023-10-16T19:59:22.910 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-10-16T19:59:22.910 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T19:59:22.961 INFO:tasks.ceph.mon.c:Stopped 2023-10-16T19:59:22.962 INFO:tasks.ceph:Checking cluster log for badness... 2023-10-16T19:59:22.962 DEBUG:teuthology.orchestra.run.smithi157:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'OSD full dropping all updates' | egrep -v 'OSD near full' | egrep -v 'pausewr flag' | egrep -v 'failsafe engaged, dropping updates' | egrep -v 'failsafe disengaged, no longer dropping' | egrep -v 'is full \(reached quota' | egrep -v POOL_FULL | egrep -v POOL_BACKFILLFULL | egrep -v PG_RECOVERY_FULL | egrep -v PG_DEGRADED | head -n 1 2023-10-16T19:59:22.996 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi157.front.sepia.ceph.com 2023-10-16T19:59:22.997 DEBUG:teuthology.orchestra.run.smithi157:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-10-16T19:59:23.187 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi157.front.sepia.ceph.com 2023-10-16T19:59:23.187 DEBUG:teuthology.orchestra.run.smithi157:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-10-16T19:59:23.294 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi157.front.sepia.ceph.com 2023-10-16T19:59:23.295 DEBUG:teuthology.orchestra.run.smithi157:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-10-16T19:59:23.385 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi157.front.sepia.ceph.com 2023-10-16T19:59:23.386 DEBUG:teuthology.orchestra.run.smithi157:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-10-16T19:59:23.463 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi187.front.sepia.ceph.com 2023-10-16T19:59:23.464 DEBUG:teuthology.orchestra.run.smithi187:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2023-10-16T19:59:23.658 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi187.front.sepia.ceph.com 2023-10-16T19:59:23.659 DEBUG:teuthology.orchestra.run.smithi187:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2023-10-16T19:59:23.756 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi187.front.sepia.ceph.com 2023-10-16T19:59:23.757 DEBUG:teuthology.orchestra.run.smithi187:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2023-10-16T19:59:23.871 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi187.front.sepia.ceph.com 2023-10-16T19:59:23.872 DEBUG:teuthology.orchestra.run.smithi187:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2023-10-16T19:59:23.973 INFO:tasks.ceph:Archiving mon data... 2023-10-16T19:59:23.975 DEBUG:teuthology.misc:Transferring archived files from smithi157:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/rishabh-2023-10-16_18:49:15-fs-rishabh-2023oct13-testing-default-smithi/7430083/data/mon.a.tgz 2023-10-16T19:59:23.975 DEBUG:teuthology.orchestra.run.smithi157:> mktemp 2023-10-16T19:59:23.993 INFO:teuthology.orchestra.run.smithi157.stdout:/tmp/tmp.h9ddqOwvY8 2023-10-16T19:59:23.993 DEBUG:teuthology.orchestra.run.smithi157:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.h9ddqOwvY8 2023-10-16T19:59:24.125 DEBUG:teuthology.orchestra.run.smithi157:> sudo chmod 0666 /tmp/tmp.h9ddqOwvY8 2023-10-16T19:59:24.212 DEBUG:teuthology.orchestra.remote:smithi157:/tmp/tmp.h9ddqOwvY8 is 279KB 2023-10-16T19:59:24.310 DEBUG:teuthology.orchestra.run.smithi157:> rm -fr /tmp/tmp.h9ddqOwvY8 2023-10-16T19:59:24.327 DEBUG:teuthology.misc:Transferring archived files from smithi187:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/rishabh-2023-10-16_18:49:15-fs-rishabh-2023oct13-testing-default-smithi/7430083/data/mon.b.tgz 2023-10-16T19:59:24.327 DEBUG:teuthology.orchestra.run.smithi187:> mktemp 2023-10-16T19:59:24.346 INFO:teuthology.orchestra.run.smithi187.stdout:/tmp/tmp.B4PzBK0T92 2023-10-16T19:59:24.346 DEBUG:teuthology.orchestra.run.smithi187:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.B4PzBK0T92 2023-10-16T19:59:24.488 DEBUG:teuthology.orchestra.run.smithi187:> sudo chmod 0666 /tmp/tmp.B4PzBK0T92 2023-10-16T19:59:24.574 DEBUG:teuthology.orchestra.remote:smithi187:/tmp/tmp.B4PzBK0T92 is 376KB 2023-10-16T19:59:24.671 DEBUG:teuthology.orchestra.run.smithi187:> rm -fr /tmp/tmp.B4PzBK0T92 2023-10-16T19:59:24.688 DEBUG:teuthology.misc:Transferring archived files from smithi187:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/rishabh-2023-10-16_18:49:15-fs-rishabh-2023oct13-testing-default-smithi/7430083/data/mon.c.tgz 2023-10-16T19:59:24.689 DEBUG:teuthology.orchestra.run.smithi187:> mktemp 2023-10-16T19:59:24.744 INFO:teuthology.orchestra.run.smithi187.stdout:/tmp/tmp.0wtqN5cFOG 2023-10-16T19:59:24.745 DEBUG:teuthology.orchestra.run.smithi187:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.0wtqN5cFOG 2023-10-16T19:59:24.879 DEBUG:teuthology.orchestra.run.smithi187:> sudo chmod 0666 /tmp/tmp.0wtqN5cFOG 2023-10-16T19:59:24.964 DEBUG:teuthology.orchestra.remote:smithi187:/tmp/tmp.0wtqN5cFOG is 376KB 2023-10-16T19:59:25.060 DEBUG:teuthology.orchestra.run.smithi187:> rm -fr /tmp/tmp.0wtqN5cFOG 2023-10-16T19:59:25.076 INFO:tasks.ceph:Cleaning ceph cluster... 2023-10-16T19:59:25.077 DEBUG:teuthology.orchestra.run.smithi157:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-10-16T19:59:25.081 DEBUG:teuthology.orchestra.run.smithi187:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-10-16T19:59:25.141 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-10-16T19:59:25.142 DEBUG:teuthology.orchestra.run.smithi157:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-10-16T19:59:25.151 DEBUG:teuthology.orchestra.run.smithi187:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-10-16T19:59:25.189 INFO:teuthology.orchestra.run.smithi157.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-10-16T19:59:25.219 INFO:teuthology.orchestra.run.smithi187.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-10-16T19:59:25.224 INFO:tasks.ceph:Archiving crash dumps... 2023-10-16T19:59:25.226 DEBUG:teuthology.misc:Transferring archived files from smithi157:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2023-10-16_18:49:15-fs-rishabh-2023oct13-testing-default-smithi/7430083/remote/smithi157/crash 2023-10-16T19:59:25.227 DEBUG:teuthology.orchestra.run.smithi157:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-10-16T19:59:25.265 DEBUG:teuthology.misc:Transferring archived files from smithi187:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2023-10-16_18:49:15-fs-rishabh-2023oct13-testing-default-smithi/7430083/remote/smithi187/crash 2023-10-16T19:59:25.266 DEBUG:teuthology.orchestra.run.smithi187:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-10-16T19:59:25.292 INFO:tasks.ceph:Shutting down logrotate 2023-10-16T19:59:25.293 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T19:59:25.310 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T19:59:25.390 DEBUG:teuthology.orchestra.run.smithi157:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-10-16T19:59:25.418 DEBUG:teuthology.orchestra.run.smithi187:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-10-16T19:59:25.445 INFO:tasks.ceph:Compressing logs... 2023-10-16T19:59:25.445 DEBUG:teuthology.orchestra.run.smithi157:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-10-16T19:59:25.460 DEBUG:teuthology.orchestra.run.smithi187:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-10-16T19:59:25.506 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102110.log 2023-10-16T19:59:25.506 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106460.log 2023-10-16T19:59:25.507 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.102110.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102686.log 2023-10-16T19:59:25.507 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106219.log 2023-10-16T19:59:25.507 INFO:teuthology.orchestra.run.smithi157.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.102110.log.gz 2023-10-16T19:59:25.508 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.106460.log: /var/log/ceph/ceph-client.admin.102686.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107735.log 2023-10-16T19:59:25.508 INFO:teuthology.orchestra.run.smithi157.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.106460.log.gz 2023-10-16T19:59:25.508 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.106219.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.102686.log.gz 2023-10-16T19:59:25.508 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.103745.log 2023-10-16T19:59:25.509 INFO:teuthology.orchestra.run.smithi157.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.106219.log.gz 2023-10-16T19:59:25.509 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.107735.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101832.log 2023-10-16T19:59:25.509 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.0.103745.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.107735.log.gz 2023-10-16T19:59:25.509 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102202.log 2023-10-16T19:59:25.510 INFO:teuthology.orchestra.run.smithi157.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.103745.log.gz 2023-10-16T19:59:25.510 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.101832.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102109.log 2023-10-16T19:59:25.510 INFO:teuthology.orchestra.run.smithi157.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.101832.log.gz 2023-10-16T19:59:25.511 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.102202.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101260.log 2023-10-16T19:59:25.511 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.102109.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.102202.log.gz 2023-10-16T19:59:25.511 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100541.log 2023-10-16T19:59:25.511 INFO:teuthology.orchestra.run.smithi157.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.102109.log.gz/var/log/ceph/ceph-client.admin.101260.log: 2023-10-16T19:59:25.512 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110178.log 2023-10-16T19:59:25.512 INFO:teuthology.orchestra.run.smithi157.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.101260.log.gz 2023-10-16T19:59:25.512 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.100541.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108104.log 2023-10-16T19:59:25.513 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.110178.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.100541.log.gz 2023-10-16T19:59:25.513 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2023-10-16T19:59:25.513 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.108104.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.110178.log.gz 2023-10-16T19:59:25.513 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102042.log 2023-10-16T19:59:25.514 INFO:teuthology.orchestra.run.smithi157.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.108104.log.gz 2023-10-16T19:59:25.514 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102778.log 2023-10-16T19:59:25.514 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-osd.2.log: /var/log/ceph/ceph-client.admin.102042.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106778.log 2023-10-16T19:59:25.514 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.102778.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109948.log 2023-10-16T19:59:25.515 INFO:teuthology.orchestra.run.smithi157.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.102042.log.gz 2023-10-16T19:59:25.515 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.106778.log: 89.2%gzip -- replaced with /var/log/ceph/ceph-client.admin.102778.log.gz-5 2023-10-16T19:59:25.515 INFO:teuthology.orchestra.run.smithi157.stderr:--verbose -- /var/log/ceph/ceph-client.admin.108607.log 2023-10-16T19:59:25.515 INFO:teuthology.orchestra.run.smithi157.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.106778.log.gz 2023-10-16T19:59:25.516 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.109948.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107054.log 2023-10-16T19:59:25.516 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.108607.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109580.log 2023-10-16T19:59:25.516 INFO:teuthology.orchestra.run.smithi157.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.109948.log.gz 2023-10-16T19:59:25.517 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.107054.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.108607.log.gz 2023-10-16T19:59:25.517 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104854.log 2023-10-16T19:59:25.517 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.109580.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.107054.log.gz 2023-10-16T19:59:25.517 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102916.log 2023-10-16T19:59:25.518 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.104854.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 89.1% 2023-10-16T19:59:25.518 INFO:teuthology.orchestra.run.smithi157.stderr: -- replaced with /var/log/ceph/ceph-client.admin.109580.log.gz 2023-10-16T19:59:25.518 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.102916.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.104854.log.gz 2023-10-16T19:59:25.518 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105474.log 2023-10-16T19:59:25.519 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.102916.log.gz 2023-10-16T19:59:25.519 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109718.log 2023-10-16T19:59:25.519 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.105474.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101168.log 2023-10-16T19:59:25.520 INFO:teuthology.orchestra.run.smithi157.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.105474.log.gz 2023-10-16T19:59:25.520 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.109718.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100754.log 2023-10-16T19:59:25.520 INFO:teuthology.orchestra.run.smithi157.stderr: 84.8% -- replaced with /var/log/ceph/ceph.log.gz 2023-10-16T19:59:25.520 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108515.log 2023-10-16T19:59:25.521 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.101168.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.109718.log.gz 2023-10-16T19:59:25.521 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.100754.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.97584.log 2023-10-16T19:59:25.521 INFO:teuthology.orchestra.run.smithi157.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.101168.log.gz 2023-10-16T19:59:25.521 INFO:teuthology.orchestra.run.smithi157.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.100754.log.gz 2023-10-16T19:59:25.522 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.108515.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109902.log 2023-10-16T19:59:25.522 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph.tmp-client.admin.97584.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102502.log 2023-10-16T19:59:25.522 INFO:teuthology.orchestra.run.smithi157.stderr: 89.4% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.108515.log.gz -- replaced with /var/log/ceph/ceph.tmp-client.admin.97584.log.gz 2023-10-16T19:59:25.523 INFO:teuthology.orchestra.run.smithi157.stderr: 2023-10-16T19:59:25.523 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.109902.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100261.log 2023-10-16T19:59:25.523 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.102502.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.109902.log.gz 2023-10-16T19:59:25.523 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101465.log 2023-10-16T19:59:25.524 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.100261.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.102502.log.gz 2023-10-16T19:59:25.524 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99637.log 2023-10-16T19:59:25.524 INFO:teuthology.orchestra.run.smithi157.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.100261.log.gz 2023-10-16T19:59:25.524 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.101465.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103254.log 2023-10-16T19:59:25.525 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.99637.log: gzip -5 --verbose -- 89.1%/var/log/ceph/ceph-osd.0.log 2023-10-16T19:59:25.525 INFO:teuthology.orchestra.run.smithi157.stderr: -- replaced with /var/log/ceph/ceph-client.admin.101465.log.gz 2023-10-16T19:59:25.525 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.103254.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.99637.log.gz 2023-10-16T19:59:25.525 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101830.log 2023-10-16T19:59:25.526 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-osd.0.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.103254.log.gz 2023-10-16T19:59:25.526 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110293.log 2023-10-16T19:59:25.526 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.101830.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100608.log 2023-10-16T19:59:25.527 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.110293.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.101830.log.gz 2023-10-16T19:59:25.527 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.103737.log 2023-10-16T19:59:25.527 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.100608.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.110293.log.gz 2023-10-16T19:59:25.527 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2023-10-16T19:59:25.528 INFO:teuthology.orchestra.run.smithi157.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.100608.log.gz 2023-10-16T19:59:25.528 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.0.103737.log: gzip -5 0.0%--verbose -- /var/log/ceph/ceph-client.admin.108653.log -- replaced with /var/log/ceph/ceph-client.0.103737.log.gz 2023-10-16T19:59:25.528 INFO:teuthology.orchestra.run.smithi157.stderr: 2023-10-16T19:59:25.528 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109304.log 2023-10-16T19:59:25.529 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.108653.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104946.log 2023-10-16T19:59:25.529 INFO:teuthology.orchestra.run.smithi157.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.108653.log.gz 2023-10-16T19:59:25.529 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.109304.log: /var/log/ceph/ceph-client.admin.104946.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105901.log 2023-10-16T19:59:25.529 INFO:teuthology.orchestra.run.smithi157.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.109304.log.gz 2023-10-16T19:59:25.530 INFO:teuthology.orchestra.run.smithi157.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.104946.log.gz 2023-10-16T19:59:25.530 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100168.log 2023-10-16T19:59:25.530 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102824.log 2023-10-16T19:59:25.531 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.105901.log: /var/log/ceph/ceph-client.admin.100168.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.105901.log.gz 2023-10-16T19:59:25.531 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.102824.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.100168.log.gz 2023-10-16T19:59:25.531 INFO:teuthology.orchestra.run.smithi157.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.102824.log.gz 2023-10-16T19:59:25.531 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103008.log 2023-10-16T19:59:25.532 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105612.log 2023-10-16T19:59:25.532 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.103008.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105520.log 2023-10-16T19:59:25.532 INFO:teuthology.orchestra.run.smithi157.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.103008.log.gz 2023-10-16T19:59:25.533 INFO:teuthology.orchestra.run.smithi157.stderr:gzip /var/log/ceph/ceph-client.admin.105612.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.109350.log 2023-10-16T19:59:25.533 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109396.log 2023-10-16T19:59:25.533 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.105520.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.105612.log.gz 2023-10-16T19:59:25.533 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.109350.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.105520.log.gz 2023-10-16T19:59:25.534 INFO:teuthology.orchestra.run.smithi157.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.109350.log.gz 2023-10-16T19:59:25.534 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.109396.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.109396.log.gz 2023-10-16T19:59:25.534 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108198.log 2023-10-16T19:59:25.534 INFO:teuthology.orchestra.run.smithi157.stderr: 92.6% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2023-10-16T19:59:25.535 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107008.log 2023-10-16T19:59:25.535 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.108198.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110504.log 2023-10-16T19:59:25.535 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.107008.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.108198.log.gz 2023-10-16T19:59:25.535 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100214.log 2023-10-16T19:59:25.536 INFO:teuthology.orchestra.run.smithi157.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.107008.log.gz 2023-10-16T19:59:25.536 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2023-10-16T19:59:25.536 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.110504.log: /var/log/ceph/ceph-client.admin.100214.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105336.log 2023-10-16T19:59:25.537 INFO:teuthology.orchestra.run.smithi157.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.110504.log.gz 2023-10-16T19:59:25.537 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.109098.log 2023-10-16T19:59:25.537 INFO:teuthology.orchestra.run.smithi157.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.100214.log.gz 2023-10-16T19:59:25.537 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.105336.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100654.log 2023-10-16T19:59:25.538 INFO:teuthology.orchestra.run.smithi157.stderr: 89.0%/var/log/ceph/ceph-client.0.109098.log: -- replaced with /var/log/ceph/ceph-client.admin.105336.log.gz 2023-10-16T19:59:25.538 INFO:teuthology.orchestra.run.smithi157.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.109098.log.gz 2023-10-16T19:59:25.538 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.100654.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107422.log 2023-10-16T19:59:25.539 INFO:teuthology.orchestra.run.smithi157.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.100654.log.gz 2023-10-16T19:59:25.539 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107920.log 2023-10-16T19:59:25.539 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99896.log 2023-10-16T19:59:25.539 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.107422.log: /var/log/ceph/ceph-client.admin.107920.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105039.log 2023-10-16T19:59:25.540 INFO:teuthology.orchestra.run.smithi157.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.107422.log.gz 2023-10-16T19:59:25.540 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.99896.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101457.log 2023-10-16T19:59:25.540 INFO:teuthology.orchestra.run.smithi157.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.107920.log.gz 2023-10-16T19:59:25.540 INFO:teuthology.orchestra.run.smithi157.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.99896.log.gz 2023-10-16T19:59:25.541 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.105039.log: /var/log/ceph/ceph-client.admin.101457.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.105039.log.gz 2023-10-16T19:59:25.541 INFO:teuthology.orchestra.run.smithi157.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.101457.log.gz 2023-10-16T19:59:25.541 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102197.log 2023-10-16T19:59:25.542 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101834.log 2023-10-16T19:59:25.542 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.102197.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2023-10-16T19:59:25.542 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.101834.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.102197.log.gz 2023-10-16T19:59:25.542 INFO:teuthology.orchestra.run.smithi157.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.101834.log.gz 2023-10-16T19:59:25.552 INFO:teuthology.orchestra.run.smithi187.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2023-10-16T19:59:25.553 INFO:teuthology.orchestra.run.smithi187.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99677.log 2023-10-16T19:59:25.553 INFO:teuthology.orchestra.run.smithi187.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99632.log 2023-10-16T19:59:25.553 INFO:teuthology.orchestra.run.smithi187.stderr:/var/log/ceph/ceph-client.admin.99677.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-10-16T19:59:25.553 INFO:teuthology.orchestra.run.smithi187.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.99677.log.gz 2023-10-16T19:59:25.554 INFO:teuthology.orchestra.run.smithi187.stderr:/var/log/ceph/ceph-client.admin.99632.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99540.log 2023-10-16T19:59:25.554 INFO:teuthology.orchestra.run.smithi187.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2023-10-16T19:59:25.554 INFO:teuthology.orchestra.run.smithi187.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.99632.log.gz 2023-10-16T19:59:25.555 INFO:teuthology.orchestra.run.smithi187.stderr:/var/log/ceph/ceph-client.admin.99540.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99495.log 2023-10-16T19:59:25.555 INFO:teuthology.orchestra.run.smithi187.stderr:/var/log/ceph/ceph-osd.6.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.99540.log.gz 2023-10-16T19:59:25.555 INFO:teuthology.orchestra.run.smithi187.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.100920.log 2023-10-16T19:59:25.555 INFO:teuthology.orchestra.run.smithi187.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.100912.log 2023-10-16T19:59:25.556 INFO:teuthology.orchestra.run.smithi187.stderr:/var/log/ceph/ceph-client.admin.99495.log: /var/log/ceph/ceph-client.1.100920.log: 91.5% -- replaced with /var/log/ceph/ceph.log.gz 2023-10-16T19:59:25.556 INFO:teuthology.orchestra.run.smithi187.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.99495.log.gz 2023-10-16T19:59:25.556 INFO:teuthology.orchestra.run.smithi187.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.100920.log.gz 2023-10-16T19:59:25.556 INFO:teuthology.orchestra.run.smithi187.stderr:/var/log/ceph/ceph-client.1.100912.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.100912.log.gz 2023-10-16T19:59:25.557 INFO:teuthology.orchestra.run.smithi187.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2023-10-16T19:59:25.557 INFO:teuthology.orchestra.run.smithi187.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-10-16T19:59:25.557 INFO:teuthology.orchestra.run.smithi187.stderr:/var/log/ceph/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.3.101535.log 2023-10-16T19:59:25.558 INFO:teuthology.orchestra.run.smithi187.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2023-10-16T19:59:25.558 INFO:teuthology.orchestra.run.smithi187.stderr:/var/log/ceph/ceph-client.3.101535.log: 0.0% -- replaced with /var/log/ceph/ceph-client.3.101535.log.gz 2023-10-16T19:59:25.558 INFO:teuthology.orchestra.run.smithi187.stderr:/var/log/ceph/ceph-osd.4.log: 93.6% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-10-16T19:59:25.558 INFO:teuthology.orchestra.run.smithi187.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99775.log 2023-10-16T19:59:25.559 INFO:teuthology.orchestra.run.smithi187.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2023-10-16T19:59:25.559 INFO:teuthology.orchestra.run.smithi187.stderr:/var/log/ceph/ceph-client.admin.99775.log: /var/log/ceph/ceph-mgr.x.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.99775.log.gz 2023-10-16T19:59:25.559 INFO:teuthology.orchestra.run.smithi187.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2023-10-16T19:59:25.559 INFO:teuthology.orchestra.run.smithi187.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99722.log 2023-10-16T19:59:25.560 INFO:teuthology.orchestra.run.smithi187.stderr:/var/log/ceph/ceph-mon.c.log: /var/log/ceph/ceph-client.admin.99722.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.99722.log.gz 2023-10-16T19:59:25.560 INFO:teuthology.orchestra.run.smithi187.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99587.log 2023-10-16T19:59:25.560 INFO:teuthology.orchestra.run.smithi187.stderr:/var/log/ceph/ceph-client.admin.99587.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.99587.log.gz 2023-10-16T19:59:25.560 INFO:teuthology.orchestra.run.smithi187.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2023-10-16T19:59:25.561 INFO:teuthology.orchestra.run.smithi187.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2023-10-16T19:59:25.561 INFO:teuthology.orchestra.run.smithi187.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2023-10-16T19:59:25.561 INFO:teuthology.orchestra.run.smithi187.stderr:/var/log/ceph/ceph-mds.b.log: 92.1% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2023-10-16T19:59:25.562 INFO:teuthology.orchestra.run.smithi187.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99449.log 2023-10-16T19:59:25.564 INFO:teuthology.orchestra.run.smithi187.stderr:/var/log/ceph/ceph-client.admin.99449.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.99449.log.gz 2023-10-16T19:59:25.564 INFO:teuthology.orchestra.run.smithi187.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.3.101539.log 2023-10-16T19:59:25.564 INFO:teuthology.orchestra.run.smithi187.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2023-10-16T19:59:25.575 INFO:teuthology.orchestra.run.smithi187.stderr:/var/log/ceph/ceph-client.3.101539.log: 0.0% -- replaced with /var/log/ceph/ceph-client.3.101539.log.gz 2023-10-16T19:59:25.582 INFO:teuthology.orchestra.run.smithi187.stderr: 95.6% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2023-10-16T19:59:25.590 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-mds.c.log: 92.2% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2023-10-16T19:59:25.590 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107604.log 2023-10-16T19:59:25.591 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102548.log 2023-10-16T19:59:25.591 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.107604.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105947.log 2023-10-16T19:59:25.591 INFO:teuthology.orchestra.run.smithi157.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.107604.log.gz 2023-10-16T19:59:25.591 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.102548.log: /var/log/ceph/ceph-client.admin.105947.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.102548.log.gz 2023-10-16T19:59:25.592 INFO:teuthology.orchestra.run.smithi157.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.105947.log.gz 2023-10-16T19:59:25.592 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106916.log 2023-10-16T19:59:25.592 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107514.log 2023-10-16T19:59:25.593 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.106916.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101076.log 2023-10-16T19:59:25.593 INFO:teuthology.orchestra.run.smithi157.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.106916.log.gz 2023-10-16T19:59:25.593 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.107514.log: /var/log/ceph/ceph-client.admin.101076.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.107514.log.gz 2023-10-16T19:59:25.593 INFO:teuthology.orchestra.run.smithi157.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.101076.log.gzgzip 2023-10-16T19:59:25.594 INFO:teuthology.orchestra.run.smithi157.stderr:-5 --verbose -- /var/log/ceph/ceph-client.2.104402.log 2023-10-16T19:59:25.594 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.109094.log 2023-10-16T19:59:25.594 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.2.104402.log: 0.0% -- replaced with /var/log/ceph/ceph-client.2.104402.log.gz 2023-10-16T19:59:25.594 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102456.log 2023-10-16T19:59:25.595 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108561.log 2023-10-16T19:59:25.595 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.0.109094.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.109094.log.gz 2023-10-16T19:59:25.595 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.102456.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102111.log 2023-10-16T19:59:25.596 INFO:teuthology.orchestra.run.smithi157.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.102456.log.gz 2023-10-16T19:59:25.596 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.108561.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105152.log 2023-10-16T19:59:25.596 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100892.log 2023-10-16T19:59:25.596 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.102111.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.108561.log.gz 2023-10-16T19:59:25.597 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.105152.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102962.log 2023-10-16T19:59:25.597 INFO:teuthology.orchestra.run.smithi157.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.102111.log.gz 2023-10-16T19:59:25.597 INFO:teuthology.orchestra.run.smithi157.stderr: 88.4%/var/log/ceph/ceph-client.admin.100892.log: -- replaced with /var/log/ceph/ceph-client.admin.105152.log.gz 2023-10-16T19:59:25.597 INFO:teuthology.orchestra.run.smithi157.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.100892.log.gz 2023-10-16T19:59:25.598 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.102962.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.102962.log.gz 2023-10-16T19:59:25.598 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107468.log 2023-10-16T19:59:25.598 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107238.log 2023-10-16T19:59:25.599 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.107468.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108346.log 2023-10-16T19:59:25.599 INFO:teuthology.orchestra.run.smithi157.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.107468.log.gz 2023-10-16T19:59:25.599 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.107238.log: /var/log/ceph/ceph-client.admin.108346.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.107238.log.gz 2023-10-16T19:59:25.599 INFO:teuthology.orchestra.run.smithi157.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.108346.log.gz 2023-10-16T19:59:25.600 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104716.log 2023-10-16T19:59:25.600 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100353.log 2023-10-16T19:59:25.600 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.104716.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106173.log 2023-10-16T19:59:25.600 INFO:teuthology.orchestra.run.smithi157.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.104716.log.gz 2023-10-16T19:59:25.601 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.100353.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-10-16T19:59:25.601 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105244.log 2023-10-16T19:59:25.601 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.106173.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.100353.log.gz 2023-10-16T19:59:25.602 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110224.log 2023-10-16T19:59:25.602 INFO:teuthology.orchestra.run.smithi157.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.106173.log.gz 2023-10-16T19:59:25.602 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.105244.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110339.log 2023-10-16T19:59:25.602 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.110224.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.105244.log.gz 2023-10-16T19:59:25.603 INFO:teuthology.orchestra.run.smithi157.stderr: 88.8% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-10-16T19:59:25.603 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.110339.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.110224.log.gz 2023-10-16T19:59:25.603 INFO:teuthology.orchestra.run.smithi157.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.110339.log.gz 2023-10-16T19:59:25.603 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105198.log 2023-10-16T19:59:25.604 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108246.log 2023-10-16T19:59:25.604 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.105198.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108300.log 2023-10-16T19:59:25.604 INFO:teuthology.orchestra.run.smithi157.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.105198.log.gz 2023-10-16T19:59:25.605 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.108246.log: /var/log/ceph/ceph-client.admin.108300.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.108246.log.gz 2023-10-16T19:59:25.605 INFO:teuthology.orchestra.run.smithi157.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.108300.log.gz 2023-10-16T19:59:25.605 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104900.log 2023-10-16T19:59:25.605 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107192.log 2023-10-16T19:59:25.606 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.104900.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106265.log 2023-10-16T19:59:25.606 INFO:teuthology.orchestra.run.smithi157.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.104900.log.gz 2023-10-16T19:59:25.606 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.107192.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101467.log 2023-10-16T19:59:25.607 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100493.log 2023-10-16T19:59:25.607 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.106265.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.107192.log.gz 2023-10-16T19:59:25.607 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.101467.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106039.log 2023-10-16T19:59:25.607 INFO:teuthology.orchestra.run.smithi157.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.106265.log.gz 2023-10-16T19:59:25.608 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.100493.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.101467.log.gz 2023-10-16T19:59:25.608 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107376.log 2023-10-16T19:59:25.608 INFO:teuthology.orchestra.run.smithi157.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.100493.log.gz 2023-10-16T19:59:25.608 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.106039.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109626.log 2023-10-16T19:59:25.609 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101829.log 2023-10-16T19:59:25.609 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.107376.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.106039.log.gz 2023-10-16T19:59:25.609 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.109626.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101464.log 2023-10-16T19:59:25.610 INFO:teuthology.orchestra.run.smithi157.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.107376.log.gz 2023-10-16T19:59:25.610 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.101829.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.109626.log.gz 2023-10-16T19:59:25.610 INFO:teuthology.orchestra.run.smithi157.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.101829.log.gz 2023-10-16T19:59:25.610 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.101464.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.101464.log.gz 2023-10-16T19:59:25.611 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110458.log 2023-10-16T19:59:25.611 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104670.log 2023-10-16T19:59:25.611 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.110458.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105728.log 2023-10-16T19:59:25.611 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.104670.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.110458.log.gz 2023-10-16T19:59:25.612 INFO:teuthology.orchestra.run.smithi157.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.104670.log.gz 2023-10-16T19:59:25.612 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.105728.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.105728.log.gz 2023-10-16T19:59:25.612 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108150.log 2023-10-16T19:59:25.613 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101463.log 2023-10-16T19:59:25.613 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.108150.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101214.log 2023-10-16T19:59:25.613 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.101463.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106127.log 2023-10-16T19:59:25.613 INFO:teuthology.orchestra.run.smithi157.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.108150.log.gz 2023-10-16T19:59:25.614 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.101214.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.101463.log.gz 2023-10-16T19:59:25.614 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103054.log 2023-10-16T19:59:25.614 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107966.log 2023-10-16T19:59:25.614 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.106127.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.101214.log.gz 2023-10-16T19:59:25.615 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.103054.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106598.log 2023-10-16T19:59:25.615 INFO:teuthology.orchestra.run.smithi157.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.106127.log.gz 2023-10-16T19:59:25.615 INFO:teuthology.orchestra.run.smithi157.stderr: 88.8%/var/log/ceph/ceph-client.admin.107966.log: -- replaced with /var/log/ceph/ceph-client.admin.103054.log.gz 2023-10-16T19:59:25.616 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108861.log 2023-10-16T19:59:25.616 INFO:teuthology.orchestra.run.smithi157.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.107966.log.gz 2023-10-16T19:59:25.616 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.106598.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110132.log 2023-10-16T19:59:25.616 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.108861.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.2.104398.log 2023-10-16T19:59:25.617 INFO:teuthology.orchestra.run.smithi157.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.106598.log.gz 2023-10-16T19:59:25.617 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.110132.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.108861.log.gz 2023-10-16T19:59:25.617 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110086.log 2023-10-16T19:59:25.617 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.2.104398.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.110132.log.gz 2023-10-16T19:59:25.618 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107689.log 2023-10-16T19:59:25.618 INFO:teuthology.orchestra.run.smithi157.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.2.104398.log.gz 2023-10-16T19:59:25.618 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.110086.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104808.log 2023-10-16T19:59:25.619 INFO:teuthology.orchestra.run.smithi157.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.110086.log.gz 2023-10-16T19:59:25.619 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.107689.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2023-10-16T19:59:25.619 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.104808.log: gzip -5 90.0%--verbose -- /var/log/ceph/ceph-client.admin.108791.log -- replaced with /var/log/ceph/ceph-client.admin.107689.log.gz 2023-10-16T19:59:25.619 INFO:teuthology.orchestra.run.smithi157.stderr: 2023-10-16T19:59:25.620 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-osd.1.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.104808.log.gz 2023-10-16T19:59:25.620 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.108791.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.108791.log.gz 2023-10-16T19:59:25.620 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110040.log 2023-10-16T19:59:25.620 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100083.log 2023-10-16T19:59:25.621 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.110040.log: /var/log/ceph/ceph-client.admin.100083.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.110040.log.gz 2023-10-16T19:59:25.621 INFO:teuthology.orchestra.run.smithi157.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.100083.log.gz 2023-10-16T19:59:25.621 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108461.log 2023-10-16T19:59:25.622 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99974.log 2023-10-16T19:59:25.622 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.108461.log: /var/log/ceph/ceph-client.admin.99974.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.108461.log.gz 2023-10-16T19:59:25.622 INFO:teuthology.orchestra.run.smithi157.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.99974.log.gz 2023-10-16T19:59:25.622 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100445.log 2023-10-16T19:59:25.623 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107330.log 2023-10-16T19:59:25.623 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.100445.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101122.log 2023-10-16T19:59:25.623 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.107330.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.100445.log.gz 2023-10-16T19:59:25.624 INFO:teuthology.orchestra.run.smithi157.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.107330.log.gz/var/log/ceph/ceph-client.admin.101122.log: 2023-10-16T19:59:25.624 INFO:teuthology.orchestra.run.smithi157.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.101122.log.gz 2023-10-16T19:59:25.624 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107828.log 2023-10-16T19:59:25.624 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106732.log 2023-10-16T19:59:25.625 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.107828.log: /var/log/ceph/ceph-client.admin.106732.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.107828.log.gz 2023-10-16T19:59:25.625 INFO:teuthology.orchestra.run.smithi157.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.106732.log.gz 2023-10-16T19:59:25.625 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109534.log 2023-10-16T19:59:25.625 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107284.log 2023-10-16T19:59:25.626 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.109534.log: /var/log/ceph/ceph-client.admin.107284.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.109534.log.gz 2023-10-16T19:59:25.626 INFO:teuthology.orchestra.run.smithi157.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.107284.log.gz 2023-10-16T19:59:25.626 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105428.log 2023-10-16T19:59:25.627 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100399.log 2023-10-16T19:59:25.627 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.105428.log: /var/log/ceph/ceph-client.admin.100399.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.105428.log.gz 2023-10-16T19:59:25.627 INFO:teuthology.orchestra.run.smithi157.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.100399.log.gz 2023-10-16T19:59:25.627 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106311.log 2023-10-16T19:59:25.628 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108699.log 2023-10-16T19:59:25.628 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.106311.log: /var/log/ceph/ceph-client.admin.108699.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.106311.log.gz 2023-10-16T19:59:25.628 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102732.log 2023-10-16T19:59:25.628 INFO:teuthology.orchestra.run.smithi157.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.108699.log.gz 2023-10-16T19:59:25.629 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109488.log 2023-10-16T19:59:25.629 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.102732.log: /var/log/ceph/ceph-client.admin.109488.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.102732.log.gz 2023-10-16T19:59:25.629 INFO:teuthology.orchestra.run.smithi157.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.109488.log.gz 2023-10-16T19:59:25.630 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107146.log 2023-10-16T19:59:25.630 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105855.log 2023-10-16T19:59:25.630 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.107146.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103967.log 2023-10-16T19:59:25.631 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.105855.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.107146.log.gz 2023-10-16T19:59:25.631 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.103967.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.105855.log.gz 2023-10-16T19:59:25.631 INFO:teuthology.orchestra.run.smithi157.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.103967.log.gz 2023-10-16T19:59:25.631 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102594.log 2023-10-16T19:59:25.632 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108012.log 2023-10-16T19:59:25.632 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.102594.log: /var/log/ceph/ceph-client.admin.108012.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.102594.log.gz 2023-10-16T19:59:25.632 INFO:teuthology.orchestra.run.smithi157.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.108012.log.gz 2023-10-16T19:59:25.633 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106962.log 2023-10-16T19:59:25.633 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105658.log 2023-10-16T19:59:25.633 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.106962.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100938.log 2023-10-16T19:59:25.633 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.105658.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.106962.log.gz 2023-10-16T19:59:25.634 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.100938.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.105658.log.gz 2023-10-16T19:59:25.634 INFO:teuthology.orchestra.run.smithi157.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.100938.log.gz 2023-10-16T19:59:25.634 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105993.log 2023-10-16T19:59:25.635 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103100.log 2023-10-16T19:59:25.635 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.105993.log: /var/log/ceph/ceph-client.admin.103100.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.105993.log.gz 2023-10-16T19:59:25.635 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100700.log 2023-10-16T19:59:25.635 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106824.log 2023-10-16T19:59:25.636 INFO:teuthology.orchestra.run.smithi157.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.103100.log.gz 2023-10-16T19:59:25.636 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.100700.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.100700.log.gz 2023-10-16T19:59:25.636 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109764.log 2023-10-16T19:59:25.636 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.106824.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101835.log 2023-10-16T19:59:25.637 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.109764.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.106824.log.gz 2023-10-16T19:59:25.637 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.101835.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.109764.log.gz 2023-10-16T19:59:25.637 INFO:teuthology.orchestra.run.smithi157.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.101835.log.gz 2023-10-16T19:59:25.637 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105290.log 2023-10-16T19:59:25.638 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108745.log 2023-10-16T19:59:25.638 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.105290.log: /var/log/ceph/ceph-client.admin.108745.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.105290.log.gz 2023-10-16T19:59:25.638 INFO:teuthology.orchestra.run.smithi157.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.108745.log.gz 2023-10-16T19:59:25.639 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101461.log 2023-10-16T19:59:25.639 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105566.log 2023-10-16T19:59:25.639 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.101461.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106552.log 2023-10-16T19:59:25.639 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.105566.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.101461.log.gz 2023-10-16T19:59:25.640 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.106552.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.105566.log.gz 2023-10-16T19:59:25.640 INFO:teuthology.orchestra.run.smithi157.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.106552.log.gz 2023-10-16T19:59:25.640 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100307.log 2023-10-16T19:59:25.641 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106506.log 2023-10-16T19:59:25.641 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.100307.log: /var/log/ceph/ceph-client.admin.106506.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.100307.log.gz 2023-10-16T19:59:25.641 INFO:teuthology.orchestra.run.smithi157.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.106506.log.gz 2023-10-16T19:59:25.641 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104762.log 2023-10-16T19:59:25.642 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101030.log 2023-10-16T19:59:25.642 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 /var/log/ceph/ceph-client.admin.104762.log: --verbose -- /var/log/ceph/ceph-client.admin.105106.log 2023-10-16T19:59:25.642 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.101030.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.104762.log.gz 2023-10-16T19:59:25.643 INFO:teuthology.orchestra.run.smithi157.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.101030.log.gz 2023-10-16T19:59:25.643 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104992.log 2023-10-16T19:59:25.643 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.105106.log: /var/log/ceph/ceph-client.admin.104992.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.105106.log.gz 2023-10-16T19:59:25.643 INFO:teuthology.orchestra.run.smithi157.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.104992.log.gz 2023-10-16T19:59:25.644 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109672.log 2023-10-16T19:59:25.644 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104624.log 2023-10-16T19:59:25.644 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.109672.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102870.log 2023-10-16T19:59:25.644 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.104624.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.109672.log.gz 2023-10-16T19:59:25.645 INFO:teuthology.orchestra.run.smithi157.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.104624.log.gz 2023-10-16T19:59:25.645 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.102870.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.102870.log.gz 2023-10-16T19:59:25.645 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101833.log 2023-10-16T19:59:25.646 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109442.log 2023-10-16T19:59:25.646 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.101833.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102196.log 2023-10-16T19:59:25.646 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.109442.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.101833.log.gz 2023-10-16T19:59:25.646 INFO:teuthology.orchestra.run.smithi157.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.109442.log.gz 2023-10-16T19:59:25.647 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.102196.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.102196.log.gz 2023-10-16T19:59:25.647 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106686.log 2023-10-16T19:59:25.647 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109810.log 2023-10-16T19:59:25.647 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.106686.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109994.log 2023-10-16T19:59:25.648 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.109810.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.106686.log.gz 2023-10-16T19:59:25.648 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.109994.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.109810.log.gz 2023-10-16T19:59:25.648 INFO:teuthology.orchestra.run.smithi157.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.109994.log.gz 2023-10-16T19:59:25.649 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101826.log 2023-10-16T19:59:25.649 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107781.log 2023-10-16T19:59:25.649 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.101826.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102204.log 2023-10-16T19:59:25.649 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.107781.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.101826.log.gz 2023-10-16T19:59:25.650 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.102204.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.107781.log.gz 2023-10-16T19:59:25.650 INFO:teuthology.orchestra.run.smithi157.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.102204.log.gz 2023-10-16T19:59:25.650 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105382.log 2023-10-16T19:59:25.650 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99331.log 2023-10-16T19:59:25.651 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.105382.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108392.log 2023-10-16T19:59:25.651 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.99331.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.105382.log.gz 2023-10-16T19:59:25.651 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.108392.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.99331.log.gz 2023-10-16T19:59:25.652 INFO:teuthology.orchestra.run.smithi157.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.108392.log.gz 2023-10-16T19:59:25.652 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102640.log 2023-10-16T19:59:25.652 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101466.log 2023-10-16T19:59:25.652 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.102640.log: /var/log/ceph/ceph-client.admin.101466.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.102640.log.gz 2023-10-16T19:59:25.653 INFO:teuthology.orchestra.run.smithi157.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.101466.log.gz 2023-10-16T19:59:25.653 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101827.log 2023-10-16T19:59:25.653 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101458.log 2023-10-16T19:59:25.653 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.101827.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107100.log 2023-10-16T19:59:25.654 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.101458.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.101827.log.gz 2023-10-16T19:59:25.654 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.107100.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.101458.log.gz 2023-10-16T19:59:25.654 INFO:teuthology.orchestra.run.smithi157.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.107100.log.gz 2023-10-16T19:59:25.654 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2023-10-16T19:59:25.655 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109856.log 2023-10-16T19:59:25.655 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-mon.a.log: /var/log/ceph/ceph-client.admin.109856.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.109856.log.gz 2023-10-16T19:59:25.655 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106870.log 2023-10-16T19:59:25.656 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110414.log 2023-10-16T19:59:25.656 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.106870.log: /var/log/ceph/ceph-client.admin.110414.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.106870.log.gz 2023-10-16T19:59:25.656 INFO:teuthology.orchestra.run.smithi157.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.110414.log.gz 2023-10-16T19:59:25.656 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100800.log 2023-10-16T19:59:25.657 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100846.log 2023-10-16T19:59:25.657 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.100800.log: 92.8% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2023-10-16T19:59:25.657 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.100846.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.100800.log.gz 2023-10-16T19:59:25.657 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108058.log 2023-10-16T19:59:25.658 INFO:teuthology.orchestra.run.smithi157.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.100846.log.gz 2023-10-16T19:59:25.658 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102410.log 2023-10-16T19:59:25.658 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.108058.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2023-10-16T19:59:25.659 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.102410.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.108058.log.gz 2023-10-16T19:59:25.659 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-mgr.y.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.102410.log.gz 2023-10-16T19:59:25.659 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107874.log 2023-10-16T19:59:25.659 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106414.log 2023-10-16T19:59:25.660 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.107874.log: /var/log/ceph/ceph-client.admin.106414.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.107874.log.gz 2023-10-16T19:59:25.660 INFO:teuthology.orchestra.run.smithi157.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.106414.log.gz 2023-10-16T19:59:25.660 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100984.log 2023-10-16T19:59:25.661 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.100984.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.100984.log.gz 2023-10-16T19:59:25.661 INFO:teuthology.orchestra.run.smithi157.stderr: 92.7% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2023-10-16T19:59:25.662 INFO:teuthology.orchestra.run.smithi157.stderr: 93.3% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2023-10-16T19:59:25.662 INFO:teuthology.orchestra.run.smithi157.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2023-10-16T19:59:25.663 INFO:teuthology.orchestra.run.smithi157.stderr: 93.2% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2023-10-16T19:59:25.663 INFO:teuthology.orchestra.run.smithi187.stderr: 92.9% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2023-10-16T19:59:25.663 INFO:teuthology.orchestra.run.smithi187.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2023-10-16T19:59:25.664 INFO:teuthology.orchestra.run.smithi187.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2023-10-16T19:59:25.664 INFO:teuthology.orchestra.run.smithi187.stderr: 93.3% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2023-10-16T19:59:25.664 INFO:teuthology.orchestra.run.smithi187.stderr: 93.2% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2023-10-16T19:59:25.673 INFO:teuthology.orchestra.run.smithi187.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2023-10-16T19:59:25.675 INFO:teuthology.orchestra.run.smithi187.stderr: 2023-10-16T19:59:25.675 INFO:teuthology.orchestra.run.smithi187.stderr:real 0m0.169s 2023-10-16T19:59:25.675 INFO:teuthology.orchestra.run.smithi187.stderr:user 0m0.794s 2023-10-16T19:59:25.676 INFO:teuthology.orchestra.run.smithi187.stderr:sys 0m0.045s 2023-10-16T19:59:25.721 INFO:teuthology.orchestra.run.smithi157.stderr: 91.0% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2023-10-16T19:59:25.722 INFO:teuthology.orchestra.run.smithi157.stderr: 2023-10-16T19:59:25.723 INFO:teuthology.orchestra.run.smithi157.stderr:real 0m0.248s 2023-10-16T19:59:25.723 INFO:teuthology.orchestra.run.smithi157.stderr:user 0m0.610s 2023-10-16T19:59:25.723 INFO:teuthology.orchestra.run.smithi157.stderr:sys 0m0.138s 2023-10-16T19:59:25.724 INFO:tasks.ceph:Archiving logs... 2023-10-16T19:59:25.724 DEBUG:teuthology.misc:Transferring archived files from smithi157:/var/log/ceph to /home/teuthworker/archive/rishabh-2023-10-16_18:49:15-fs-rishabh-2023oct13-testing-default-smithi/7430083/remote/smithi157/log 2023-10-16T19:59:25.726 DEBUG:teuthology.orchestra.run.smithi157:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-16T19:59:26.030 DEBUG:teuthology.misc:Transferring archived files from smithi187:/var/log/ceph to /home/teuthworker/archive/rishabh-2023-10-16_18:49:15-fs-rishabh-2023oct13-testing-default-smithi/7430083/remote/smithi187/log 2023-10-16T19:59:26.031 DEBUG:teuthology.orchestra.run.smithi187:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-16T19:59:26.165 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-10-16T19:59:26.195 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-10-16T19:59:26.196 DEBUG:teuthology.orchestra.run.smithi157:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-16T19:59:26.198 DEBUG:teuthology.orchestra.run.smithi187:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-16T19:59:26.276 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-10-16T19:59:26.287 INFO:teuthology.task.clock:Checking final clock skew... 2023-10-16T19:59:26.288 DEBUG:teuthology.orchestra.run.smithi157:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-16T19:59:26.291 DEBUG:teuthology.orchestra.run.smithi187:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-16T19:59:26.305 INFO:teuthology.orchestra.run.smithi157.stderr:bash: ntpq: command not found 2023-10-16T19:59:26.309 INFO:teuthology.orchestra.run.smithi187.stderr:bash: ntpq: command not found 2023-10-16T19:59:26.311 INFO:teuthology.orchestra.run.smithi157.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-16T19:59:26.311 INFO:teuthology.orchestra.run.smithi157.stdout:=============================================================================== 2023-10-16T19:59:26.311 INFO:teuthology.orchestra.run.smithi157.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 41 +448us[ +448us] +/- 70ms 2023-10-16T19:59:26.311 INFO:teuthology.orchestra.run.smithi157.stdout:^* hv02.front.sepia.ceph.com 3 6 377 42 -1913us[-1918us] +/- 50ms 2023-10-16T19:59:26.312 INFO:teuthology.orchestra.run.smithi157.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 42 +3171us[+3171us] +/- 93ms 2023-10-16T19:59:26.312 INFO:teuthology.orchestra.run.smithi157.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-10-16T19:59:26.314 INFO:teuthology.orchestra.run.smithi187.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-16T19:59:26.314 INFO:teuthology.orchestra.run.smithi187.stdout:=============================================================================== 2023-10-16T19:59:26.314 INFO:teuthology.orchestra.run.smithi187.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 42 +396us[ +455us] +/- 70ms 2023-10-16T19:59:26.315 INFO:teuthology.orchestra.run.smithi187.stdout:^* hv02.front.sepia.ceph.com 3 6 377 41 -1946us[-1887us] +/- 50ms 2023-10-16T19:59:26.315 INFO:teuthology.orchestra.run.smithi187.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 41 +3118us[+3118us] +/- 93ms 2023-10-16T19:59:26.315 INFO:teuthology.orchestra.run.smithi187.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-10-16T19:59:26.316 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-10-16T19:59:26.326 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-10-16T19:59:26.326 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-10-16T19:59:26.336 DEBUG:teuthology.orchestra.run.smithi157:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-10-16T19:59:26.447 DEBUG:teuthology.orchestra.run.smithi187:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-10-16T19:59:26.537 DEBUG:teuthology.orchestra.run.smithi157:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-16T19:59:26.569 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-16T19:59:26.570 DEBUG:teuthology.orchestra.run.smithi187:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-16T19:59:26.601 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-16T19:59:26.602 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-10-16T19:59:26.612 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-10-16T19:59:26.620 INFO:teuthology.task.internal:Duration was 834.438843 seconds 2023-10-16T19:59:26.621 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-10-16T19:59:26.631 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-10-16T19:59:26.631 DEBUG:teuthology.orchestra.run.smithi157:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-16T19:59:26.633 DEBUG:teuthology.orchestra.run.smithi187:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-16T19:59:26.677 INFO:teuthology.orchestra.run.smithi157.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-16T19:59:26.688 INFO:teuthology.orchestra.run.smithi187.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-16T19:59:26.967 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-10-16T19:59:26.967 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi157.front.sepia.ceph.com 2023-10-16T19:59:26.968 DEBUG:teuthology.orchestra.run.smithi157:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-16T19:59:26.989 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi187.front.sepia.ceph.com 2023-10-16T19:59:26.990 DEBUG:teuthology.orchestra.run.smithi187:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-16T19:59:27.012 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-10-16T19:59:27.013 DEBUG:teuthology.orchestra.run.smithi157:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-16T19:59:27.032 DEBUG:teuthology.orchestra.run.smithi187:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-16T19:59:27.094 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-10-16T19:59:27.094 DEBUG:teuthology.orchestra.run.smithi157:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-16T19:59:27.114 DEBUG:teuthology.orchestra.run.smithi187:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-16T19:59:27.209 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-10-16T19:59:27.220 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-10-16T19:59:27.220 DEBUG:teuthology.orchestra.run.smithi157:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-16T19:59:27.247 DEBUG:teuthology.orchestra.run.smithi187:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-16T19:59:27.274 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-10-16T19:59:27.286 DEBUG:teuthology.orchestra.run.smithi157:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-16T19:59:27.289 DEBUG:teuthology.orchestra.run.smithi187:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-16T19:59:27.313 INFO:teuthology.orchestra.run.smithi157.stdout:kernel.core_pattern = core 2023-10-16T19:59:27.339 INFO:teuthology.orchestra.run.smithi187.stdout:kernel.core_pattern = core 2023-10-16T19:59:27.353 DEBUG:teuthology.orchestra.run.smithi157:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-16T19:59:27.382 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-16T19:59:27.383 DEBUG:teuthology.orchestra.run.smithi187:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-16T19:59:27.410 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-16T19:59:27.410 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-10-16T19:59:27.421 INFO:teuthology.task.internal:Transferring archived files... 2023-10-16T19:59:27.422 DEBUG:teuthology.misc:Transferring archived files from smithi157:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2023-10-16_18:49:15-fs-rishabh-2023oct13-testing-default-smithi/7430083/remote/smithi157 2023-10-16T19:59:27.423 DEBUG:teuthology.orchestra.run.smithi157:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-16T19:59:27.463 DEBUG:teuthology.misc:Transferring archived files from smithi187:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2023-10-16_18:49:15-fs-rishabh-2023oct13-testing-default-smithi/7430083/remote/smithi187 2023-10-16T19:59:27.463 DEBUG:teuthology.orchestra.run.smithi187:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-16T19:59:27.500 INFO:teuthology.task.internal:Removing archive directory... 2023-10-16T19:59:27.501 DEBUG:teuthology.orchestra.run.smithi157:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-16T19:59:27.503 DEBUG:teuthology.orchestra.run.smithi187:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-16T19:59:27.551 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-10-16T19:59:27.562 INFO:teuthology.task.internal:Not uploading archives. 2023-10-16T19:59:27.563 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-10-16T19:59:27.573 INFO:teuthology.task.internal:Tidying up after the test... 2023-10-16T19:59:27.573 DEBUG:teuthology.orchestra.run.smithi157:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-16T19:59:27.576 DEBUG:teuthology.orchestra.run.smithi187:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-16T19:59:27.590 INFO:teuthology.orchestra.run.smithi157.stdout: 262320 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Oct 16 19:59 /home/ubuntu/cephtest 2023-10-16T19:59:27.590 INFO:teuthology.orchestra.run.smithi157.stdout: 393242 4 d--------- 2 ubuntu ubuntu 4096 Oct 16 19:58 /home/ubuntu/cephtest/mnt.0 2023-10-16T19:59:27.591 INFO:teuthology.orchestra.run.smithi157.stderr:find: ‘/home/ubuntu/cephtest/mnt.0’: Permission denied 2023-10-16T19:59:27.592 INFO:teuthology.orchestra.run.smithi157.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2023-10-16T19:59:27.593 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-16T19:59:27.594 ERROR:teuthology.run_tasks:Manager failed: internal.base Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/task/internal/__init__.py", line 53, in base run.wait( File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi157 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2023-10-16T19:59:27.603 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-10-16T19:59:27.614 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-10-16T19:59:27.624 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: CommandFailedError: Command failed on smithi157 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2023-10-16T19:59:27.625 INFO:teuthology.nuke:Checking targets against current locks 2023-10-16T19:59:27.633 INFO:teuthology.orchestra.run.smithi187.stdout: 262320 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 16 19:59 /home/ubuntu/cephtest 2023-10-16T19:59:27.664 DEBUG:teuthology.nuke:shortname: smithi157 2023-10-16T19:59:27.664 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-16T19:59:27.688 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi157.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-10-16_18:49:15-fs-rishabh-2023oct13-testing-default-smithi/7430083', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-16 19:40:19.634404', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-10-16T19:59:27.692 DEBUG:teuthology.nuke:shortname: smithi187 2023-10-16T19:59:27.692 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-16T19:59:27.715 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi187.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-10-16_18:49:15-fs-rishabh-2023oct13-testing-default-smithi/7430083', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-16 19:40:19.632769', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-10-16T19:59:27.743 INFO:teuthology.orchestra.console.smithi157:Power off 2023-10-16T19:59:27.744 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-16T19:59:27.768 DEBUG:teuthology.orchestra.console.smithi157:power off output: Chassis Power Control: Down/Off 2023-10-16T19:59:27.769 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-16T19:59:27.785 INFO:teuthology.orchestra.console.smithi187:Power off 2023-10-16T19:59:27.786 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-16T19:59:27.795 DEBUG:teuthology.orchestra.console.smithi157:check power output: Chassis Power is on 2023-10-16T19:59:27.809 DEBUG:teuthology.orchestra.console.smithi187:power off output: Chassis Power Control: Down/Off 2023-10-16T19:59:27.810 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-16T19:59:27.837 DEBUG:teuthology.orchestra.console.smithi187:check power output: Chassis Power is on 2023-10-16T19:59:31.797 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-16T19:59:31.838 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-16T19:59:31.906 DEBUG:teuthology.orchestra.console.smithi157:check power output: Chassis Power is on 2023-10-16T19:59:31.950 DEBUG:teuthology.orchestra.console.smithi187:check power output: Chassis Power is on 2023-10-16T19:59:35.908 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-16T19:59:35.951 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-16T19:59:36.020 DEBUG:teuthology.orchestra.console.smithi157:check power output: Chassis Power is off 2023-10-16T19:59:36.062 DEBUG:teuthology.orchestra.console.smithi187:check power output: Chassis Power is off 2023-10-16T19:59:36.122 INFO:teuthology.orchestra.console.smithi157:Power off completed 2023-10-16T19:59:36.163 INFO:teuthology.orchestra.console.smithi187:Power off completed 2023-10-16T19:59:36.268 INFO:teuthology.run:Summary data: description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/mds-full} duration: 834.4388425350189 failure_reason: 'Test failure: test_barrier (tasks.cephfs.test_full.TestClusterFull)' flavor: default owner: scheduled_rishabh@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=1dbcf339a7d24ace89e00b82e5fe3635 status: fail success: false 2023-10-16T19:59:36.268 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T19:59:36.357 INFO:teuthology.run:FAIL